Commit Graph

278 Commits

Author SHA1 Message Date
msramalho
4e6b9250bf updates makefile to clear docker cache and dangling images 2024-03-11 19:11:47 +00:00
msramalho
17b3a40e4c improve observability 2024-03-11 14:57:08 +00:00
msramalho
74cdc1a3e6 auto-archiver bump 2024-03-05 14:54:08 +00:00
msramalho
48109c53aa error logs updated 2024-02-29 13:30:21 +00:00
msramalho
8ecd0f10f2 security updates 2024-02-29 13:22:13 +00:00
msramalho
cabfe225fc version update 2024-02-25 15:23:18 +00:00
msramalho
f602b3d60c version bump 2024-02-23 18:09:22 +00:00
msramalho
5d5aa1d63b aa version bump 2024-02-23 14:14:14 +00:00
msramalho
0438d30a60 finally closes #36 2024-02-22 18:26:10 +00:00
msramalho
88daf7f939 new volume issue attempt 2024-02-21 19:06:25 +00:00
msramalho
b88dd36710 closes #36 by updating auto-archiver to v0.9.3 2024-02-21 17:30:47 +00:00
msramalho
a648b90406 simplifies Bearer keys to a single one 2024-02-21 13:52:35 +00:00
Kai
035cdbc064 Merge pull request #39 from bellingcat/auth
Remove basic auth and rename methods
2024-02-15 10:19:35 -10:00
Lilia Kai
61a5d9a8d7 Remove basic auth and rename methods
All our clients are now using bearer auth so we can remove basic.

Also renamed methods to be more distinct about the differences between
them. Everything goes through bearer auth but in some cases we are
authenticating a user and other times it's either a server or a
particular api key.
2024-02-14 08:29:54 -10:00
Miguel Sozinho Ramalho
af59779c52 Merge pull request #37 from bellingcat/auth
Refactor auth methods
2024-02-01 11:50:50 +00:00
Lilia Kai
e37b848ef5 Refactor auth methods
De duplicate some common codepaths. Also, for routes accepting basic
authentication, allow bearer auth as an alternative. This allows
clients to switch to bearer auth opportunistically, but we won't
have to coordinate deployments.

Basic auth should be deprecated since we don't really use a
user/password auth scheme.
2024-01-31 12:38:37 -10:00
Lilia Kai
b83e51de68 correct comment in compose file 2024-01-31 12:31:15 -10:00
Miguel Sozinho Ramalho
b83f550099 Merge pull request #35 from bellingcat/instrument
Instrument exceptions by type
2024-01-10 16:37:59 +00:00
Lilia Kai
5258da65a5 Instrument exceptions by type 2024-01-08 16:45:25 +01:00
msramalho
c058bfd067 fixes unique constraint issues for archives containing the same url in archive_urls 2023-12-20 18:38:28 +00:00
msramalho
cff6f713bd aa dep update 2023-12-20 14:28:24 +00:00
Miguel Sozinho Ramalho
cdfe7429f0 Merge pull request #34 from bellingcat/loopback
Bind the web app to the loopback interface
2023-12-18 10:42:20 +00:00
msramalho
23beab0eb8 logging correct emails in sheet_service endpoint 2023-12-17 23:55:26 +00:00
Lilia Kai
f4f378082c Bind the web app to the loopback interface
Making it only accesible over ssl via the nginx proxy.
2023-12-14 16:54:41 +01:00
msramalho
3599ab2c19 dependency updates 2023-12-13 19:06:02 +00:00
msramalho
496a3651e5 detecting already inserted entries 2023-12-13 14:59:51 +00:00
msramalho
74f93ef856 catch cached inserts 2023-12-13 14:28:28 +00:00
msramalho
50417481f4 dep updated 2023-12-13 14:16:15 +00:00
msramalho
7dd0503d90 slight /metrics improvement 2023-12-13 13:46:53 +00:00
msramalho
48272cc8e9 dependencies update 2023-12-13 13:46:41 +00:00
msramalho
b92b8e3f8a auto-archiver dep update 2023-12-13 11:51:23 +00:00
msramalho
0e8864c68e updates auto-archiver 2023-12-13 10:38:38 +00:00
Miguel Sozinho Ramalho
1b7e6602db Merge pull request #33 from bellingcat/allow-query-before-archive 2023-12-13 10:30:36 +00:00
msramalho
99acfb113f most recent first 2023-12-12 22:43:31 +00:00
msramalho
3d4d7979a5 fixes data leak 2023-12-12 22:24:36 +00:00
msramalho
bb4ac31c12 version updated 2023-12-12 19:17:24 +00:00
Miguel Sozinho Ramalho
b0332ca438 Merge pull request #32 from bellingcat/remove-static-file 2023-12-12 19:14:58 +00:00
msramalho
6874d123eb adds logic to test if archive is needed, if specified by the user 2023-12-12 19:14:10 +00:00
Lilia Kai
76c99af48b Remove static file endpoint 2023-12-11 13:43:44 +01:00
msramalho
3ab5477e6c removing tmp log 2023-10-25 15:01:51 +01:00
msramalho
5e0024c726 temp changes 2023-10-25 14:59:25 +01:00
msramalho
7ed54c18d7 fixing sql non-null constaint 2023-10-25 14:51:41 +01:00
Miguel Sozinho Ramalho
099c854a91 Merge pull request #17 from bellingcat/archive 2023-10-17 16:12:38 +01:00
msramalho
e3c128c4fd adds access control to new endpoint 2023-10-17 16:08:35 +01:00
Lilia Kai
d8bb637532 Add db task endpoint 2023-10-16 14:53:08 +02:00
Miguel Sozinho Ramalho
d99ddea9a9 Merge pull request #13 from bellingcat/get_status 2023-09-22 10:30:29 +01:00
msramalho
f017dbe1f2 quick fix author_id 2023-09-20 13:52:14 +01:00
msramalho
c6cd027e13 allows search to happen with API_TOKEN 2023-09-20 11:30:57 +01:00
Lilia Kai
f20dd05928 Refactor get_status and create_archive_task error handling
Raise exceptions instead of returning error messages from the worker in
create_arvive_task. This ensures consistency in how the errors are
presented on the task result: the Exception will be the result instead
of *maybe* being wrapped in an object like {error: Exception}.

This lets us simplify error handling in get_status so we have only one
try/except block where the error can be returned to the client.
2023-09-20 11:43:55 +02:00
Lilia Kai
00201770ba Create archive task returns dict instead of string
This will save the task result in redis as a json object instead of a
json-encoded string. This makes for a nicer response from get_status and
prevents the client having to parse a json string to work with the
result.
2023-09-20 11:43:55 +02:00