Commit Graph

959 Commits

Author SHA1 Message Date
Patrick Robertson
6ba79049d9 Capitalize help text 2025-02-27 22:16:33 +00:00
Patrick Robertson
7620a671d1 Overwrite settings_base file 2025-02-27 22:02:44 +00:00
Patrick Robertson
54a2a19dd7 Also build auto-archiver 2025-02-27 21:56:36 +00:00
Patrick Robertson
3eb4ab41b8 Also generate the schema on each run 2025-02-27 21:38:55 +00:00
Patrick Robertson
65a9885d86 A few more manifest types 2025-02-27 21:33:04 +00:00
Patrick Robertson
4ee1e75aa2 Fix readthedocs config file 2025-02-27 21:24:34 +00:00
Patrick Robertson
1141c00e9a Remove unused files, set up for RTD 2025-02-27 21:23:38 +00:00
Patrick Robertson
15da907e81 Add a bit of typescripting 2025-02-27 15:58:30 +00:00
Patrick Robertson
2ec44f4170 Documentation on building the settings page 2025-02-27 15:42:37 +00:00
Patrick Robertson
1e92c03b1d Tweaks to settings page + more declarations in manifests 2025-02-27 15:21:11 +00:00
Patrick Robertson
efe9fdf915 Tidy ups to config editor page 2025-02-27 13:02:50 +00:00
Patrick Robertson
f58f110436 Check at least 1 URL provided for new cli_feeder module rewrite 2025-02-26 17:59:13 +00:00
Patrick Robertson
70d89c71ce Fully-working settings page editor 2025-02-26 17:02:49 +00:00
Patrick Robertson
bb961b131c Turn cli_feeder *back* into a module, it's better like this for settings etc, documentation etc. 2025-02-26 15:41:33 +00:00
Patrick Robertson
e467fc90c2 Merge branch 'main' into settings_page 2025-02-26 15:32:07 +00:00
Patrick Robertson
600f43e790 Set up structure for react 2025-02-26 09:34:44 +00:00
Patrick Robertson
1ad158c016 Merge pull request #211 from bellingcat/docs_improvements
Docs tidyups, howto on logging and authentication, remove exit(), small fixes
2025-02-25 14:13:13 +00:00
Patrick Robertson
d10c7fbe55 Better documentation based on the discord feedbackgst 2025-02-24 22:42:57 +00:00
Patrick Robertson
ca1ed418aa Throw an error for invalid __manifest__ syntax + fix: allow default values of False/None 2025-02-24 21:46:24 +00:00
Patrick Robertson
73a2e2d752 Fix tests for moving orchestration to secrets/orchestration.yaml 2025-02-21 19:05:39 +00:00
Patrick Robertson
1c17629ac6 Tweaks 2025-02-21 18:54:27 +00:00
Patrick Robertson
7562938151 Proof of concept for settings page 2025-02-21 18:04:48 +00:00
Patrick Robertson
091a19e25c Further docs improvements/tidy ups 2025-02-21 16:52:30 +00:00
Patrick Robertson
77212e8e3f Finishing touches to the how-tos 2025-02-20 15:45:48 +00:00
Patrick Robertson
9661e90a05 Allow disabling logging in auto_archiver with logging: enabled: false 2025-02-20 15:45:32 +00:00
Patrick Robertson
0bec71d203 Finish how to on authentication 2025-02-20 15:33:50 +00:00
Patrick Robertson
4174285898 Fix unit tests 2025-02-20 13:18:06 +00:00
Patrick Robertson
eda359a1ef Fix json loader - it should go in 'validators' not 'utils'
Fixes #214
2025-02-20 13:10:39 +00:00
Patrick Robertson
40488e0869 Use 'Auto Archiver' naming for consistency.
auto-archiver is reserved in the docs for when talking about the command line usage
2025-02-20 11:50:29 +00:00
Patrick Robertson
061f29c885 How-to on updating config file to version 0.13+ 2025-02-20 11:46:57 +00:00
Patrick Robertson
cbea551876 Better display name for wayback machine to emphasise it's typically used as an enricher 2025-02-20 11:46:57 +00:00
Patrick Robertson
b978484a89 Rename wacz_enricher to wacz_extractor_enricher. Fixes #205 2025-02-20 11:46:57 +00:00
Patrick Robertson
49b6c32058 Fix the 'full' mode which creates a complete config file 2025-02-20 11:34:05 +00:00
Patrick Robertson
4b51ec9ad5 Remove dangling import 2025-02-20 11:20:16 +00:00
Patrick Robertson
7734a551fa Move 'assert_valid_url' out into utils, don't use assert but raise
assert is recommended only for debugging
2025-02-20 11:19:29 +00:00
Patrick Robertson
77b2b099c6 Replace exit() with raise exceptions. Better for code implementations
exit() is reserved solely for command line-called areas now
also assert is only recommended for debugging
2025-02-20 11:19:13 +00:00
Patrick Robertson
40b8359348 Implementation test with 2 x orchestrators with different configs 2025-02-20 11:18:28 +00:00
Patrick Robertson
5ccea8e44a Absolute paths in README for Github/PyPi/Dockerhub etc. 2025-02-20 11:18:28 +00:00
Patrick Robertson
7dde8d609d Merge main 2025-02-20 10:29:57 +00:00
Patrick Robertson
6ea943b680 Fix link 2025-02-20 10:27:24 +00:00
Patrick Robertson
5211c5de18 Merge pull request #210 from bellingcat/logger_fix
Fix issue #200 + Refactor _LAZY_LOADED_MODULES
v0.13.4
2025-02-19 15:11:42 +00:00
Erin Clark
6cdefaa751 Merge pull request #194 from bellingcat/tests/add_module_tests
Add unit tests for individual modules.
Includes a couple of small bug fixes and light refactoring.
2025-02-19 13:51:43 +00:00
Patrick Robertson
04507577b6 Version bump 2025-02-19 13:36:50 +00:00
erinhmclark
47a634fc63 Add WACZ, Wayback and local storage tests. 2025-02-19 13:14:08 +00:00
Patrick Robertson
a9802dd004 Remove the global _LAZY_LOADED_MODULES and allow each instance of ArchivingOrchestrator to load its own modules 2025-02-19 12:25:35 +00:00
erinhmclark
a8ffb19325 Fix auth key name for cookies_from_browser. 2025-02-19 10:40:54 +00:00
Patrick Robertson
222a94563f WIP: Docs tidyups+add howto on logging and authentication
(Authentication is WIP)
2025-02-19 10:37:04 +00:00
Patrick Robertson
eb60b271b9 Fix issue #200 2025-02-19 10:35:14 +00:00
erinhmclark
ddf2e76624 Include Atlos Storage __init__.py for module recognition. 2025-02-19 09:24:34 +00:00
erinhmclark
10a5ad62b8 Include Atlos tests, metadata fixture. 2025-02-19 09:18:41 +00:00