Patrick Robertson
5211c5de18
Merge pull request #210 from bellingcat/logger_fix
...
Fix issue #200 + Refactor _LAZY_LOADED_MODULES
2025-02-19 15:11:42 +00:00
Erin Clark
6cdefaa751
Merge pull request #194 from bellingcat/tests/add_module_tests
...
Add unit tests for individual modules.
Includes a couple of small bug fixes and light refactoring.
2025-02-19 13:51:43 +00:00
Patrick Robertson
04507577b6
Version bump
2025-02-19 13:36:50 +00:00
erinhmclark
47a634fc63
Add WACZ, Wayback and local storage tests.
2025-02-19 13:14:08 +00:00
Patrick Robertson
a9802dd004
Remove the global _LAZY_LOADED_MODULES and allow each instance of ArchivingOrchestrator to load its own modules
2025-02-19 12:25:35 +00:00
erinhmclark
a8ffb19325
Fix auth key name for cookies_from_browser.
2025-02-19 10:40:54 +00:00
Patrick Robertson
eb60b271b9
Fix issue #200
2025-02-19 10:35:14 +00:00
erinhmclark
ddf2e76624
Include Atlos Storage __init__.py for module recognition.
2025-02-19 09:24:34 +00:00
erinhmclark
10a5ad62b8
Include Atlos tests, metadata fixture.
2025-02-19 09:18:41 +00:00
erinhmclark
f0fd9bf445
Updates tests to use pytest-mock.
2025-02-18 23:32:03 +00:00
erinhmclark
657fbd357d
Merge branch 'main' into tests/add_module_tests
2025-02-18 19:47:47 +00:00
erinhmclark
7b88df72cb
Update test_metadata_enricher.py
2025-02-18 19:46:57 +00:00
Patrick Robertson
3c543a3a6a
Various fixes for issues with new architecture ( #208 )
...
* Add formatters to the TOC - fixes #204
* Add 'steps' settings to the example YAML in the docs. Fixes #206
* Improved docs on authentication architecture
* Fix setting modules on the command line - they now override any module settings in the orchestration as opposed to appending
* Fix tests for gsheet-feeder: add a test service_account.json (note: not real keys in there)
* Rename the command line entrypoint to _command_line_run
Also: make it clear that code implementation should not call this
Make sure the command line entry returns (we don't want a generator)
* Fix unit tests to use now code-entry points
* Version bump
* Move iterating of generator up to __main__
* Breakpoint
* two minor fixes
* Fix unit tests + add new '__main__' entry point implementation test
* Skip youtube tests if running on CI. Should still run them locally
* Fix full implementation run on GH actions
* Fix skipif test for GH Actions CI
* Add skipifs for truth - it blocks GH:
---------
Co-authored-by: msramalho <19508417+msramalho@users.noreply.github.com >
2025-02-18 19:10:09 +00:00
erinhmclark
ce5a200d1f
Added tests, updated instagram_tbot_extractor.py raise failure.
2025-02-18 12:59:10 +00:00
erinhmclark
f4c623b11b
Merge branch 'main' into tests/add_module_tests
2025-02-17 09:03:04 +00:00
Patrick Robertson
6d43bc7d4d
Fix generator programmatic setup ( #197 )
...
* Fix returning a generator of a generator
* Move download test test to pytest.mark.download
2025-02-15 17:36:44 +00:00
Miguel Sozinho Ramalho
9297697ef5
makes orchestrator.run return the results to allow for code integration ( #196 )
2025-02-15 12:41:26 +00:00
erinhmclark
8ed3ef2f33
Merge branch 'main' into tests/add_module_tests
2025-02-14 12:47:40 +00:00
Miguel Sozinho Ramalho
5614af3f63
removes fixed oscrypto dependency, it blocked pypi publishing ( #195 )
...
* disables tests on ubuntu-latest
* drops fixed oscrypto version for git commit
* version bump
2025-02-14 10:51:56 +00:00
erinhmclark
71b41dd901
Remove accidental path, yet again.
2025-02-14 10:05:32 +00:00
erinhmclark
b0756a6a34
Remove accidental full path.
2025-02-14 09:57:44 +00:00
erinhmclark
319c1e8f92
Add more tests.
2025-02-14 09:48:37 +00:00
erinhmclark
3fce593aad
Merge branch 'main' into tests/add_module_tests
2025-02-12 19:33:29 +00:00
erinhmclark
cbe98c729d
Enricher tests
2025-02-12 19:32:40 +00:00
Miguel Sozinho Ramalho
27f9287b65
markdown fixes
2025-02-12 17:37:36 +00:00
erinhmclark
d9d936c2ca
Thumbnail enricher fix seconds to minutes.
2025-02-12 12:22:27 +00:00
Patrick Robertson
d849678137
Merge pull request #193 from bellingcat/links
...
Fix links to docs
2025-02-12 13:11:59 +01:00
erinhmclark
da267f20d7
Update screenshot refs
2025-02-12 11:54:40 +00:00
Patrick Robertson
70f155dfce
add more of the USPs to the readme
2025-02-12 11:48:51 +00:00
Patrick Robertson
86254bdd4e
Fix link in how to
2025-02-12 11:48:01 +00:00
Patrick Robertson
17f13db56c
Make that code block a shell
2025-02-12 11:45:09 +00:00
Patrick Robertson
d776be8a81
Fix links to docs
2025-02-12 11:41:54 +00:00
Patrick Robertson
460a71649c
Merge pull request #190 from bellingcat/docs_update
...
Docs improvement
2025-02-12 12:38:04 +01:00
Patrick Robertson
a0c4a82825
Improved docstrings for base modules
2025-02-12 11:32:13 +00:00
Patrick Robertson
8054ea96b3
Document double dash between command line args and feeder urls on command line
2025-02-12 11:20:15 +00:00
Patrick Robertson
de79e17128
better wording in link
2025-02-12 11:19:21 +00:00
Patrick Robertson
d28d99daa6
Docs tidy ups and re-organising
2025-02-12 11:16:17 +00:00
Patrick Robertson
5b481f72ab
Tidy ups to manifests for docs
2025-02-11 20:03:53 +00:00
Patrick Robertson
4c119b4db8
Add missing manifest for atlos_storage
2025-02-11 20:03:45 +00:00
Patrick Robertson
d8f47ff9e4
Add multi-type modules to all headings on TOC
2025-02-11 19:46:57 +00:00
Patrick Robertson
1ee7981c6e
Add YAML config to the module docs
2025-02-11 19:42:03 +00:00
Patrick Robertson
22fa9ba456
further tweaks
2025-02-11 18:52:28 +00:00
Patrick Robertson
1b976f4c09
Remove unused atlos util functions
2025-02-11 18:49:54 +00:00
Patrick Robertson
756f46012b
Remove empty file
2025-02-11 18:47:54 +00:00
Patrick Robertson
1d69053dd5
Upgrade certifi
2025-02-11 18:41:37 +00:00
Patrick Robertson
40a95f7348
Add likify deps
2025-02-11 18:40:44 +00:00
Patrick Robertson
a307d09e67
Readthedocs now requires all packages for running the pre-build scripts
2025-02-11 18:38:41 +00:00
Patrick Robertson
2c87474186
Change path for scripts
2025-02-11 18:37:03 +00:00
Patrick Robertson
e65a99078f
Slight tweaks of toctrees + reordering
2025-02-11 18:28:21 +00:00
Patrick Robertson
e43dda2817
Merge pull request #185 from bellingcat/load_modules
...
Refactor auto-archiver to use a modular structure for feeders/extractors/enrichers etc.
2025-02-11 19:21:46 +01:00
