Patrick Robertson
|
5e5e1c43a1
|
When loading modules, check they have been added to the right 'step' in the config
Fixes an issue seen on discord where a user accidentally set up metadata_enricher under 'extractors'
|
2025-03-20 18:09:26 +04:00 |
|
Patrick Robertson
|
1e19ad77c6
|
Fix tests
|
2025-03-20 18:08:19 +04:00 |
|
Patrick Robertson
|
f22af5e123
|
Tweak WACZ enricher docs + add comment on WACZ_ENABLE_DOCKER
|
2025-03-20 16:48:30 +04:00 |
|
Patrick Robertson
|
799cef3a8c
|
Cleanup docker-compose
|
2025-03-20 16:48:30 +04:00 |
|
erinhmclark
|
2921061fde
|
Add flexible extractor_args to generic_extractor.py
|
2025-03-19 19:19:28 +00:00 |
|
Patrick Robertson
|
e531906d73
|
Create an independent profile file for each wacz_extractor_enricher instance
|
2025-03-19 18:08:24 +04:00 |
|
Patrick Robertson
|
244341d22c
|
Skip check for 'docker' bin dependency if already running in docker
|
2025-03-19 18:08:04 +04:00 |
|
Erin Clark
|
90932a7bc8
|
Merge pull request #259 from bellingcat/fix_youtube_generic
Small fix for generic_extractor.py for general/ youtube extraction.
|
2025-03-19 11:52:56 +00:00 |
|
Patrick Robertson
|
488675056b
|
Download generate_google_services.sh script from GH - it's not packaged with the app
|
2025-03-19 15:52:39 +04:00 |
|
erinhmclark
|
93921e71d4
|
Clarify comments in pot scripts.
|
2025-03-19 11:33:35 +00:00 |
|
erinhmclark
|
675de50ee7
|
Update module test to test for default config keys within loaded
|
2025-03-19 10:47:28 +00:00 |
|
erinhmclark
|
fc6946f78a
|
Run format.
|
2025-03-18 21:43:18 +00:00 |
|
erinhmclark
|
2fdf6b7564
|
Update generic_extractor.py for general/ youtube extraction.
|
2025-03-18 21:33:21 +00:00 |
|
erinhmclark
|
a577228465
|
Update generic_extractor.py for general/ youtube extraction.
|
2025-03-18 21:10:06 +00:00 |
|
erinhmclark
|
ba9d67e4bb
|
Merge branch 'main' into feat/yt-dlp-pots
|
2025-03-18 20:10:38 +00:00 |
|
erinhmclark
|
c4e63ebd8c
|
Add conditional check to setup bgutils token generation script.
TODO: Update tests
|
2025-03-18 14:54:57 +00:00 |
|
Miguel Sozinho Ramalho
|
f6863b8eb2
|
Update src/auto_archiver/modules/gsheet_feeder_db/__manifest__.py
|
2025-03-18 14:10:47 +00:00 |
|
erinhmclark
|
b83bfda187
|
Update directory location, add .gitignore
|
2025-03-18 14:10:20 +00:00 |
|
Miguel Sozinho Ramalho
|
5c34ac1293
|
Update docs/source/how_to/gsheets_setup.md
|
2025-03-18 14:05:23 +00:00 |
|
erinhmclark
|
cb632723bd
|
Add scripts to pull only /server/ section of pots generator, adn only install at runtime.
|
2025-03-18 13:47:01 +00:00 |
|
Patrick Robertson
|
7d972ee9b8
|
Merge pull request #258 from bellingcat/version_bump
Version bump
v0.13.7
|
2025-03-18 12:18:09 +00:00 |
|
Patrick Robertson
|
b64826dc16
|
Merge pull request #257 from bellingcat/standardise_parsedates
Standardise parse dates to get_datetime_from_str
|
2025-03-18 12:17:51 +00:00 |
|
erinhmclark
|
0c892f3cf1
|
Temp fix for tests by setting path in manifest.
|
2025-03-18 11:44:08 +00:00 |
|
Patrick Robertson
|
23e74803ee
|
Version bump
|
2025-03-18 10:52:23 +00:00 |
|
Patrick Robertson
|
d03ecdb037
|
Standardise parse dates to get_datetime_from_str
|
2025-03-18 10:22:58 +00:00 |
|
Patrick Robertson
|
a5ebbf4726
|
Merge pull request #256 from bellingcat/dropin_cleanup
Refactor the dropin 'is_suitable' method + fix for tikwm
|
2025-03-18 10:08:24 +00:00 |
|
Patrick Robertson
|
89e387030d
|
Tests for suitable URLs for tikwm
|
2025-03-18 10:04:03 +00:00 |
|
Patrick Robertson
|
8ec053ed1b
|
Refactor the dropin 'is_suitable' method + fix tikwm implementation
Makes it easier to maintain/understand.
|
2025-03-18 09:14:14 +00:00 |
|
erinhmclark
|
43ef8f2aeb
|
Add update to POT setup script.
|
2025-03-17 20:59:34 +00:00 |
|
erinhmclark
|
e6b1a8c893
|
Add POT setup script.
|
2025-03-17 20:34:00 +00:00 |
|
erinhmclark
|
8548b7def7
|
Refactor setup method to pull and transpile the token generator.
|
2025-03-17 18:53:59 +00:00 |
|
Patrick Robertson
|
29db537fab
|
Docs on using the script to auto-generate service accounts
|
2025-03-17 18:11:18 +00:00 |
|
erinhmclark
|
bbe25537c7
|
Merge branch 'main' into feat/yt-dlp-pots
|
2025-03-17 16:54:29 +00:00 |
|
Patrick Robertson
|
c4a3a45bf7
|
Script to auto-generate a service account
|
2025-03-17 15:42:43 +00:00 |
|
erinhmclark
|
5daeae994a
|
Fix the extractor args for new list structure.
|
2025-03-17 14:17:31 +00:00 |
|
Patrick Robertson
|
3ea02c115e
|
Merge pull request #254 from bellingcat/rtd_docs
Add info on building RTD versions + automated building of tagged versions
|
2025-03-17 13:01:20 +00:00 |
|
Patrick Robertson
|
ab03e48708
|
Add info on building RTD versions + automated building of tagged versions
|
2025-03-17 12:52:04 +00:00 |
|
Patrick Robertson
|
3d4056ef70
|
Merge pull request #223 from bellingcat/facebook_extractor
Create facebook dropin - working for images + text.
|
2025-03-17 12:45:05 +00:00 |
|
Patrick Robertson
|
51041bf91e
|
Merge pull request #253 from bellingcat/settings_page
Update material version, minify code
|
2025-03-17 11:59:37 +00:00 |
|
erinhmclark
|
f5bbfe5d1c
|
Merge branch 'main' into feat/yt-dlp-pots
|
2025-03-17 10:43:35 +00:00 |
|
Patrick Robertson
|
f56cd6891b
|
Finish incomplete sentence
|
2025-03-17 10:33:50 +00:00 |
|
Patrick Robertson
|
0765640bff
|
Fix up tiktok dropin for slightly modified generic_extractor format
|
2025-03-17 10:31:22 +00:00 |
|
Patrick Robertson
|
06b1f4c0ca
|
Fix lingering merge conflict issues
|
2025-03-17 10:12:55 +00:00 |
|
Patrick Robertson
|
59b910ec30
|
Merge main
|
2025-03-17 10:05:11 +00:00 |
|
Patrick Robertson
|
7e360240bf
|
Copy ytdlp code into AA project - seems like ytdlp won't be merged anytime soon
|
2025-03-17 09:57:05 +00:00 |
|
Patrick Robertson
|
9e03d745d8
|
Add '-it' to the list of docker flags, so that docker gives a colour log output
|
2025-03-17 09:45:12 +00:00 |
|
Patrick Robertson
|
7badf89c28
|
Create the 'secrets' folder if it doesn't exist on first run
Easier setup for users
|
2025-03-17 09:40:46 +00:00 |
|
Patrick Robertson
|
d59530c8e7
|
Fix if logic bug
|
2025-03-17 09:40:27 +00:00 |
|
Patrick Robertson
|
0ec5451f66
|
Nicer error log when no URLs provided for CLI feeder - don't need the stacktrace
|
2025-03-17 09:34:33 +00:00 |
|
Patrick Robertson
|
99e9ac2465
|
Fix 'Syntax Error' warning in python3.12+
|
2025-03-17 09:29:51 +00:00 |
|