1529 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Patrick Robertson	6700250891	Add a test for checking module type on setup	2025-03-20 18:18:53 +04:00
Patrick Robertson	5e5e1c43a1	When loading modules, check they have been added to the right 'step' in the config ... Fixes an issue seen on discord where a user accidentally set up metadata_enricher under 'extractors'	2025-03-20 18:09:26 +04:00
Patrick Robertson	1e19ad77c6	Fix tests	2025-03-20 18:08:19 +04:00
Patrick Robertson	f22af5e123	Tweak WACZ enricher docs + add comment on WACZ_ENABLE_DOCKER	2025-03-20 16:48:30 +04:00
Patrick Robertson	799cef3a8c	Cleanup docker-compose	2025-03-20 16:48:30 +04:00
erinhmclark	2921061fde	Add flexible extractor_args to generic_extractor.py	2025-03-19 19:19:28 +00:00
Patrick Robertson	e531906d73	Create an independent profile file for each wacz_extractor_enricher instance	2025-03-19 18:08:24 +04:00
Patrick Robertson	244341d22c	Skip check for 'docker' bin dependency if already running in docker	2025-03-19 18:08:04 +04:00
Erin Clark	90932a7bc8	Merge pull request #259 from bellingcat/fix_youtube_generic ... Small fix for generic_extractor.py for general/ youtube extraction.	2025-03-19 11:52:56 +00:00
Patrick Robertson	488675056b	Download generate_google_services.sh script from GH - it's not packaged with the app	2025-03-19 15:52:39 +04:00
erinhmclark	93921e71d4	Clarify comments in pot scripts.	2025-03-19 11:33:35 +00:00
erinhmclark	675de50ee7	Update module test to test for default config keys within loaded	2025-03-19 10:47:28 +00:00
erinhmclark	fc6946f78a	Run format.	2025-03-18 21:43:18 +00:00
erinhmclark	2fdf6b7564	Update generic_extractor.py for general/ youtube extraction.	2025-03-18 21:33:21 +00:00
erinhmclark	a577228465	Update generic_extractor.py for general/ youtube extraction.	2025-03-18 21:10:06 +00:00
erinhmclark	ba9d67e4bb	Merge branch 'main' into feat/yt-dlp-pots	2025-03-18 20:10:38 +00:00
erinhmclark	c4e63ebd8c	Add conditional check to setup bgutils token generation script. ... TODO: Update tests	2025-03-18 14:54:57 +00:00
Miguel Sozinho Ramalho	f6863b8eb2	Update src/auto_archiver/modules/gsheet_feeder_db/__manifest__.py	2025-03-18 14:10:47 +00:00
erinhmclark	b83bfda187	Update directory location, add .gitignore	2025-03-18 14:10:20 +00:00
Miguel Sozinho Ramalho	5c34ac1293	Update docs/source/how_to/gsheets_setup.md	2025-03-18 14:05:23 +00:00
erinhmclark	cb632723bd	Add scripts to pull only /server/ section of pots generator, adn only install at runtime.	2025-03-18 13:47:01 +00:00
Patrick Robertson	7d972ee9b8	Merge pull request #258 from bellingcat/version_bump ... Version bump v0.13.7	2025-03-18 12:18:09 +00:00
Patrick Robertson	b64826dc16	Merge pull request #257 from bellingcat/standardise_parsedates ... Standardise parse dates to get_datetime_from_str	2025-03-18 12:17:51 +00:00
erinhmclark	0c892f3cf1	Temp fix for tests by setting path in manifest.	2025-03-18 11:44:08 +00:00
Patrick Robertson	23e74803ee	Version bump	2025-03-18 10:52:23 +00:00
Patrick Robertson	d03ecdb037	Standardise parse dates to get_datetime_from_str	2025-03-18 10:22:58 +00:00
Patrick Robertson	a5ebbf4726	Merge pull request #256 from bellingcat/dropin_cleanup ... Refactor the dropin 'is_suitable' method + fix for tikwm	2025-03-18 10:08:24 +00:00
Patrick Robertson	89e387030d	Tests for suitable URLs for tikwm	2025-03-18 10:04:03 +00:00
Patrick Robertson	8ec053ed1b	Refactor the dropin 'is_suitable' method + fix tikwm implementation ... Makes it easier to maintain/understand.	2025-03-18 09:14:14 +00:00
erinhmclark	43ef8f2aeb	Add update to POT setup script.	2025-03-17 20:59:34 +00:00
erinhmclark	e6b1a8c893	Add POT setup script.	2025-03-17 20:34:00 +00:00
erinhmclark	8548b7def7	Refactor setup method to pull and transpile the token generator.	2025-03-17 18:53:59 +00:00
Patrick Robertson	29db537fab	Docs on using the script to auto-generate service accounts	2025-03-17 18:11:18 +00:00
erinhmclark	bbe25537c7	Merge branch 'main' into feat/yt-dlp-pots	2025-03-17 16:54:29 +00:00
Patrick Robertson	c4a3a45bf7	Script to auto-generate a service account	2025-03-17 15:42:43 +00:00
erinhmclark	5daeae994a	Fix the extractor args for new list structure.	2025-03-17 14:17:31 +00:00
Patrick Robertson	3ea02c115e	Merge pull request #254 from bellingcat/rtd_docs ... Add info on building RTD versions + automated building of tagged versions	2025-03-17 13:01:20 +00:00
Patrick Robertson	ab03e48708	Add info on building RTD versions + automated building of tagged versions	2025-03-17 12:52:04 +00:00
Patrick Robertson	3d4056ef70	Merge pull request #223 from bellingcat/facebook_extractor ... Create facebook dropin - working for images + text.	2025-03-17 12:45:05 +00:00
Patrick Robertson	51041bf91e	Merge pull request #253 from bellingcat/settings_page ... Update material version, minify code	2025-03-17 11:59:37 +00:00
erinhmclark	f5bbfe5d1c	Merge branch 'main' into feat/yt-dlp-pots	2025-03-17 10:43:35 +00:00
Patrick Robertson	f56cd6891b	Finish incomplete sentence	2025-03-17 10:33:50 +00:00
Patrick Robertson	0765640bff	Fix up tiktok dropin for slightly modified generic_extractor format	2025-03-17 10:31:22 +00:00
Patrick Robertson	06b1f4c0ca	Fix lingering merge conflict issues	2025-03-17 10:12:55 +00:00
Patrick Robertson	59b910ec30	Merge main	2025-03-17 10:05:11 +00:00
Patrick Robertson	7e360240bf	Copy ytdlp code into AA project - seems like ytdlp won't be merged anytime soon	2025-03-17 09:57:05 +00:00
Patrick Robertson	9e03d745d8	Add '-it' to the list of docker flags, so that docker gives a colour log output	2025-03-17 09:45:12 +00:00
Patrick Robertson	7badf89c28	Create the 'secrets' folder if it doesn't exist on first run ... Easier setup for users	2025-03-17 09:40:46 +00:00
Patrick Robertson	d59530c8e7	Fix if logic bug	2025-03-17 09:40:27 +00:00
Patrick Robertson	0ec5451f66	Nicer error log when no URLs provided for CLI feeder - don't need the stacktrace	2025-03-17 09:34:33 +00:00