13 Commits

Author	SHA1	Message	Date
erinhmclark	c4bb667cec	Merge branch 'load_modules' into add_module_tests ... # Conflicts: # src/auto_archiver/modules/s3_storage/s3_storage.py # src/auto_archiver/utils/gsheet.py # src/auto_archiver/utils/misc.py	2025-02-10 16:17:08 +00:00
erinhmclark	f311621e58	Small fixes. ... Add timestamp helper method.	2025-02-10 15:57:42 +00:00
msramalho	8fb3dc754b	fixing telethon extractor to use default entrypoint	2025-02-10 14:59:51 +00:00
erinhmclark	52542812dc	Merge tests from version with context.	2025-02-05 16:42:58 +00:00
Patrick Robertson	d6b4b7a932	Further cleanup ... * Removes (partly) the ArchivingOrchestrator * Removes the cli_feeder module, and makes it the 'default', allowing you to pass URLs directly on the command line, without having to use the cumbersome --cli_feeder.urls. Just do auto-archiver https://my.url.com * More unit tests * Improved error handling	2025-01-30 16:44:40 +01:00
Patrick Robertson	b7d9145f6c	Further tidyups + refactoring for new structure ... * Add implementation tests for orchestrator + logging tests * Standardise method/class vars for extractors to see if they are suitable * Fix bugs with removing default loguru logger (allows further customisation) * Fix bug loading required fields from file *	2025-01-30 13:21:10 +01:00
Patrick Robertson	00a7018f36	Fix up dependency checking (use 'dependencies' instead of 'external_dependencies' -> simpler/easier to remember	2025-01-29 19:25:22 +01:00
erinhmclark	e1a9373336	Refactoring for new config setup	2025-01-27 19:03:02 +00:00
Patrick Robertson	7fd95866a1	Further fixes/changes to loading 'types' for config + manifest edits	2025-01-27 11:48:04 +01:00
erinhmclark	ebebd27897	Fix archiver to extractor naming	2025-01-27 09:11:45 +00:00
erinhmclark	0453d95f56	fix config parsing in manifests	2025-01-24 13:24:54 +00:00
erinhmclark	aa7ca93a43	Update manifests and modules	2025-01-24 12:58:16 +00:00
erinhmclark	1274a1b231	More manifests, base modules and rename from archiver to extractor.	2025-01-23 16:40:48 +00:00