4 Commits

Author	SHA1	Message	Date
Patrick Robertson	6ab8fd2ee4	Tidy up setting modules as Orchestrator attributes on startup. ... Don't override the values in config['steps'] – the config should be left as is	2025-02-06 10:20:05 +01:00
Patrick Robertson	d6b4b7a932	Further cleanup ... * Removes (partly) the ArchivingOrchestrator * Removes the cli_feeder module, and makes it the 'default', allowing you to pass URLs directly on the command line, without having to use the cumbersome --cli_feeder.urls. Just do auto-archiver https://my.url.com * More unit tests * Improved error handling	2025-01-30 16:44:40 +01:00
Patrick Robertson	fade68c6f4	Fix up unit tests - dataclass + subclasses not having @dataclass was breaking it	2025-01-30 13:45:24 +01:00
Patrick Robertson	b7d9145f6c	Further tidyups + refactoring for new structure ... * Add implementation tests for orchestrator + logging tests * Standardise method/class vars for extractors to see if they are suitable * Fix bugs with removing default loguru logger (allows further customisation) * Fix bug loading required fields from file *	2025-01-30 13:21:10 +01:00