176 Commits

Author	SHA1	Message	Date
erinhmclark	57b3bec935	Google sheets feeder and database implemented.	2025-01-27 20:13:12 +00:00
erinhmclark	6c67effd8c	remove name reference in local_storage.py	2025-01-27 19:17:18 +00:00
erinhmclark	e1a9373336	Refactoring for new config setup	2025-01-27 19:03:02 +00:00
Patrick Robertson	f68e2726f2	Refactor loader + step into module, use LazyBaseModule and BaseModule	2025-01-27 14:01:36 +01:00
Patrick Robertson	7fd95866a1	Further fixes/changes to loading 'types' for config + manifest edits	2025-01-27 11:48:04 +01:00
Patrick Robertson	14e2479599	Merge branch 'more_mainifests' into load_modules	2025-01-27 11:05:56 +01:00
erinhmclark	ebebd27897	Fix archiver to extractor naming	2025-01-27 09:11:45 +00:00
erinhmclark	21a7ff0520	Fix types in manifests	2025-01-27 08:43:18 +00:00
erinhmclark	dd402b456f	Fix and add types to manifest	2025-01-24 18:50:11 +00:00
Patrick Robertson	f1e9ab6751	Merge branch 'main' into load_modules	2025-01-24 15:23:15 +01:00
erinhmclark	024fe58377	fix config parsing in manifests, remove module level configs	2025-01-24 13:33:12 +00:00
erinhmclark	0453d95f56	fix config parsing in manifests	2025-01-24 13:24:54 +00:00
erinhmclark	aa7ca93a43	Update manifests and modules	2025-01-24 12:58:16 +00:00
Patrick Robertson	9befb9776c	Fix loading modules when entry_point isn't set	2025-01-23 21:08:54 +01:00
erinhmclark	50f4ebcdc3	Move storage configs into individual manifests, assert format on useage.	2025-01-23 17:01:30 +00:00
erinhmclark	c3403ced26	Rename storages for clarity	2025-01-23 16:51:17 +00:00
erinhmclark	1274a1b231	More manifests, base modules and rename from archiver to extractor.	2025-01-23 16:40:48 +00:00
erinhmclark	9db26cdfc2	Merge branch 'load_modules' into more_mainifests ... # Conflicts: # src/auto_archiver/core/orchestrator.py	2025-01-23 09:19:54 +00:00
erinhmclark	79684f8348	Set up feeder manifests (not merged by source yet)	2025-01-23 09:16:42 +00:00
Patrick Robertson	65ef46d01e	Fix loading already loaded modules - don't load them twice	2025-01-23 00:09:39 +01:00
Patrick Robertson	550097ab7b	Get module loading working properly	2025-01-22 23:54:21 +01:00
erinhmclark	99c8c69085	Manifests for databases	2025-01-22 18:18:13 +00:00
Patrick Robertson	54995ad6ab	Further tweaks based on __manifest__.py files ... Loading configs now works	2025-01-22 13:11:43 +01:00
erinhmclark	7b3a1468cd	Create manifest files for archiver modules.	2025-01-22 10:21:27 +01:00
Patrick Robertson	4830f99300	Get parsing of manifest and combining with config file working	2025-01-21 20:03:10 +01:00
Patrick Robertson	241b35002c	Initial changes to move to '__manifest__' format	2025-01-21 19:02:38 +01:00