40 Commits

Author	SHA1	Message	Date
msramalho	6c80a5b82d	session file logic	2022-10-18 17:35:59 +01:00
msramalho	93be1af93f	adds instagram post/profile	2022-10-18 15:45:10 +01:00
msramalho	f0f844a569	improves browsertrix configurations	2022-10-18 11:21:10 +01:00
msramalho	57464f1506	refactors for edges in browsertrix and s3 upload, adds timeout parameter	2022-10-17 14:07:31 +01:00
Ed Summers	c34fb9cf10	Add browsertrix profile config option ... This commit adds a browsertrix profile option to the configuration. In order to not require the passing of the browsertrix config to every Archiver, the Archiver constructors (include the base) were modified to accept a Storage and Config instance. Some of the constructors them pick out the pieces they need from the Config, in addition to calling the parent constructor. In order to avoid a circular import that this created the Config object now defines the default hash function to use, rather than having it be a static property of the Archiver class.	2022-10-11 16:21:42 -04:00
msramalho	961dcdb4ef	Merge branch 'dev' into oauth	2022-07-25 14:58:56 +01:00
msramalho	6124bc5f72	refactored and simplified obtaining credentials	2022-07-25 14:52:50 +01:00
msramalho	9317b5e035	turning HASH_ALGORITHM into global archiver prop	2022-07-25 12:27:50 +01:00
msramalho	2d7d8c4e08	renaming and making default SHA-256	2022-07-25 12:12:43 +01:00
Dave Mateer	524b40b869	Added Google OAuth flow for Google Drive so can use a real user and not a service account to save files	2022-07-18 13:39:00 +01:00
Dave Mateer	363a8ef67a	Added hash_algorithm to config to choose between SHA256 and SHA3_512	2022-07-18 13:15:48 +01:00
msramalho	37e1fcd540	comment	2022-07-14 18:10:53 +02:00
msramalho	90cb080c81	refactoring and renaming	2022-07-14 18:10:02 +02:00
Dave Mateer	42172566f2	Added whitelist and blacklist for workwheets (not spreadsheet)	2022-07-12 12:53:59 +01:00
msramalho	ffe1c425a0	new archiver, new hack, ready	2022-06-27 01:07:55 +02:00
msramalho	7ab8d0e825	tmp folder randomly created in folder	2022-06-16 19:58:26 +02:00
msramalho	d2e29f85d2	selenium: quit and close	2022-06-16 18:45:47 +02:00
msramalho	08f48ae351	handling selenium better	2022-06-15 23:17:32 +02:00
msramalho	59afe7fd63	vk-archiver implemented	2022-06-15 16:38:18 +02:00
msramalho	6872d8e103	check if exists to configuration, save_logs to command line	2022-06-14 21:37:02 +02:00
msramalho	a7a555ea85	refactor configs	2022-06-14 21:19:45 +02:00
msramalho	dc60bb1558	json -> yaml	2022-06-14 21:18:18 +02:00
msramalho	c11a208253	more verbose about mandatory columns	2022-06-14 19:54:08 +02:00
msramalho	bd5146ac3e	bug fixes	2022-06-08 18:17:25 +02:00
msramalho	9e871b3bbc	telethon config fixes	2022-06-08 13:46:20 +02:00
msramalho	562d2f51ad	bot token	2022-06-08 13:39:57 +02:00
msramalho	1df68c3652	config bug fix	2022-06-08 11:45:04 +02:00
msramalho	90a6083bc1	logs to config	2022-06-08 11:13:12 +02:00
msramalho	f87acb6d1d	refactor	2022-06-07 18:41:58 +02:00
msramalho	e32c0788b7	minor update	2022-06-03 19:40:26 +02:00
msramalho	e2d1a5d6be	import cleanups	2022-06-03 18:30:12 +02:00
msramalho	5135e97d3f	cleanup auto_archive and config	2022-06-03 18:03:49 +02:00
msramalho	a2fdfacb26	config refactor and cleanup	2022-06-03 17:32:25 +02:00
msramalho	2a01038c0c	memleak	2022-05-11 00:14:42 +02:00
msramalho	bca960b228	merge from master and fixes	2022-05-10 23:09:33 +02:00
msramalho	6bd6f88b46	refactor	2022-05-09 17:45:54 +02:00
msramalho	0d65798308	wip: configurations and logic	2022-05-09 14:54:48 +02:00
msramalho	f00e31c23d	introduce config.py	2022-05-03 20:33:54 +02:00
msramalho	ac9ed1a0d7	extract wayback config	2022-05-03 20:33:38 +02:00
msramalho	a7948ac768	extract telegram config	2022-05-03 20:33:19 +02:00