151 Commits

Author	SHA1	Message	Date
msramalho	7a5c9c65bd	detects duplicates before storing, eg: wacz getting media already fetched by another archiver	2023-07-28 10:51:48 +01:00
msramalho	fc93ebaba0	cleanup	2023-07-28 10:49:39 +01:00
msramalho	1b44a302cd	removing some reverse search engines	2023-07-28 10:49:20 +01:00
msramalho	1368f7aebc	feat: making grayscale a toggle	2023-07-28 10:49:03 +01:00
msramalho	e3a0003a47	adding WACZ screenshots	2023-07-27 21:36:25 +01:00
msramalho	59551b3b20	minor improvements: finding best twitter image quality	2023-07-27 21:36:15 +01:00
msramalho	f086d89111	new escape message	2023-07-27 20:14:59 +01:00
msramalho	3dd3775cbd	removes rearchiving logic	2023-07-27 20:14:50 +01:00
msramalho	1e66a2c905	Bump version to v0.6.0 for release	2023-07-27 15:42:29 +01:00
msramalho	e8f44b652e	minor improvements	2023-07-27 15:42:23 +01:00
msramalho	dd034da844	feat: WACZ enricher can now be probed for media, and used as an archiver OR enricher	2023-07-27 15:42:10 +01:00
msramalho	65e3c99483	Bump version to v0.5.28 for release	2023-07-26 16:13:14 +01:00
msramalho	888ad8f004	fix: twitter hack videos extension detection	2023-07-26 16:12:56 +01:00
msramalho	086a9e6c84	fix: remove unnecessary log	2023-07-11 12:17:15 +01:00
msramalho	4d80ee6f02	Bump version to v0.5.27 for release	2023-07-11 12:16:06 +01:00
msramalho	92569ae6be	fix: telegram archiver was outdated for images	2023-07-11 12:15:56 +01:00
msramalho	abaf86c776	Bump version to v0.5.26 for release	2023-07-02 18:42:59 +02:00
msramalho	8005a1955a	fixes #82 twitter api walls	2023-07-02 18:42:43 +02:00
msramalho	04f827f183	Bump version to v0.5.25 for release	2023-06-26 18:15:45 +01:00
msramalho	a2c6cdc111	Bump version to v0.5.24 for release	2023-06-26 17:58:47 +01:00
msramalho	a0971fc601	final code review changes	2023-06-26 17:32:19 +01:00
msramalho	0cba2c25c6	get all media method	2023-06-26 17:28:19 +01:00
msramalho	7c0b05b276	new column	2023-06-26 17:27:57 +01:00
msramalho	3bbfdf6eba	fix: excluding screenshots	2023-06-26 17:27:49 +01:00
msramalho	a7a6bda1c2	improve missing col behaviour to error log	2023-06-26 17:27:37 +01:00
msramalho	d80145002d	formatter to accommodate properties of inner media	2023-06-26 17:06:50 +01:00
msramalho	b4f86d0e8d	refactor to hash all images and save hex string	2023-06-26 17:06:30 +01:00
msramalho	6cf3e109ed	refactor discovery of inner media elements	2023-06-26 17:05:25 +01:00
Emiel de Heij	9fc09c724b	add module for perceptual hashing with pdq	2023-06-26 15:25:55 +02:00
Logan Williams	cc66ee3fd4	bump to patch 23	2023-06-06 12:24:43 -06:00
Logan Williams	b3b727b005	Fix ValueError	2023-06-06 12:13:08 -06:00
msramalho	ee37b20e6c	fix: on missing col	2023-05-24 20:25:30 +01:00
msramalho	a184bf7b97	Bump version to v0.5.20 for release	2023-05-24 20:24:35 +01:00
msramalho	e535f44a88	optional folder	2023-05-24 20:24:15 +01:00
msramalho	0f28bf0e35	Bump version to v0.5.19 for release	2023-05-24 19:57:51 +01:00
msramalho	18a8636552	feat: new DB for auto-archiver-api	2023-05-24 19:24:53 +01:00
msramalho	81be65c828	Bump version to v0.5.18 for release	2023-05-24 11:19:02 +01:00
msramalho	0a91863212	typing fixes	2023-05-24 11:18:39 +01:00
msramalho	3ad8349e3f	Bump version to v0.5.17 for release	2023-05-23 19:05:53 +01:00
msramalho	2768225cd1	fix: generator not called	2023-05-23 19:05:47 +01:00
msramalho	3e44b9b577	Bump version to v0.5.16 for release	2023-05-23 18:12:56 +01:00
msramalho	1a5797d0f8	feat: orchestrator fed returns archive result	2023-05-23 18:12:04 +01:00
msramalho	768b8fce9f	Bump version to v0.5.15 for release	2023-05-19 12:35:26 +01:00
msramalho	613b1f1e50	properly overwrite configs	2023-05-19 12:35:19 +01:00
msramalho	919c37bfb6	Bump version to v0.5.14 for release	2023-05-19 12:18:02 +01:00
msramalho	a655b3c987	gsheet accepts ID too	2023-05-19 12:17:34 +01:00
msramalho	3da9c9cf8f	Bump version to v0.5.13 for release	2023-05-19 11:49:38 +01:00
msramalho	68e9d2a2ce	allows yaml config to be overwritten	2023-05-19 11:49:02 +01:00
Logan Williams	c47da0a46f	Fix issue with profiles in browsertrix	2023-05-11 15:08:27 +02:00
msramalho	b7c69c0f0d	Bump version to v0.5.12 for release	2023-05-10 18:58:34 +01:00