53 Commits

Author	SHA1	Message	Date
msramalho	f87acb6d1d	refactor	2022-06-07 18:41:58 +02:00
msramalho	e2d1a5d6be	import cleanups	2022-06-03 18:30:12 +02:00
msramalho	5e495b713f	minor update	2022-06-03 18:23:53 +02:00
msramalho	66e214afa4	minor improvements and cleanup archivers	2022-06-03 18:23:45 +02:00
msramalho	5135e97d3f	cleanup auto_archive and config	2022-06-03 18:03:49 +02:00
msramalho	10f03cb888	Merge branch 'dev' into refactor-configs	2022-06-02 17:30:47 +02:00
msramalho	159adf9afe	refactoring filenumber into subfolder	2022-05-26 19:18:29 +02:00
msramalho	ea261635a2	cleanup	2022-05-25 10:32:26 +02:00
Dave Mateer	dbac5accbd	Save to folders for S3 and GD. Google Drive (GD) storage	2022-05-11 15:39:44 +01:00
msramalho	d7f44b948f	wayback fix	2022-05-10 23:15:58 +02:00
msramalho	bca960b228	merge from master and fixes	2022-05-10 23:09:33 +02:00
msramalho	f6e8da34b8	Merge remote-tracking branch 'origin/main' into refactor-configs	2022-05-10 22:37:09 +02:00
msramalho	94b37b02ba	telethon refactor for failures	2022-05-10 20:23:44 +02:00
msramalho	6bd6f88b46	refactor	2022-05-09 17:45:54 +02:00
Miguel Sozinho Ramalho	3a3d3c6690	Merge pull request #29 from djhmateer/fb-cookie	2022-05-09 15:53:07 +01:00
Miguel Sozinho Ramalho	3c0811a80d	Merge pull request #28 from djhmateer/yt-sub	2022-05-09 15:52:10 +01:00
msramalho	0d65798308	wip: configurations and logic	2022-05-09 14:54:48 +02:00
Dave Mateer	7ae6e0c6f8	fb cooke in ytd	2022-05-09 11:38:08 +01:00
Dave Mateer	bd235347ac	Added catch in youtubedl_archiver for twitter.com to see if a linked video is in there eg vk.com	2022-05-09 11:23:42 +01:00
Dave Mateer	cb18289e4f	Get Twitter original size image quality	2022-05-09 10:55:38 +01:00
msramalho	f00e31c23d	introduce config.py	2022-05-03 20:33:54 +02:00
msramalho	ac9ed1a0d7	extract wayback config	2022-05-03 20:33:38 +02:00
msramalho	a7948ac768	extract telegram config	2022-05-03 20:33:19 +02:00
Dave Mateer	fec380e93d	Fixed wwww (4 w's) to www in youtubedl	2022-04-27 10:18:10 +01:00
msramalho	8358ab0bfc	assert post is not None	2022-03-30 11:12:06 +02:00
msramalho	3bdeec1d2f	fix deprecation warning for selenium	2022-03-30 11:05:31 +02:00
msramalho	e5168fa07c	removing TODO	2022-03-30 10:55:57 +02:00
msramalho	576f1a8f68	fix the UTF-8 issue for cyrilic	2022-03-30 10:55:33 +02:00
Logan Williams	398f296789	Fix Selenium driver issues with telegram links	2022-03-18 11:10:27 +01:00
Logan Williams	538bb05395	Merge branch 'main' of github.com:bellingcat/auto-archiver into main	2022-03-18 09:53:29 +01:00
Logan Williams	d611aa1e14	Some videos don't render a duration for some reason	2022-03-18 09:44:17 +01:00
msramalho	450065b6fb	removes print	2022-03-16 19:56:18 +01:00
msramalho	516db483d6	telethon archiver working for 0,1,1+ media objects	2022-03-16 19:51:02 +01:00
msramalho	c2ae382a4e	isloates html page generation logic so it can be reused	2022-03-16 19:50:44 +01:00
msramalho	0035603bfb	telethon-poc	2022-03-15 18:45:53 +01:00
msramalho	3b9b42b854	minor code cleanup	2022-03-15 11:32:39 +01:00
msramalho	077c71f941	fixes index out fo range bug	2022-03-09 12:18:06 +01:00
Logan Williams	82ca6792c4	Fix issue with extracting time from Telegram media posts	2022-03-02 14:45:36 +01:00
Logan Williams	aa4b175dea	Fix issue with timestamps being convereted to user format	2022-02-28 12:54:58 +01:00
Logan Williams	6ebce974f0	WIP: Make timezones more consistent in UTC	2022-02-28 08:42:59 +01:00
Logan Williams	2d50703489	Generate archivers for Telegram posts with images; move generation to function in base_archiver	2022-02-28 08:41:45 +01:00
Logan Williams	63a2847ac9	Add header argument; set up webdriver	2022-02-25 16:09:35 +01:00
Logan Williams	09dc5b5b81	Fix issue with query parameters by using urllib	2022-02-25 15:29:56 +01:00
Logan Williams	6a62c5798c	Add Twitter non-video archiver	2022-02-25 13:55:43 +01:00
Logan Williams	1eb17e4de5	Add hash and screenshot methods; switch to more recent ytdl fork	2022-02-25 13:54:40 +01:00
msramalho	8bce84082a	minor updates	2022-02-23 18:32:40 +01:00
msramalho	214d52d36f	improved tmp folder management	2022-02-23 16:43:42 +01:00
msramalho	3cafc444fc	creates tmp folder if not exists	2022-02-23 16:32:38 +01:00
msramalho	9a264a7dfe	cleanup and docs	2022-02-23 16:07:58 +01:00
msramalho	9550cd509e	making code more resilient to exceptions	2022-02-23 13:57:11 +01:00