81 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
msramalho	ec4ae84487	case-insensitive is a bad idea	2022-03-12 20:06:31 +01:00
msramalho	69483d432c	adds logs	2022-03-12 20:04:08 +01:00
msramalho	6e5e7212c2	fixes header offset	2022-03-12 19:56:00 +01:00
msramalho	486c3295b5	log	2022-03-12 19:54:10 +01:00
msramalho	6c5d6f521e	implements fresh status retrieval if needed	2022-03-10 19:00:02 +01:00
msramalho	52333874c9	making column names configurable through the command line	2022-03-09 12:38:04 +01:00
msramalho	077c71f941	fixes index out fo range bug	2022-03-09 12:18:06 +01:00
msramalho	ff874fe0d3	simplifies access to google sheets, single get_values	2022-03-09 12:17:51 +01:00
msramalho	544e7578a6	removes duplicate code	2022-03-09 11:46:14 +01:00
msramalho	59027ac477	simplification	2022-03-09 11:44:19 +01:00
msramalho	39ec190e56	adds README instructions for geckodriver	2022-03-09 11:44:05 +01:00
Logan Williams	82ca6792c4	Fix issue with extracting time from Telegram media posts	2022-03-02 14:45:36 +01:00
Logan Williams	aa4b175dea	Fix issue with timestamps being convereted to user format	2022-02-28 12:54:58 +01:00
Logan Williams	c6b159905b	Switch to headless Firefox	2022-02-28 11:45:32 +01:00
Logan Williams	6ebce974f0	WIP: Make timezones more consistent in UTC	2022-02-28 08:42:59 +01:00
Logan Williams	2d50703489	Generate archivers for Telegram posts with images; move generation to function in base_archiver	2022-02-28 08:41:45 +01:00
Logan Williams	63a2847ac9	Add header argument; set up webdriver	2022-02-25 16:09:35 +01:00
Logan Williams	09dc5b5b81	Fix issue with query parameters by using urllib	2022-02-25 15:29:56 +01:00
Logan Williams	6a62c5798c	Add Twitter non-video archiver	2022-02-25 13:55:43 +01:00
Logan Williams	1eb17e4de5	Add hash and screenshot methods; switch to more recent ytdl fork	2022-02-25 13:54:40 +01:00
Logan Williams	d76e3bc7ec	Merge pull request #13 from bellingcat/refactor-archivers ... WIP: Refactor archivers	2022-02-25 08:05:22 +01:00
msramalho	8bce84082a	minor updates	2022-02-23 18:32:40 +01:00
msramalho	4bbbdcc7fd	minor update	2022-02-23 18:30:06 +01:00
msramalho	214d52d36f	improved tmp folder management	2022-02-23 16:43:42 +01:00
msramalho	3cafc444fc	creates tmp folder if not exists	2022-02-23 16:32:38 +01:00
msramalho	1d62009c4f	creates utils module and moves gworkseet there	2022-02-23 16:24:59 +01:00
msramalho	2601313249	removed archivers.py	2022-02-23 16:13:09 +01:00
msramalho	3096725a2b	Merge branch 'refactor-archivers' of https://github.com/bellingcat/auto-archiver into refactor-archivers	2022-02-23 16:12:47 +01:00
msramalho	9a264a7dfe	cleanup and docs	2022-02-23 16:07:58 +01:00
msramalho	9550cd509e	making code more resilient to exceptions	2022-02-23 13:57:11 +01:00
msramalho	644aa0811c	todo	2022-02-23 09:57:44 +01:00
msramalho	374852e740	cleanup	2022-02-23 09:57:04 +01:00
msramalho	2d145802b5	extracted worksheet operations	2022-02-23 09:54:03 +01:00
msramalho	e4603a9423	refactoring storage and bringing changes from origin	2022-02-22 16:03:35 +01:00
Logan Williams	07b5d357b4	Fix bugs in WaybackArchiver, follow redirects sometimes	2022-02-22 08:20:45 +01:00
msramalho	f3ce226665	split into multiple files MVP	2022-02-21 14:19:09 +01:00
Logan Williams	009c0dd8ca	Clean up dependencies	2022-02-20 11:06:47 +01:00
Logan Williams	51d448f0cb	Refactor archivers to make it easier to add support for new types of URLs	2022-02-20 10:36:53 +01:00
Logan Williams	b52380446f	Merge branch 'jamesarnall-refactor-dry' into main	2021-10-21 10:01:11 +00:00
Logan Williams	7e2e9f999d	Fix merge conflicts with get_key, remove os module as a function input	2021-10-21 10:01:05 +00:00
Logan Williams	0492eee65e	Generate storage keys in reusable way	2021-10-21 09:55:50 +00:00
James Arnall	b639a9b819	Minor refactoring to avoid redundant code	2021-09-08 14:20:23 -07:00
Logan Williams	2097e42df0	Dynamically adjust number of keyframes for contact sheet view.	2021-08-25 11:04:14 +00:00
Logan Williams	e3b400ca4e	Add Facebook cookie option	2021-08-24 11:17:29 +02:00
Logan Williams	4472389ae5	Remove case-sensitivity to column titles	2021-08-24 10:43:22 +02:00
Logan Williams	67e41b80ce	Add LICENSE	2021-06-24 16:14:32 +02:00
Logan Williams	194ff84e35	Merge pull request #9 from jamesarnall/gspreadconfig ... Changed instructions on creating credential files	2021-06-12 19:04:24 +02:00
James Arnall	1e6b504c7a	Changed instructions on creating credential files ... The original instructions specified putting the gspread credentials file in the default location, but the code looks for a file in another place. The README now reflects the code's behavior.	2021-06-12 11:37:09 -05:00
Logan Williams	3aa2a083ba	Update README.md	2021-06-04 12:07:03 +02:00
Logan Williams	af99f16f71	Use Internet Archive Save Now V2 API	2021-06-03 11:20:06 +02:00