bellingcat/auto-archiver
1
0
Fork 0
mirror of https://github.com/bellingcat/auto-archiver.git synced 2026-06-08 03:18:28 +03:00
Code Issues Packages Projects Releases Wiki Activity
68 Commits 19 Branches 124 Tags
c6b159905b865f0b93a6bd574e8517cbecac01d1
Commit Graph

68 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Logan Williams
c6b159905b Switch to headless Firefox 2022-02-28 11:45:32 +01:00
Logan Williams
6ebce974f0 WIP: Make timezones more consistent in UTC 2022-02-28 08:42:59 +01:00
Logan Williams
2d50703489 Generate archivers for Telegram posts with images; move generation to function in base_archiver 2022-02-28 08:41:45 +01:00
Logan Williams
63a2847ac9 Add header argument; set up webdriver 2022-02-25 16:09:35 +01:00
Logan Williams
09dc5b5b81 Fix issue with query parameters by using urllib 2022-02-25 15:29:56 +01:00
Logan Williams
6a62c5798c Add Twitter non-video archiver 2022-02-25 13:55:43 +01:00
Logan Williams
1eb17e4de5 Add hash and screenshot methods; switch to more recent ytdl fork 2022-02-25 13:54:40 +01:00
Logan Williams
d76e3bc7ec Merge pull request #13 from bellingcat/refactor-archivers 
WIP: Refactor archivers
 2022-02-25 08:05:22 +01:00
msramalho
8bce84082a minor updates 2022-02-23 18:32:40 +01:00
msramalho
4bbbdcc7fd minor update 2022-02-23 18:30:06 +01:00
msramalho
214d52d36f improved tmp folder management 2022-02-23 16:43:42 +01:00
msramalho
3cafc444fc creates tmp folder if not exists 2022-02-23 16:32:38 +01:00
msramalho
1d62009c4f creates utils module and moves gworkseet there 2022-02-23 16:24:59 +01:00
msramalho
2601313249 removed archivers.py 2022-02-23 16:13:09 +01:00
msramalho
3096725a2b Merge branch 'refactor-archivers' of https://github.com/bellingcat/auto-archiver into refactor-archivers 2022-02-23 16:12:47 +01:00
msramalho
9a264a7dfe cleanup and docs 2022-02-23 16:07:58 +01:00
msramalho
9550cd509e making code more resilient to exceptions 2022-02-23 13:57:11 +01:00
msramalho
644aa0811c todo 2022-02-23 09:57:44 +01:00
msramalho
374852e740 cleanup 2022-02-23 09:57:04 +01:00
msramalho
2d145802b5 extracted worksheet operations 2022-02-23 09:54:03 +01:00
msramalho
e4603a9423 refactoring storage and bringing changes from origin 2022-02-22 16:03:35 +01:00
Logan Williams
07b5d357b4 Fix bugs in WaybackArchiver, follow redirects sometimes 2022-02-22 08:20:45 +01:00
msramalho
f3ce226665 split into multiple files MVP 2022-02-21 14:19:09 +01:00
Logan Williams
009c0dd8ca Clean up dependencies 2022-02-20 11:06:47 +01:00
Logan Williams
51d448f0cb Refactor archivers to make it easier to add support for new types of URLs 2022-02-20 10:36:53 +01:00
Logan Williams
b52380446f Merge branch 'jamesarnall-refactor-dry' into main 2021-10-21 10:01:11 +00:00
Logan Williams
7e2e9f999d Fix merge conflicts with get_key, remove os module as a function input 2021-10-21 10:01:05 +00:00
Logan Williams
0492eee65e Generate storage keys in reusable way 2021-10-21 09:55:50 +00:00
James Arnall
b639a9b819 Minor refactoring to avoid redundant code 2021-09-08 14:20:23 -07:00
Logan Williams
2097e42df0 Dynamically adjust number of keyframes for contact sheet view. 2021-08-25 11:04:14 +00:00
Logan Williams
e3b400ca4e Add Facebook cookie option 2021-08-24 11:17:29 +02:00
Logan Williams
4472389ae5 Remove case-sensitivity to column titles 2021-08-24 10:43:22 +02:00
Logan Williams
67e41b80ce Add LICENSE 2021-06-24 16:14:32 +02:00
Logan Williams
194ff84e35 Merge pull request #9 from jamesarnall/gspreadconfig 
Changed instructions on creating credential files
 2021-06-12 19:04:24 +02:00
James Arnall
1e6b504c7a Changed instructions on creating credential files 
The original instructions specified putting the gspread credentials file in the default location, but the code looks for a file in another place. The README now reflects the code's behavior.
 2021-06-12 11:37:09 -05:00
Logan Williams
3aa2a083ba Update README.md 2021-06-04 12:07:03 +02:00
Logan Williams
af99f16f71 Use Internet Archive Save Now V2 API 2021-06-03 11:20:06 +02:00
Logan Williams
0b8f55de18 Check to see if Internet Archive request succeeded 2021-06-01 14:35:32 +02:00
Logan Williams
3e1e0e6a5f Add in progress status to Archive requests 2021-06-01 11:35:14 +02:00
Logan Williams
5b0fe4212a Rename files to use consistent punctuation 2021-06-01 09:33:20 +00:00
Logan Williams
2540b54113 Allow redirects for Archive requets 2021-06-01 11:30:47 +02:00
Logan Williams
ebafd1a744 Update Pipfile 2021-06-01 09:19:12 +00:00
Logan Williams
cbfc054203 Use service_account.json 2021-06-01 11:05:13 +02:00
Logan Williams
a65b0eb6e9 Merge branch 'main' of github.com:bellingcat/auto-archiver 2021-06-01 11:00:52 +02:00
Logan Williams
aaf75eb284 Add internet archive fallback 2021-06-01 11:00:40 +02:00
Logan Williams
4e21603407 Add documentation for auto-auto-archiver 2021-05-14 14:07:16 +02:00
Logan Williams
4d76867b5e Update README.md 2021-05-14 14:06:41 +02:00
Logan Williams
339f62fade Update auto archiver docs with new header declaration method 2021-05-12 09:01:45 +02:00
Logan Williams
866c4fa7fd Support (some) Telegram links 2021-05-03 14:16:09 +02:00
Logan Williams
3ba3f3cdf8 Add auto-auto archiver 2021-03-25 13:42:42 +01:00