Commit Graph

  • 63a2847ac9 Add header argument; set up webdriver Logan Williams 2022-02-25 16:09:35 +01:00
  • 09dc5b5b81 Fix issue with query parameters by using urllib Logan Williams 2022-02-25 15:29:56 +01:00
  • 6a62c5798c Add Twitter non-video archiver Logan Williams 2022-02-25 13:55:43 +01:00
  • 1eb17e4de5 Add hash and screenshot methods; switch to more recent ytdl fork Logan Williams 2022-02-25 13:54:40 +01:00
  • d76e3bc7ec Merge pull request #13 from bellingcat/refactor-archivers Logan Williams 2022-02-25 08:05:22 +01:00
  • 8bce84082a minor updates msramalho 2022-02-23 18:32:40 +01:00
  • 4bbbdcc7fd minor update msramalho 2022-02-23 18:30:06 +01:00
  • 214d52d36f improved tmp folder management msramalho 2022-02-23 16:43:42 +01:00
  • 3cafc444fc creates tmp folder if not exists msramalho 2022-02-23 16:32:38 +01:00
  • 1d62009c4f creates utils module and moves gworkseet there msramalho 2022-02-23 16:24:59 +01:00
  • 2601313249 removed archivers.py msramalho 2022-02-23 16:13:09 +01:00
  • 3096725a2b Merge branch 'refactor-archivers' of https://github.com/bellingcat/auto-archiver into refactor-archivers msramalho 2022-02-23 16:12:47 +01:00
  • 9a264a7dfe cleanup and docs msramalho 2022-02-23 16:07:58 +01:00
  • 9550cd509e making code more resilient to exceptions msramalho 2022-02-23 13:57:11 +01:00
  • 644aa0811c todo msramalho 2022-02-23 09:57:44 +01:00
  • 374852e740 cleanup msramalho 2022-02-23 09:57:04 +01:00
  • 2d145802b5 extracted worksheet operations msramalho 2022-02-23 09:54:03 +01:00
  • e4603a9423 refactoring storage and bringing changes from origin msramalho 2022-02-22 16:03:35 +01:00
  • 07b5d357b4 Fix bugs in WaybackArchiver, follow redirects sometimes Logan Williams 2022-02-22 08:20:45 +01:00
  • f3ce226665 split into multiple files MVP msramalho 2022-02-21 14:19:09 +01:00
  • 009c0dd8ca Clean up dependencies Logan Williams 2022-02-20 11:06:47 +01:00
  • 51d448f0cb Refactor archivers to make it easier to add support for new types of URLs Logan Williams 2022-02-20 10:27:25 +01:00
  • b52380446f Merge branch 'jamesarnall-refactor-dry' into main Logan Williams 2021-10-21 10:01:11 +00:00
  • 7e2e9f999d Fix merge conflicts with get_key, remove os module as a function input Logan Williams 2021-10-21 10:01:05 +00:00
  • 0492eee65e Generate storage keys in reusable way Logan Williams 2021-10-21 09:55:50 +00:00
  • b639a9b819 Minor refactoring to avoid redundant code James Arnall 2021-09-08 14:20:23 -07:00
  • 2097e42df0 Dynamically adjust number of keyframes for contact sheet view. Logan Williams 2021-08-25 11:04:14 +00:00
  • e3b400ca4e Add Facebook cookie option Logan Williams 2021-08-24 11:17:29 +02:00
  • 4472389ae5 Remove case-sensitivity to column titles Logan Williams 2021-08-24 10:43:22 +02:00
  • 67e41b80ce Add LICENSE Logan Williams 2021-06-24 16:14:32 +02:00
  • 194ff84e35 Merge pull request #9 from jamesarnall/gspreadconfig Logan Williams 2021-06-12 19:04:24 +02:00
  • 1e6b504c7a Changed instructions on creating credential files James Arnall 2021-06-12 11:37:09 -05:00
  • 3aa2a083ba Update README.md Logan Williams 2021-06-04 12:07:03 +02:00
  • af99f16f71 Use Internet Archive Save Now V2 API Logan Williams 2021-06-03 11:20:06 +02:00
  • 0b8f55de18 Check to see if Internet Archive request succeeded Logan Williams 2021-06-01 14:35:32 +02:00
  • 3e1e0e6a5f Add in progress status to Archive requests Logan Williams 2021-06-01 11:35:14 +02:00
  • 5b0fe4212a Rename files to use consistent punctuation Logan Williams 2021-06-01 09:33:20 +00:00
  • 2540b54113 Allow redirects for Archive requets Logan Williams 2021-06-01 11:30:47 +02:00
  • ebafd1a744 Update Pipfile Logan Williams 2021-06-01 09:19:12 +00:00
  • cbfc054203 Use service_account.json Logan Williams 2021-06-01 11:05:13 +02:00
  • a65b0eb6e9 Merge branch 'main' of github.com:bellingcat/auto-archiver Logan Williams 2021-06-01 11:00:52 +02:00
  • aaf75eb284 Add internet archive fallback Logan Williams 2021-06-01 11:00:40 +02:00
  • 4e21603407 Add documentation for auto-auto-archiver Logan Williams 2021-05-14 14:07:16 +02:00
  • 4d76867b5e Update README.md Logan Williams 2021-05-14 14:06:41 +02:00
  • 339f62fade Update auto archiver docs with new header declaration method Logan Williams 2021-05-12 09:01:45 +02:00
  • 866c4fa7fd Support (some) Telegram links Logan Williams 2021-05-03 14:16:09 +02:00
  • 3ba3f3cdf8 Add auto-auto archiver Logan Williams 2021-03-25 13:42:42 +01:00
  • cbc337798e Remove all-worksheets option, loop through all worksheets by default Logan Williams 2021-03-18 11:07:57 +01:00
  • 9070689d95 Thumbnail and metadata extraction Logan Williams 2021-03-18 11:03:13 +01:00
  • 99870d5287 Merge branch 'main' of github.com:bellingcat/auto-archiver into main Logan Williams 2021-03-15 10:20:39 +01:00
  • f40b924d0d Detect columns from header names, fixes #2 Logan Williams 2021-03-15 10:20:33 +01:00
  • a0180ccaaa pep8 format Logan Williams 2021-03-15 10:08:02 +01:00
  • a87b9a7b30 Update README.md Logan Williams 2021-02-09 15:27:42 +01:00
  • ad883c9232 Add intro Logan Williams 2021-02-09 15:22:58 +01:00
  • 8c7a3387bd Use correct image for after picture Logan Williams 2021-02-09 15:20:19 +01:00
  • 0d1dc42654 Add readme Logan Williams 2021-02-09 15:19:46 +01:00
  • d6cb20dace Combine streaming/non-streaming into one script with CLI arguments Logan Williams 2021-02-09 14:55:26 +01:00
  • 853e018ace Synchronize with remote version Logan Williams 2021-02-08 11:21:42 +00:00
  • e55a4d55dc Works with multiple sheets (hardcoded) Logan Williams 2021-01-19 10:04:30 +00:00
  • f6abb0fb3e Handle multiple videos with error Logan Williams 2021-01-15 17:00:01 +01:00
  • 888c263d76 Hacky fix for youtube filename issue Logan Williams 2021-01-15 12:19:36 +01:00
  • bfc38d36d5 Don't archive twice Logan Williams 2021-01-15 12:10:05 +01:00
  • 8fd8da05df Use batch updates Logan Williams 2021-01-15 11:51:03 +01:00
  • f6cfcfc194 add requirements file Logan Williams 2021-01-15 10:50:07 +00:00
  • 2af24085c9 Initial commit Logan Williams 2021-01-15 11:31:58 +01:00