Commit Graph

  • 0bd9e043ed Merge pull request #58 from bellingcat/dev Miguel Sozinho Ramalho 2022-09-21 18:53:13 +02:00
  • c77b4a080a update comment msramalho 2022-09-21 18:52:23 +02:00
  • e813249520 Merge pull request #56 from djhmateer/oauth Miguel Sozinho Ramalho 2022-07-25 15:03:49 +01:00
  • 992dee022a format msramalho 2022-07-25 14:59:04 +01:00
  • 961dcdb4ef Merge branch 'dev' into oauth msramalho 2022-07-25 14:58:56 +01:00
  • 6124bc5f72 refactored and simplified obtaining credentials msramalho 2022-07-25 14:52:50 +01:00
  • 12918d4fce Merge pull request #55 from djhmateer/dev-upstream Miguel Sozinho Ramalho 2022-07-25 12:38:33 +01:00
  • 63140d69c1 format msramalho 2022-07-25 12:35:27 +01:00
  • e180b82b0d removing useless constructors msramalho 2022-07-25 12:29:42 +01:00
  • 9317b5e035 turning HASH_ALGORITHM into global archiver prop msramalho 2022-07-25 12:27:50 +01:00
  • 2d7d8c4e08 renaming and making default SHA-256 msramalho 2022-07-25 12:12:43 +01:00
  • 7b8be95e25 removing empty line msramalho 2022-07-25 12:12:14 +01:00
  • 524b40b869 Added Google OAuth flow for Google Drive so can use a real user and not a service account to save files Dave Mateer 2022-07-18 13:39:00 +01:00
  • 9f9b9d8f63 adding in GD token Dave Mateer 2022-07-18 13:25:05 +01:00
  • 363a8ef67a Added hash_algorithm to config to choose between SHA256 and SHA3_512 Dave Mateer 2022-07-18 13:15:48 +01:00
  • 6d8be4c07f s3 allow online preview instead of forced download msramalho 2022-07-14 18:16:06 +02:00
  • d701141c1b Merge pull request #51 from djhmateer/whitelist Miguel Sozinho Ramalho 2022-07-14 17:13:29 +01:00
  • 37e1fcd540 comment msramalho 2022-07-14 18:10:53 +02:00
  • 90cb080c81 refactoring and renaming msramalho 2022-07-14 18:10:02 +02:00
  • 4a7aac59de Merge pull request #50 from djhmateer/leadingslash Miguel Sozinho Ramalho 2022-07-14 16:45:49 +01:00
  • 03e542a0fc isolate into function msramalho 2022-07-14 17:45:28 +02:00
  • 42172566f2 Added whitelist and blacklist for workwheets (not spreadsheet) Dave Mateer 2022-07-12 12:53:59 +01:00
  • 16bd54b8d3 Put in fix for leading / in Google Drive Dave Mateer 2022-07-12 12:44:29 +01:00
  • 3095ce3054 fix: missing key bug msramalho 2022-07-04 18:25:33 +02:00
  • 7aeb38a773 Merge pull request #45 from bellingcat/twitter-api-and-hack Miguel Sozinho Ramalho 2022-06-27 13:37:52 +01:00
  • 4b423dfc34 fix telethon exception msramalho 2022-06-27 14:36:58 +02:00
  • 34536e7f14 added explanation for 2 twitter archivers msramalho 2022-06-27 11:17:23 +02:00
  • 179528562b minor updates msramalho 2022-06-27 01:07:59 +02:00
  • ffe1c425a0 new archiver, new hack, ready msramalho 2022-06-27 01:07:55 +02:00
  • 76b531c56a Merge pull request #44 from bellingcat/vk-url-lib Miguel Sozinho Ramalho 2022-06-21 14:40:08 +01:00
  • b4e9d6a2a8 removes log msramalho 2022-06-21 15:39:54 +02:00
  • c4efa6e597 dding thumbnails msramalho 2022-06-21 15:39:13 +02:00
  • 8a8251d622 fix in upstream lib for filenames msramalho 2022-06-21 01:44:48 +02:00
  • 74d421dc94 update lib msramalho 2022-06-21 00:05:32 +02:00
  • 88ede91304 refactoring to use vk_url_scraper msramalho 2022-06-20 14:44:06 +02:00
  • 177e3a623e improve log msramalho 2022-06-16 20:04:43 +02:00
  • 14dae0b938 remove unused import msramalho 2022-06-16 20:01:23 +02:00
  • 74cef2f21b Merge pull request #43 from bellingcat/refactor-tmp-dir-logic Miguel Sozinho Ramalho 2022-06-16 19:00:19 +01:00
  • 7ab8d0e825 tmp folder randomly created in folder msramalho 2022-06-16 19:58:26 +02:00
  • d2e29f85d2 selenium: quit and close msramalho 2022-06-16 18:45:47 +02:00
  • 3efb835222 fix: telethon bad regex for ?single msramalho 2022-06-16 18:06:17 +02:00
  • 3d9a2622c3 Update README.md Miguel Sozinho Ramalho 2022-06-16 16:23:53 +01:00
  • 2650dcc680 Merge pull request #42 from bellingcat/dev Miguel Sozinho Ramalho 2022-06-16 16:20:32 +01:00
  • 4c6f3ea688 Merge pull request #33 from bellingcat/refactor-configs Miguel Sozinho Ramalho 2022-06-16 16:19:28 +01:00
  • b7f1ec5404 Merge pull request #40 from bellingcat/vk-archiver Miguel Sozinho Ramalho 2022-06-16 16:18:48 +01:00
  • 14add43923 fixing auto_auto_archive msramalho 2022-06-16 17:17:25 +02:00
  • cdd66fb7da returning empty string thumbs msramalho 2022-06-16 16:30:08 +02:00
  • afc7e133cf simplifying telethon msramalho 2022-06-16 16:26:30 +02:00
  • 81eb00a767 handle deleted telegram msramalho 2022-06-16 16:19:57 +02:00
  • 81ce27bdb3 fix msramalho 2022-06-16 14:34:33 +02:00
  • ec1993c5dc telethon fix msramalho 2022-06-16 14:33:50 +02:00
  • b37f7adc8f another telethon fix msramalho 2022-06-16 14:29:51 +02:00
  • 277d81d687 telethon minor fix msramalho 2022-06-16 14:16:18 +02:00
  • 2ac08a34f6 ydl timestamp bug fix msramalho 2022-06-16 13:45:02 +02:00
  • c6bcb59005 improvement for albums msramalho 2022-06-15 23:36:10 +02:00
  • 08f48ae351 handling selenium better msramalho 2022-06-15 23:17:32 +02:00
  • 659097c072 better error log msramalho 2022-06-15 22:54:18 +02:00
  • 3b6678818e title for vk photo msramalho 2022-06-15 22:47:55 +02:00
  • ed4b193ae7 walrus msramalho 2022-06-15 22:30:08 +02:00
  • c08b5268f7 using API instead of scraping msramalho 2022-06-15 21:25:15 +02:00
  • 2f02336403 example config msramalho 2022-06-15 17:18:47 +02:00
  • 86e1d3545e fix for missing telethon config msramalho 2022-06-15 17:17:46 +02:00
  • b1f70bb818 minor improvements msramalho 2022-06-15 17:14:08 +02:00
  • 5cc21fa4e0 bug fix msramalho 2022-06-15 17:04:56 +02:00
  • 2dbdf9b8d3 check if exists msramalho 2022-06-15 17:04:50 +02:00
  • 771c5376c4 simplify display msramalho 2022-06-15 16:47:20 +02:00
  • 951b16ba9c improving media page with images and videos msramalho 2022-06-15 16:38:30 +02:00
  • 59afe7fd63 vk-archiver implemented msramalho 2022-06-15 16:38:18 +02:00
  • 3bffee41a0 README updates msramalho 2022-06-14 21:40:04 +02:00
  • 6872d8e103 check if exists to configuration, save_logs to command line msramalho 2022-06-14 21:37:02 +02:00
  • a7a555ea85 refactor configs msramalho 2022-06-14 21:19:45 +02:00
  • dc60bb1558 json -> yaml msramalho 2022-06-14 21:18:18 +02:00
  • 64c083b37b wayback should re-archive even if old version exists msramalho 2022-06-14 20:55:59 +02:00
  • 2be539d39e twitter archiver improvements msramalho 2022-06-14 20:55:43 +02:00
  • bd753b27ed numbers in markdown msramalho 2022-06-14 20:55:30 +02:00
  • 12648bbce9 centralizing slugify url method msramalho 2022-06-14 20:15:14 +02:00
  • 6499161f5c fixing gd bug on twitter images msramalho 2022-06-14 19:55:05 +02:00
  • 22f20ba744 improve debugging msramalho 2022-06-14 19:54:53 +02:00
  • c11a208253 more verbose about mandatory columns msramalho 2022-06-14 19:54:08 +02:00
  • eca10023b0 detecting errors at a higher level to avoid false "in progress" messages msramalho 2022-06-14 19:28:34 +02:00
  • 06e8781f0f clarify it is a filename msramalho 2022-06-14 19:19:20 +02:00
  • d9b8c48af0 missing parameter bug fix msramalho 2022-06-14 19:19:14 +02:00
  • c8a02cb93a new wayback error action msramalho 2022-06-08 18:25:58 +02:00
  • bd5146ac3e bug fixes msramalho 2022-06-08 18:17:25 +02:00
  • 9e871b3bbc telethon config fixes msramalho 2022-06-08 13:46:20 +02:00
  • 562d2f51ad bot token msramalho 2022-06-08 13:39:57 +02:00
  • 067e6d8954 retry mechanism msramalho 2022-06-08 13:39:52 +02:00
  • 6dcb59fea6 removing unnecessary method msramalho 2022-06-08 11:46:00 +02:00
  • f0a276e3a5 bug fix msramalho 2022-06-08 11:45:38 +02:00
  • 1df68c3652 config bug fix msramalho 2022-06-08 11:45:04 +02:00
  • a0be3c8a22 todo msramalho 2022-06-08 11:44:57 +02:00
  • c622f941d7 tiktok bug fix msramalho 2022-06-08 11:44:49 +02:00
  • 90a6083bc1 logs to config msramalho 2022-06-08 11:13:12 +02:00
  • 13e7d0bf1b improving path operations msramalho 2022-06-08 11:11:09 +02:00
  • 3019778b8f readme updates msramalho 2022-06-07 18:52:19 +02:00
  • 29a9a55f87 config refactor msramalho 2022-06-07 18:44:52 +02:00
  • 3791afc94c readme updates msramalho 2022-06-07 18:43:04 +02:00
  • f87acb6d1d refactor msramalho 2022-06-07 18:41:58 +02:00
  • d46b8e1157 README updates msramalho 2022-06-07 18:41:43 +02:00
  • 6f08cef459 example config msramalho 2022-06-07 18:41:38 +02:00