Commit Graph

288 Commits

Author SHA1 Message Date
msramalho
f6bc45361a ignore custom configs 2022-05-10 20:48:40 +02:00
msramalho
94b37b02ba telethon refactor for failures 2022-05-10 20:23:44 +02:00
msramalho
39f27ec1bc reenable telethon 2022-05-10 20:23:13 +02:00
msramalho
b459f36dda C 2022-05-09 18:23:01 +02:00
msramalho
e0276dfab1 additional cleanup 2022-05-09 18:19:38 +02:00
msramalho
6bd6f88b46 refactor 2022-05-09 17:45:54 +02:00
Miguel Sozinho Ramalho
bba510b8c2 Merge pull request #30 from djhmateer/logging 2022-05-09 15:59:49 +01:00
Miguel Sozinho Ramalho
6e8eccefd8 self-documenting info message 2022-05-09 15:59:35 +01:00
Miguel Sozinho Ramalho
05a3adfc36 Merge pull request #31 from djhmateer/firefox 2022-05-09 15:59:02 +01:00
Miguel Sozinho Ramalho
3a3d3c6690 Merge pull request #29 from djhmateer/fb-cookie 2022-05-09 15:53:07 +01:00
Miguel Sozinho Ramalho
3c0811a80d Merge pull request #28 from djhmateer/yt-sub 2022-05-09 15:52:10 +01:00
Miguel Sozinho Ramalho
16f4093fbf Merge pull request #27 from djhmateer/bar 2022-05-09 13:56:10 +01:00
msramalho
0d65798308 wip: configurations and logic 2022-05-09 14:54:48 +02:00
Dave Mateer
bb599f702d Reload firefox driver on every spreadsheet row 2022-05-09 12:16:18 +01:00
Dave Mateer
f52d8cdef8 add back in d_dotenv() 2022-05-09 12:02:43 +01:00
Dave Mateer
e3c0ae1d45 dotenv 2022-05-09 11:57:54 +01:00
Dave Mateer
e18a9779db added log diretory and file creation 2022-05-09 11:55:10 +01:00
Dave Mateer
07b82f0e82 update .example.env 2022-05-09 11:46:19 +01:00
Dave Mateer
51f635ce50 get env variable FACEBOOK_COOKIE patch through from auto_archive 2022-05-09 11:44:25 +01:00
Dave Mateer
7ae6e0c6f8 fb cooke in ytd 2022-05-09 11:38:08 +01:00
Dave Mateer
bd235347ac Added catch in youtubedl_archiver for twitter.com to see if a linked video is in there eg vk.com 2022-05-09 11:23:42 +01:00
Dave Mateer
cb18289e4f Get Twitter original size image quality 2022-05-09 10:55:38 +01:00
msramalho
f592c7fcfe refactor to use config.py 2022-05-03 20:34:04 +02:00
msramalho
f00e31c23d introduce config.py 2022-05-03 20:33:54 +02:00
msramalho
ac9ed1a0d7 extract wayback config 2022-05-03 20:33:38 +02:00
msramalho
a7948ac768 extract telegram config 2022-05-03 20:33:19 +02:00
msramalho
03a6611c86 adds local storage 2022-05-03 20:33:02 +02:00
msramalho
24340190af s3 storage config refactor 2022-05-03 20:32:53 +02:00
msramalho
b680700b22 ignoring config file 2022-05-03 20:32:23 +02:00
Miguel Sozinho Ramalho
8f62e8b7c6 Update README.md 2022-05-03 14:45:18 +01:00
Miguel Sozinho Ramalho
77700060a4 Merge pull request #25 from djhmateer/foo 2022-05-03 14:37:31 +01:00
Dave Mateer
fec380e93d Fixed wwww (4 w's) to www in youtubedl 2022-04-27 10:18:10 +01:00
Logan Williams
1b020b5856 Merge pull request #21 from bellingcat/resolve-telethon-issues
Resolve telethon issues
2022-04-26 10:13:14 +02:00
msramalho
8358ab0bfc assert post is not None 2022-03-30 11:12:06 +02:00
msramalho
3bdeec1d2f fix deprecation warning for selenium 2022-03-30 11:05:31 +02:00
msramalho
e5168fa07c removing TODO 2022-03-30 10:55:57 +02:00
msramalho
576f1a8f68 fix the UTF-8 issue for cyrilic 2022-03-30 10:55:33 +02:00
Logan Williams
398f296789 Fix Selenium driver issues with telegram links 2022-03-18 11:10:27 +01:00
Logan Williams
538bb05395 Merge branch 'main' of github.com:bellingcat/auto-archiver into main 2022-03-18 09:53:29 +01:00
Logan Williams
050b04e31d Add flag for storage privacy 2022-03-18 09:53:21 +01:00
Logan Williams
d611aa1e14 Some videos don't render a duration for some reason 2022-03-18 09:44:17 +01:00
Logan Williams
0fe455558a Merge pull request #20 from bellingcat/telegram-through-api
archiver for telegram API
2022-03-18 09:38:44 +01:00
msramalho
450065b6fb removes print 2022-03-16 19:56:18 +01:00
msramalho
516db483d6 telethon archiver working for 0,1,1+ media objects 2022-03-16 19:51:02 +01:00
msramalho
c2ae382a4e isloates html page generation logic so it can be reused 2022-03-16 19:50:44 +01:00
msramalho
30787506a1 additional logging 2022-03-16 19:50:29 +01:00
msramalho
0035603bfb telethon-poc 2022-03-15 18:45:53 +01:00
msramalho
3b9b42b854 minor code cleanup 2022-03-15 11:32:39 +01:00
Logan Williams
0304860bce Don't check status for empty URL rows 2022-03-14 11:10:51 +01:00
Logan Williams
aaca6efac1 Merge pull request #19 from bellingcat/screenshots
Merge feature branch
2022-03-14 09:51:57 +01:00