Commit Graph

19 Commits

Author SHA1 Message Date
Logan Williams
3480452fac Fix type hints 2022-02-24 20:36:23 +01:00
Logan Williams
1ad7c8bc11 Search for since per-channel 2022-02-24 20:26:10 +01:00
Logan Williams
0b1c175dd9 Modify GettrScraper to yield results, archive media (videos incomplete) 2022-02-24 20:25:14 +01:00
Logan Williams
456d592792 Use user id for TwitterScraper 2022-02-24 20:24:03 +01:00
Logan Williams
d159c09aa4 yield data rather than returning a list 2022-02-24 18:58:08 +01:00
Logan Williams
d163e6b3d9 Fix logging logic in scraper controller 2022-02-24 18:49:06 +01:00
Logan Williams
e64d845002 Archive media in Twitter scraper 2022-02-24 18:48:48 +01:00
Logan Williams
214287b7a8 Archive media in dictionary 2022-02-24 17:35:24 +01:00
Logan Williams
a87cfd570a Add Telegram channel scraper 2022-02-24 16:37:13 +01:00
Logan Williams
6092e4caa5 Add method for archiving media, reoranize scraper base classes 2022-02-24 16:36:55 +01:00
Logan Williams
e09e0f5202 Merge pull request #1 from bellingcat/add-docs
Add documentation generation with Sphinx
2022-02-22 15:19:54 +01:00
Tristan Lee
9fe3d90b0b fixed warnings from sphinx-build, made build path consistent with gitignore (removed sphinx build directory from version control) 2022-02-21 16:13:16 -06:00
Logan Williams
e3d29bf811 Add documentation generation with Sphinx 2022-02-21 17:52:38 +01:00
Tristan Lee
139459e3b2 implemented Bitchute scraper 2022-02-18 12:45:10 -06:00
Tristan Lee
4668d4df11 implemented Gettr scraper 2022-02-18 10:13:37 -06:00
Logan Williams
0e5f9f77f3 Configure pipenv 2022-02-18 15:05:02 +01:00
Logan Williams
b824b98a95 Reorganize transformer defition location 2022-02-18 14:57:10 +01:00
Logan Williams
c5d49ef521 Reorganize class definitions slightly 2022-02-18 14:14:25 +01:00
Logan Williams
82ad210b8e Initial commit 2022-02-18 14:01:49 +01:00