Commit Graph

10 Commits

Author SHA1 Message Date
Tristan Lee
1eb82c5f3e sorted imports using isort and tried to add pre-commit hook for isort 2023-08-07 20:04:16 -05:00
Tristan Lee
fab65a5d67 formatted with black, added pre-commit hook, pegged typing_extensions package version to fix spaCy issue 2023-08-04 14:51:00 -05:00
Tristan Lee
c21e43ddfa refactored import structure 2022-03-04 10:55:54 -06:00
Logan Williams
8ab56ff5ba Remove MAX_POSTS, auto detect MIME type
Co-authored-by: Tristan Lee <tristan@bellingcat.com>
2022-02-25 08:52:42 +01:00
Logan Williams
1ad7c8bc11 Search for since per-channel 2022-02-24 20:26:10 +01:00
Logan Williams
d159c09aa4 yield data rather than returning a list 2022-02-24 18:58:08 +01:00
Logan Williams
d163e6b3d9 Fix logging logic in scraper controller 2022-02-24 18:49:06 +01:00
Logan Williams
6092e4caa5 Add method for archiving media, reoranize scraper base classes 2022-02-24 16:36:55 +01:00
Logan Williams
c5d49ef521 Reorganize class definitions slightly 2022-02-18 14:14:25 +01:00
Logan Williams
82ad210b8e Initial commit 2022-02-18 14:01:49 +01:00