12 Commits

Author SHA1 Message Date
Logan Williams
ebbc6b69dd Add new function for insert post (faster/bulk) 2023-05-04 14:04:55 +02:00
Logan Williams
6226a9a76e Ignore lobs 2023-03-02 15:26:38 +00:00
Logan Williams
d1f9dd0e01 Limit max # of archived files per session 2022-04-12 12:57:04 +00:00
Logan Williams
7f87b03de5 Add option to clear registered scrapers, necessary for tests 2022-03-31 16:17:35 +02:00
Logan Williams
1c1ff7fb6f Fix bug with Telethon scraper and certain media; add media_archived flag to TwitterScraper 2022-03-31 08:15:09 +02:00
Logan Williams
c0a094eefa Load channels from google sheet in test.py 2022-03-22 11:37:47 +01:00
Tristan Lee
739e1d8484 added capability of running scraper without archiving media, and implemented prototype Telethon scraper for Telegram 2022-03-09 12:12:01 -06:00
Tristan Lee
cd5f68e9e5 added basic unit tests 2022-03-04 12:36:09 -06:00
Logan Williams
e6085689b5 On second thought, don't share secrets 2022-02-24 20:47:46 +01:00
Tristan Lee
9fe3d90b0b fixed warnings from sphinx-build, made build path consistent with gitignore (removed sphinx build directory from version control) 2022-02-21 16:13:16 -06:00
Logan Williams
e3d29bf811 Add documentation generation with Sphinx 2022-02-21 17:52:38 +01:00
Logan Williams
82ad210b8e Initial commit 2022-02-18 14:01:49 +01:00