bellingcat/cisticola
1
0
Fork 0
mirror of https://github.com/bellingcat/cisticola.git synced 2026-06-14 22:38:31 +03:00
Code Issues Packages Projects Releases Wiki Activity
183 Commits 14 Branches 4 Tags
c15022402d99eab52ff2bb7420a07a41e1efcf41
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Logan Williams c15022402d Add an option to scape posts older than the database record as well as newer (Telegram only)
2022-09-05 13:48:01 +00:00
cisticola
Add an option to scape posts older than the database record as well as newer (Telegram only)
2022-09-05 13:48:01 +00:00
docs
refactored Gab scraper to use gabber instead of garc
2022-03-30 08:05:10 -05:00
tests
tested telegram transformers and implemented vk transformers
2022-06-23 15:06:10 -05:00
.gitignore
Limit max # of archived files per session
2022-04-12 12:57:04 +00:00
app.py
Add an option to scape posts older than the database record as well as newer (Telegram only)
2022-09-05 13:48:01 +00:00
Pipfile
Add an option to scape posts older than the database record as well as newer (Telegram only)
2022-09-05 13:48:01 +00:00
Pipfile.lock
Add an option to scape posts older than the database record as well as newer (Telegram only)
2022-09-05 13:48:01 +00:00
pytest.ini
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
README.md
Add documentation generation with Sphinx
2022-02-21 17:52:38 +01:00
spacy_setup.sh
Add some more fields to media DB, fix bugs in testing
2022-07-05 11:11:43 +02:00
sync_with_gsheet.py
Remove normalized_url column from channel creation
2022-08-24 15:35:08 +02:00
telethon_session_init.py
Minor bug fixes; helper tool for Telethon sessions
2022-07-28 08:42:59 +00:00

README.md

Cisticola

Cisticola, the bird

Description
Coordinates scrapers and interfaces with database
open-source-researchpythonscraperservice
Readme 1 MiB
Languages
Python 99.8%
Shell 0.2%