bellingcat/cisticola
1
0
Fork 0
mirror of https://github.com/bellingcat/cisticola.git synced 2026-06-11 04:48:33 +03:00
Code Issues Packages Projects Releases Wiki Activity
197 Commits 14 Branches 4 Tags
d80ad442da19d0ba68775912844cfb4bc6ac10b6
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Tristan Lee d80ad442da specified columns to update, skipped channel lookups to increase speed
2022-12-25 14:59:11 -08:00
cisticola
specified columns to update, skipped channel lookups to increase speed
2022-12-25 14:59:11 -08:00
docs
refactored Gab scraper to use gabber instead of garc
2022-03-30 08:05:10 -05:00
tests
tested telegram transformers and implemented vk transformers
2022-06-23 15:06:10 -05:00
.gitignore
Limit max # of archived files per session
2022-04-12 12:57:04 +00:00
app.py
specified columns to update, skipped channel lookups to increase speed
2022-12-25 14:59:11 -08:00
Pipfile
Add an option to scape posts older than the database record as well as newer (Telegram only)
2022-09-05 13:48:01 +00:00
Pipfile.lock
Add an option to scape posts older than the database record as well as newer (Telegram only)
2022-09-05 13:48:01 +00:00
pytest.ini
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
README.md
Add documentation generation with Sphinx
2022-02-21 17:52:38 +01:00
retransform.py
added capability to retransform/update posts in database
2022-10-26 07:20:19 -05:00
spacy_setup.sh
Add some more fields to media DB, fix bugs in testing
2022-07-05 11:11:43 +02:00
sync_with_gsheet.py
removed special case
2022-10-26 08:22:13 -05:00
telethon_session_init.py
Minor bug fixes; helper tool for Telethon sessions
2022-07-28 08:42:59 +00:00

README.md

Cisticola

Cisticola, the bird

Description
Coordinates scrapers and interfaces with database
open-source-researchpythonscraperservice
Readme 1 MiB
Languages
Python 99.8%
Shell 0.2%