bellingcat/cisticola
1
0
Fork 0
mirror of https://github.com/bellingcat/cisticola.git synced 2026-06-08 03:18:34 +03:00
Code Issues Packages Projects Releases Wiki Activity
185 Commits 14 Branches 4 Tags
3bb5af11e6e5c8e59412f74f0ffad30415b630e3
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Tristan Lee 3bb5af11e6 changed ORM and Google Sheet sync to reflect converting channels.country to JSONB array, added index for detected_language
2022-10-26 08:16:49 -05:00
cisticola
changed ORM and Google Sheet sync to reflect converting channels.country to JSONB array, added index for detected_language
2022-10-26 08:16:49 -05:00
docs
refactored Gab scraper to use gabber instead of garc
2022-03-30 08:05:10 -05:00
tests
tested telegram transformers and implemented vk transformers
2022-06-23 15:06:10 -05:00
.gitignore
Limit max # of archived files per session
2022-04-12 12:57:04 +00:00
app.py
Add features for running archive-media simultaneously
2022-07-20 09:26:47 +00:00
Pipfile
Add some more fields to media DB, fix bugs in testing
2022-07-05 11:11:43 +02:00
Pipfile.lock
Add some more fields to media DB, fix bugs in testing
2022-07-05 11:11:43 +02:00
pytest.ini
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
README.md
Add documentation generation with Sphinx
2022-02-21 17:52:38 +01:00
spacy_setup.sh
Add some more fields to media DB, fix bugs in testing
2022-07-05 11:11:43 +02:00
sync_with_gsheet.py
changed ORM and Google Sheet sync to reflect converting channels.country to JSONB array, added index for detected_language
2022-10-26 08:16:49 -05:00
telethon_session_init.py
Minor bug fixes; helper tool for Telethon sessions
2022-07-28 08:42:59 +00:00

README.md

Cisticola

Cisticola, the bird

Description
Coordinates scrapers and interfaces with database
open-source-researchpythonscraperservice
Readme 1 MiB
Languages
Python 99.8%
Shell 0.2%