bellingcat/cisticola
1
0
Fork 0
mirror of https://github.com/bellingcat/cisticola.git synced 2026-06-08 03:18:34 +03:00
Code Issues Packages Projects Releases Wiki Activity
191 Commits 14 Branches 4 Tags
10b33b3dbb18a32fb675636f97f631c127877f06
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Tristan Lee 10b33b3dbb Merge pull request #66 from bellingcat/country-language-searching 
Updated ORM and sync to improve filtering by language and country
2022-10-26 12:25:59 -05:00
cisticola
Merge pull request #66 from bellingcat/country-language-searching
2022-10-26 12:25:59 -05:00
docs
refactored Gab scraper to use gabber instead of garc
2022-03-30 08:05:10 -05:00
tests
tested telegram transformers and implemented vk transformers
2022-06-23 15:06:10 -05:00
.gitignore
Limit max # of archived files per session
2022-04-12 12:57:04 +00:00
app.py
Add an option to scape posts older than the database record as well as newer (Telegram only)
2022-09-05 13:48:01 +00:00
Pipfile
Add an option to scape posts older than the database record as well as newer (Telegram only)
2022-09-05 13:48:01 +00:00
Pipfile.lock
Add an option to scape posts older than the database record as well as newer (Telegram only)
2022-09-05 13:48:01 +00:00
pytest.ini
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
README.md
Add documentation generation with Sphinx
2022-02-21 17:52:38 +01:00
spacy_setup.sh
Add some more fields to media DB, fix bugs in testing
2022-07-05 11:11:43 +02:00
sync_with_gsheet.py
removed special case
2022-10-26 08:22:13 -05:00
telethon_session_init.py
Minor bug fixes; helper tool for Telethon sessions
2022-07-28 08:42:59 +00:00

README.md

Cisticola

Cisticola, the bird

Description
Coordinates scrapers and interfaces with database
open-source-researchpythonscraperservice
Readme 1 MiB
Languages
Python 99.8%
Shell 0.2%