bellingcat/cisticola
1
0
Fork 0
mirror of https://github.com/bellingcat/cisticola.git synced 2026-06-07 19:08:35 +03:00
Code Issues Packages Projects Releases Wiki Activity
193 Commits 14 Branches 4 Tags
3ec6f50213ec86f09afa45d5310f517a68870c98
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Logan Williams 3ec6f50213 Merge pull request #67 from bellingcat/sync-bug-fixes 
fixed channel sync bugs
2022-10-27 09:27:02 +02:00
cisticola
Merge pull request #66 from bellingcat/country-language-searching
2022-10-26 12:25:59 -05:00
docs
refactored Gab scraper to use gabber instead of garc
2022-03-30 08:05:10 -05:00
tests
tested telegram transformers and implemented vk transformers
2022-06-23 15:06:10 -05:00
.gitignore
Limit max # of archived files per session
2022-04-12 12:57:04 +00:00
app.py
Add an option to scape posts older than the database record as well as newer (Telegram only)
2022-09-05 13:48:01 +00:00
Pipfile
Add an option to scape posts older than the database record as well as newer (Telegram only)
2022-09-05 13:48:01 +00:00
Pipfile.lock
Add an option to scape posts older than the database record as well as newer (Telegram only)
2022-09-05 13:48:01 +00:00
pytest.ini
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
README.md
Add documentation generation with Sphinx
2022-02-21 17:52:38 +01:00
spacy_setup.sh
Add some more fields to media DB, fix bugs in testing
2022-07-05 11:11:43 +02:00
sync_with_gsheet.py
fixed problem from gspread update where empty columns raised error, fixed problem where sync tried to process empty channel
2022-10-26 14:47:59 -05:00
telethon_session_init.py
Minor bug fixes; helper tool for Telethon sessions
2022-07-28 08:42:59 +00:00

README.md

Cisticola

Cisticola, the bird

Description
Coordinates scrapers and interfaces with database
open-source-researchpythonscraperservice
Readme 1 MiB
Languages
Python 99.8%
Shell 0.2%