This website requires JavaScript.
Explore
Help
Register
Sign In
bellingcat
/
cisticola
Watch
1
Star
0
Fork
0
You've already forked cisticola
mirror of
https://github.com/bellingcat/cisticola.git
synced
2026-06-11 12:58:33 +03:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
198
Commits
14
Branches
4
Tags
294f6a5172e2acf02f5081ee50cb6f23e5a02d59
Go to file
Code
Clone
HTTPS
Tea CLI
Open with VS Code
Open with VSCodium
Open with Intellij IDEA
Download ZIP
Download TAR.GZ
Download BUNDLE
Tristan Lee
294f6a5172
possible performance improvement
2022-12-25 15:19:05 -08:00
cisticola
possible performance improvement
2022-12-25 15:19:05 -08:00
docs
refactored Gab scraper to use gabber instead of garc
2022-03-30 08:05:10 -05:00
tests
tested telegram transformers and implemented vk transformers
2022-06-23 15:06:10 -05:00
.gitignore
Limit max # of archived files per session
2022-04-12 12:57:04 +00:00
app.py
specified columns to update, skipped channel lookups to increase speed
2022-12-25 14:59:11 -08:00
Pipfile
Add an option to scape posts older than the database record as well as newer (Telegram only)
2022-09-05 13:48:01 +00:00
Pipfile.lock
Add an option to scape posts older than the database record as well as newer (Telegram only)
2022-09-05 13:48:01 +00:00
pytest.ini
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
README.md
Add documentation generation with Sphinx
2022-02-21 17:52:38 +01:00
retransform.py
added capability to retransform/update posts in database
2022-10-26 07:20:19 -05:00
spacy_setup.sh
Add some more fields to media DB, fix bugs in testing
2022-07-05 11:11:43 +02:00
sync_with_gsheet.py
removed special case
2022-10-26 08:22:13 -05:00
telethon_session_init.py
Minor bug fixes; helper tool for Telethon sessions
2022-07-28 08:42:59 +00:00
README.md
Cisticola
Description
Coordinates scrapers and interfaces with database
open-source-research
python
scraper
service
Readme
1
MiB
Languages
Python
99.8%
Shell
0.2%
