bellingcat/cisticola
1
0
Fork 0
mirror of https://github.com/bellingcat/cisticola.git synced 2026-06-07 19:08:35 +03:00
Code Issues Packages Projects Releases Wiki Activity
208 Commits 14 Branches 4 Tags
ebbc6b69ddb50d86c42e9f366d54bd6264e59b7e
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Logan Williams ebbc6b69dd Add new function for insert post (faster/bulk)
2023-05-04 14:04:55 +02:00
cisticola
Add new function for insert post (faster/bulk)
2023-05-04 14:04:55 +02:00
docs
refactored Gab scraper to use gabber instead of garc
2022-03-30 08:05:10 -05:00
tests
tested telegram transformers and implemented vk transformers
2022-06-23 15:06:10 -05:00
.gitignore
Add new function for insert post (faster/bulk)
2023-05-04 14:04:55 +02:00
app.py
Use telethon session CLI argument always; improvements to Telegram transformer (author id/username for chats, min_id via CLI argument, use the same session)
2023-03-04 09:51:15 +01:00
crontab
Add new function for insert post (faster/bulk)
2023-05-04 14:04:55 +02:00
Dockerfile
Add new function for insert post (faster/bulk)
2023-05-04 14:04:55 +02:00
Pipfile
Add new function for insert post (faster/bulk)
2023-05-04 14:04:55 +02:00
Pipfile.lock
Add new function for insert post (faster/bulk)
2023-05-04 14:04:55 +02:00
pytest.ini
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
README.md
Add documentation generation with Sphinx
2022-02-21 17:52:38 +01:00
spacy_setup.sh
Support related Telegram chats (associated discussion groups)
2023-03-02 16:21:43 +01:00
sync_with_gsheet.py
Support related Telegram chats (associated discussion groups)
2023-03-02 16:21:43 +01:00
telethon_session_init.py
Minor bug fixes; helper tool for Telethon sessions
2022-07-28 08:42:59 +00:00

README.md

Cisticola

Cisticola, the bird

Description
Coordinates scrapers and interfaces with database
open-source-researchpythonscraperservice
Readme 1 MiB
Languages
Python 99.8%
Shell 0.2%