This website requires JavaScript.
Explore
Help
Register
Sign In
bellingcat
/
cisticola
Watch
1
Star
0
Fork
0
You've already forked cisticola
mirror of
https://github.com/bellingcat/cisticola.git
synced
2026-06-11 21:08:34 +03:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
100
Commits
14
Branches
4
Tags
b6386747d478ab82948c33f614be67e543252775
Go to file
Code
Clone
HTTPS
Tea CLI
Open with VS Code
Open with VSCodium
Open with Intellij IDEA
Download ZIP
Download TAR.GZ
Download BUNDLE
Logan Williams
b6386747d4
Add indices on appropriate columns; limit # of posts to archive
2022-04-04 10:54:27 +00:00
cisticola
Add indices on appropriate columns; limit # of posts to archive
2022-04-04 10:54:27 +00:00
docs
refactored Gab scraper to use gabber instead of garc
2022-03-30 08:05:10 -05:00
tests
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
.gitignore
Add option to clear registered scrapers, necessary for tests
2022-03-31 16:17:35 +02:00
app.py
Remove 200 post limit; add log rotation
2022-04-03 16:32:00 +00:00
Pipfile
Remove 200 post limit; add log rotation
2022-04-03 16:32:00 +00:00
Pipfile.lock
Remove 200 post limit; add log rotation
2022-04-03 16:32:00 +00:00
pytest.ini
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
README.md
Add documentation generation with Sphinx
2022-02-21 17:52:38 +01:00
russian_telegram_ingest.py
renamed 'archive_media' and 'media' to avoid name collision, changed scope of test fixture controller to 'function' so that db is fresh for each executed test
2022-03-09 13:19:35 -06:00
README.md
Cisticola
Description
Coordinates scrapers and interfaces with database
open-source-research
python
scraper
service
Readme
1
MiB
Languages
Python
99.8%
Shell
0.2%
