This website requires JavaScript.
Explore
Help
Register
Sign In
bellingcat
/
cisticola
Watch
1
Star
0
Fork
0
You've already forked cisticola
mirror of
https://github.com/bellingcat/cisticola.git
synced
2026-06-12 21:38:33 +03:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
101
Commits
14
Branches
4
Tags
v2022-04-04
Go to file
Code
Clone
HTTPS
Tea CLI
Open with VS Code
Open with VSCodium
Open with Intellij IDEA
Download ZIP
Download TAR.GZ
Download BUNDLE
Logan Williams
36c81c8e17
Merge pull request
#40
from bellingcat/next-release
...
Add indices on appropriate columns; limit # of posts to archive
2022-04-04 13:03:16 +02:00
cisticola
Add indices on appropriate columns; limit # of posts to archive
2022-04-04 10:54:27 +00:00
docs
refactored Gab scraper to use gabber instead of garc
2022-03-30 08:05:10 -05:00
tests
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
.gitignore
Add option to clear registered scrapers, necessary for tests
2022-03-31 16:17:35 +02:00
app.py
Remove 200 post limit; add log rotation
2022-04-03 16:32:00 +00:00
Pipfile
Remove 200 post limit; add log rotation
2022-04-03 16:32:00 +00:00
Pipfile.lock
Remove 200 post limit; add log rotation
2022-04-03 16:32:00 +00:00
pytest.ini
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
README.md
Add documentation generation with Sphinx
2022-02-21 17:52:38 +01:00
russian_telegram_ingest.py
renamed 'archive_media' and 'media' to avoid name collision, changed scope of test fixture controller to 'function' so that db is fresh for each executed test
2022-03-09 13:19:35 -06:00
README.md
Cisticola
Description
Coordinates scrapers and interfaces with database
open-source-research
python
scraper
service
Readme
1
MiB
Languages
Python
99.8%
Shell
0.2%
