This website requires JavaScript.
Explore
Help
Register
Sign In
bellingcat
/
cisticola
Watch
1
Star
0
Fork
0
You've already forked cisticola
mirror of
https://github.com/bellingcat/cisticola.git
synced
2026-06-07 19:08:35 +03:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
101
Commits
14
Branches
4
Tags
36c81c8e175d5050f96808e0680dc3f8bfdba977
Go to file
Code
Clone
HTTPS
Tea CLI
Open with VS Code
Open with VSCodium
Open with Intellij IDEA
Download ZIP
Download TAR.GZ
Download BUNDLE
Logan Williams
36c81c8e17
Merge pull request
#40
from bellingcat/next-release
...
Add indices on appropriate columns; limit # of posts to archive
2022-04-04 13:03:16 +02:00
cisticola
Add indices on appropriate columns; limit # of posts to archive
2022-04-04 10:54:27 +00:00
docs
refactored Gab scraper to use gabber instead of garc
2022-03-30 08:05:10 -05:00
tests
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
.gitignore
Add option to clear registered scrapers, necessary for tests
2022-03-31 16:17:35 +02:00
app.py
Remove 200 post limit; add log rotation
2022-04-03 16:32:00 +00:00
Pipfile
Remove 200 post limit; add log rotation
2022-04-03 16:32:00 +00:00
Pipfile.lock
Remove 200 post limit; add log rotation
2022-04-03 16:32:00 +00:00
pytest.ini
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
README.md
Add documentation generation with Sphinx
2022-02-21 17:52:38 +01:00
russian_telegram_ingest.py
renamed 'archive_media' and 'media' to avoid name collision, changed scope of test fixture controller to 'function' so that db is fresh for each executed test
2022-03-09 13:19:35 -06:00
README.md
Cisticola
Description
Coordinates scrapers and interfaces with database
open-source-research
python
scraper
service
Readme
1
MiB
Languages
Python
99.8%
Shell
0.2%
