bellingcat/cisticola
1
0
Fork 0
mirror of https://github.com/bellingcat/cisticola.git synced 2026-06-14 22:38:31 +03:00
Code Issues Packages Projects Releases Wiki Activity
89 Commits 14 Branches 4 Tags
c7253148d1cf15c8b153ec76611b9b277a84c5d9
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Tristan Lee c7253148d1 added 'retries' argument to youtube-dl options, and made options consistent across youtube-dl instances.
2022-04-03 19:31:32 -05:00
cisticola
added 'retries' argument to youtube-dl options, and made options consistent across youtube-dl instances.
2022-04-03 19:31:32 -05:00
docs
refactored Gab scraper to use gabber instead of garc
2022-03-30 08:05:10 -05:00
tests
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
.gitignore
Add option to clear registered scrapers, necessary for tests
2022-03-31 16:17:35 +02:00
app.py
Catch exceptions in get_posts so that archiving continues despites errors
2022-03-31 20:27:18 +02:00
Pipfile
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
Pipfile.lock
merged main
2022-04-01 02:05:25 -05:00
pytest.ini
implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method
2022-04-01 01:30:49 -05:00
README.md
Add documentation generation with Sphinx
2022-02-21 17:52:38 +01:00
russian_telegram_ingest.py
renamed 'archive_media' and 'media' to avoid name collision, changed scope of test fixture controller to 'function' so that db is fresh for each executed test
2022-03-09 13:19:35 -06:00

README.md

Cisticola

Cisticola, the bird

Description
Coordinates scrapers and interfaces with database
open-source-researchpythonscraperservice
Readme 1 MiB
Languages
Python 99.8%
Shell 0.2%