bellingcat/cisticola
1
0
Fork 0
mirror of https://github.com/bellingcat/cisticola.git synced 2026-06-08 03:18:34 +03:00
Code Issues Packages Projects Releases Wiki Activity
42 Commits 14 Branches 4 Tags
db03cbf1417e57b0d4a03ab5ea3e0a2acc8106d5
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Tristan Lee db03cbf141 Merge pull request #13 from bellingcat/transformer 
Merged Transformer branch into main, including example of Transformer instance for Twitter and associated test
2022-03-14 11:13:57 -05:00
cisticola
Add Transformer and ETLController docstrings
2022-03-14 14:02:57 +01:00
docs
fixed warnings from sphinx-build, made build path consistent with gitignore (removed sphinx build directory from version control)
2022-02-21 16:13:16 -06:00
tests
Add TwitterTransformer test
2022-03-14 13:39:10 +01:00
.gitignore
added capability of running scraper without archiving media, and implemented prototype Telethon scraper for Telegram
2022-03-09 12:12:01 -06:00
Pipfile
Implement transformer for TwitterScraper that handles media; implement image OCR and EXIF extraction
2022-03-10 15:34:24 +01:00
Pipfile.lock
implemented method to reset database, to enable the 'contoller' fixture scope to be shared across the whole package, which will enable the transformer tests to be run without re-running the scrapers
2022-03-10 10:20:49 -06:00
pytest.ini
added capability of running scraper without archiving media, and implemented prototype Telethon scraper for Telegram
2022-03-09 12:12:01 -06:00
README.md
Add documentation generation with Sphinx
2022-02-21 17:52:38 +01:00
russian_telegram_ingest.py
renamed 'archive_media' and 'media' to avoid name collision, changed scope of test fixture controller to 'function' so that db is fresh for each executed test
2022-03-09 13:19:35 -06:00
test.py
Add TwitterTransformer test
2022-03-14 13:39:10 +01:00

README.md

Cisticola

Cisticola, the bird

Description
Coordinates scrapers and interfaces with database
open-source-researchpythonscraperservice
Readme 1 MiB
Languages
Python 99.8%
Shell 0.2%