bellingcat/auto-archiver
1
0
Fork 0
mirror of https://github.com/bellingcat/auto-archiver.git synced 2026-06-07 19:08:30 +03:00
Code Issues Packages Projects Releases Wiki Activity
1,034 Commits 19 Branches 124 Tags
ce46a8a7ac42f4da97d0d56f365c3ea1341d2e9e
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Erin Clark ce46a8a7ac Merge pull request #240 from bellingcat/update_release 
Update project version to: 0.13.5.

Update the release process docs and the latest version in pyproject.toml
2025-03-07 18:21:17 +00:00
.github/workflows
Add poetry.lock and pyproject.toml paths to trigger tests.
2025-03-07 18:01:08 +00:00
docs
Update the release description to tag on release
2025-03-07 18:04:51 +00:00
scripts
Don't force enable a module under all types - allows modules to be set as only feeder/only extractor etc.
2025-03-07 14:59:11 +00:00
src/auto_archiver
Add 'reject all' cookie button
2025-03-07 16:40:34 +00:00
tests
Merge branch 'main' into merge_modules
2025-03-07 16:19:51 +00:00
.dockerignore
docker initial files
2022-10-31 17:10:55 +00:00
.gitignore
Fix sorting of steps in the outputted file
2025-03-04 11:51:26 +00:00
.pylintrc
Ignore pylint statements for manifest files
2025-01-21 17:59:52 +01:00
.readthedocs.yaml
Overwrite settings_base file
2025-02-27 22:02:44 +00:00
CONTRIBUTING.md
Fix links to docs
2025-02-12 11:41:54 +00:00
docker-compose.yaml
Add docker-compose for easy building and running of docker image in dev
2025-01-15 14:36:02 +01:00
Dockerfile
Remove geckodriver .tar file
2025-03-07 11:52:14 +00:00
LICENSE
Add LICENSE
2021-06-24 16:14:32 +02:00
poetry.lock
Update the release process docs and the latest version in pyproject.toml
2025-03-07 17:33:32 +00:00
pyproject.toml
Update the release process docs and the latest version in pyproject.toml
2025-03-07 17:33:32 +00:00
README.md
Better documentation based on the discord feedbackgst
2025-02-24 22:42:57 +00:00

README.md

Auto Archiver

PyPI version Docker Image Version (latest by date) Core Test Status Download Test Status

Auto Archiver is a Python tool to automatically archive content on the web in a secure and verifiable way. It takes URLs from different sources (e.g. a CSV file, Google Sheets, command line etc.) and archives the content of each one. It can archive social media posts, videos, images and webpages. Content can enriched, then saved either locally or remotely (S3 bucket, Google Drive). The status of the archiving process can be appended to a CSV report, or if using Google Sheets – back to the original sheet.

Read the article about Auto Archiver on bellingcat.com.

Installation

View the Installation Guide for full instructions

Advanced:

To get started quickly using Docker:

docker pull bellingcat/auto-archiver && docker run --rm -v secrets:/app/secrets bellingcat/auto-archiver --config secrets/orchestration.yaml

Or pip:

pip install auto-archiver && auto-archiver --help

Contributing

We welcome contributions to the Auto Archiver project! See the Contributing Guide for how to get involved!

Description
Automatically archive links to videos, images, and social media content from Google Sheets (and more).
archivedockeropen-source-researchpythonscrapingserviceweb-archiving
Readme MIT 16 MiB
Languages
Python 92.9%
TypeScript 3.6%
HTML 2.1%
Shell 0.8%
Dockerfile 0.3%
Other 0.3%