bellingcat/auto-archiver
1
0
Fork 0
mirror of https://github.com/bellingcat/auto-archiver.git synced 2026-06-07 19:08:30 +03:00
Code Issues Packages Projects Releases Wiki Activity
1,546 Commits 19 Branches 124 Tags
main
Commit Graph

1546 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Miguel Sozinho Ramalho
6f949738a3 Merge branch 'dev' into v1-dm-changes 2025-06-17 13:05:34 +01:00
msramalho
1b6d85884b complements authentication changes 2025-06-17 12:54:43 +01:00
msramalho
7ab804d163 dependencies update 2025-06-17 12:50:35 +01:00
Dave Mateer
b3adc5603a metadata.json hardcode in storage. add new metadata_json_enricher. log level change in orchestrator 2025-06-17 09:51:19 +01:00
Dave Mateer
ba3f1a52e8 Logging each_level_in_separate_file feature 2025-06-16 16:15:54 +01:00
Dave Mateer
a60d800b31 Changed log level for media 2025-06-16 15:07:39 +01:00
Dave Mateer
f2e80758a7 typo on authentication docs. Updated install docs. 2025-06-16 14:59:55 +01:00
Dave Mateer
f07fdbc500 Custom local version comment in toml file 2025-06-16 14:54:15 +01:00
Dave Mateer
b236f2510d Updates to installation docs 2025-06-16 14:40:40 +01:00
Dave Mateer
529d8b60bf Gitgnore to include launch.json and installtion docs to include build script. 2025-06-16 14:37:21 +01:00
msramalho
cd6a2b6031 generic_extractor download tests adaptations 2025-06-11 20:05:35 +01:00
msramalho
dfb361e3a0 reset generic_extractor description in result 2025-06-11 19:55:54 +01:00
Miguel Sozinho Ramalho
3d31c7605b Merge pull request #319 from bellingcat/feat/linkedin-antibot 
Antibot Dropin for Linkedin
 2025-06-11 19:42:38 +01:00
msramalho
d7a48e465b fix copypasta 2025-06-11 18:04:49 +01:00
msramalho
aaa9ead39d adds documentation for dropins 2025-06-11 17:58:53 +01:00
msramalho
f5be7a50c1 Testing Linkedin Dropin for Antibot 2025-06-11 16:52:03 +01:00
msramalho
2adcf231f7 new LinkedIn Dropin for Antibot 2025-06-11 16:51:52 +01:00
msramalho
cd19181d8f minor improvements 2025-06-11 16:51:42 +01:00
msramalho
b60469767a more flexibility to antibot dropins media finding process 2025-06-11 16:51:22 +01:00
msramalho
d60d02c16e improves download_from_url 2025-06-11 16:50:31 +01:00
msramalho
e567bba6f9 improves docs for how-to and migrations 2025-06-11 13:37:03 +01:00
msramalho
3cf51dd874 adds tracker remove feature and tests 2025-06-11 11:56:42 +01:00
msramalho
69ddb72146 separate reddit tests 2025-06-11 11:27:11 +01:00
msramalho
1039e9631f new reddit tests with .env.test 2025-06-11 11:22:23 +01:00
Miguel Sozinho Ramalho
79f42c3c41 Merge pull request #318 from bellingcat/feat/antibot-reddit 
Adds RedditDropin and other flow improvements
 2025-06-10 18:39:34 +01:00
msramalho
8314833ae8 removes exclude_media_extensions option 2025-06-10 18:34:33 +01:00
msramalho
6279610a43 updates docs 2025-06-10 18:28:45 +01:00
msramalho
fc89d96517 escape sequence 2025-06-10 18:04:33 +01:00
msramalho
54fda9cad4 antibot in docker uses a different user_data_dir 2025-06-10 18:04:27 +01:00
msramalho
71636233cb adds migration information and VkDropin info. 2025-06-10 17:07:10 +01:00
msramalho
fdbe96f2e4 vk and reddit should work without credentials but log the error 2025-06-10 16:44:14 +01:00
msramalho
22bd8727df python dependencies bump 2025-06-10 16:43:55 +01:00
msramalho
499c272260 dependabot switch to monthly 2025-06-10 16:37:52 +01:00
Miguel Sozinho Ramalho
f232bc45b8 Merge pull request #315 from bellingcat/dependabot/docker/webrecorder/browsertrix-crawler-1.6.2 
Bump webrecorder/browsertrix-crawler from 1.6.1 to 1.6.2
 2025-06-10 16:34:30 +01:00
msramalho
4270e06728 npm update on scripts/settings 2025-06-10 16:33:47 +01:00
msramalho
ca00aa302d version bump breaking 2025-06-10 16:31:32 +01:00
msramalho
773fa82f06 introduces reddit dropin 2025-06-10 16:31:19 +01:00
msramalho
ef0e909a72 extractor to auto detect best quality 2025-06-10 16:29:35 +01:00
msramalho
6bbc7fb47a improves antibot flow and makes auth_wall detection optional 2025-06-10 16:29:07 +01:00
msramalho
809b8c7749 default dropin introduced 2025-06-10 16:14:42 +01:00
msramalho
6d82655cc4 manifest improvement for antibot 2025-06-10 16:14:34 +01:00
msramalho
6bd493a791 dropin with new ytdlp feature and helper method 2025-06-10 16:11:55 +01:00
msramalho
287e823f43 improves twitter URL cleaning and introduces another bestquality check 2025-06-10 16:09:38 +01:00
msramalho
c815488daa adds new URLs to ignore 2025-06-10 15:44:52 +01:00
dependabot[bot]
f53e34d6bd Bump webrecorder/browsertrix-crawler from 1.6.1 to 1.6.2 
Bumps webrecorder/browsertrix-crawler from 1.6.1 to 1.6.2.

---
updated-dependencies:
- dependency-name: webrecorder/browsertrix-crawler
  dependency-version: 1.6.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2025-06-09 20:55:07 +00:00
Miguel Sozinho Ramalho
4cfbc3008b Merge pull request #313 from bellingcat/feat/antibot-auth 
Introduces more flexibility to the Antibot Extractor
 2025-06-08 14:42:35 +01:00
msramalho
6f02493ff1 adds clips extraction to VK, though generic_extractor should still be run for those 2025-06-08 14:36:55 +01:00
msramalho
1f2d637928 minor improvements 2025-06-08 14:16:21 +01:00
msramalho
18cc05a2fe allows auth_for_site to receive do.main directly 2025-06-08 14:16:12 +01:00
msramalho
c96fd71f35 minor cleanup 2025-06-07 20:06:53 +01:00