Patrick Robertson
333201acec
Merge branch 'main' into settings_page
2025-03-07 15:17:42 +00:00
Patrick Robertson
027985024b
Merge pull request #234 from bellingcat/update_suggestions
...
Auto Updates
2025-03-07 15:12:03 +00:00
Patrick Robertson
48b29d43f7
Merge pull request #233 from bellingcat/docker-webdriver-aarch64
...
Docker webdriver aarch64
2025-03-07 15:04:45 +00:00
Erin Clark
8ae3d9c031
Merge pull request #235 from bellingcat/instagram_extractor_bugfix
...
Instagram extractor bugfix:
- Fix typo from config changes
- Add warning message to documentation to alert to it not being maintained.
2025-03-07 15:02:05 +00:00
Patrick Robertson
158e6be0b1
Don't force enable a module under all types - allows modules to be set as only feeder/only extractor etc.
2025-03-07 14:59:11 +00:00
erinhmclark
4df03255a4
Fix typo in __manifest__.py
2025-03-07 14:56:35 +00:00
Patrick Robertson
503ba3d1c1
Add note on auto updates to readme
2025-03-07 14:46:50 +00:00
Patrick Robertson
f6f397700e
Fix typo + use hidden password fields for secret info
2025-03-07 12:41:09 +00:00
erinhmclark
89d2a8bb54
Update the __manifest__.py of the Instagram Extractor.
2025-03-07 12:34:19 +00:00
Patrick Robertson
e72b3e14ba
Change default height of screenshots to attempt to capture more information
2025-03-07 12:08:29 +00:00
Patrick Robertson
dba44b1ac1
Use WebDriverWait when waiting for elements in screenshot enricher
2025-03-07 12:07:54 +00:00
Patrick Robertson
e756f1504f
Remove geckodriver .tar file
2025-03-07 11:52:14 +00:00
Patrick Robertson
2c5e138263
Add a note on disabling the auto-update for yt-dlp
2025-03-07 11:44:24 +00:00
Patrick Robertson
478f0b2171
Tidy-ups to auto-updating code
2025-03-07 09:59:18 +00:00
erinhmclark
fa1e65f54c
Fix instagram_extractor.py typo, add warning to docs, and add basic regex test.
2025-03-06 16:25:38 +00:00
Patrick Robertson
358884c5d1
Fix unit tests for yt-dlp update
2025-03-04 17:04:23 +00:00
Patrick Robertson
be09aa927d
Make 'STARTED' command INFO not warning
2025-03-04 16:51:17 +00:00
Patrick Robertson
e6a578e60e
Check for auto-archiver updates and present warning if there's a newer version available
2025-03-04 16:51:17 +00:00
Patrick Robertson
0eb112431b
Auto-update yt-dlp based on generic_extractor.ytdlp_update_interval (default=5 days)
2025-03-04 16:43:46 +00:00
Patrick Robertson
f54d6519a8
Fix sorting of steps in the outputted file
2025-03-04 11:51:26 +00:00
Patrick Robertson
07ee773a54
Better drag & drop + keep comments in file
2025-03-04 10:54:16 +00:00
erinhmclark
a705a78632
Fix instagram_extractor.py typo in config value.
2025-03-03 21:06:09 +00:00
Patrick Robertson
dcaf7639be
Rename 'upgrading...' page to 'upgrading from...' because it's also valid for 0.13+ versions
2025-03-03 19:58:47 +00:00
Patrick Robertson
0b5a0fcb32
Better error logs if users have XXXX_archiver modules enabled in config
2025-03-03 19:57:09 +00:00
Patrick Robertson
1fe023cd70
Throw a nicer error if a user has an orchestration.yaml file in the old format (feeder: / archivers: / formatter: )
2025-03-03 19:51:55 +00:00
Patrick Robertson
a47e18ef9a
Bump gecko driver to 0.36.0
2025-03-03 16:00:11 +00:00
Patrick Robertson
0dfab2d1bc
Add some code to attempt to click the cookies banners on various websites
2025-03-03 15:55:04 +00:00
Patrick Robertson
dea0a49600
Download correct gecko-driver for the platform + fix setting executable path when running in Docker
...
Fixes #232
2025-03-03 15:41:44 +00:00
Erin Clark
011ded2bde
Merge pull request #225 from bellingcat/small_issues
...
## GSheets Columns updates
- Update the available columns in the Google Sheet Feeder and Database.
- Update the Sheet Template to reflect this.
## Other Fixes
- Ensure test file cleanup.
- Additional tests.
- Correctly mark download test.
- Small typos.
2025-03-03 13:06:27 +00:00
Patrick Robertson
a88a37d0a5
Hook in to RTD theme to set react theme
2025-03-03 11:56:23 +00:00
Patrick Robertson
9845804277
Fix up TODO plus add comments on integration into RTD page
2025-03-03 09:18:19 +00:00
Patrick Robertson
cc14e5cb9f
Remove extra html/head tag from page - now it's embedded in RTD
2025-03-03 09:06:40 +00:00
Patrick Robertson
6ba79049d9
Capitalize help text
2025-02-27 22:16:33 +00:00
Patrick Robertson
7620a671d1
Overwrite settings_base file
2025-02-27 22:02:44 +00:00
Patrick Robertson
54a2a19dd7
Also build auto-archiver
2025-02-27 21:56:36 +00:00
Patrick Robertson
3eb4ab41b8
Also generate the schema on each run
2025-02-27 21:38:55 +00:00
Patrick Robertson
65a9885d86
A few more manifest types
2025-02-27 21:33:04 +00:00
Patrick Robertson
4ee1e75aa2
Fix readthedocs config file
2025-02-27 21:24:34 +00:00
Patrick Robertson
1141c00e9a
Remove unused files, set up for RTD
2025-02-27 21:23:38 +00:00
Patrick Robertson
15da907e81
Add a bit of typescripting
2025-02-27 15:58:30 +00:00
Patrick Robertson
2ec44f4170
Documentation on building the settings page
2025-02-27 15:42:37 +00:00
Patrick Robertson
1e92c03b1d
Tweaks to settings page + more declarations in manifests
2025-02-27 15:21:11 +00:00
Patrick Robertson
efe9fdf915
Tidy ups to config editor page
2025-02-27 13:02:50 +00:00
erinhmclark
4280791f07
Fix mocking in test_wayback_enricher.py.
2025-02-27 11:25:58 +00:00
Patrick Robertson
f58f110436
Check at least 1 URL provided for new cli_feeder module rewrite
2025-02-26 17:59:13 +00:00
Patrick Robertson
70d89c71ce
Fully-working settings page editor
2025-02-26 17:02:49 +00:00
Patrick Robertson
bb961b131c
Turn cli_feeder *back* into a module, it's better like this for settings etc, documentation etc.
2025-02-26 15:41:33 +00:00
Patrick Robertson
e467fc90c2
Merge branch 'main' into settings_page
2025-02-26 15:32:07 +00:00
erinhmclark
8124bb831d
Merge branch 'main' into small_issues
...
# Conflicts:
# src/auto_archiver/core/base_module.py
# src/auto_archiver/utils/misc.py
2025-02-26 13:19:49 +00:00
erinhmclark
b2e654aef9
Remove context manager from test_pdq_hash_enricher.py
2025-02-26 12:57:33 +00:00
