erinhmclark
|
2921061fde
|
Add flexible extractor_args to generic_extractor.py
|
2025-03-19 19:19:28 +00:00 |
|
Patrick Robertson
|
e531906d73
|
Create an independent profile file for each wacz_extractor_enricher instance
|
2025-03-19 18:08:24 +04:00 |
|
Patrick Robertson
|
244341d22c
|
Skip check for 'docker' bin dependency if already running in docker
|
2025-03-19 18:08:04 +04:00 |
|
Patrick Robertson
|
488675056b
|
Download generate_google_services.sh script from GH - it's not packaged with the app
|
2025-03-19 15:52:39 +04:00 |
|
erinhmclark
|
fc6946f78a
|
Run format.
|
2025-03-18 21:43:18 +00:00 |
|
erinhmclark
|
2fdf6b7564
|
Update generic_extractor.py for general/ youtube extraction.
|
2025-03-18 21:33:21 +00:00 |
|
erinhmclark
|
a577228465
|
Update generic_extractor.py for general/ youtube extraction.
|
2025-03-18 21:10:06 +00:00 |
|
erinhmclark
|
ba9d67e4bb
|
Merge branch 'main' into feat/yt-dlp-pots
|
2025-03-18 20:10:38 +00:00 |
|
erinhmclark
|
c4e63ebd8c
|
Add conditional check to setup bgutils token generation script.
TODO: Update tests
|
2025-03-18 14:54:57 +00:00 |
|
Miguel Sozinho Ramalho
|
f6863b8eb2
|
Update src/auto_archiver/modules/gsheet_feeder_db/__manifest__.py
|
2025-03-18 14:10:47 +00:00 |
|
erinhmclark
|
cb632723bd
|
Add scripts to pull only /server/ section of pots generator, adn only install at runtime.
|
2025-03-18 13:47:01 +00:00 |
|
erinhmclark
|
0c892f3cf1
|
Temp fix for tests by setting path in manifest.
|
2025-03-18 11:44:08 +00:00 |
|
Patrick Robertson
|
d03ecdb037
|
Standardise parse dates to get_datetime_from_str
|
2025-03-18 10:22:58 +00:00 |
|
Patrick Robertson
|
89e387030d
|
Tests for suitable URLs for tikwm
|
2025-03-18 10:04:03 +00:00 |
|
Patrick Robertson
|
8ec053ed1b
|
Refactor the dropin 'is_suitable' method + fix tikwm implementation
Makes it easier to maintain/understand.
|
2025-03-18 09:14:14 +00:00 |
|
erinhmclark
|
e6b1a8c893
|
Add POT setup script.
|
2025-03-17 20:34:00 +00:00 |
|
erinhmclark
|
8548b7def7
|
Refactor setup method to pull and transpile the token generator.
|
2025-03-17 18:53:59 +00:00 |
|
Patrick Robertson
|
29db537fab
|
Docs on using the script to auto-generate service accounts
|
2025-03-17 18:11:18 +00:00 |
|
erinhmclark
|
bbe25537c7
|
Merge branch 'main' into feat/yt-dlp-pots
|
2025-03-17 16:54:29 +00:00 |
|
erinhmclark
|
5daeae994a
|
Fix the extractor args for new list structure.
|
2025-03-17 14:17:31 +00:00 |
|
Patrick Robertson
|
3d4056ef70
|
Merge pull request #223 from bellingcat/facebook_extractor
Create facebook dropin - working for images + text.
|
2025-03-17 12:45:05 +00:00 |
|
erinhmclark
|
f5bbfe5d1c
|
Merge branch 'main' into feat/yt-dlp-pots
|
2025-03-17 10:43:35 +00:00 |
|
Patrick Robertson
|
0765640bff
|
Fix up tiktok dropin for slightly modified generic_extractor format
|
2025-03-17 10:31:22 +00:00 |
|
Patrick Robertson
|
06b1f4c0ca
|
Fix lingering merge conflict issues
|
2025-03-17 10:12:55 +00:00 |
|
Patrick Robertson
|
59b910ec30
|
Merge main
|
2025-03-17 10:05:11 +00:00 |
|
Patrick Robertson
|
7e360240bf
|
Copy ytdlp code into AA project - seems like ytdlp won't be merged anytime soon
|
2025-03-17 09:57:05 +00:00 |
|
Patrick Robertson
|
7badf89c28
|
Create the 'secrets' folder if it doesn't exist on first run
Easier setup for users
|
2025-03-17 09:40:46 +00:00 |
|
Patrick Robertson
|
d59530c8e7
|
Fix if logic bug
|
2025-03-17 09:40:27 +00:00 |
|
Patrick Robertson
|
0ec5451f66
|
Nicer error log when no URLs provided for CLI feeder - don't need the stacktrace
|
2025-03-17 09:34:33 +00:00 |
|
Patrick Robertson
|
99e9ac2465
|
Fix 'Syntax Error' warning in python3.12+
|
2025-03-17 09:29:51 +00:00 |
|
Patrick Robertson
|
42162c5e3f
|
Various docs improvements based on Friday Office Hours discussion
|
2025-03-17 09:23:43 +00:00 |
|
Patrick Robertson
|
17463de937
|
Merge pull request #247 from bellingcat/opentimestamps
Opentimestamps Module
|
2025-03-14 13:41:46 +00:00 |
|
Patrick Robertson
|
a8e5585e6c
|
github format
|
2025-03-14 12:52:01 +00:00 |
|
Patrick Robertson
|
19715c8ec2
|
Merge branch 'main' into webdriver-cookies
|
2025-03-14 12:44:48 +00:00 |
|
Patrick Robertson
|
17ae75fb95
|
Ruff fixes
|
2025-03-14 12:38:12 +00:00 |
|
Patrick Robertson
|
b8da7607e8
|
Merge branch 'main' into opentimestamps
|
2025-03-14 12:36:03 +00:00 |
|
erinhmclark
|
72f48f0147
|
Fix merge conflicts.
|
2025-03-14 12:11:24 +00:00 |
|
erinhmclark
|
846474a4e2
|
Merge branch 'main' into linting_etc
|
2025-03-14 10:50:13 +00:00 |
|
Patrick Robertson
|
f504d2e304
|
Merge branch 'main' into webdriver-cookies
|
2025-03-14 09:37:12 +00:00 |
|
msramalho
|
4d67dce4c8
|
minor log fix
|
2025-03-13 19:24:05 +00:00 |
|
Patrick Robertson
|
f6b13327f0
|
Tweaks and additional debug logging
|
2025-03-13 17:41:41 +00:00 |
|
Patrick Robertson
|
589c834047
|
Fix parsing ytdlp args - we should first run them through the parse_options method
|
2025-03-13 17:41:40 +00:00 |
|
Patrick Robertson
|
0efeaaabb1
|
Revert to using time.sleep and .click() - since we only want to be waiting the first time (for the page to load)
|
2025-03-13 17:41:16 +00:00 |
|
Patrick Robertson
|
b908655cc8
|
Remove references to litecoin + several tidy-ups
|
2025-03-13 17:40:00 +00:00 |
|
Patrick Robertson
|
10ceb7aa15
|
Move tikwm extractor into a droping for the generic extractor
|
2025-03-13 15:59:42 +00:00 |
|
Patrick Robertson
|
e7489ac4c4
|
Tidy up opentimestamps
* Simplify
* Don't add fake (pending) attestations if the calendar urls all have issues
* Remove unnecessary configs
* Improve docs on upgrading + verifying
|
2025-03-13 14:30:33 +00:00 |
|
erinhmclark
|
8673bc5979
|
Fix unused imports and include rule.
|
2025-03-13 13:55:31 +00:00 |
|
erinhmclark
|
e76551ba22
|
Add documentation, pre-commit hook, more make commands and
|
2025-03-13 13:21:32 +00:00 |
|
erinhmclark
|
6e52a534e7
|
More fixes from Bugbear suggestions
|
2025-03-12 16:07:05 +00:00 |
|
erinhmclark
|
753c3c6214
|
Linting tests
|
2025-03-12 14:27:45 +00:00 |
|