msramalho
dd4e372703
use ffmpeg -bitexact to reduce duplicate content storing
2025-06-02 19:33:53 +01:00
msramalho
b9f7927a3b
closes 305 and further fixes finding local downloads from uncommon ytdlp extractors
2025-06-02 19:14:09 +01:00
msramalho
d99b7c9efe
Merge remote-tracking branch 'origin/main' into dev
2025-06-02 13:25:34 +01:00
Dave Mateer
48be13fb2a
catch for if self.comments are true but no actual comments in video ( #303 )
...
* catch for if self.comments are true but no actual comments in video
* simplifies check code
---------
Co-authored-by: Miguel Sozinho Ramalho <19508417+msramalho@users.noreply.github.com >
2025-06-02 13:02:19 +01:00
Dave Mateer
4aae5047f5
Changed log level on gsheet_feeder_db started from warning to info ( #301 )
2025-06-02 12:53:21 +01:00
msramalho
2d7206f99d
REMOVES vk_extractor until further notice
2025-06-02 12:06:02 +01:00
msramalho
ac24fd8f49
improves generic extractor edge-cases and yt-dlp updates
2025-06-02 12:03:51 +01:00
msramalho
ee3e871dd8
wacz: allow exceptional cases where more than one resource image is available
2025-05-28 11:53:29 +01:00
erinhmclark
144adaad5b
Only return success for instagram_tbot_extractor.py with content.
2025-03-31 14:14:36 +01:00
Erin Clark
c7c7eb00a1
Merge pull request #286 from bellingcat/version_comparison
...
Small code fixes and GH Actions cache
2025-03-31 12:40:42 +01:00
erinhmclark
7e4ba62918
Small code change
2025-03-31 12:05:39 +01:00
erinhmclark
8940580638
Add poetry cache clear, and small code change
2025-03-31 11:41:26 +01:00
erinhmclark
a590647279
Small code tidy to trigger tests.
2025-03-31 11:23:49 +01:00
Erin Clark
8685b6bf13
Merge pull request #285 from bellingcat/fix-ubuntu-22
...
[WIP] Change order of poetry install - in case this fixes core tests
2025-03-28 15:38:03 +00:00
Patrick Robertson
fd540bd03a
Code change to trigger tests
2025-03-28 18:29:59 +04:00
Erin Clark
96efdcbba1
Merge pull request #281 from bellingcat/add_inst_api_script
...
Add InstagrAPI server script to be used with the Instagram API Extractor.
2025-03-28 13:58:37 +00:00
erinhmclark
5e7c57650b
Update "default" to "auto" for clarity, update docs
2025-03-28 13:16:16 +00:00
erinhmclark
b5dc1854a2
Merge branch 'main' into feat/yt-dlp-pots
2025-03-28 10:42:24 +00:00
erinhmclark
00b29db390
Update documentaion for instagrapi api
2025-03-28 00:41:35 +00:00
Patrick Robertson
b7949a489f
Simplify telethon unit tests for CI (don't use TestExtractorBase - it causes loading issues)
2025-03-26 23:51:21 +04:00
Patrick Robertson
95ea9fb231
Telethon unit tests + tidyup
2025-03-26 22:53:27 +04:00
erinhmclark
2cad5edea8
Fix default config
2025-03-26 17:33:00 +00:00
Patrick Robertson
580de88366
Set the new session filename *before* copying
...
Fixes a potential bug whereby if the copy fails for some reason, the 'cleanup' command would remove the original session file
2025-03-26 21:32:23 +04:00
erinhmclark
093ce34a6a
Ruff format.
2025-03-26 17:02:20 +00:00
erinhmclark
7872d9356c
Merge branch 'main' into feat/yt-dlp-pots
2025-03-26 17:00:38 +00:00
erinhmclark
ae523eb06f
Udpate PO token generation script method
2025-03-26 16:45:29 +00:00
erinhmclark
d87c0dc3a9
Implement update for pot plugin.
2025-03-26 16:02:29 +00:00
Patrick Robertson
20bc80b9ef
Slightly more consistent/tidier naming for the session files
...
Don't add/remove .session from name, keep the file name without .session at all times
2025-03-26 15:57:11 +04:00
Patrick Robertson
0073a08525
Update manifest dependencies to remove tsp_client et al.
2025-03-26 14:57:55 +04:00
Patrick Robertson
d6be1ff84f
Merge branch 'main' into timestamping_rewrite
2025-03-26 14:37:51 +04:00
erinhmclark
633290a9cc
Update for pot providers list
2025-03-25 18:27:06 +00:00
erinhmclark
040a864d5c
Merge branch 'refs/heads/main' into feat/yt-dlp-pots
...
# Conflicts:
# poetry.lock
2025-03-25 18:26:43 +00:00
erinhmclark
b4c33318c4
Merge branch 'main' into feat/yt-dlp-pots
...
# Conflicts:
# src/auto_archiver/modules/generic_extractor/__manifest__.py
# tests/test_modules.py
2025-03-25 15:16:31 +00:00
Patrick Robertson
beb7f3893d
Add comments/notes to WACZ enricher about browser profiles
2025-03-24 17:39:47 +04:00
Patrick Robertson
3c4625d708
Further ruff tweaks
2025-03-24 16:39:59 +04:00
Patrick Robertson
31fa7380f5
Fix up unit tests + issue when working with self-signed certs
2025-03-24 16:00:40 +04:00
Patrick Robertson
396ec03bae
Tidy up unit tests further + make more non-download
2025-03-24 15:26:22 +04:00
Patrick Robertson
dfde6f1995
Merge main into timestamping_enricher
2025-03-24 15:09:29 +04:00
Patrick Robertson
c980500978
Actually restart AA after updating yt-dlp.
...
A simple 'importlib.reload()' doesn't take into account all imports
2025-03-24 14:33:59 +04:00
Patrick Robertson
4b5a8c0199
Add warning *inside* instagram_extractor that it's not actively maintained
2025-03-21 12:09:58 +04:00
Patrick Robertson
14c56f4916
Provide better logs for screenshot enricher when auth is/isn't supported (cookies only)
2025-03-21 12:05:47 +04:00
Patrick Robertson
42e16aebd6
Merge pull request #255 from bellingcat/autogenerate_services_account
...
Script to auto-generate a service account
2025-03-20 18:00:45 +00:00
Patrick Robertson
e6c5705f70
Merge pull request #261 from bellingcat/wacz_separate_profile
...
Wacz minor adjustments
2025-03-20 15:51:56 +00:00
Erin Clark
613ba0c05d
Merge pull request #262 from bellingcat/generic_extractor_args
...
Add flexible extractor_args to generic_extractor.py
This allows users to pass any of the options listed [here](https://github.com/yt-dlp/yt-dlp/blob/master/README.md#extractor-arguments ) to yt-dlp extractor_args.
example usage:
```
generic_extractor:
facebook_cookie:
...
extractor_args:
youtube:
player_client: web,tv
generic:
is_live: true
```
2025-03-20 15:38:20 +00:00
Patrick Robertson
0a5ba3385e
Fix small bug in twitter dropin
...
- previously the 'content' was being set to a json dump of the tweet, it should be set to full_text
2025-03-20 18:55:22 +04:00
Patrick Robertson
f22af5e123
Tweak WACZ enricher docs + add comment on WACZ_ENABLE_DOCKER
2025-03-20 16:48:30 +04:00
erinhmclark
2921061fde
Add flexible extractor_args to generic_extractor.py
2025-03-19 19:19:28 +00:00
Patrick Robertson
e531906d73
Create an independent profile file for each wacz_extractor_enricher instance
2025-03-19 18:08:24 +04:00
Patrick Robertson
488675056b
Download generate_google_services.sh script from GH - it's not packaged with the app
2025-03-19 15:52:39 +04:00
erinhmclark
fc6946f78a
Run format.
2025-03-18 21:43:18 +00:00
