msramalho
55d9ffaacd
typo
2025-06-17 18:51:21 +01:00
msramalho
f19fb575a7
logging updates
2025-06-17 18:50:54 +01:00
msramalho
dfb361e3a0
reset generic_extractor description in result
2025-06-11 19:55:54 +01:00
msramalho
e567bba6f9
improves docs for how-to and migrations
2025-06-11 13:37:03 +01:00
msramalho
71636233cb
adds migration information and VkDropin info.
2025-06-10 17:07:10 +01:00
msramalho
1f2d637928
minor improvements
2025-06-08 14:16:21 +01:00
msramalho
07ff5baf07
adds Dropin flexible integration for antibot
2025-06-07 19:09:37 +01:00
msramalho
d202d79e0f
lint
2025-06-07 19:06:14 +01:00
msramalho
952487da30
adds missing bin dependency
2025-06-07 18:14:42 +01:00
msramalho
c7a84bc97a
generalizes ydl info to filename method for reusing
2025-06-07 18:14:08 +01:00
msramalho
d130c1b3fa
WIP attempt at ytdlp impersonation
2025-06-04 11:53:18 +01:00
msramalho
cbd189c97d
general cleanup
2025-06-04 11:53:01 +01:00
Miguel Sozinho Ramalho
6735fa890b
v1.0.1 dependency updates, generic extractor improvements ( #307 )
...
* wacz: allow exceptional cases where more than one resource image is available
* improves generic extractor edge-cases and yt-dlp updates
* REMOVES vk_extractor until further notice
* bumps browsertrix in docker image
* npm version bump on scripts/settings
* poetry updates
* Changed log level on gsheet_feeder_db started from warning to info (#301 )
* closes 305 and further fixes finding local downloads from uncommon ytdlp extractors
* use ffmpeg -bitexact to reduce duplicate content storing
* formatting
* adds yt-dlp curl-cffi
* version bump
* linting
---------
Co-authored-by: Dave Mateer <davemateer@gmail.com >
2025-06-02 20:57:12 +01:00
Dave Mateer
48be13fb2a
catch for if self.comments are true but no actual comments in video ( #303 )
...
* catch for if self.comments are true but no actual comments in video
* simplifies check code
---------
Co-authored-by: Miguel Sozinho Ramalho <19508417+msramalho@users.noreply.github.com >
2025-06-02 13:02:19 +01:00
erinhmclark
5e7c57650b
Update "default" to "auto" for clarity, update docs
2025-03-28 13:16:16 +00:00
erinhmclark
2cad5edea8
Fix default config
2025-03-26 17:33:00 +00:00
erinhmclark
093ce34a6a
Ruff format.
2025-03-26 17:02:20 +00:00
erinhmclark
ae523eb06f
Udpate PO token generation script method
2025-03-26 16:45:29 +00:00
erinhmclark
d87c0dc3a9
Implement update for pot plugin.
2025-03-26 16:02:29 +00:00
erinhmclark
633290a9cc
Update for pot providers list
2025-03-25 18:27:06 +00:00
erinhmclark
040a864d5c
Merge branch 'refs/heads/main' into feat/yt-dlp-pots
...
# Conflicts:
# poetry.lock
2025-03-25 18:26:43 +00:00
erinhmclark
b4c33318c4
Merge branch 'main' into feat/yt-dlp-pots
...
# Conflicts:
# src/auto_archiver/modules/generic_extractor/__manifest__.py
# tests/test_modules.py
2025-03-25 15:16:31 +00:00
Patrick Robertson
c980500978
Actually restart AA after updating yt-dlp.
...
A simple 'importlib.reload()' doesn't take into account all imports
2025-03-24 14:33:59 +04:00
Erin Clark
613ba0c05d
Merge pull request #262 from bellingcat/generic_extractor_args
...
Add flexible extractor_args to generic_extractor.py
This allows users to pass any of the options listed [here](https://github.com/yt-dlp/yt-dlp/blob/master/README.md#extractor-arguments ) to yt-dlp extractor_args.
example usage:
```
generic_extractor:
facebook_cookie:
...
extractor_args:
youtube:
player_client: web,tv
generic:
is_live: true
```
2025-03-20 15:38:20 +00:00
Patrick Robertson
0a5ba3385e
Fix small bug in twitter dropin
...
- previously the 'content' was being set to a json dump of the tweet, it should be set to full_text
2025-03-20 18:55:22 +04:00
erinhmclark
2921061fde
Add flexible extractor_args to generic_extractor.py
2025-03-19 19:19:28 +00:00
erinhmclark
fc6946f78a
Run format.
2025-03-18 21:43:18 +00:00
erinhmclark
2fdf6b7564
Update generic_extractor.py for general/ youtube extraction.
2025-03-18 21:33:21 +00:00
erinhmclark
a577228465
Update generic_extractor.py for general/ youtube extraction.
2025-03-18 21:10:06 +00:00
erinhmclark
ba9d67e4bb
Merge branch 'main' into feat/yt-dlp-pots
2025-03-18 20:10:38 +00:00
erinhmclark
c4e63ebd8c
Add conditional check to setup bgutils token generation script.
...
TODO: Update tests
2025-03-18 14:54:57 +00:00
erinhmclark
cb632723bd
Add scripts to pull only /server/ section of pots generator, adn only install at runtime.
2025-03-18 13:47:01 +00:00
erinhmclark
0c892f3cf1
Temp fix for tests by setting path in manifest.
2025-03-18 11:44:08 +00:00
Patrick Robertson
d03ecdb037
Standardise parse dates to get_datetime_from_str
2025-03-18 10:22:58 +00:00
Patrick Robertson
89e387030d
Tests for suitable URLs for tikwm
2025-03-18 10:04:03 +00:00
Patrick Robertson
8ec053ed1b
Refactor the dropin 'is_suitable' method + fix tikwm implementation
...
Makes it easier to maintain/understand.
2025-03-18 09:14:14 +00:00
erinhmclark
e6b1a8c893
Add POT setup script.
2025-03-17 20:34:00 +00:00
erinhmclark
8548b7def7
Refactor setup method to pull and transpile the token generator.
2025-03-17 18:53:59 +00:00
erinhmclark
bbe25537c7
Merge branch 'main' into feat/yt-dlp-pots
2025-03-17 16:54:29 +00:00
erinhmclark
5daeae994a
Fix the extractor args for new list structure.
2025-03-17 14:17:31 +00:00
Patrick Robertson
3d4056ef70
Merge pull request #223 from bellingcat/facebook_extractor
...
Create facebook dropin - working for images + text.
2025-03-17 12:45:05 +00:00
erinhmclark
f5bbfe5d1c
Merge branch 'main' into feat/yt-dlp-pots
2025-03-17 10:43:35 +00:00
Patrick Robertson
0765640bff
Fix up tiktok dropin for slightly modified generic_extractor format
2025-03-17 10:31:22 +00:00
Patrick Robertson
06b1f4c0ca
Fix lingering merge conflict issues
2025-03-17 10:12:55 +00:00
Patrick Robertson
59b910ec30
Merge main
2025-03-17 10:05:11 +00:00
Patrick Robertson
7e360240bf
Copy ytdlp code into AA project - seems like ytdlp won't be merged anytime soon
2025-03-17 09:57:05 +00:00
Patrick Robertson
42162c5e3f
Various docs improvements based on Friday Office Hours discussion
2025-03-17 09:23:43 +00:00
Patrick Robertson
a8e5585e6c
github format
2025-03-14 12:52:01 +00:00
Patrick Robertson
19715c8ec2
Merge branch 'main' into webdriver-cookies
2025-03-14 12:44:48 +00:00
erinhmclark
72f48f0147
Fix merge conflicts.
2025-03-14 12:11:24 +00:00
