msramalho
3194fee95d
fix telethon bug when running in celery workers that close the event loop
2026-03-12 10:20:11 +00:00
msramalho
23a88e3cf4
ci issues
2026-03-02 17:07:09 +00:00
msramalho
077b03fc61
minor tests change to work in gh actions
2026-03-02 14:08:14 +00:00
msramalho
bc66dd4f2a
fxtwitter working instead of nitter
2026-03-02 12:31:28 +00:00
msramalho
3e2c0b564b
wiki fix
2026-01-08 15:49:42 +00:00
msramalho
3a22cc28c0
skip tiktok antibot test in CI
2025-10-23 10:17:14 +01:00
msramalho
dbb3dfa04f
fixes wikipedia test
2025-10-23 10:04:44 +01:00
msramalho
43cbc6ac56
generic extractor improvements
2025-10-23 09:51:14 +01:00
msramalho
d3efd7121c
avoid empty metadata comments
2025-07-06 14:05:17 +01:00
msramalho
9d3cd5774b
an improved approach for #295
2025-07-06 14:04:01 +01:00
msramalho
3a34a49822
adds antibot tiktok logic for photos closes #295
2025-07-05 18:31:12 +01:00
msramalho
c2c9718f73
make python api tests work on gh when no env is set
2025-06-30 02:20:51 +01:00
msramalho
12b457706b
closes #166 adds story URL feature to telethon extractor
2025-06-18 17:37:44 +01:00
msramalho
592dc30415
closes #330
2025-06-18 16:40:55 +01:00
msramalho
76fd329fe5
twitter tests fix
2025-06-17 23:51:03 +01:00
msramalho
cd6a2b6031
generic_extractor download tests adaptations
2025-06-11 20:05:35 +01:00
msramalho
d7a48e465b
fix copypasta
2025-06-11 18:04:49 +01:00
msramalho
f5be7a50c1
Testing Linkedin Dropin for Antibot
2025-06-11 16:52:03 +01:00
msramalho
69ddb72146
separate reddit tests
2025-06-11 11:27:11 +01:00
msramalho
1039e9631f
new reddit tests with .env.test
2025-06-11 11:22:23 +01:00
msramalho
8314833ae8
removes exclude_media_extensions option
2025-06-10 18:34:33 +01:00
msramalho
6bbc7fb47a
improves antibot flow and makes auth_wall detection optional
2025-06-10 16:29:07 +01:00
msramalho
6f02493ff1
adds clips extraction to VK, though generic_extractor should still be run for those
2025-06-08 14:36:55 +01:00
msramalho
d13a5ef003
adds tests in minor improvements
2025-06-07 19:58:18 +01:00
msramalho
2c6be4447f
linting
2025-06-04 14:17:38 +01:00
msramalho
22408e2a98
adds test for antibot
2025-06-04 11:59:59 +01:00
msramalho
cbd189c97d
general cleanup
2025-06-04 11:53:01 +01:00
Miguel Sozinho Ramalho
6735fa890b
v1.0.1 dependency updates, generic extractor improvements ( #307 )
...
* wacz: allow exceptional cases where more than one resource image is available
* improves generic extractor edge-cases and yt-dlp updates
* REMOVES vk_extractor until further notice
* bumps browsertrix in docker image
* npm version bump on scripts/settings
* poetry updates
* Changed log level on gsheet_feeder_db started from warning to info (#301 )
* closes 305 and further fixes finding local downloads from uncommon ytdlp extractors
* use ffmpeg -bitexact to reduce duplicate content storing
* formatting
* adds yt-dlp curl-cffi
* version bump
* linting
---------
Co-authored-by: Dave Mateer <davemateer@gmail.com >
2025-06-02 20:57:12 +01:00
erinhmclark
144adaad5b
Only return success for instagram_tbot_extractor.py with content.
2025-03-31 14:14:36 +01:00
erinhmclark
c510c04643
Update config reference in test_generic_extractor.py
2025-03-28 13:43:46 +00:00
erinhmclark
0840b7283c
Format
2025-03-28 10:43:00 +00:00
erinhmclark
b5dc1854a2
Merge branch 'main' into feat/yt-dlp-pots
2025-03-28 10:42:24 +00:00
erinhmclark
efab0f9a91
Add test
2025-03-28 10:37:22 +00:00
Patrick Robertson
b7949a489f
Simplify telethon unit tests for CI (don't use TestExtractorBase - it causes loading issues)
2025-03-26 23:51:21 +04:00
Patrick Robertson
e06b0c0585
Skip checking if docker is running for tests + more graceful test for filename
2025-03-26 23:03:48 +04:00
Patrick Robertson
95ea9fb231
Telethon unit tests + tidyup
2025-03-26 22:53:27 +04:00
erinhmclark
040a864d5c
Merge branch 'refs/heads/main' into feat/yt-dlp-pots
...
# Conflicts:
# poetry.lock
2025-03-25 18:26:43 +00:00
erinhmclark
b4c33318c4
Merge branch 'main' into feat/yt-dlp-pots
...
# Conflicts:
# src/auto_archiver/modules/generic_extractor/__manifest__.py
# tests/test_modules.py
2025-03-25 15:16:31 +00:00
Patrick Robertson
a9fe959ea1
Fix unit tests for latest yt-dlp
...
(Yt-dlp title is now truncated)
2025-03-24 17:48:15 +04:00
Patrick Robertson
0a5ba3385e
Fix small bug in twitter dropin
...
- previously the 'content' was being set to a json dump of the tweet, it should be set to full_text
2025-03-20 18:55:22 +04:00
erinhmclark
ba9d67e4bb
Merge branch 'main' into feat/yt-dlp-pots
2025-03-18 20:10:38 +00:00
erinhmclark
c4e63ebd8c
Add conditional check to setup bgutils token generation script.
...
TODO: Update tests
2025-03-18 14:54:57 +00:00
Patrick Robertson
89e387030d
Tests for suitable URLs for tikwm
2025-03-18 10:04:03 +00:00
Patrick Robertson
59b910ec30
Merge main
2025-03-17 10:05:11 +00:00
erinhmclark
72f48f0147
Fix merge conflicts.
2025-03-14 12:11:24 +00:00
erinhmclark
846474a4e2
Merge branch 'main' into linting_etc
2025-03-14 10:50:13 +00:00
Patrick Robertson
2e25e59fa6
Fix unit tests - make caplog checks more robust, having added a new logger/debug call
2025-03-13 16:07:49 +00:00
Patrick Robertson
10ceb7aa15
Move tikwm extractor into a droping for the generic extractor
2025-03-13 15:59:42 +00:00
erinhmclark
0bef78b0b4
Remove autouse property of mock_sleep.
2025-03-13 15:23:35 +00:00
erinhmclark
16012df30b
Revert exception check in test.
2025-03-13 13:57:04 +00:00
