msramalho
22408e2a98
adds test for antibot
2025-06-04 11:59:59 +01:00
msramalho
378b1a6d22
expand S3 objects content type for better preview results in non-latin languages
2025-06-04 11:53:41 +01:00
msramalho
d130c1b3fa
WIP attempt at ytdlp impersonation
2025-06-04 11:53:18 +01:00
msramalho
cbd189c97d
general cleanup
2025-06-04 11:53:01 +01:00
msramalho
d2e8f1a512
introduces antibot step with seleniumbase
2025-06-04 11:20:46 +01:00
msramalho
488802b632
poetry update
2025-06-04 11:08:44 +01:00
msramalho
ee68f3efee
Merge remote-tracking branch 'origin/main' into feat/seleniumbase
2025-06-03 11:05:16 +01:00
Miguel Sozinho Ramalho
6735fa890b
v1.0.1 dependency updates, generic extractor improvements ( #307 )
...
* wacz: allow exceptional cases where more than one resource image is available
* improves generic extractor edge-cases and yt-dlp updates
* REMOVES vk_extractor until further notice
* bumps browsertrix in docker image
* npm version bump on scripts/settings
* poetry updates
* Changed log level on gsheet_feeder_db started from warning to info (#301 )
* closes 305 and further fixes finding local downloads from uncommon ytdlp extractors
* use ffmpeg -bitexact to reduce duplicate content storing
* formatting
* adds yt-dlp curl-cffi
* version bump
* linting
---------
Co-authored-by: Dave Mateer <davemateer@gmail.com >
2025-06-02 20:57:12 +01:00
Dave Mateer
48be13fb2a
catch for if self.comments are true but no actual comments in video ( #303 )
...
* catch for if self.comments are true but no actual comments in video
* simplifies check code
---------
Co-authored-by: Miguel Sozinho Ramalho <19508417+msramalho@users.noreply.github.com >
2025-06-02 13:02:19 +01:00
msramalho
e6fdef66df
improves instructions on docker setup with an example URL
2025-04-28 11:16:01 +01:00
msramalho
5cf640af8a
experiments with seleniumbase
2025-04-28 11:08:00 +01:00
Miguel Sozinho Ramalho
33cacd145f
Update tests-download.yaml
...
to shift ownership of notifications
2025-04-07 21:15:18 +01:00
Miguel Sozinho Ramalho
0f69b5fe0c
update repo badges
2025-03-31 16:19:29 +01:00
Erin Clark
ad2e8397b2
Merge pull request #287 from bellingcat/fix/insta_tbot_empty
...
Only return success for instagram_tbot_extractor.py with content.
2025-03-31 14:31:46 +01:00
erinhmclark
144adaad5b
Only return success for instagram_tbot_extractor.py with content.
2025-03-31 14:14:36 +01:00
Erin Clark
c7c7eb00a1
Merge pull request #286 from bellingcat/version_comparison
...
Small code fixes and GH Actions cache
2025-03-31 12:40:42 +01:00
erinhmclark
7e4ba62918
Small code change
2025-03-31 12:05:39 +01:00
erinhmclark
9c2b506189
update runner os to matrix os.
2025-03-31 12:00:24 +01:00
erinhmclark
8940580638
Add poetry cache clear, and small code change
2025-03-31 11:41:26 +01:00
erinhmclark
c2821d7c83
Fix poetry install deletion
2025-03-31 11:25:51 +01:00
erinhmclark
a590647279
Small code tidy to trigger tests.
2025-03-31 11:23:49 +01:00
erinhmclark
1edfdae03e
Update download tests to match cache process.
2025-03-31 11:17:40 +01:00
erinhmclark
6c7f6af4b4
Add cache action with key to OS, py version and lockfile hash, and install packages from source.
2025-03-31 11:11:56 +01:00
Erin Clark
8685b6bf13
Merge pull request #285 from bellingcat/fix-ubuntu-22
...
[WIP] Change order of poetry install - in case this fixes core tests
2025-03-28 15:38:03 +00:00
Patrick Robertson
0ce7f5a1b5
Disable caching
2025-03-28 18:40:02 +04:00
Patrick Robertson
85d3f2fa02
Revert changes
2025-03-28 18:36:11 +04:00
Patrick Robertson
fd540bd03a
Code change to trigger tests
2025-03-28 18:29:59 +04:00
Patrick Robertson
86f328515c
Use cache key that includes os version
2025-03-28 18:29:52 +04:00
erinhmclark
68992025b0
Update version comparison.
2025-03-28 14:29:44 +00:00
Patrick Robertson
6544934825
Merge pull request #283 from bellingcat/1.0-release
...
v1.0.0 release 🎉
2025-03-28 18:06:59 +04:00
Patrick Robertson
197599b406
Merge pull request #284 from bellingcat/revert-downloads-test
...
Revert downloads CI tests changes
2025-03-28 18:06:49 +04:00
Erin Clark
96efdcbba1
Merge pull request #281 from bellingcat/add_inst_api_script
...
Add InstagrAPI server script to be used with the Instagram API Extractor.
2025-03-28 13:58:37 +00:00
Patrick Robertson
2ec494b4b9
Revert downloads CI tests changes
...
It wasn't properly being triggered after the core tests. this reverts so that the download tests just run whatever
2025-03-28 17:55:58 +04:00
Erin Clark
1d18399d70
Merge pull request #222 from bellingcat/feat/yt-dlp-pots
...
yt-dlp proposed extractor_args and PO Token client.
2025-03-28 13:54:27 +00:00
Patrick Robertson
3550a009e6
v1.0.0 release 🎉
2025-03-28 13:53:29 +00:00
erinhmclark
dd7d85b4b4
Lock
2025-03-28 13:47:18 +00:00
erinhmclark
c510c04643
Update config reference in test_generic_extractor.py
2025-03-28 13:43:46 +00:00
erinhmclark
a0d955fe84
lock
2025-03-28 13:39:58 +00:00
erinhmclark
5e7c57650b
Update "default" to "auto" for clarity, update docs
2025-03-28 13:16:16 +00:00
erinhmclark
1db7d6702d
Update the documentation
2025-03-28 12:27:18 +00:00
erinhmclark
b1a8792f9f
Remove duplicate line
2025-03-28 11:44:37 +00:00
erinhmclark
f715100dd5
Add run_instagrapi_server.sh and update docs
2025-03-28 11:31:23 +00:00
erinhmclark
dbcf19d1b8
Update update path reference
2025-03-28 10:55:21 +00:00
erinhmclark
0840b7283c
Format
2025-03-28 10:43:00 +00:00
erinhmclark
b5dc1854a2
Merge branch 'main' into feat/yt-dlp-pots
2025-03-28 10:42:24 +00:00
erinhmclark
efab0f9a91
Add test
2025-03-28 10:37:22 +00:00
erinhmclark
bc35116975
Update poetry.lock
2025-03-28 10:37:13 +00:00
Patrick Robertson
25f1f5dc93
Merge pull request #279 from bellingcat/telethon_tweaks
...
Fix calling extractor.cleanup (fixes telethon issue) + tidy up telethon extractor session file naming
2025-03-28 14:13:26 +04:00
erinhmclark
f99dcc63a1
Minor updates
2025-03-28 09:46:44 +00:00
Patrick Robertson
48fbfc3b86
Merge pull request #280 from bellingcat/download-tests
...
Download tests
2025-03-28 13:33:30 +04:00
