erinhmclark
319c1e8f92
Add more tests.
2025-02-14 09:48:37 +00:00
erinhmclark
3fce593aad
Merge branch 'main' into tests/add_module_tests
2025-02-12 19:33:29 +00:00
erinhmclark
d9d936c2ca
Thumbnail enricher fix seconds to minutes.
2025-02-12 12:22:27 +00:00
Patrick Robertson
1d69053dd5
Upgrade certifi
2025-02-11 18:41:37 +00:00
Patrick Robertson
40a95f7348
Add likify deps
2025-02-11 18:40:44 +00:00
Patrick Robertson
dbc564e18b
Add sphinx_book_theme theme to poetry
2025-02-10 22:58:52 +00:00
Patrick Robertson
91ca325fd5
Update yt-dlp to latest version + remove code no longer needed from bluesky dropin
2025-02-04 17:46:46 +01:00
Patrick Robertson
b7d9145f6c
Further tidyups + refactoring for new structure
...
* Add implementation tests for orchestrator + logging tests
* Standardise method/class vars for extractors to see if they are suitable
* Fix bugs with removing default loguru logger (allows further customisation)
* Fix bug loading required fields from file
*
2025-01-30 13:21:10 +01:00
Patrick Robertson
18ff36ce15
Add ruamel to dependencies (replaces pyyaml)
2025-01-29 19:37:41 +01:00
erinhmclark
e1a9373336
Refactoring for new config setup
2025-01-27 19:03:02 +00:00
Patrick Robertson
f1e9ab6751
Merge branch 'main' into load_modules
2025-01-24 15:23:15 +01:00
Patrick Robertson
e8138eac1c
Add ubuntu-latest to the matrix of test runners ( #181 )
...
* Don't clutter logs with info about generic dropin
* Add ubuntu-latest to unit tests
This is currently failing due to an issue with oscrypto and newer openssl https://github.com/wbond/oscrypto/issues/78#issuecomment-1756317472
* fix oscrypto version for ubuntu 24 compatibility (boto3 too see #180 )
---------
Co-authored-by: msramalho <19508417+msramalho@users.noreply.github.com >
2025-01-24 14:03:55 +00:00
Patrick Robertson
54995ad6ab
Further tweaks based on __manifest__.py files
...
Loading configs now works
2025-01-22 13:11:43 +01:00
Patrick Robertson
6388983815
Merge branch 'main' into youtubedlp-rewrite
2025-01-21 16:43:14 +01:00
Patrick Robertson
394bcd8d47
Further refactoring of youtubedl_archiver->base_archiver
...
* Keep twitter_api_archiver
* Remove unit tests for obsolete archivers
* Guess filename of media using the 'Content-Type' header
* Add mechanism to run 'expensive' tests last (see conftest.py) and also flag expensive tests to fail straight off (pytest.mark.incremental)
2025-01-17 11:56:08 +01:00
erinhmclark
d3eec5d90f
Basic docs structure for RTD
2025-01-15 21:45:29 +00:00
Patrick Robertson
3ff7a9444d
Update yt-dlp to latest version (2025.1.12) to add bsky support
2025-01-15 17:58:07 +01:00
Patrick Robertson
74cf1f5f23
Merge branch 'main' into youtubedlp-rewrite
2025-01-15 17:47:23 +01:00
Patrick Robertson
c3dd19f309
Sniff filetype of downloaded media and add extension
...
Also download in chunks - fixes 2 x TODOs
2025-01-15 17:46:47 +01:00
Patrick Robertson
74a4a24a23
Remove toml - unused
...
(pytest etc. use tomli, which is instlled)
2025-01-14 18:13:27 +01:00
Patrick Robertson
20726c1116
Remove tiktok-downloader - getting info is broken
...
TODO: switch to using youtube-dlp
2025-01-14 17:40:45 +01:00
Patrick Robertson
2eb2ab9ac9
Merge branch 'main' into remove_dependencies
2025-01-14 17:39:20 +01:00
Patrick Robertson
080f474d49
Remove minify_html package - HTML file is no longer minified
...
Savings were 5K (~15KB vs ~20KB) for the generated .html file, but minify_html is currently not compatible with python3.13+
2025-01-14 11:36:10 +01:00
Patrick Robertson
6329b72ee8
Remove argparse from dependency list
...
Argparse is installed by default on python>=3.2, we only support python3.10+
Ref: https://pypi.org/project/argparse/#description
2025-01-14 10:50:47 +01:00
Patrick Robertson
ab2eb3c7f5
Add dev dependencies to poetry
2025-01-13 20:42:08 +01:00
erinhmclark
84ee1b422f
Update and restrict versions of Poetry and Python.
2025-01-13 17:42:51 +00:00
erinhmclark
d80b4b7557
Remove snscrape and Python 3.12 restriction.
2025-01-12 12:15:56 +00:00
erinhmclark
08e83eb94e
Update pyproject.toml configuration for Poetry version 2.0.0.
2025-01-12 12:15:56 +00:00
erinhmclark
dd822b8b44
Update poetry.lock
2025-01-12 12:15:56 +00:00
erinhmclark
5490947657
Add packaging to Poetry.
2025-01-12 12:15:56 +00:00
erinhmclark
fd9a6c26ed
Create Poetry environment.
...
Required addition of transitive package (pyOpenSSL) and version restrictions on cryptography, boto3.
2025-01-12 12:15:56 +00:00
