erinhmclark
85abe1837a
Ruff format with defaults.
2025-03-10 18:44:54 +00:00
erinhmclark
cbb0414e5f
Switch to ruff
2025-03-10 16:05:23 +00:00
erinhmclark
f4f2424eb5
Add black and flake8
2025-03-10 13:15:11 +00:00
erinhmclark
1a2d9de819
Update the release process docs and the latest version in pyproject.toml
2025-03-07 17:33:32 +00:00
erinhmclark
7e4b44883b
Add temp options for testing
2025-03-04 14:03:39 +00:00
erinhmclark
2c1753e14b
Added Bgutils PO token provider.
2025-03-03 21:11:41 +00:00
erinhmclark
0eae2bee6a
Add yt-dlp-get-pot and yt-dlp-getpot-wpc requirements.
2025-03-03 21:08:00 +00:00
Patrick Robertson
6987a4827e
Set poetry packages - remove tsp_client and update cryptography
2025-02-25 11:57:20 +00:00
Patrick Robertson
5211c5de18
Merge pull request #210 from bellingcat/logger_fix
...
Fix issue #200 + Refactor _LAZY_LOADED_MODULES
2025-02-19 15:11:42 +00:00
Patrick Robertson
04507577b6
Version bump
2025-02-19 13:36:50 +00:00
erinhmclark
f0fd9bf445
Updates tests to use pytest-mock.
2025-02-18 23:32:03 +00:00
Patrick Robertson
3c543a3a6a
Various fixes for issues with new architecture ( #208 )
...
* Add formatters to the TOC - fixes #204
* Add 'steps' settings to the example YAML in the docs. Fixes #206
* Improved docs on authentication architecture
* Fix setting modules on the command line - they now override any module settings in the orchestration as opposed to appending
* Fix tests for gsheet-feeder: add a test service_account.json (note: not real keys in there)
* Rename the command line entrypoint to _command_line_run
Also: make it clear that code implementation should not call this
Make sure the command line entry returns (we don't want a generator)
* Fix unit tests to use now code-entry points
* Version bump
* Move iterating of generator up to __main__
* Breakpoint
* two minor fixes
* Fix unit tests + add new '__main__' entry point implementation test
* Skip youtube tests if running on CI. Should still run them locally
* Fix full implementation run on GH actions
* Fix skipif test for GH Actions CI
* Add skipifs for truth - it blocks GH:
---------
Co-authored-by: msramalho <19508417+msramalho@users.noreply.github.com >
2025-02-18 19:10:09 +00:00
Miguel Sozinho Ramalho
9297697ef5
makes orchestrator.run return the results to allow for code integration ( #196 )
2025-02-15 12:41:26 +00:00
Miguel Sozinho Ramalho
5614af3f63
removes fixed oscrypto dependency, it blocked pypi publishing ( #195 )
...
* disables tests on ubuntu-latest
* drops fixed oscrypto version for git commit
* version bump
2025-02-14 10:51:56 +00:00
Patrick Robertson
40a95f7348
Add likify deps
2025-02-11 18:40:44 +00:00
Patrick Robertson
dbc564e18b
Add sphinx_book_theme theme to poetry
2025-02-10 22:58:52 +00:00
Patrick Robertson
91ca325fd5
Update yt-dlp to latest version + remove code no longer needed from bluesky dropin
2025-02-04 17:46:46 +01:00
Patrick Robertson
b7d9145f6c
Further tidyups + refactoring for new structure
...
* Add implementation tests for orchestrator + logging tests
* Standardise method/class vars for extractors to see if they are suitable
* Fix bugs with removing default loguru logger (allows further customisation)
* Fix bug loading required fields from file
*
2025-01-30 13:21:10 +01:00
Patrick Robertson
18ff36ce15
Add ruamel to dependencies (replaces pyyaml)
2025-01-29 19:37:41 +01:00
Patrick Robertson
f1e9ab6751
Merge branch 'main' into load_modules
2025-01-24 15:23:15 +01:00
Patrick Robertson
e8138eac1c
Add ubuntu-latest to the matrix of test runners ( #181 )
...
* Don't clutter logs with info about generic dropin
* Add ubuntu-latest to unit tests
This is currently failing due to an issue with oscrypto and newer openssl https://github.com/wbond/oscrypto/issues/78#issuecomment-1756317472
* fix oscrypto version for ubuntu 24 compatibility (boto3 too see #180 )
---------
Co-authored-by: msramalho <19508417+msramalho@users.noreply.github.com >
2025-01-24 14:03:55 +00:00
Patrick Robertson
54995ad6ab
Further tweaks based on __manifest__.py files
...
Loading configs now works
2025-01-22 13:11:43 +01:00
Patrick Robertson
6388983815
Merge branch 'main' into youtubedlp-rewrite
2025-01-21 16:43:14 +01:00
Patrick Robertson
17c1c9c360
Fix up core unit tests when a twitter api key isn't provided
2025-01-17 12:02:38 +01:00
Patrick Robertson
394bcd8d47
Further refactoring of youtubedl_archiver->base_archiver
...
* Keep twitter_api_archiver
* Remove unit tests for obsolete archivers
* Guess filename of media using the 'Content-Type' header
* Add mechanism to run 'expensive' tests last (see conftest.py) and also flag expensive tests to fail straight off (pytest.mark.incremental)
2025-01-17 11:56:08 +01:00
erinhmclark
d3eec5d90f
Basic docs structure for RTD
2025-01-15 21:45:29 +00:00
Patrick Robertson
3ff7a9444d
Update yt-dlp to latest version (2025.1.12) to add bsky support
2025-01-15 17:58:07 +01:00
Patrick Robertson
74cf1f5f23
Merge branch 'main' into youtubedlp-rewrite
2025-01-15 17:47:23 +01:00
Patrick Robertson
c3dd19f309
Sniff filetype of downloaded media and add extension
...
Also download in chunks - fixes 2 x TODOs
2025-01-15 17:46:47 +01:00
Patrick Robertson
74a4a24a23
Remove toml - unused
...
(pytest etc. use tomli, which is instlled)
2025-01-14 18:13:27 +01:00
Patrick Robertson
20726c1116
Remove tiktok-downloader - getting info is broken
...
TODO: switch to using youtube-dlp
2025-01-14 17:40:45 +01:00
Patrick Robertson
2eb2ab9ac9
Merge branch 'main' into remove_dependencies
2025-01-14 17:39:20 +01:00
Patrick Robertson
6f10270baf
Remove unittest and switch to pytest fully
2025-01-14 16:28:39 +01:00
Patrick Robertson
080f474d49
Remove minify_html package - HTML file is no longer minified
...
Savings were 5K (~15KB vs ~20KB) for the generated .html file, but minify_html is currently not compatible with python3.13+
2025-01-14 11:36:10 +01:00
Patrick Robertson
6329b72ee8
Remove argparse from dependency list
...
Argparse is installed by default on python>=3.2, we only support python3.10+
Ref: https://pypi.org/project/argparse/#description
2025-01-14 10:50:47 +01:00
Patrick Robertson
ab2eb3c7f5
Add dev dependencies to poetry
2025-01-13 20:42:08 +01:00
erinhmclark
84ee1b422f
Update and restrict versions of Poetry and Python.
2025-01-13 17:42:51 +00:00
erinhmclark
d80b4b7557
Remove snscrape and Python 3.12 restriction.
2025-01-12 12:15:56 +00:00
erinhmclark
08e83eb94e
Update pyproject.toml configuration for Poetry version 2.0.0.
2025-01-12 12:15:56 +00:00
erinhmclark
26abd6f7ae
Added TODO comment for adding a version restriction.
2025-01-12 12:15:56 +00:00
erinhmclark
5490947657
Add packaging to Poetry.
2025-01-12 12:15:56 +00:00
erinhmclark
fd9a6c26ed
Create Poetry environment.
...
Required addition of transitive package (pyOpenSSL) and version restrictions on cryptography, boto3.
2025-01-12 12:15:56 +00:00
msramalho
e19a4c85ed
pipfile test
2023-02-07 23:21:18 +00:00
msramalho
9f0e24f218
toml
2023-02-07 23:15:46 +00:00
msramalho
cab4281504
toml
2023-02-07 23:02:45 +00:00
msramalho
ceefd87cf2
path
2023-02-07 23:00:00 +00:00
msramalho
7061ddcf62
toml
2023-02-07 22:56:43 +00:00
msramalho
753039240f
pyproject
2023-01-21 19:01:02 +00:00
