Galen Reich
|
3f4fd2606b
|
Bump version
|
2024-03-08 14:50:07 +00:00 |
|
Galen Reich
|
d2fb0cc484
|
change video limit to avoid error
|
2024-03-08 14:44:55 +00:00 |
|
Tristan Lee
|
6369e9579a
|
used updated Playwright error module in import
|
2023-12-08 05:13:03 -06:00 |
|
Tristan Lee
|
efa3a47984
|
changed publishing workflow file to hopefully avoid making a new PyPi package every push to main, and incremented version patch number
|
2023-09-21 06:14:59 -05:00 |
|
Tristan Lee
|
c7f2db1f9d
|
no way to robustly set Windows files to readonly, so removed those tests
|
2023-09-21 05:51:28 -05:00 |
|
Tristan Lee
|
89d89521fa
|
added headed argument to more robustly handle issues with scrapers headless mode
|
2023-09-19 16:30:13 -05:00 |
|
Tristan Lee
|
fee300d4d7
|
reorganized output directory parsing tests
|
2023-09-19 00:45:56 -05:00 |
|
Tristan Lee
|
8e10c93e31
|
made the process_output_dir function more reliable on Windows
|
2023-09-15 02:43:30 -05:00 |
|
Tristan Lee
|
92ae29c722
|
updated version
|
2023-09-12 11:26:07 -05:00 |
|
Tristan Lee
|
b916512bde
|
removed auth module and authorization, since msToken isnt actually required to run scraper
|
2023-09-11 21:43:33 -05:00 |
|
Tristan Lee
|
92861e0e5d
|
configured verbosity argument with logging level
|
2023-09-11 21:29:37 -05:00 |
|
Tristan Lee
|
6fa1e5026c
|
made downloading more robust against transient and permanent errors, fixed issue where media file URLs weren't being updated after scraping
|
2023-09-09 00:42:56 -05:00 |
|
Tristan Lee
|
1f4b956ce9
|
made scraping more robust against transient playwright exceptions, set order of hashtags to scrape based on file modified time
|
2023-09-07 11:18:22 -05:00 |
|
Tristan Lee
|
91a8aaef38
|
added video link to msToken input, improved handling of output directories without write permission (and added relevant unit test), removed unused requirements.txt things
|
2023-09-06 19:51:16 -05:00 |
|
Tristan Lee
|
10821e30f2
|
preparing for publishing (removed pipenv commands from workflow, added Contributing section on README, added functionality to pin dependency versions with requirements.txt)
|
2023-09-06 09:51:31 -05:00 |
|
Tristan Lee
|
8c32a3cf16
|
updated README, made yt-dlp downloading more robust against errors, changed name of videos folder to media (since images and audio files are also downloaded now)
|
2023-09-04 13:51:28 -05:00 |
|
Tristan Lee
|
5ae9624968
|
added tests, changed __main__ to cli
|
2023-09-04 13:26:38 -05:00 |
|
Tristan Lee
|
0f8e865bf3
|
added type hints for auth, incorporated auth into base module
|
2023-09-04 10:40:30 -05:00 |
|
Tristan Lee
|
cf575e6cf6
|
updated README and added authorization
|
2023-09-01 18:33:32 -05:00 |
|
Tristan Lee
|
a7bd023c21
|
simplified downloading logic (methods for keeping track of files less necessary since scraping can be done in Python), added functionality to use yt-dlp to download videos, added functionality to download TikTok image galleries
|
2023-09-01 17:05:13 -05:00 |
|
msramalho
|
7b63b9f349
|
Bump version to v1.0.4 for release
|
2023-03-13 10:08:42 +00:00 |
|
msramalho
|
e1ac3b5057
|
fixing not founds
|
2023-03-13 10:08:35 +00:00 |
|
msramalho
|
f962878354
|
Bump version to v1.0.3 for release
|
2023-03-13 09:54:14 +00:00 |
|
msramalho
|
c4aa5a6cc5
|
Bump version to v1.0.2 for release
|
2023-02-13 16:55:27 +00:00 |
|
msramalho
|
2968ada6c8
|
Bump version to v1.0.1 for release
|
2023-02-13 16:52:23 +00:00 |
|
msramalho
|
4f81673f04
|
Bump version to v1.0.0 for release
|
2023-02-13 16:49:54 +00:00 |
|
msramalho
|
980a27ff96
|
pypi fixes
|
2023-02-13 16:48:26 +00:00 |
|
Richard Mwewa
|
83fe050c15
|
Update run_downloader.py
|
2023-01-19 03:41:10 +02:00 |
|
Richard Mwewa
|
f8c12a8d68
|
Update hashtag_frequencies.py
|
2023-01-19 03:40:37 +02:00 |
|
Richard Mwewa
|
fb4755244f
|
Update main.py
|
2023-01-19 03:32:04 +02:00 |
|
Richard Mwewa
|
9dd22c90c7
|
Create main.py
|
2023-01-19 03:17:11 +02:00 |
|
Richard Mwewa
|
5f4eb9f2c8
|
Refactored for PyPI
|
2023-01-19 03:15:28 +02:00 |
|
Richard Mwewa
|
1409c50034
|
Refactored for PyPI
|
2023-01-19 03:13:20 +02:00 |
|
X
|
41007a8fa6
|
changed filehandler to debug level to capture logged data
|
2022-05-06 12:20:00 +02:00 |
|
X
|
280303f461
|
changed filehandler level to INFO and changed Logger to files
|
2022-05-06 11:54:00 +02:00 |
|
Tristan Lee
|
e0f55145e1
|
fixed typo in error message
|
2022-05-06 03:39:33 -05:00 |
|
Tristan Lee
|
21b404ff57
|
renamed source directory
|
2022-05-06 03:13:40 -05:00 |
|