26 Commits

Author SHA1 Message Date
Tristan Lee
cb30169ece fixed problems in recommendationengine class, updated README 2022-08-09 09:45:40 -05:00
Tristan Lee
b18e5591fa changed type of Comment.created from int (timestamp) to datetime.datetime 2022-04-12 23:50:07 -05:00
Tristan Lee
d45246d5d6 Merge pull request #2 from bellingcat/refactor
Refactored package structure, added capability to download all channel videos rather than first 1000
2022-04-12 23:10:40 -05:00
Tristan Lee
1627b38ae4 deleted unused base.get_Recommended function (deprecated by RecommendationEngine) 2022-04-12 23:06:42 -05:00
Tristan Lee
bcb68a17fb implemented method for retrieving ALL videos from a channel, not just the first 1000, increased robustness of make_requests wrapper, added missing unit tests 2022-04-12 22:46:51 -05:00
Tristan Lee
71eecf7c9e added recommendation engine and updated example, handled additional edge cases 2022-04-12 02:45:01 -05:00
Tristan Lee
0aac7493a4 updated examples with refactored scraper, increased speed of recommendation engine fetchibng by implementing normalized_names_to_video_info routine, that allows requesting multiple videos at a time 2022-04-11 23:28:44 -05:00
Tristan Lee
44a673f889 refactored base classes to have structure more similar to snscrape, made scraper 'get' methods return dataclasses or list of dataclasses rather than dicts 2022-04-11 10:27:12 -05:00
Tristan Lee
3fd841f76a added general case for handling additional media file types 2022-04-06 10:36:18 -05:00
Tristan Lee
2383359a6d handled case where video is a single image 2022-04-02 20:56:45 -05:00
Tristan Lee
00a5123a37 handled quoted characters in URL 2022-03-29 10:34:56 -05:00
Tristan Lee
6dc8710211 allowed OdyseeChannel to re-use a specified auth_token 2022-03-29 09:55:18 -05:00
Tristan Lee
c85dea215a added capability to generate auth_token 2022-03-08 10:07:42 -06:00
Tristan Lee
8506fd4377 added empty __init__.py file so that coverage is correctly computed 2022-03-02 09:49:08 -06:00
Tristan Lee
8dc9a9b28e added unit tests and made keyword arguments more consistent 2022-03-02 09:44:17 -06:00
Tristan Lee
00799059b3 implemented retry wrapper for all requests, to increase robustness 2022-03-01 16:56:50 -06:00
Tristan Lee
18b89f19ec made info dict more consistent between video and comment objects 2022-02-28 09:00:41 -06:00
Tristan Lee
2617077654 standardized some fields in info attributes, converted get_all_videos and get_all_comments to return generators 2022-02-28 08:37:24 -06:00
Tristan Lee
1151c28943 added distribution/packaging rules to gitignore 2022-02-25 20:36:33 -06:00
Tristan Lee
72ea0a63de added method to get streaming URL for a given video 2022-02-25 19:35:31 -06:00
Tristan Lee
16140c117c accounted for more video edge cases 2022-02-25 17:49:12 -06:00
Tristan Lee
53f45967b3 added capabilities for handling edge cases for video inputs 2022-02-17 22:58:07 -06:00
Tristan Lee
a6d2527bc7 refactored code to avoid circular imports, isolated all requests to api.py module 2022-02-17 12:45:40 -06:00
Tristan Lee
c4b6d023c5 added method to get subscriber count for a channel 2022-02-17 11:49:04 -06:00
Tristan Lee
1324983b49 converted script into Python package 2022-02-11 14:53:36 -06:00
Tristan Lee
80264bbe13 initial commit: got basic functionality working 2022-02-10 21:57:17 -06:00