Geranium
e3bdc02a7c
Reddit: deprecate 'created' property for 'date'
...
This fixes a crash when using --since with the Reddit scraper,
as the CLI code expects items to have a date property.
2022-05-23 23:31:44 +01:00
JustAnotherArchivist
8702a9c7e2
Add Reddit submission scraper
...
Closes #312
2022-02-07 04:43:54 +00:00
JustAnotherArchivist
8ac1fd3ea8
Refactor Pushshift code to separate the general things from the search
2022-02-07 04:43:19 +00:00
JustAnotherArchivist
560c78c5cf
Make all optional scraper arguments keyword-only and fix Mastodon argument style to conform with the other scrapers
...
Cf. #376
2022-01-30 00:21:18 +00:00
JustAnotherArchivist
107c3c71c2
Remove unnecessary f-strings
...
Cf. #370
2022-01-28 21:22:13 +00:00
JustAnotherArchivist
deb2659dd6
Prefix CLI-related methods with an underscore
...
Closes #355
2022-01-12 21:07:10 +00:00
JustAnotherArchivist
267b7d0e32
Rename CLI classmethods
2022-01-05 02:27:09 +00:00
JustAnotherArchivist
f189ab4241
Prefix all private API names with an underscore
...
Cf. #328
2022-01-03 17:51:23 +00:00
JustAnotherArchivist
a37ea528d3
Refactor Reddit scrapers again to merge RedditPushshiftScraper and RedditScraper
...
Cf. #328
2022-01-03 17:48:35 +00:00
JustAnotherArchivist
eee06d8593
Refactor Reddit scrapers into a more reasonable code structure
...
Cf. #328
2021-12-24 04:58:32 +00:00
JustAnotherArchivist
a6b6f3faaa
Throw an error on empty arguments
...
Fixes #290
2021-10-10 17:43:27 +00:00
JustAnotherArchivist
5e829e2541
Refactor class instantiation to remove the need to repeat 'retries' everywhere
2021-09-30 09:58:10 +00:00
JustAnotherArchivist
bd53e729a0
Replace named tuples with dataclasses and move JSON conversion logic to the base classes
...
Named tuples were never really adequate for this since the order aspect of them doesn't make sense.
Further, named tuples don't support multiple inheritance. This meant that the objects returned by get_items() were not actually Items, for example. Since Python 3.9, such named tuples cannot be created anymore.
Fixes #111
2020-10-15 23:44:28 +00:00
JustAnotherArchivist
d8e7f96d4d
Add support for Reddit
...
Closes #15
2020-08-31 03:38:20 +00:00
