implemented deferred media archiving for all scrapers, and implemented tests for them. Refactored archiving methods of Instagram and Gettr scrapers to be able to use default archiving method

This commit is contained in:
Tristan Lee
2022-04-01 01:30:49 -05:00
parent 16aad4ef2c
commit 282f33eff3
26 changed files with 417 additions and 261 deletions

View File

@@ -12,10 +12,9 @@ addopts =
--html='reports/tests.html'
--self-contained-html
markers =
profile: marks tests for only extracting channel metadata (deselect with '-m
"not profile"')
media: marks tests for archiving all media attachments (deselect with '-m
"not media"')
profile: marks tests for only extracting channel metadata (deselect with '-m "not profile"')
media: marks tests for archiving all media attachments (deselect with '-m "not media"')
unarchived: marks tests for archiving all unarchived media attachments (deselect with '-m "not unarchived"')
filterwarnings =
ignore:the imp module is deprecated:DeprecationWarning
ignore:The localize method is no longer necessary, as this time zone supports the fold attribute