Commit Graph

Select branches

Hide Pull Requests

add-vk-user

master

more-tg-info

telegram-media

#1

#2

#3

#4

#5

#6

#7

#8

#8

v0.1

v0.1.1

v0.1.2

v0.1.3

v0.2.0

v0.3.0

v0.3.1

v0.3.2

v0.3.3

v0.3.4

Mono Color

• cacd783b95 merged upstram changes more-tg-info Tristan Lee 2023-04-04 04:19:54 -05:00
• 3dd9c28e31 Add snake_to_camel helper JustAnotherArchivist 2023-04-03 02:35:26 +00:00
• 7186c833dd Move dict remapping helper to utils module JustAnotherArchivist 2023-04-03 02:35:05 +00:00
• 1c3a592415 Fix KeyError on broadcast cards with incomplete broadcaster user data JustAnotherArchivist 2023-04-01 22:08:20 +00:00
• 285d5874fc Deprecate cursor argument to TwitterSearchScraper JustAnotherArchivist 2023-03-20 19:19:19 +00:00
• adac052723 Treat 404 responses from Twitter as a block JustAnotherArchivist 2023-03-20 19:15:11 +00:00
• edac5f38cb Validate mode parameter on TwitterSearchScraper JustAnotherArchivist 2023-03-15 01:19:53 +00:00
• b93cf2640c Revise bug reporting instructions: add instructions and field for debug log, put less emphasis on dump files, request minimal reproducer, and reorder template JustAnotherArchivist 2023-03-15 01:14:12 +00:00
• e47fbe3d1f Bump user agent JustAnotherArchivist 2023-03-14 03:03:50 +00:00
• 99050710d7 Fix AttributeError crashes on resolving user IDs to usernames or vice-versa JustAnotherArchivist 2023-03-03 01:34:53 +00:00
• 3f7bb0516d Fix crash due to missing profile timeline on unavailable users (e.g. protected) JustAnotherArchivist 2023-03-03 01:32:07 +00:00
• 98b50ff9e9 Separate warnings for empty responses and unavailable users/communities JustAnotherArchivist 2023-03-03 01:16:49 +00:00
• fd75fff202 Fix crash on communities without a description JustAnotherArchivist 2023-03-03 00:39:08 +00:00
• c77d19da5d Fix crash on some deleted tweets in communities JustAnotherArchivist 2023-03-03 00:31:30 +00:00
• 945bfbde04 Merge pull request #743 from kelcheone/master JustAnotherArchivist 2023-03-02 21:24:07 +00:00
• 0942beedd6 fix: code style line spacing KΞVIN KΞLCHΞ 2023-03-02 19:08:53 +00:00
• 3545837637 fix: code style line spacing KΞVIN KΞLCHΞ 2023-03-02 19:05:16 +00:00
• aa8d93e07c Merge branch 'JustAnotherArchivist:master' into master KΞVIN KΞLCHΞ 2023-03-01 22:49:43 +03:00
• 7061ad2eb5 fix: code style kelche 2023-03-01 18:09:34 +03:00
• 03ef3debaf Fix behaviour on SIGPIPE/BrokenPipeError JustAnotherArchivist 2023-02-28 20:20:28 +00:00
• 42cb6d8170 Fix crash on quotedRefResult without an actual result JustAnotherArchivist 2023-02-28 20:16:55 +00:00
• ea7c6786c2 Handle TweetWithVisibilityResults on quoted tweets JustAnotherArchivist 2023-02-28 20:16:07 +00:00
• 61dbbba6b1 feat: cashtag func kelche 2023-02-27 22:39:31 +03:00
• d1592177ab feat: cashtag func kelche 2023-02-27 22:35:21 +03:00
• 21cf626803 Update list of scrapers JustAnotherArchivist 2023-02-21 22:10:33 +00:00
• f329b69ed4 Add support for scraping Twitter's user search JustAnotherArchivist 2023-02-21 22:07:40 +00:00
• f109f3fd46 Fix forgotten warning name change (cf. 7327a013) JustAnotherArchivist 2023-02-21 21:59:06 +00:00
• 7330e0a9a0 Rename private logger variable JustAnotherArchivist 2023-02-21 21:26:00 +00:00
• 4e6956e564 Remove dead code JustAnotherArchivist 2023-02-21 21:25:01 +00:00
• 4e70306f99 Deprecate Entity type JustAnotherArchivist 2023-02-21 21:24:00 +00:00
• 7327a01397 Refactor module-level deprecation code JustAnotherArchivist 2023-02-21 21:23:12 +00:00
• 880a0a7f55 Handle TweetUnavailable results JustAnotherArchivist 2023-02-21 20:16:23 +00:00
• 57b126c656 Add support for scraping Twitter Communities JustAnotherArchivist 2023-02-21 20:15:57 +00:00
• 82f64a6472 Remove dead code JustAnotherArchivist 2023-02-21 06:22:13 +00:00
• 6a6b02cb28 Handle tombstones JustAnotherArchivist 2023-02-21 04:18:12 +00:00
• 3d6cd63a00 Fix more logger typos JustAnotherArchivist 2023-02-21 04:17:40 +00:00
• 9a2f1524c2 Remove dead code JustAnotherArchivist 2023-02-21 04:03:30 +00:00
• b5694e01a2 Fix logger typo JustAnotherArchivist 2023-02-21 03:57:19 +00:00
• 280b972f22 Fix extraction of tweets behind 'offensive' replies button JustAnotherArchivist 2023-02-19 06:26:35 +00:00
• 6ba478657b Merge pull request #733 from mrunderline/fix/telegram_channel_members_count JustAnotherArchivist 2023-02-20 19:16:03 +00:00
• 71fb33af70 fix: telegram channel members count Ali Madihi 2023-02-20 22:14:34 +03:30
• c65e36a094 Bump GraphQL endpoints JustAnotherArchivist 2023-02-19 05:59:42 +00:00
• 206907612d Fix double dump on exceptions with --dump-locals JustAnotherArchivist 2023-02-19 05:12:47 +00:00
• fe5d90b748 Fix tweets behind 'Show more replies' button getting missed JustAnotherArchivist 2023-02-19 03:29:39 +00:00
• f1cb96b685 Merge pull request #724 from quentinwolf/patch-1 JustAnotherArchivist 2023-02-19 02:55:27 +00:00
• 8709282ba0 Add deprecated properties to JSON JustAnotherArchivist 2023-02-19 02:51:47 +00:00
• 0933a30e37 change fullUrl to use 'orig' instead of 'large' quentinwolf 2023-02-13 16:45:44 -07:00
• d60ce38b6a Make (most) consistency errors in unified cards non-fatal JustAnotherArchivist 2023-02-10 02:39:06 +00:00
• 23ebdd2a3c Fix YAML syntax JustAnotherArchivist 2023-02-02 21:03:52 +00:00
• 35c0c32c38 Refine bug report template JustAnotherArchivist 2023-02-02 21:02:16 +00:00
• b515a66b93 Fix crash in recursive tweet scraping JustAnotherArchivist 2023-01-19 16:18:15 +00:00
• 36e85c54c1 Log response headers for debugging JustAnotherArchivist 2023-01-16 03:48:21 +00:00
• 49270f6d3a Fix debug messages for redirects to report the correct status code and redirect location JustAnotherArchivist 2023-01-16 03:47:46 +00:00
• d0fb9ab8a9 Log TLS connection details for debugging JustAnotherArchivist 2023-01-16 02:39:05 +00:00
• 5d3f27bc2b Fix title-less BroadcastCard crash JustAnotherArchivist 2023-01-15 16:36:04 +00:00
• b7cb270b6e Fix crash on empty user objects JustAnotherArchivist 2023-01-15 12:31:28 +00:00
• 8ad26fc7d1 Switch from setup.py to pyproject.toml JustAnotherArchivist 2023-01-13 18:52:03 +00:00
• 1fb5c39168 Add Python 3.11 classifier JustAnotherArchivist 2023-01-13 10:12:39 +00:00
• d81d247a87 Port Reddit scraper to new Pushshift API JustAnotherArchivist 2023-01-13 10:07:58 +00:00
• 564a5eca77 Fix crash on unavailable users in cards JustAnotherArchivist 2023-01-13 09:12:16 +00:00
• bf0e720b5a Fix crash on empty tweet entries in timelines JustAnotherArchivist 2023-01-13 09:01:15 +00:00
• 27374285a2 Fix crash on missing source label data JustAnotherArchivist 2023-01-13 08:32:02 +00:00
• 238bdcd560 Reduce warnings about duplicate users on cards JustAnotherArchivist 2023-01-13 08:28:52 +00:00
• e846a6a4cd Fix KeyError in card user handling JustAnotherArchivist 2023-01-13 08:06:57 +00:00
• cbeb65d5c9 Fix KeyError crash on some tweets with AmplifyCards JustAnotherArchivist 2023-01-13 07:57:31 +00:00
• 3e19f8f84b Add support for image_collection_website unified cards JustAnotherArchivist 2023-01-13 07:36:53 +00:00
• 28f5a45825 Fix empty page counter not getting reset on results JustAnotherArchivist 2023-01-13 06:59:51 +00:00
• 2196bdf3e8 Extract vibe JustAnotherArchivist 2023-01-13 04:09:00 +00:00
• faf09b2f5e Extract tweet view counts JustAnotherArchivist 2023-01-13 04:00:50 +00:00
• 3e297c9a42 Update GraphQL API parameters JustAnotherArchivist 2023-01-13 04:00:31 +00:00
• a0414d92cf Extract alt text for media on Twitter JustAnotherArchivist 2023-01-13 03:13:10 +00:00
• ff5e2d61ee Update search API parameters JustAnotherArchivist 2023-01-13 03:01:48 +00:00
• 129ad3fc34 Add --max-empty-pages option to stop long (potentially infinite) empty pagination JustAnotherArchivist 2023-01-13 02:35:48 +00:00
• 7de8d734e9 Override TLS ciphers to get past Twitter's new fingerprinting JustAnotherArchivist 2023-01-13 02:25:39 +00:00
• ceb06664f0 Clarify descriptions of issue templates JustAnotherArchivist 2023-01-11 22:52:52 +00:00
• 996cf882cc Expose status code for non-200 Twitter responses JustAnotherArchivist 2023-01-11 20:00:08 +00:00
• e449d5cdbe Expose individual error messages when all request retries fail JustAnotherArchivist 2023-01-11 19:59:47 +00:00
• cbdaee6864 Merge pull request #343 from TheTechRobo/master JustAnotherArchivist 2022-12-19 23:25:17 +00:00
• a3bee057b1 Merge pull request #615 from engkimo/fix-return-twitter-place-ids JustAnotherArchivist 2022-12-19 22:57:40 +00:00
• 6f9a0e6534 Merge pull request #590 from caseyho/UnifiedCardApp_no_category JustAnotherArchivist 2022-12-19 22:55:36 +00:00
• 4ff4af13cf Add returning Twitter Place IDs engkimo 2022-12-06 11:23:01 +09:00
• e09aea70e7 Fix Twitter username length limit JustAnotherArchivist 2022-12-03 06:36:52 +00:00
• cbdfeed812 fixed edge case where members information wasnt included Tristan Lee 2022-11-30 12:59:38 -06:00
• aa325fa1a5 Handle UnifiedCardApp with no category Casey Ho 2022-11-14 17:38:03 -08:00
• 46a603053c Handle users with extensions but no label JustAnotherArchivist 2022-10-16 21:13:46 +00:00
• 59abeaf04c Make newsletter card images optional JustAnotherArchivist 2022-09-04 15:04:20 +00:00
• e13033fea0 Fix AttributeError on certain videos included from other platforms JustAnotherArchivist 2022-08-24 15:53:21 +00:00
• 9294c26ffa Make PeriscopeBroadcastCard.thumbnailUrl optional to handle tweets without a thumbnail JustAnotherArchivist 2022-08-21 01:58:41 +00:00
• d6bce5b1d6 Merge pull request #518 from hgrsd/fix/vkontakte-photo-scrape JustAnotherArchivist 2022-08-21 01:49:59 +00:00
• 2c7a85a620 Add warning on unknown page_info types JustAnotherArchivist 2022-08-21 01:40:49 +00:00
• ff18f6f771 Fix video extraction on Weibo JustAnotherArchivist 2022-08-21 01:40:31 +00:00
• da3d870e10 Drop app icons when Twitter didn't actually include them in the response JustAnotherArchivist 2022-08-13 21:17:55 +00:00
• 279d1cf4a1 fix(vkontakte): update photo detection hgrsd 2022-07-16 18:27:02 +01:00
• 40b8d9f267 Merge pull request #7 from bellingcat/more-tg-info master Tristan Lee 2022-07-05 08:29:09 -07:00
• fdc40f7411 Merge pull request #6 from bellingcat/add-vk-user Tristan Lee 2022-07-05 08:28:01 -07:00
• 82351800d6 Merge pull request #5 from JustAnotherArchivist/master Tristan Lee 2022-07-05 08:25:20 -07:00
• 73f10a4f24 fixed edge case where channel with no members fails _get_entity Tristan Lee 2022-07-05 10:23:26 -05:00
• cb429909d0 added User dataclass as argument to VKontaktePost dataclass add-vk-user Tristan Lee 2022-07-05 10:21:59 -05:00
• d72b51953f Fix missing r prefix on string with regex backslashes JustAnotherArchivist 2022-06-24 23:12:50 +00:00
• 056cd6215c incorporated requested changes from maintainer, removed modifications to VK module Tristan Lee 2022-06-23 15:47:18 -05:00