bellingcat/snscrape
1
0
Fork 0
mirror of https://github.com/bellingcat/snscrape.git synced 2026-06-08 02:28:29 +03:00
Code Issues Packages Projects Releases Wiki Activity

Fix pagination on profile pages

Browse Source
This commit is contained in:
JustAnotherArchivist
2020-09-01 03:23:45 +00:00
parent d9572ec450
commit 072519f539
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
snscrape/modules/twitter.py
View File

@@ -193,7 +193,7 @@ class TwitterAPIScraper(TwitterCommonScraper):
else:
continue
for entry in entries:
if entry['entryId'] == 'sq-cursor-bottom':
if entry['entryId'] == 'sq-cursor-bottom' or entry['entryId'].startswith('cursor-bottom-'):
newCursor = entry['content']['operation']['cursor']['value']
if not newCursor or newCursor == cursor:
# End of pagination