bellingcat/snscrape
1
0
Fork 0
mirror of https://github.com/bellingcat/snscrape.git synced 2026-06-13 12:58:27 +03:00
Code Issues Packages Projects Releases Wiki Activity

Fix crash on (some?) inexistent groups

Browse Source
This commit is contained in:
JustAnotherArchivist
2019-06-30 18:36:30 +00:00
parent 5f7e6936c1
commit 6d6e3fa16c
1 changed files with 5 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
snscrape/modules/facebook.py
View File

@@ -186,6 +186,11 @@ class FacebookGroupScraper(FacebookCommonScraper):
elif r.status_code != 200: elif r.status_code != 200:
logger.error('Got status code {r.status_code}') logger.error('Got status code {r.status_code}')
return return
if 'content:{pagelet_group_mall:{container_id:"' not in r.text:
logger.error('Code container ID marker not found (does the group exist?)')
return
soup = bs4.BeautifulSoup(r.text, 'lxml') soup = bs4.BeautifulSoup(r.text, 'lxml')
# Posts are inside an HTML comment in two code tags with IDs listed in JS... # Posts are inside an HTML comment in two code tags with IDs listed in JS...