bellingcat/reddit-post-scraping-tool
1
0
Fork 0
mirror of https://github.com/bellingcat/reddit-post-scraping-tool.git synced 2026-06-13 05:58:29 +03:00
Code Issues Packages Projects Releases Wiki Activity

Added setup project for easy installation. Scraping more than 100 posts. Fully Async. Major code improvements and optimisations

Browse Source
This commit is contained in:
rly0nheart
2023-12-03 18:37:13 +00:00
parent 6611cc2023
commit c25d3942ec
1 changed files with 23 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files

37
RPST GUI/RPST/README.md
View File

@@ -1,43 +1,52 @@
![reddit](https://github.com/bellingcat/reddit-post-scraping-tool/assets/74001397/558d31b8-575d-4ab4-a4cf-ec5c41105d12) ![rpst](https://github.com/bellingcat/reddit-post-scraping-tool/assets/74001397/b9ec50b2-d2cb-419f-b8f0-d170b0630875)
## Note
> Use [Knew Karma](https://github.com/bellingcat/knewkarma) for more advanced and improved features.
# RPST (Reddit Post Scraping Tool) # RPST (Reddit Post Scraping Tool)
Retrieve **Reddit** posts that contain the specified keyword from a specified subreddit.
Retrieve **Reddit** posts that contain the specified **keyword** from a specified **subreddit**.
[![Upload Python Package](https://github.com/bellingcat/reddit-post-scraping-tool/actions/workflows/python-publish.yml/badge.svg)](https://github.com/rly0nheart/reddit-post-scraping-tool/actions/workflows/python-publish.yml) [![CodeQL](https://github.com/bellingcat/reddit-post-scraping-tool/actions/workflows/codeql.yml/badge.svg)](https://github.com/rly0nheart/reddit-post-scraping-tool/actions/workflows/codeql.yml) ![.Net](https://img.shields.io/badge/.NET-5C2D91?style=flat&logo=.net&logoColor=white) ![Python](https://img.shields.io/badge/python-3670A0?style=flat&logo=python&logoColor=ffdd54) [![Upload Python Package](https://github.com/bellingcat/reddit-post-scraping-tool/actions/workflows/python-publish.yml/badge.svg)](https://github.com/rly0nheart/reddit-post-scraping-tool/actions/workflows/python-publish.yml) [![CodeQL](https://github.com/bellingcat/reddit-post-scraping-tool/actions/workflows/codeql.yml/badge.svg)](https://github.com/rly0nheart/reddit-post-scraping-tool/actions/workflows/codeql.yml) ![.Net](https://img.shields.io/badge/.NET-5C2D91?style=flat&logo=.net&logoColor=white) ![Python](https://img.shields.io/badge/python-3670A0?style=flat&logo=python&logoColor=ffdd54)
# ✅ Features # ✅ Features
## *GUI* ## *GUI*
- [x] Dark mode (*Right-click*).
- [x] Saves results to a JSON file (*Right-click*). - [x] Dark mode (*Right-click>Settings>Dark Mode*).
- [x] Saves results to a JSON/CSV file (*Right-click>Settings>Save posts>to JSON/to CSV*).
- [x] Logs errors to a file. - [x] Logs errors to a file.
- [x] In-App feature to check for Updates. - [x] In-App feature to check for Updates.
## *CLI* ## *CLI*
- [x] Saves results to JSON (*specifiy* `--json`). - [x] Saves results to JSON (*specifiy* `--json`).
- [x] Saves results to CSV (*specify* `--csv`). - [x] Saves results to CSV (*specify* `--csv`).
- [x] Automatically checks for new updates, and notifies user if updates were found. - [x] Automatically checks for new updates, and notifies user if updates were found.
# 📃 TODO # 📃 TODO
## *GUI* ## *GUI*
- [ ] Make it installable with a setup.exe/setup.msi file. - [ ] Make it installable with a setup.exe/setup.msi file.
- [x] Add manual dark mode option, that will be persistent in all sessions.
- [x] Make settings persistent in all sessions.
- [x] Make it save results to a CSV file.
# 🖥️ Tested environments # 🖥️ Tested environments
## *GUI* ## *GUI*
- [x] Microsoft Windows 11 - [x] Microsoft Windows 11
## *CLI* ## *CLI*
- [x] Android Termux - [x] Android Termux
- [x] Microsoft Windows 11 - [x] Microsoft Windows 11
- [x] Ubuntu 22.04 - latest versions - [x] Ubuntu 22.04 - latest versions
# 📖 Wiki # 📖 Documentation
[Refer to the Wiki](https://github.com/bellingcat/reddit-post-scraping-tool/wiki) for installation instructions, in addition to all other documentation.
[Refer to the Wiki](https://github.com/bellingcat/reddit-post-scraping-tool/wiki) for installation instructions, in
addition to all other documentation.
# 🖼️ Screenshots
You can view a collection of screenshots for both the *CLI* and *GUI* [here](https://github.com/bellingcat/reddit-post-scraping-tool/tree/master/images)
*** ***
<a href="https://www.buymeacoffee.com/_rly0nheart"><img src="https://img.buymeacoffee.com/button-api/?text=Buy me a coffee&emoji=&slug=_rly0nheart&button_colour=40DCA5&font_colour=ffffff&font_family=Comic&outline_colour=000000&coffee_colour=FFDD00" /></a> [![me](https://github.com/bellingcat/knewkarma/assets/74001397/efd19c7e-9840-4969-b33c-04087e73e4da)](https://about.me/rly0nheart)
![me](https://github.com/bellingcat/reddit-post-scraping-tool/assets/74001397/21e0bb33-7a84-45d6-92ba-00e40891ba31)