This repository provides tools for scraping data from Reddit. The scraped results are saved into a local SQLite database named reddit_data.db.
- Python Version: Ensure you have Python version 3.7 or higher installed on your machine. You can verify this with the command
python --version. - Git: Ensure you have Git installed. This is required to clone the repository.
-
Clone the Repository:
git clone git@github.com:gitphantomman/reddit_scraping_for_miner.git
-
Navigate to the Directory:
cd path/reddit_scraping_for_miner -
Install Dependencies:
pip install -r requirements.txt
-
Start the scraping process with:
python scrap.py
-
Upon completion, the scraped results will be saved into an SQLite database file named
reddit_data.db. -
To view the results, use a database management tool such as
dbeaver-ce.
