This repo is a clone of an individual project part of Trybe junior web developer course.
https://www.betrybe.com/ (in Portuguese)
The block enclosed by this project covers Python and data scraping. Tech News is a simple app that fetches news from a Brazilian tech website (TechMundo) and scrapes titles, urls and first paragraphs of its latest news. 🤖
The project's filenames and architecture are defined by the project and must be unchanged to pass the course tests.
Original requirements and instructions (in Portuguese) for the project are here.
Requisites sum-up:
- Create functions step-by-step to:
- fetch data
- scrape and store contents using MongoDB
- Develop features to:
- search fetched news by title, date, category and news source
- Analyze stored news to bring the top 5 most popular news and the top 5 categories
- Create a script to run the app from the terminal
Clone the repo or download the zip.
Be sure to have Python installed in your system.
Go to the project folder, start a virtual environment, and run phyton's default command to install.
Example (in Ubuntu):
python3 -m venv .venv && source .venv/bin/activate
python3 -m pip install -r dev-requirements.txt
Sometimes one might stumble upon an error related to Python Wheel lib when running the
pip install ...
command above.
Runpip install wheel
in project folder and run thepip install...
command again.
To run the app:
tech-news-analyzer
To run tests (within project folder):
python3 -m pytest