Skip to content

Trybe course - Block 35: Intro to Python & Data scraping - project Tech news

Notifications You must be signed in to change notification settings

cyranodev/trybe-proj-tech-news

Repository files navigation

This repo is a clone of an individual project part of Trybe junior web developer course.

https://www.betrybe.com/ (in Portuguese)

Tech News

!project status
!python !black !flake8 !pytest

Requisites

The block enclosed by this project covers Python and data scraping. Tech News is a simple app that fetches news from a Brazilian tech website (TechMundo) and scrapes titles, urls and first paragraphs of its latest news. 🤖

The project's filenames and architecture are defined by the project and must be unchanged to pass the course tests.

Original requirements and instructions (in Portuguese) for the project are here.

Requisites sum-up:

  • Create functions step-by-step to:
    • fetch data
    • scrape and store contents using MongoDB
  • Develop features to:
    • search fetched news by title, date, category and news source
    • Analyze stored news to bring the top 5 most popular news and the top 5 categories
  • Create a script to run the app from the terminal

Instructions

Clone the repo or download the zip.

Be sure to have Python installed in your system.

Go to the project folder, start a virtual environment, and run phyton's default command to install.
Example (in Ubuntu):

python3 -m venv .venv && source .venv/bin/activate
python3 -m pip install -r dev-requirements.txt

Sometimes one might stumble upon an error related to Python Wheel lib when running the pip install ... command above.
Run pip install wheel in project folder and run the pip install... command again.

To run the app:

tech-news-analyzer

To run tests (within project folder):

python3 -m pytest

Important: mongoDB services must be installed and active in your machine.

About

Trybe course - Block 35: Intro to Python & Data scraping - project Tech news

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages