project_crawler

Python crawler with different spiders

make sure you have installed Python
download Pip and run it
use Pip to install Scrapy

/* Use this command to start scraping */

scrapy crawl -nameOfSpider-

It automatically writes the crawl to a JSON file