Disclaimer:

These codes are provided for educational purpose only. It is illegal to scrap webpages which are disallowed to
do so. Please, Read robots.txt file before web scraping. robots.txt can be found at website_link/robots.txt.
Example: https://www.linkedin.com/robots.txt