Recently I faced a challenge of designing a web crawling and scraping system. To build context, I started my work by reading Web Scraping with Python...