https://developebiz.com/design-a-web-crawler/
Design a Web Crawler for Efficient Web Scraping