Don't have Telegram yet? Try it now!
https://rud.is/b/2017/07/28/analyzing-wait-delay-settings-in-common-crawl-robots-txt-data-with-r/
Analyzing "Crawl-Delay" Settings in Common Crawl robots.txt Data with R