http://www.kitploit.com/2014/03/parsero-robotstxt-audit-tool.html