https://rayamarketing.com/blog/Application-Role-Robot-Txt-File