Robots.txt is a file that exists on the root Listing of each Web page and may be used to instruct serps on which directories/documents of the website they could crawl and incorporate in their index. Based on Rubright, a better solution is hand-finding your potential clients to make sure that https://news.rafeeg.ae