What is robots.txt file? Robots.txt is a text file that must be place into the root directory of your website so that search engine spiders may easily find it. In a very short answer for what is robots.txt file?