Robots.txt: What Is Robots.txt?

Robots.txt is a text file in a website’s root directory that is used to control which pages are indexed by search engine robots.