Crawler: What Is a Web Crawler? | Wordstream

You are here

Crawler: What Is a Web Crawler?

A crawler, or web crawler, is a computer program that "reads" or indexes data on the World Wide Web. Search engines use crawlers to provide up-to-date search results. Also known as a spider.