Crawl frequency refers to how often a website is crawled by search engine spiders. The more frequently a particular website is updated, the more frequently it will be crawled. Other factors that affect crawl frequency include domain authority [1] and number of URL parameters.