What is the Maximum Crawl Rate for Pages?
Questions
What is the maximum crawl rate that should be used to crawl a site?
Answer
The recommended crawl rate is 2 per requests per second.
What is the maximum crawl rate that should be used to crawl a site?
The recommended crawl rate is 2 per requests per second.