What is the Maximum Crawl Rate for Pages?
Questions
What is the maximum crawl rate that should be used to crawl a site?
Answer
The recommended crawl rate is 2 per requests per second.
More information
| Measuring and monitoring your page performance |
What is the maximum crawl rate that should be used to crawl a site?
The recommended crawl rate is 2 per requests per second.
| Measuring and monitoring your page performance |