The following article is our English interpretation of an post originally published on Baidu Webmaster Help pages in Chinese language. If you'd like to check out the original article, you can find it here: https://ziyuan.baidu.com/college/courseinfo?id=267&page=12Crawl frequency refers to the total number of times a search engine (specifically Baiduspider) accesses your website within a given time frame—usually measured daily.
If Baiduspider crawls a site too frequently, it can strain your server and affect site stability. To prevent this, Baiduspider automatically adjusts its crawl rate based on factors such as:
- How frequently your content is updated
- The load capacity and responsiveness of your server
When Should You Adjust the Crawl Frequency Limit?
By default, Baiduspider self-adjusts crawl frequency to match your site’s server capacity. However, if you notice that Baiduspider’s crawling is impacting your website’s performance or stability, you can manually set a maximum crawl limit per day using the appropriate tool in Baidu Search Console.
A couple of important reminders:
Be cautious when lowering the limit. If it’s set too low, it may reduce how often your content gets indexed, potentially affecting your visibility in search results.
Setting a crawl limit does not increase crawl frequency. It only sets an upper cap.