Google has stated that they have updated its crawl stats report so that it could manage “Additional Types of Crawls” as well. Google doesn’t give a piece of clear information on what types of additional crawls will be managed.
Recommendation:
Additional Types of Crawls
According to Google, the latest report will break down crawl request into the following types:
- File Type
- Response Type
- Purpose Type
- Googlebot Type
The crawl stats report has increased its reporting coverage for additional types of crawls. As a result, you may see a jump in the number of crawls reported for your site. This does not reflect additional crawling of your site, only improved reporting.
Earlier, Google stretched Googlebot types to help Googlebot for images, Adbot, Video, etc. As a result, many SEO specialists are guessing, this time Google will more category to “By Response”.