John Mueller recently says that there is no need of using a crawler for building XML sitemap file. The user doesn’t have access to read the database of its CMS files still to do that is very efficient.

Also Read: Google Says Disavowing Link Leads To Discard All Associations

Building Of XML sitemap file:

John further added the user can easily build files in the backend on the local database. with the help of these users can easily be notified when there is any change in the website. Moreover, the user will have the last modification date as well.

Reasons for Not Crawling the Website:

There are 2 main reasons due to which the user should not crawl their websites:

  • The user might skip some important information.
  • It will cause great stress on the server resources used by the user.
Leave a Reply



That answer every ifs and buts of digital marketing

Stay ahead with deeper understanding of the trends and up-to-date marketing tactics; all tried & tested in the ever-growing digital space.

Looking to
Achieve your Goals?

Let us help you
get there!

We're a digital agency focused on
creative and results-driven solutions.

Start With
Submit Form Below