John Mueller recently says that there is no need of using a crawler for building XML sitemap file. The user doesn’t have access to read the database of its CMS files still to do that is very efficient.

Also Read: Google Says Disavowing Link Leads To Discard All Associations

Building Of XML sitemap file:

John further added the user can easily build files in the backend on the local database. with the help of these users can easily be notified when there is any change in the website. Moreover, the user will have the last modification date as well.

Reasons for Not Crawling the Website:

There are 2 main reasons due to which the user should not crawl their websites:

• The user might skip some important information.
• It will cause great stress on the server resources used by the user.