Google’s John Mueller Says on Twitter that the URL parameter tool is not a replacement for robot.txt file for blocking content so there is no use of using it. John then was asked, ” How reliable is it?” when setting up “crawl no URLs” of a specific type of URL pattern. John Replied ” It is not a replacement for robots.txt- if you want to be sure that something is not crawled, then you should block it properly.”

Here Are The Tweets : 

Mueller Tweets
Image Source: Search Engine Roundtable

Recommendation: Google Tests Displaying Web Pages In Youtube Search Results

It is to note that last year John Mueller said to not make use of robots.txt to block indexing of URLs with parameters. So one must keep in mind this as well.

 

Leave a Reply

WE ARE TECHNIANS

Latest Articles & video

Good quality, informative articles about the industry

Looking to
Achieve your Goals?

Let us help you
get there!

We're a digital agency focused on
creative and results-driven solutions.

Start With
Submit Form Below