Danny Sullivan, Google’s Public Liaison, explained the detailed information about the search quality raters and whether they are considered in the ranking algorithm or not. Every year Google’s search algorithm is changed thousand times, in a way that is always beneficial for searchers globally.
“We invite people to give us feedback on different iterations of our projects and we do field research to understand how people in different communities access information online.”
Google’s only goal is to make information accessible to everyone globally and helpful for all of them with a commitment to serve all while chasing the goal.
Search Rater Guidelines
Google has made rater guidelines accessible to all, it describes how the algorithms work. The guideline crosses 160 pages.
“… we like to say that Search is designed to return relevant results from the most reliable sources available.”
More than 10,000 people around the globe come under Google’s search quality raters. They provide judgment on signals like relevance and trustworthiness. They provide views on how people will experience search results. The rating depends on Google Guidelines and the raters read the Google guidelines and are tested before they provide feedback.
How Rater Works
Google makes a group of raters and provides them with a set of queries with two versions of the result pages. One set contains the current version of Google and another set has the upcoming improved search results.
Assessment is based on the rater guidelines against the queries. Raters run research on the sources to make an assessment on things like expertise, authoritativeness, and trustworthiness also referred to as “E-A-T”.
Once everything is done they provide quality feedback with page rating.
“It’s important to note that this rating does not directly impact how this page or site ranks in Search. Nobody is deciding that any given source is “authoritative” or “trustworthy.” In particular, pages are not assigned ratings as a way to determine how well to rank them.”