Search quality rater guidelines - 2022

Query and User Intent Result

Rating

Fails to Meet Explanation

Query: [stony child development center west point phone number] User Location : West Point, New York User Intent: Find the telephone number for the Stony Child Development Center in West Point, New York.

The answer in this block provides the phone number for the West Point Club, not the Stony Child Development Center located in West Point, New York. This result Fails to Meet the user intent.

The answer provided in this result block is factually inaccurate. Stairs have been a common architectural feature of buildings, pathways, outdoor structures, etc. since long before 1948, and they were not invented by a person named Werner Bösendörfer.

Query: [who invented stairs] User Intent: Find out about the origin of stairs.

Query: [batman] User Location: Anaheim, California User Intent: Find information about the fictional superhero that appears in American comic books, movies, and television shows. Query: [obama] User Location: Austin, Texas User Intent: Find information about Barack Obama.

It is extremely unlikely (potentially a no-chance

interpretation) that this query is looking for information on a city in Turkey called Batman, given that the user is located in the United States. No or almost no users would be satisfied with this result.

It is extremely unlikely (potentially a no-chance

interpretation) that this query is looking for information on a city in Japan called Obama, given that the user is located in the United States. No or almost no users would be satisfied with this result.

Copyright 2022

117

Made with FlippingBook - Online magazine maker