Search quality rater guidelines - 2022

Query and User Intent Result

Rating

Highly Meets Explanation

Query: [how to get from seattle to xpppzyfii] User Location: Seattle, Washington User Intent: Get directions from Seattle to another place. Note that the location in the query (<xpppzyfii=) is garbled and it is impossible to know what the user wanted. (The name was likely mistyped or mistranscribed from a voice query.) Query: [kristen wiig] User Intent: Find more information about the actress, comedian, writer, and producer.

Even though the user has to re-enter the destination, the result block recognizes that the user was asking for directions from Seattle. The user has to enter the destination manually because the name in the query (<xpppzyfii=) is so garbled that there is no good guess as to what the user meant. Therefore, this block is satisfying because it helps the user correct the request and then immediately get the desired directions. This is a fan site dedicated to Kristen Wiig. The website has comprehensive info including over 50,000 pictures and 300 video clips, interviews, articles, and more. This website Highly Meets the need of many or most users. This is a broad query. Different users may be looking for different things. This result shows multiple tables of images with the letters in the Greek alphabet. This result would be helpful for many users. Some users may wish to see additional results. This is a broad query for an actress. Different users may be looking for different things. This result shows recent news about Jennifer Aniston. The articles are timely (at the time this was written) and relatively interesting, and not just common everyday news about the actress. Many users would be satisfied with the result and some users may wish to see more results.

Query: [greek alphabet] User Intent: Find historical information about the Greek alphabet, the names of the letters in the Greek alphabet, images of the letters, etc.

Query: [jennifer aniston] User Intent: Find images, recent news, gossip, information, etc. about Jennifer Aniston.

Copyright 2022

105

Made with FlippingBook - Online magazine maker