Search quality rater guidelines - 2022

19.1 Misspelled and Mistyped Queries

145 146 146 148 149 150 152 153 157 160 160 160 160 161 163 163 163 164 165 166

19.2 Name Queries

20.0 Non-Fully Meets Results for URL Queries

21.0 Product Queries: Importance of Browsing and Researching

22.0 Rating Visit-in-Person Intent Queries

22.1 Examples Where User Location Does (and Does Not) Matter 23.0 Rating English Language Results in Non-English Locales 23.1 Examples of English (and Non-English) Results in Non-English Locales 24.0 Rating Dictionary and Encyclopedia Results for Different Queries

Appendix: Using the Evaluation Platform

25.0 Overview

26.0 Acquiring Tasks

27.0 Rating Tasks Using the Rating Interface

28.0 Releasing Tasks

29.0 Understanding the User Location on the Task Page

30.0 Reporting Duplicate Results in Tasks

30.1 Pre-Identified Duplicates 30.2 Rater-Identified Duplicates 30.3 Reporting Duplicate Results

31.0 Simplified Needs Met Tasks

Appendix 2: Guideline Change Log

167

Copyright 2022

4

Made with FlippingBook - Online magazine maker