Search quality rater guidelines - 2022

12.5 Queries with Multiple Meanings

76 78 78 79 80 80 81 83 84 84 85 89 89 89 92 92 98 99 99

12.6 Query Meanings Can Change Over Time

12.7 Understanding User Intent

12.7.1 Know and Know Simple Queries

12.7.2 Do Queries

12.7.3 Website Queries

12.7.4 Visit-in-Person Queries and User Location

12.7.5 Queries with Multiple User Intents

12.8 Understanding Result Blocks

12.8.1 Web Search Result Block Examples 12.8.2 Special Content Result Block Examples

Part 3: Needs Met Rating Guideline

13.0 Rating Using the Needs Met Scale

13.1 Rating Result Blocks: Block Content and Landing Pages

13.2 Fully Meets (FullyM)

13.2.1 Examples of Fully Meets (FullyM) Result Blocks

13.2.2 Examples of Queries that Cannot Have Fully Meets Results

13.3 Highly Meets (HM)

13.3.1 Examples of Highly Meets (HM) Result Blocks

13.4 Moderately Meets (MM)

109 109 111 111 114 114 123 126 126 126 126 127 127 128 128 128 129 131 131 131 133 133 133 135 143 145

13.4.1 Examples of Moderately Meets (MM) Result Blocks

13.5 Slightly Meets (SM)

13.5.1 Examples of Slightly Meets (SM) Result Blocks

13.6 Fails to Meet (FailsM)

13.6.1 Examples of Fails to Meet (FailsM) Result Blocks 14.0 The Relationship between Page Quality and Needs Met 15.0 Rating Porn, Foreign Language, and Did Not Load Results

15.1 Porn Flag

15.2 Needs Met Rating for Porn Results

15.2.1 Needs Met Rating for Clear Non-Porn Intent Queries 15.2.2 Needs Met Rating for Possible Porn Intent Queries 15.2.3 Needs Met Rating for Clear Porn Intent Queries

15.3 Reporting Illegal Images 15.4 Foreign Language Flag

15.4.1 Using the Foreign Language Flag

15.4.2 Needs Met Rating for Foreign Language Results

15.5 Did Not Load Flag

15.5.1 Using the Did Not Load Flag

15.5.2 Needs Met Rating and the Did Not Load Flag

15.6 Additional Flags in Some Rating Tasks

16.0 Rating Queries with Multiple Interpretations and Intents

16.1 Rating Queries with Both Website and Visit-in-Person Intent

17.0 Specificity of Queries and Landing Pages 18.0 Needs Met Rating and Freshness 19.0 Misspelled and Mistyped Queries and Results

Copyright 2022

3

Made with FlippingBook - Online magazine maker