Search Intent Guidelines

Terms to Understand

Query – a question, especially one addressed to a search engine.

Keyword – a word or concept of significance.

Label – the answer selected for each question within the Hitapp.

Result Page – the webpage given in the hitapp to be evaluated.

Intent – Intention or goal

Purpose – the reason for which something is created.

Popularity – the state or condition of being liked, admired, or supported by many people

Scope – the extent of the area or subject matter that something deals with or to which it is relevant.

Possible – feasible, capable of being realized.

Ambiguous – open to more than one interpretation.

Task Overview

When a user issues a query on a search engine, they usually have some results in mind whether it is a
specific website or a type of information. We call this goal the user Intent. For some queries, many
people would have the same intent. For others, there may be a wide range of possible intents. Your task
is to determine how popular the intent for the given result page would be for the query.

Steps for Judging

Understand the query – Read the query. Use the Query Intent Description, Bing Results and Google
results to ensure you understand what the user is searching for. Think about what the keywords of the
query are.

Understand the Result Page – Read through the main content of the Result Page and determine the
purpose of the page. Then consider what possible intent this purpose matches.

Understanding the Questions:

1. How many people would want the result page for this query?
a. Consider what possible intent a user would have when viewing the Result Page. How
popular would that intent be?
 All users who made the query

Users with this intent

Almost All Most

About Half Few Almost None

Understanding the Labels:

1. How many people would want the result page for this query?
a. Almost All – a result so popular that nearly everyone would want it.
b. Most – A highly popular intent that the clear majority of people would want.
c. About Half – A popular intent that some people would want, but an about equal
number would not.
d. Few – A less popular intent that only a small portion of people would want.
e. Almost None – An unlikely or unrealistic intent that no one or almost no one would
want.

Labeling the Hitapp – select the label that best answer the hitapp questions.

Questions to consider:
 Does the Result Page address all of the keywords of the query?

What is the purpose of the Result Page?

Is the query too ambiguous where any Intent seems equally likely?

Examples

Query Result Page Label Explanation

Blueberry https://thebusybaker.ca/best-ever-banana-nut-muffins/ Almost No users if any would
muffins recipe None intend to get a recipe for
banana nut muffins when
searching for Blueberry
muffins recipe.

Blueberry https://www.insider.com/which-chef-has-the-best- Few Only a few people’s intent

muffins recipe blueberry-muffin-recipe would be to find out
which chef has the best
recipe. This would only be
popular with a FEW users
as it does not give the
recipes.
Blueberry https://glutenfreebaking.com/gluten-free-blueberry-muffin- About A specific type of
muffins recipe recipe/ Half blueberry muffin recipe
would be popular, but no
more popular than other
varieties. As other
varieties would be equally
popular, we consider
About Half of the users
would want this.
Blueberry https://youtu.be/BEGIb6BhH2M Most Most users would want to
muffins recipe find a recipe. A video
showing how to make
Blueberry muffins would
be very popular, though
not as popular as a page
giving a written recipe.
Blueberry https://www.allrecipes.com/recipe/6865/to-die-for- Almost Finding a recipe for
muffins recipe blueberry-muffins/ All Blueberry muffins would
be such a popular intent it
would be safe to say
Almost All people would
want this.
Can’t judge the hit? – some hits can’t be judged for reasons that are outside of your control. If that
occurs, please select the appropriate reason and submit.

• In Wrong Language – if the query or result page is in a different language from the one
marked in the title (Search Intent [EN]). English queries with English Result Pages should
always be judged normally.
• Does Not Load – If the page doesn’t load.
• Adult Content – If the page has adult content.
• Requires Login – If you cannot view the content of the page without logging in to the
site.
• Harmful Content – If you suspect the page might download something harmful to your
computer (spyware or malware).