Does this store have this product?

For this task, we will give you queries by users who are looking to visit a local business. These
queries are product or category of products like: "women’s clothing", "shoes", "computers".
Some queries will also contain more specific descriptions, qualities, brands or models, etc. Your
task is to determine how well the result matches the product intent in the query.

Step 1. Consider the intent of the query. When a user enters this query on a search engine,
what are they most likely to expect? Use your own experience as a web user as well, ask
yourself “what would be the result I’d expect with my query?” Users can be imprecise with
their queries, so we must first determine the intent of the query and what they are searching
for. Ignore location and informational keywords in the query ([near me] [downtown] [Boston]
[hours] [ratings]).

Step 1a. Use the information at the bottom of the page in the tab to
determine whether this query has been correctly labeled as a Product query. A Product is a
physical thing you purchase to take with you or have delivered. This includes Specific items (Air
Jordan True Flight), larger categories (shoes), a category of store (shoe store), brand plus
product or category (Nike shoes), and brand names (Nike).

-pets and livestock are also considered products.

-Any Brand with its own stores that sell only their own product is Product intent, whether they
also sell at other stores or not.

Step 2. Now that we understand the query, you will need to research the business in the Result
to see how well the business matches the intent of the query.

You will use the and search buttons to thoroughly

research the business to see if the business matches the query product’s criteria. Sometimes
the “Primary [W]ebsite” button will have an incorrect website, or no website connected to it.
Do not log a technical error if the website does not connect to the correct business or does not
load. Instead, do a side search in another window for the result name and see if you can find
the correct website (copy and paste the name for quicker and more accurate results).
Some points to keep in mind about Query and Answer:
-Keywords in the query that describe the individual entity (hiking shoes, baby clothes, second-
hand bicycles, Ford F-150 truck) and can be verified in the business description or website are
considered for this task.
-Keywords that rank businesses now or across time (best, popular, new) are ignored because
they can change and are filtered at a later stage.
-Assume New intent. [Cars] [Honda Cars] we assume they mean new cars, and used cars are an
alternate intent. If the query is for ‘used’ specifically, [Used cars], [antique books] then results
that only sell new are No, does not have
-Seasonal or rotating stock: sometimes queries will be for products that are out of season
([snow pants] in July) so stores will not have them now. If the store is likely to carry such items
when appropriate, judge based on that assumption, e.g., Sporting goods stores or department
stores with outdoor clothing are likely to carry them with other winter gear.
-For the results, Products only available online do not count. Make sure the results do not say
“not available in stores,” “online only” or are from third-party sellers online, not actually
available at the physical stores we would send users to. Check the website for that store to see
if it has or is likely to have the queried products. A Walmart without an Auto Center is a bad
result for the query [walmart tire center].

How to Research the Query and Answer:

The search results window on the right side of the page may help you to interpret the query.
You may also click the search button in the Query box to open a new window
for more results or a better view of the search engine, especially if the answer is not plainly
evident in the search view on the page.
If you are blocked from using the hitapp search tools, try changing the Proxy settings by
choosing a proxy from the dropdown (i.e ‘Proxy 1’), clicking the ‘Blocked by Google’ checkbox,
and then clicking on the ‘Google’ button. This will open a link in a new window, not in the
window on the right.

If you are still blocked, try entering the query in a browser window of your own (sometimes a
different incognito window helps as well). The window shows results from the “ Issued from”
location. If you do your own search, it may help to enter that location so you can see similar
results. Alternatively, if the window on the right side consistently does not load, you may click
the dropdown menu and change the default browser to Bing, which may help you see search
engine results.

Remember, we do not consider location for match quality, only to give us a better idea of what
the user may be looking for.

To help you make the decision about the result, we have given you questions about the query
and the business in the answer:

Does this Query contain a specific store name or brand name?

Query Contains a:
-Specific store Name (Nike shoes (could be brand or store); Nordstrom shoes)
-Brand name (Samsung, Reebok shoes). This includes Brands that have their own store, brands
that are sold only through other stores or dealerships, queries for a brand at another named
store, and named stores with a product or other brand.
------
Other Notes:
Sub-Brands: also count as Brands, items that are only associated with one parent brand, ex.
[(Apple) iPad], [(Ford) Mustang].
Generic trademarks: Some brand names have become common enough to mean that general
type of product, for example “Jacuzzi” is a brand and also a general term for hot tub, or Kleenex
is a brand and also what people commonly call disposable facial tissues. This is called a generic
trademark and we want to capture both possible intents of the query, so we’ll treat it like a
general product category query, not a Brand. If you are unsure, the top introduction section on
the Wikipedia page may help you, but if that does not say you can treat as a regular Brand
query. Please mark queries that are generic trademarks as “No, Is product, product category,
or product line.”
Seasonal Items: Results to queries for seasonal items should be based on the type of store and
what they carry. While {Swimsuits} may not be available in December, a department store with
different types of clothing for men, women, and children will likely have swimsuits for all those
groups when they are in season, so we can rate these results by what they are likely to carry
when the season comes.
Please note: For the results, Products only available online do not count. Make sure the
results do not say “not available in stores,” “online only” or are from third-party sellers online,
not actually available at the physical stores we would send users to. Check the website for that
store to see if it has or is likely to have the queried products. For the query [walmart tire
center], a Walmart without an Auto Center is a bad result.

Your answer will be either:

Yes, has store name or brand name (see page 4)

No, is product, product category, or product line (see page 5)
See the following pages for the corresponding guideline for those answer choices

What is the relationship between the Query and the Result?

1. Store name matches query Store matches the store named in the query
• [Nike Shoes] is a brand query for which a “Nike Store” is Store name matches query
• [Nike shoes Nordstrom] is a query for the store “Nordstrom”.
• [Nike store] and result called “Footlocker” carries Nike products, but is NOT the store
that matches the query, so would not be this answer choice.

2. Authorized Dealer This category is ONLY for New vehicles. Cars, trucks, industrial vehicles,
farm equipment, campers/trailers (includes tow-behind style), ATVs, snowmobiles, etc. The
Store name may not include the brand name, but if the result is a dealer of that brand of
vehicle or camper, it qualifies for this rating

3. Different store, but offers brand

Query is for a brand that has its own stores and does not specify a store to buy it at
• [Nike shoes] and the result is a store that carries Nike shoes but is not a ‘Nike’ store is
this answer choice. Check the website to confirm that brand and type of product are
carried in that physical store.

Queries that are car brands with no other clues, and the result does not sell cars, but does sell
other items of that brand.
• [Honda] and result is a business that sells Honda Power Equipment, Honda Lawn
mowers, etc.

Meets the full interpretation of the query but only offers used products, when the user didn’t
specify used
 • [cars] and the result is a car reseller or used car dealer

4. Does not have brand / Has Brand but does not have Product specified / Is not the store
specified
The result does not have the brand or branded product in the query
▪ [Nike shoes] and result does not carry Nike products, or only carries Nike hats

If the query is for Brand + other store, the result is not the store named in the query
▪ [Nike shoes Nordstrom] and result Footlocker carries Nike but is not the right store as
Nike is the product brand, not the store in this case.

Any non-brand store that is specified if the result is a different store.

▪ [Shoes Nordstrom] result is Footlocker.

The query specifies “Used” and the result only carries new products. [Cars] could mean new or
used, but if the user has queried for used, they specifically do NOT want new.

Is the Result a store that specializes in the product in the Query?

1. Yes, store specializes

Store meets the full range of interpretations for the query.
-If the query is broad, like [shoes] there are many kinds of shoes like women’s, men’s,
children’s, formal shoes, sports shoes, boots, sandals, etc. A store that has a wide variety of
shoes that could meet most of these interpretations will be considered as specializing. This
could be a shoe store with many different kinds, or a department store with a shoe department
that has many different types of shoes.
- [Office supplies] and result “Office Max” has paper, pens, ink, printers, furniture,
computers, all the kinds of things that would supply an office.
-If the interpretation of the query is very specific, a result that has it will still be considered to
meet the full range of the query. For example [paper plates] is a category that does not usually
have a large selection, so a grocery store, a corner market, a hypermarket store like Walmart,
and a drugstore are all answers that are likely to fully satisfy a user looking for disposable paper
dishes.
2. No, but has selection
The result has some items that match the query, but the query is general enough that the result
only has a partial selection of items that would be expected in that category. This is also the
rating for words that can mean different things, like [glasses] can be spectacles or drinking
glasses.
- [Office supplies] and result is a store that only sells copiers and printers, which are
supplies that would go in an office, but does not have the full range of things one could
mean with that query.
- [Fabrics] and result sells a variety of upholstery fabrics, but upholstery is only one kind
of fabric commonly found in a fabric store.

3. No, but has product

“Has product” means the result meets either a full or partial interpretation of the query, but
the items are either used when used was not specified, or for rent, rather than for sale
You may also use this rating for results that seem likely to meet the query, but there is not
enough information to be positive. For example, if the query is for a specific hair product, and
the result is a beauty supply store that may have that, but they don’t have a website that you
can check.

4. No, does not have product

Product is not carried in stores, including when the website shows product as “Online Only” or
through third-party sellers. OR Query specifies Used/Antique/pre-owned, etc. and the result
only carries new items. OR You cannot tell but it is not likely they would carry the product, e.g
[cigar store] and result does not have a website but is a florist.

Internal - ‘Product Category’ tab, do not include in UHRS PDF GL

Does this query have Product Intent:

A product is a physical thing you purchase to take with you or to have delivered. This includes specific
items (Air Jordan True Flight), larger categories (shoes), a category of store (shoe store), Brand plus
product or category (Nike shoes), and Brand names (Nike).

Pets and livestock animals are also considered Products.

Any Brand with its own stores that sell only their own products is Product intent, whether they also sell
in other stores or not. Pay attention to the whole query, if a query has both a brand and another store
name, (Nike shoes Nordstrom) then we consider this a query for Nordstrom store and Nike products.
{Nike}- Has own stores with only their products
and sell at other stores.
{Nike shoes Nordstrom} Product/brand at Named
store
{Honda} Car brands are Products
{Frozen Pizza} bought at store to make at home
{Old Navy} sold at Old Navy stores, which only sell {Home Hardware} always do a search for a query
Old Navy brand.
{Women’s clothing store} stores that sell
products are product intent
{Used Car Sales}
{Goldendoodles for sale} Pet or livestock/ farm
animal
{Target} - Department store with own brand, but
no stores that sell ONLY Target products.
{Nordstrom} department store with no product
{Honda of Bellingham} Exact business name of
dealership
{Pizza delivery} considered cuisine as pizza is
ready to eat
that seems like a category, some like this are
actually store names.
{iPhone repair} intent is service of a product you
already have, not purchase of new product
{car detailing} Service
{Elephants} not pet or livestock/ farm animal