You are on page 1of 178

Maps Search Evaluation Guidelines

Version 2.0.1
March, 27 th , 2017

1 Introduction ............................................................................................................................................ 4
1.1 The Rating Tool ............................................................................................................................................................................................... 4
1.2 Rating Scale ....................................................................................................................................................................................................... 8
1.3 Comments .......................................................................................................................................................................................................... 9
1.3.1 Comments – Best Practices ................................................................................................................................................................... 10
1.4 Rating Workflow .......................................................................................................................................................................................... 11
1.5 Result Level Issues ...................................................................................................................................................................................... 11
1.5.1 Result name/Title is in unexpected language or script ........................................................................................................... 12
1.5.2 Business/POI Name .................................................................................................................................................................................. 13
1.5.3 Title of Address Type Results ............................................................................................................................................................... 16
1.5.4 Classification in unexpected language or script .......................................................................................................................... 16
1.5.5 Business/POI is closed or does not exist .......................................................................................................................................... 17
2 Understanding User Intent ..................................................................................................................... 18
2.1 Query ................................................................................................................................................................................................................ 18
2.1.1 Research Expectation .............................................................................................................................................................................. 20
2.2 Result Types .................................................................................................................................................................................................. 20
2.3 User Location ................................................................................................................................................................................................ 21
2.4 User Viewport ............................................................................................................................................................................................... 22
2.5 Location Intent ............................................................................................................................................................................................. 25
2.6 Implicit Location .......................................................................................................................................................................................... 25
2.7 Explicit Location .......................................................................................................................................................................................... 26
3 Relevance .............................................................................................................................................. 27
3.1 Primary and secondary intent ................................................................................................................................................................. 28
3.1.1 Result satisfies user intent .................................................................................................................................................................... 28
3.1.2 Is there a navigational result? ............................................................................................................................................................ 31
3.2 Prominence .................................................................................................................................................................................................... 32
3.3 Distance ........................................................................................................................................................................................................... 34
3.4 Promoting and Demoting ......................................................................................................................................................................... 35
3.5 Lots of Possible Results ............................................................................................................................................................................ 36
3.6 Few Possible Results .................................................................................................................................................................................. 37
3.7 Few Possible Results and Far Distance .............................................................................................................................................. 38
3.8 Rural Areas ..................................................................................................................................................................................................... 39
3.9 Location - User Intent Deviation ........................................................................................................................................................... 40
3.10 Location – User Intent Deviation for Chain Business ................................................................................................................ 41
3.11 Address does not Exist (Rate real world) ...................................................................................................................................... 42
3.12 Associated Entities ................................................................................................................................................................................... 42

1

3.13 City vs. municipality ................................................................................................................................................................................ 46
3.14 Unexpected results ................................................................................................................................................................................... 47
3.15 Multiple transit POIs with the same name .................................................................................................................................... 49
3.16 POIs and transit intent ........................................................................................................................................................................... 49
3.17 Category query vs. navigational query ............................................................................................................................................ 50
3.17.1 Transit queries ........................................................................................................................................................................................ 51
3.17.2 Stops vs. Stations .................................................................................................................................................................................... 53
3.18 Chain queries and location modifier ................................................................................................................................................ 54
3.19 Relevance – Service level mismatch ................................................................................................................................................. 55
4 Name Accuracy ...................................................................................................................................... 56
4.1 Name not applicable (n/a) ...................................................................................................................................................................... 56
4.2 Correct .............................................................................................................................................................................................................. 56
4.3 Partially Correct ........................................................................................................................................................................................... 59
4.3.1 Minor and Moderate Misspellings ..................................................................................................................................................... 59
4.3.2 Service Level Mismatch .......................................................................................................................................................................... 61
4.3.3 Incorrect classification ........................................................................................................................................................................... 61
4.4 Incorrect .......................................................................................................................................................................................................... 63
4.5 Can’t Verify ..................................................................................................................................................................................................... 64
4.6 Transit Names ............................................................................................................................................................................................... 64
5 Address Accuracy: Components & Issues ................................................................................................ 65
5.1 Address Components ................................................................................................................................................................................. 65
5.1.1 Street Number ............................................................................................................................................................................................ 65
5.1.2 Unit/Apt ........................................................................................................................................................................................................ 67
5.1.3 Street Name ................................................................................................................................................................................................. 68
5.1.4 Locality & Administrative Divisions .................................................................................................................................................. 70
5.1.5 Postal Code .................................................................................................................................................................................................. 70
5.1.6 State or Region ........................................................................................................................................................................................... 71
5.1.7 Country .......................................................................................................................................................................................................... 72
5.2 Address does not exist .............................................................................................................................................................................. 72
5.3 Language/Script Issue in Address ....................................................................................................................................................... 73
5.4 Country Specific issue ................................................................................................................................................................................ 73
5.5 Other Issue ..................................................................................................................................................................................................... 74
6 Address Accuracy: Result Expectation .................................................................................................... 74
6.1 Business/POI Result ................................................................................................................................................................................... 74
6.1.1 Businesses/POI with moving locations ............................................................................................................................................ 74
6.1.2 Temporarily Closed Businesses ........................................................................................................................................................... 75
6.1.3 Events ............................................................................................................................................................................................................. 75
6.2 Residential Address Result ..................................................................................................................................................................... 76
6.2.1 Address Formats ........................................................................................................................................................................................ 76
6.3 Street Result .................................................................................................................................................................................................. 77
6.4 Locality Result .............................................................................................................................................................................................. 77
6.5 Postal Code Result ....................................................................................................................................................................................... 78
6.6 State/Region Result .................................................................................................................................................................................... 78
6.7 Country Result .............................................................................................................................................................................................. 79
6.8 Natural Features .......................................................................................................................................................................................... 79
6.9 Transit Stations, (National) Parks & Other Features without Expected Address ........................................................... 80
6.9.1 Official Address Present ......................................................................................................................................................................... 80
6.9.2 No Official Address ................................................................................................................................................................................... 82

2

7 Address Accuracy: Research ................................................................................................................... 83
7.1 Confirm Correct Address ......................................................................................................................................................................... 84
7.1.1 Confirming Correct Residential Address ......................................................................................................................................... 84
7.1.2 Official Web Page ...................................................................................................................................................................................... 84
7.1.3 Official Resources ...................................................................................................................................................................................... 85
7.1.4 Resource Hierarchy in case of conflict ............................................................................................................................................. 85
7.2 Correct with formatting issues .............................................................................................................................................................. 85
7.3 Confirm Incorrect Address ...................................................................................................................................................................... 85
7.3.1 Incorrect Address ...................................................................................................................................................................................... 86
7.3.2 Can’t Verify: Address Pointing at Feature ...................................................................................................................................... 86
7.4 Rating in Ambiguous Situations ............................................................................................................................................................ 88
8 Pin guidelines ......................................................................................................................................... 92
8.1 General considerations ............................................................................................................................................................................. 92
8.1.1 Satellite Imagery vs. Vector map ....................................................................................................................................................... 92
8.1.2 Boundaries of the feature ...................................................................................................................................................................... 94
8.1.3 Next Door ...................................................................................................................................................................................................... 95
8.1.4 Can’t Verify (Smallest Identified Area) ............................................................................................................................................ 96
8.2 Single rooftop ................................................................................................................................................................................................ 97
8.2.1 Residential property with multiple buildings. ............................................................................................................................ 105
8.3 Multiple rooftops (Campus rule) ....................................................................................................................................................... 106
8.3.1 Single Complex Campus ....................................................................................................................................................................... 108
8.3.2 Dispersed Campus ................................................................................................................................................................................... 111
8.4 No rooftops ................................................................................................................................................................................................. 113
8.4.1 Natural Features ..................................................................................................................................................................................... 113
8.4.2 Administrative divisions ...................................................................................................................................................................... 118
8.5 Parking Lots & Parking Structures ................................................................................................................................................... 121
8.5.1 Shopping Malls with a single rooftop ............................................................................................................................................. 122
8.6 Transit POIs ................................................................................................................................................................................................ 123
8.6.1 Bus Stops ..................................................................................................................................................................................................... 124
8.6.2 Transit POI with Multiple Rooftops/Platforms ......................................................................................................................... 124
8.6.3 Transit POIs with Single Rooftop ..................................................................................................................................................... 127
8.6.4 Underground Transit Stations .......................................................................................................................................................... 127
9 How to rate results ............................................................................................................................... 134
9.1 Specific address ......................................................................................................................................................................................... 134
9.2 Other Address Types ............................................................................................................................................................................... 141
9.2.1 Non-specific address .............................................................................................................................................................................. 144
9.3 Address does not exist ........................................................................................................................................................................... 152
9.4 Point of interest ......................................................................................................................................................................................... 154
9.5 Understanding Multiple Query Interpretations: Beyond Viewport and User Position ............................................. 155
9.6 Business Queries ....................................................................................................................................................................................... 160
9.6.1 Non-chain businesses ............................................................................................................................................................................ 160
9.6.2 Chain Businesses ...................................................................................................................................................................................... 164
9.6.3 Business with Limited Access ............................................................................................................................................................. 166
9.6.4 No Physical Location, Back office & Operating out of Home ............................................................................................... 166
9.6.5 Business/POI does not exist ................................................................................................................................................................ 167
9.7 Category Queries ...................................................................................................................................................................................... 168
9.8 Soft Categories ........................................................................................................................................................................................... 172
9.8.1 Category: Parking ................................................................................................................................................................................... 174

3

Each task will present you with a search query and the results/suggestions that are provided to our users. All the data produced from this task will be used for evaluation purposes only. Your task is to establish how well the results/suggestions satisfy the user’s query and evaluate the overall user experience.1 The Rating Tool We use a web-based rating tool to rate Maps Search queries.1 Introduction This document explains the evaluation process for Maps Search. 1. A snapshot of the tool is included below: The Rating Tool Interface - 4 .

Here is a list of what you should be able to infer from the user interface. reveals coordinates. Note: Clicking on the pin reveals the coordinates of the pin location (lat/long in decimal degrees). The shape of the box may vary depending on the size and orientation of the device the user was using at the time.g. Name Screenshot Description User User viewport: A shaded grey box centered on a Viewport device icon shows the user viewport at the time when the query was issued (if known). when issuing the query. Viewport This device icon shows the center of the user symbol viewport at the time of the user query. Zooming in on the pin reveals a circle with the radius of 50m and a diameter of 100m to help you in the rating process. It represents the map area the user was looking at. the grey tip marks the location where the pin dropped. Note: In some cases the user viewport may be so small that you cannot see it. The blue head of the pin is only an indicator. but (if we have viewport information) the device icon is always visible at any scale. but (if we have viewport information) the device icon will always be visible. Result identification: By clicking on any of the blue pins. regardless of the map scale. The user viewport is an approximation of the boundaries of a user’s screen. the grey box may not be visible (e. the corresponding result flashes a few times to attract attention. Individual results are marked with blue pins on the map. if zoomed out). Note: Depending on the map scale. 5 . This icon has no rating significance other than being to identify the viewport on the map. Result pin Indicates result locations. Clicking on the viewport symbol. This is used for identification purposes.

Rating Click here to open the guidelines for this task. Guidelines 6 . Center Viewport shortcut button that allows you to move Viewport the result viewport to the center of the user viewport without changing the zoom level (map scale). Note: Clicking on the icon reveals the coordinates of the user location (lat/long in decimal degrees).Name Screenshot Description User A yellow icon shaped as a bust indicates the user location location at the time of the user query (if known). Zoom Allows zooming in and out of the map. Center User Viewport shortcut buttons provide convenient controls to pan or zoom to common map viewport settings. only the results themselves. Pin balloon Upon selecting an individual result or a pin. “Center user” allows you to move the result viewport to the user location without changing the zoom level (map scale). a box temporary balloon is displayed over the pin in the results viewport. the balloon text may also show additional information which can be used for research purposes and helps you understand the result: • phone number (never call a business) • URL • coordinates of the result (lat/long in decimal degrees) Note: We do not evaluate the information within the Pin balloon box. You can controller change the zoom level by clicking the + (zoom in) or – (zoom out) buttons. In addition to the name and address (as shown in the results list). Map layer This widget allows you to select which map layer is selector displayed.

Name Screenshot Description
Query Shows the user query as it was entered by the user,
header how long ago the current viewport was set.
User query: The search term the user entered into
the search bar.
Viewport Age: Indicates how long ago the user
moved the viewport.
If viewport age is less than 15 minutes, it’s
considered fresh and indicated with a green text. If
viewport age is more than 15 minutes, it’s
considered stale and indicated with a red text.
Task Type: Indicates the task name which you are
working on
Locale: Indicates the country and language
combination this task is for. Also referred to as test
language.
Top level This is a top level question that needs to be rated for
question each query.

Result The result returned for a user query.

Each result has two checkboxes, which if selected,
make questions disappear, as they do not need to
be answered. The relevance and address accuracy
dropdown menus have additional checkboxes
appear.

Note: One query, depending on its type, can
generate more than one result.

Pin identification: By clicking on the header of any
result, the corresponding pin gets centered, and a
result listing balloon appears on the map above the
pin.

Copy result Allows you to copy the information to your
name to the clipboard
clipboard
"Submit" After selecting the relevant ratings from the
button dropdown menu and rating “Is there a navigational
result for this query?”, clicking the Submit button
will save your rating.

7

1.2 Rating Scale

The interface shows all information needed for rating:
• User Query
• User and Viewport Location
• Viewport Age
• Result Details

The ratings and comments are collected within the rating interface. There is a high level question
followed by individual results. Each result has two checkboxes followed by dropdown answers and a
comment field. Additional checkboxes appear in case the address accuracy is selected as incorrect. To submit
ratings, click the “Submit” button.

8

1.3 Comments

Comments are mandatory for any rating below Good for relevance or below Correct /Perfect for
data accuracy. Here are some observations:

Issue Identified Expectations
Relevancy Demotions You should be able to explain why you chose a
specific rating. For example, you might demote
a result because of distance from the user’s
location compared to similar results/potential
results, secondary intents etc. Your comment
should explain your reasoning.

Data Corrections and Research Resources If you have had to do research to confirm
portions of a result, result prominence or you've
found a mistake in the data or bad pin, your
comment should include the correct
information and your source. Without adding
the correct information and the source it came
from, a reviewer will have to spend the same
amount of time researching, as you have to
confirm your answer.

Special Note: Confirm that any links you
include directly lead to the information you
gathered. If they do not, include a link to the
main website instead and specify how to get to
your information.

Data Issues It is important to include your reasoning when
rating something other than Correct . For
example:
• If the street number is wrong include the
correct address
o correct street number: 332 W El Camino
Real, Sunnyvale, CA 94087
• if the pin is wrong include the correct
coordinates:
o correct pin: 37.353150, -121.997281

9

• Be Concise – Don’t waste time writing elaborate comments. Pin Accuracy -> Perfect Ireland Cafe de Jaren Relevance -> Excellent Wrong pin: correct location 52.895389 Nieuwe Name Accuracy -> Correct Doelenstraat Address Accuracy -> Correct 20-22.1. • Comment in English! .User Intent Issue Result does not satisfy user intent – intent is the Library Name Accuracy -> Correct city of Cork.Your comments will sometimes be reviewed or used by those who are not very familiar with your locale or its language.3. result not prominent 57-61 Grand Address Accuracy -> Correct Parade.368067. be specific and efficient with your comments. 4. Result Ratings Example comment Cork City Relevance -> Bad . Netherlands 10 . All your comments should be written in English so they are understandable to the widest possible audience.If you are demoting because of a guideline intricacy. Cork. 1012 Pin Accuracy -> Wrong CP Amsterdam. it is useful to reference the guideline/rule that influenced your decision.1 Comments – Best Practices • Reference Guidelines .

1.4 Rating Workflow For every result you will pay close attention to the following rating workflow: These steps will be described in the following sections.5 Result Level Issues Some issues impact the entire result quality and are rated through two separate checkboxes for unexpected language/script and closed/non-existent business. disregarding whether any other returned suggestions are similar or identical.1. 11 . . Rate every result on its own merits.

the result makes no sense to the user and has therefore no relevance. • When the address details are in an unexpected language or script. No further rating is needed. The address accuracy is rated as Incorrect – Language/Script Issue . The Result name/title is in unexpected language or script checkbox is used in such cases. For more details.1. see chapter Language/Script Issue in Address. the result title and address details are displayed in different lines: 12 . the result can still be understood and therefore rated in terms of relevance and name accuracy. In the rating tool.1 Result name/Title is in unexpected language or script There are two language/scrape issue checkboxes used for different purposes: • When a result name or title is in an unexpected language or script.5.

Minor Differences in Spelling
Don’t consider minor spelling issues such as missing or added diacritics as unexpected language. The
same applies to unnecessary or less relevant parts of a name or title. In case the name contains a commonly
used category in English, such as “Airport”, rate also normally. Only use this checkbox to report more severe
issues and issues listed in the respective Country Specific Guidelines.

For results that could go either way, apply the following logic: If you are still able to identify the
result with certainty and no other guidance is in place, don’t mark it as unexpected language.

1.5.2 Business/POI Name
The result names below for the queries [prague airport] or [floating market] for a test set to English don’t
allow the user to understand the relevance, even when the fresh viewport is set on the area of the result.

13

The business/POI name is in an expected language or script, when it is:
• In the language/script of the test
• In the language/script of the query
• In the language of the result region but uses the same script as either the query or the test.

In case of multiple languages or scripts within the same business name, consider the result in the language or
script that matches the user query.

Special attention is to be given to brand and chain names. Please make sure to consult the Country Specific
Guidelines regarding more information on your market.

Expected Languages Explanation and Rating Example
Query Expected language/script:
• Test: en_US
The query gives clues in what • User/Result in California, USA
language the user is typing. Any
result that matches a specific query • Query: [mystery]
on a general match or spell correct • Result name: Mystery Spot
is considered to be an expected • Result is in English
language. This also includes remote
results in foreign countries. Unexpected language/script:
• Test: en_US
But: Consider official result name • User/Result in California, USA
variations and default to the device • Query: [mark]
language for very short queries.
• Result name: စျေးကွက်
• “Market” in Burmese script

14

Expected Languages Explanation and Rating Example
Test Language & Expected language/script:
Region • Test: en_US
• User/Result in California, USA
• Query: [college]
The language set on a test is • Result name: Skyline College
always considered expected and is
also used when the query does not Unexpected language/script:
allow to identify the language for
• Test: en_US
very short queries.
• User/Result in California, USA
• Query: [college]
• Result name: Colegio Skyline
• “Colegio” is in Spanish
Language of result Expected language/script:
region • Test: en_US
• User/Result in Rio de Janeiro, BR
• Query: [beach]
• Result name: Praia de Copacabana
• Result for the category beach.
The language of the result region is
expected as result language as
Unexpected language/script:
long as it uses the same script as
the test or the query. • Test: en_US
• User/Result in Rio, BR
• Query: [beach]
• Result name: Playa de Copacabana
• Returning the name in Spanish is
unexpected language.

Brand & chain names A business/POI name is not Expected language/script:
translated, even when it would be • Test: en_US
possible. But the business • User/Result in Tokyo, JP
themselves may offer a localized • Query: [izakaya]
name for the region. • Result name: En Osaka Namba
• Result name for this Izakaya Restaurant is
Any official name variation using
in the test and query script.
the same script as the test or query
that is accepted in the language
Unexpected language/script:
region is expected.
• Test: en_US
In bilingual areas are all official • User/Result in Tokyo, JP
names in all the languages of the • Query: [izakaya]
area expected, unless otherwise • Result name: 居酒屋
specified in the Country Specific • Result name uses different script than the
Guidelines. test and query.

15

bridge. Some features however are translated into the test language of the user. This component is often prominently displayed as title as shown in the image to the left. such as Munich or Cologne) • State • Country Not usually localized components are: • Feature type (square. Localized and non-localized Components Address Results can often not be translated and are accepted in the original version of the result location. (See more details on Classification) 16 . Demote also in case the result can still be understood by the user.3 Title of Address Type Results Address Type results do not have a name like businesses.5. Their most specific and therefore most relevant part is what defines the Address Type. The title of Address Type results follows the same guidelines as business/POI names. roundabout or intersection) • Street names and street addresses including building names 1. especially for bilingual areas or world languages such as English.5.4 Classification in unexpected language or script In case the classification is in unexpected language or script. Localized components (into test language) may be: • City (prominent localities.1. but is clearly not a used form in the market. consider it as wrong and demote the Name Accuracy to Partially Correct . Although the preferred language is the test language. also the query and language of the result location are accepted as long as they are using the same script.

Only use this checkbox if you have enough evidence to prove the business is closed. After determining the closure or non-existence by using official resources. randomly moving (e. Name and Address Inaccurate In case the business has an incorrect name and address.5. mark the result as Business/POI is closed or does not exist and give a relevance rating as if the place is open or does exist. assume the business could exist and rate the data accuracy as C an ’t V e ri fy . Closed/does not exist vs.g. In ambiguous situations. rate the relevance by assuming the business/POI exists and based on User Intent and Distance/Prominence. 17 . food truck without a fixed schedule) and non-recurring past events with no further significance that do not carry any map intent. Use the closed/does not exist checkbox only for the specified purpose.5 Business/POI is closed or does not exist This checkbox is used when a result is closed/non-existent. rate according to your best knowledge. Rating Relevance of Closed/non-existing Business/POI After selecting the “closed/does not exist” checkbox.1. use the dropdowns to signal what precisely is wrong. When a decision is not possible due to lack of resources.

locality. The user is looking for where this Creek Blvd.2 Understanding User Intent In the rating interface. user viewport and viewport age. POIs can be internationally or locally known. Query number. CA 94087] [Stevens Address This is an address query for a street. Query particular street is located. street name. The section below will explain these elements in more detail and their interaction. you will be presented with the following elements: • User Query • User and Viewport Location • Viewport Age • Result Details User intent refers to the interaction between query. A category refers to entities that share a set of characteristics.1 Query The queries you will be presented within the tool are actual queries issued by users on our platform. Sunnyvale. user location. where businesses are considered POIs. These guidelines use a very broad definition of POI. Because these queries are user generated. Cupertino CA] 18 . It contains a street Camino Real. Here are examples of each type: Query Query Explanation Type [717 E El Address This is an address query. also known as a full address. state and postal code. There can be several query types: • address queries (Geo queries) • business queries • Point of Interest (POI) queries • category queries A point of interest (POI) is a location that people can find interesting or useful. 2. they can: • be misspelled • have mistakes in them • be inconsistent • be ambiguous • be badly formatted • have no maps intent The first step in the rating process is to make sure you understand the query.

Query Query Explanation
Type
[Austin, TX] Address This is an address query for a city. The user is looking for the general
Query location for the city of Austin.
[Ireland] Address This is an address query for a country. The user is looking for the location of
Query the country of Ireland.
[New York] Address This is an ambiguous query, as it could refer to New York City or New York
Query State. You will find further information on prominence, user location and
the viewport in the following sections to help you decide the intent of this
query.
[Zola Palo Business This is a business query with a location modifier (Palo Alto). The user is
alto] Query looking for a specific restaurant in Palo Alto, CA.
[Bookasaurus] Business This is a business query with a request for a children's store in Sunnyvale,
Query CA. The viewport and user location can help you pinpoint the desired
location for such a query.
[Starbucks, 7 Business This is a query for a chain business followed by a specific address. Chain
Boulevard Query businesses are businesses that have more than one location, everything
Poissonnière, from national chains like Starbucks down to small local chains. Other
75002 Paris, examples include: Target, Auchan, Albert Heijn, and Boots.
France]
[Target Business This is a business query with a request for the chain business Target in
sunnyvale] Query Sunnyvale, CA. Queries can include location modifiers, such as Sunnyvale,
that make them more specific.
[London POI This is a query for a famous POI in London.
Bridge] query
[Eiffel Tower] POI POI in Paris
query
[Danube POI This is a query for a river in Europe.
River] query
[Charing POI This is a query for a transit station in London.
Cross Station] query
[union POI Famous location in San Francisco.
Square, SF] query
[sunnyvale POI Local POI in Sunnyvale, CA.
library] query
[fast fod] Category This query requests locations where fast food is served. Assume the user
query wanted the query typed correctly when the query has a simple misspelling.
[bus stop] Category This is a query for bus stops.
query
[coffee] Category This is a query for businesses that sell coffee.
query
[gym] Category This is a query for fitness centers.
query

19

2.1.1 Research Expectation

Always do research to understand the user’s query and intent:
• use your favorite search engine to understand the query
• use official resources whenever possible
• use your local knowledge to understand the query

Since we use queries issued by actual users, there will be cases where the query is just gibberish or
simply has no Maps application. Do your best to understand the query and see how well our results satisfy the
user’s intent, but don't be shy about assigning a Bad rating if a result does not fit the user’s intent.

2.2 Result Types
A user query can result in 2 different types of suggestions:
• Address: Consists of multiple address types (e.g. residential address, locality)
• Business/POI: Business and POI have a name and address. Because they are rated the same, they are
listed together.

20

2.3 User Location

The user icon is an approximate rendering of the actual user’s coordinates when the query was issued.
Here are a few examples focusing only on user location:

Query Screenshot Explanation
[Chili’s The user location is close to
] Fredericksburg, VA.

User location: 38.20620,-77.66015
[6 Rue User is located outside of Grenoble,
Berthe France.
de
Boissie
ux
Grenob
le,
France]

User location: 45.13414,6.53890

21

We consider the viewport stale if the viewport age is more than 15 minutes.2. 22 .4 User Viewport You will be presented with information regarding the age of the viewport: Definition Screenshot We consider the viewport fresh if the viewport age is 15 minutes or less.

66015 Viewport Age: 3 minutes User location: Outside of Spotsylvania 23 .54763 Viewport Age: a few seconds User location: Santa Clara. Here are a few examples queries and viewport age: Query Screenshot Explanation [starbucks] The query is for the chain business Starbucks with a fresh viewport of a few seconds.-77. User viewport: 38.-0. CA [chili's] This is a query for the chain business “Chili’s” with a fresh viewport that’s 3 minutes old.20620.43335. User Viewport: 51.

the viewport location is in San Francisco. CA. User viewport: 41.80975. For this query.45429 Viewport age: 2 days User location: in Los Angeles. User viewport: 37. CA. CA 24 .-81.-122.[walmart] This is a query for the chain business “Walmart” with a stale viewport that’s 5 hours old.69216 Viewport age: 5 hours User location: Outside of Cleveland [commis] This is a query for a restaurant in Oakland with a stale viewport that’s two hours old. while the user location is Los Angeles.46145.

the location intent is considered implicit and given by the user location and viewport.[Little Sheep This is a query for a chain Mongolian business with a fresh Hot Pot] viewport of a few seconds.46395. such as [chinese] or [479 margarita ave]. User viewport: 38. There are 2 location intents: the user explicitly types a location in the query (explicit). user and the given viewport (implicit) are used to determine the location intent. Use the table to judge the location intent appropriately given an implicit location intent: 25 . 2.5 Location Intent A suggestion is most relevant to the user when it is located in the user's area of expected results. CA 2.6 Implicit Location For a query that does not contain an explicit location intent.-122. or the location of the phone.69703 Viewport age: a few seconds User location: in Cupertino.

7 Explicit Location The explicit location intent typed by the user defines the area in which results are expected. Viewport User Location Intent When the user is within the fresh viewport. 26 . and results inside the area cannot be rated Bad for distance alone. consider only the user location as Outside Viewport location intent. Fresh Results are expected in or near the viewport area. 2. the viewport remains the location Missing intent. take the user location Inside Viewport as location intent. Inside Viewport When the viewport is stale. When the user is missing. As an example: The query [1475 s coast dr costa mesa] returns the same results independent of the user location or viewport. The user and viewport are disregarded at that point. Results are expected in or near the viewport. localities etc. the locale of Missing the test becomes the location intent with a strong focus on prominent results. Stale Use the stale viewport as location intent when the user location Missing is missing. Missing The user location sets the location intent when the viewport is Present not present. Present or Viewport Age Rate the viewport as fresh when the viewport age is missing. The user Outside Viewport location is considered as an alternative location when no results can be found in the viewport. The explicit location intent can include: specific address or location modifiers such as neighborhoods. Missing entirely In case the user location and viewport are missing.

Good Only partially satisfies the user’s intent due to relevance or distance.g.3 Relevance The rating scale for Relevance is: Rating Explanation The most likely result implied by the user’s query. Adult Content Businesses and POIs with legal adult content are rated: • Navigational to Bad (due to distance). incomplete address that is extremely close) A high-quality result that clearly satisfies the user’s intent. Technically satisfies the user’s intent but does so poorly due to relevance Acceptable or distance. complete address) • Proximity (e. General Rating Rules • Rate each result individually and demote based on relevance and distance. Multiple results Excellent can be considered high quality. Eiffel Tower) • Unique (e. A rating of Navigational does not exclude other results from satisfying the query to a lesser degree. • Bad (due to relevance). if the query mentions such content explicitly. user’s location and/or user’s viewport that completely satisfies the distinct user’s intent.g. demote the existing suggestions considering the missing ones. A distinct user intent is defined by the following characteristics or a Navigationa combination of them: l • Extreme prominence (e.g. 27 . Bad Does not satisfy the user’s intent due to relevance or distance. • Always rate against the real world: If there is a better suggestion but we are not showing it. if the query does not imply such intent.

• Ignore the order of the suggestions and evaluate each suggestion individually.1. rate Bad . • Secondary Intent: A suggestion that is less likely to be the user’s intent. Relevance is established by looking at the relationship between: • User intent satisfaction • Prominence • Distance 3. • Ignore duplicate results and rate them individually. we should look at the relationship between the user intent and the result.1 Primary and secondary intent We can typically find the user’s intent though a combination of the query. user’s location/viewport and local knowledge. no need to demote or leave a comment. • If you come across suggestions that are extremely inappropriate or illegal.1 Result satisfies user intent In order to determine the primary and secondary intent. Secondary intent results should receive a starting demotion to Good due to relevance and have the User Intent checkbox selected. but are still valid matches. 3. We define these potential answers as either Primary or Secondary Intent: • Primary Intent: The most obvious and likely user intent for the most popular existing suggestions. Rate the relevance of each result without considering the data accuracy. Suggestions matching secondary intent are often not as prominent and farther away from the user. You can identify such content by asking yourself if it’s likely to be embarrassing when seen by users. The questions that you need to ask yourself are: • Is there a logical relationship between the query and the result? • How likely is the user to be looking for this result given the query and the location intent? 28 . but sometimes the query is more ambiguous or could have multiple interpretations.

and the suggestion provides the full and currently accurate name. • Most non-navigational queries will have an array of ratings ranging from Excellent to Bad . a navigational query will have one entity satisfying the distinct intent and multiple entities satisfying secondary intent or not satisfying the intent at all. • Category: The user query is a category and the result satisfies that specific category. but most often the result satisfies the most specific part of the query. 29 . which may or may not be displayed within the information provided in the result. • Most often. There are other ways a result can satisfy the user query: • Abbreviation/Alternate: The user query is an abbreviation or alternate name. select the U se r I nt en t I ss ue checkbox. o Most often you will have a result being rated Navigational and multiple results being rated Good or Acceptable for secondary intent or Bad as it does not satisfy. A result can satisfy user intent for multiple reasons. We refer to this as a general connection. For any relevance ratings below E xc el le n t . o rating a result Navigational and one Excellent in the same query is rarely seen (see example in section Non-specific address). A few observations: • It is very rare that a navigational query has multiple primary intents.

rate the result Bad . and the suggestion corrects that issue. Satisfies Intent: Result satisfies user intent by Richmond BART Transit [bart] Station Intent providing a close station that runs the requested transit service for a user/viewport located in the Richmond area. • Associated Entity: The result satisfies the query because it is either the larger entity of the intended entity in the query or one of the smaller entities within the intended result. (See Chapter Associated Entities for more details) If the result does not satisfy the user intent as specified. • Spell correction: The user query is misspelled.g. the suggestion must match that system. café in English. Place du Trocadéro and Bibliothèque François Mitterrand in French). If the query indicates a specific transit system. Satisfies Intent: When there is no "Clair St" within [23 Clair 23 Clair Spell Boulevard Correction or around the viewport/user. o The query does not include a special character but the suggestion with special characters adds value to the user and is therefore considered spell corrected. Suggestion/ Type of User Query Description Result Connection San Francisco Satisfies Intent: Users are likely to start their [marriot] Marriott Union General search with the name of the brand “Marriott”. Starting grade should be Good for secondary intent. when no result for the actual query exists at the user location or when the user intent clearly is satisfied by the spell corrected suggestions. Airport Satisfies Intent: The suggestion is the correct [sears tower] Willis Tower Alternate name of what was formerly known as the Sears Tower. Satisfies Intent: "oe" is a valid variation for the Special [möllersdorf] Moellersdorf Characters special character "ö" in the country/language of the suggestion (Germany). • Special Characters: Always consider the specific language conventions. o The country or language does not have the special character and is generally perceived as a form of expression or style (e. we consider "Clair street] Boulevard" as the most likely intent. Spell Satisfies Intent: The suggestion spell corrects the [aple store] apple store Correction user's obvious mistake. Newark Liberty Satisfies Intent: The international airport code for [ewr] International Abbreviation Newark Liberty International Airport is EWR. This only applies to obvious issues. Square [Houston George Bush General Satisfies Intent: The user is likely searching for the airport] Intercontinental Houston airport called “George Bush Intercontinental”. In general. user intent is satisfied when: o The query contains a special character and the suggestion is a valid variation (if applicable). Satisfies Intent: A category search for "food" in a [food] La Ciccia Category viewport over San Francisco returns a popular Italian restaurant. • Transit Intent: The suggestion satisfies the transit intent of the query. 30 .

Satisfies Intent: The store "Sports Fever" is within [westfield Associated Sports Fever Entity the mall "Westfield Horton Plaza. Rate Bad . A few observations: • If you rated any result for a query with Navigational .1. Starting grade should Horton plaza] be Good for secondary intent. you will answer this question No 31 . Satisfying the user intent is only the first step in the rating process and covers the minimum requirements for a result to be considered relevant. The rating you reach by following this step is called: initial rating. you have to check if there are any potential results in the real world that are missing and can be rated with Navigational o If you found a result in the real world that can be rated Navigational . You will need to determine if the query intent is distinct: • If the query has a distinct intent. For each query there is a need to evaluate if there are navigational results in the real world that can completely satisfy the user intent. Satisfies Intent: The particular "Starbucks" is [penn Associated Starbucks Entity within "Penn Station". Distance and prominence should be considered next in order to establish the final grade. 3. you will need to answer a query level question. you will have to answer this question Yes • If you did not rate any results with Navigational . Starting grade should be Good station] for secondary intent. Does not satisfy user intent There is no Santa Cruz [airport] Boardwalk None connection between the query string and the result.2 Is there a navigational result? Once you have identified the user intent. then you will answer this question with No You should be able to answer this question even before evaluating the results by doing research and making sure that you understand the query and the user viewport and location. then you will answer this question with Yes • If the query does not have a distinct intent. you will answer this question Yes o If you did not find a result in the real world that can be rated Navigational .

2 Prominence The prominence of a feature refers to its popularity (the number of people and media sources visiting and referencing it). Oftentimes we can conclude a feature has a certain level of prominence without doing a great deal of research. Instead. for the query [Machu Picchu] is the historical site in Peru. for instance. Consider the following list to get a general idea of the concept of prominence. • The feature is known in the country. • The feature is known in the region. • You can expect lots of reviews for categories such as: o restaurants o bars o museums o hair salons • And fewer reviews for: o parks o gas stations o train stations o banks o playgrounds You should not be demoting a result simply because it doesn’t have any reviews. • The feature may not even be known locally. • The feature is known locally. A closer restaurant with the same name just outside the viewport can be a secondary intent and is therefore rated lower. 32 . When unclear about the prominence of a result.3. and a small business is less prominent than an airport or train station. take a lack of reviews into consideration as you evaluate the context of the query and the type of the result: • Are reviews for the result type atypical? • Is the business new? The most prominent feature and therefore primary user intent. you can establish both prominence and quality by doing a simple web search and looking up reviews. A big business/POI generally has higher prominence than a local road. ordered from the most prominent to the least prominent: • The feature is known internationally.

Massachusetts. fresh user viewport.Query Result Relevance rating Explanation [Machu Picchu] Machu Picchu. Peru Navigational Historical site and most fresh viewport in relevant result. 307 Somerville Ave. some Machu Picchu Good Since the result is distance away from from Restaurant reasonably close to the Somerville. 33 . it will Somerville. MA be considered secondary intent for this query.

Factors affecting distance include: • Number of possible suggestions in the real world • Distribution of all possible suggestions • Population density -> rural. the less desirable it becomes. urban or suburban The graph below shows that the suggested gas stations for the query [gas] are less desirable as distance increases and therefore rated lower. The reasoning is simple: the user is offered many possible suggestions that are all very similar so the closest entities providing the expected service can be considered the best options. which are farther away.3 Distance The farther away the result is. Once you have judged how relevant the suggestion is based on user intent. If you would rate significantly higher.3. The distance to the user or viewport and the prominence of the suggestion allow you to decide if a demotion should be applied. it is a Distance/Prominence issue. are less important and should be demoted according to their additional distance. especially for queries highly driven by distance to the user/viewport — such as hospitals. Judge each suggestion with regards to its specific situation. Select the check box D is ta nc e /P ro mi ne n ce I ss ue when demoting for Distance/Prominence. pharmacies or grocery stores. imagine the location intent close to the result. 34 . In case you are not sure if the issue is more a User Intent Issue. Defining what is far and what is close depends on the context of each individual query. Suggestions. consider it in the context of all possible suggestions in the real world.

On the other hand. a diner can receive an Excellent if the diner is the closest result that would satisfy the user’s intent. Some general rules for when to promote and demote (this is not a comprehensive list): Promote when: • results are important because of size. Please note the following: • The examples are for illustration purposes only and may be invented • All examples have a fresh viewport. and the bus stop is among the closest ones to the user’s location intent. CA] is explicit and distance and prominence do not have a part to play. if the result is a large bus hub that is a bit farther away from the user it should still receive an Excellent because of its size. smaller bus stops. 35 . However. regardless of the fact that there are closer. Results close to the user should not be demoted because there is a larger bus stop farther away. The following examples address common situations and explain how to evaluate the relevance of the suggestions. prominence and satisfying the user intent. the criteria for relevance of this type of business should be based mainly on distance and size (how large the bus stop is).rural. urban or suburban • The number of businesses that satisfy the query • The distance to the user or viewport Here are some examples: For the category [food]. Before you make your decision to demote or not because of prominence or distance. For the category [bus stops]. but the large bus stop should be promoted because of its importance. If the result is a small bus stop in a rural area. the query [629 N Mathilda Ave. Of course. if that same diner was located in an area with lots of restaurant it would receive a lower rating because there are likely several other places that satisfy user intent which are higher in quality and prominence.3. it is important that you look at: • The type of area around the result . there are queries you will not need to promote or demote. For example. it should be rated Excellent . prominence and distance should all be relative to the query and the context around the query.4 Promoting and Demoting A result’s fit to user intent. Sunnyvale. such as a large airport or large bus stop • results are the only ones available within a reasonable distance • results are of very high quality when we expect them to have reviews Demote when: • results are far away • there are better results in terms of quality and prominence available in the real world Here are examples of multiple situations and how to interpret the relationship between distance.

3. In this example.5 Lots of Possible Results A query such as [starbucks] can potentially have multiple results to satisfy the user. distance is more important than prominence and results that are closer to user location/viewport should be rated higher than results that are further away. user location outside of the CA viewport Rate Good locations that are further away from the user/viewport Good Rate Acceptable locations that are significantly farther way from the user/viewport Acceptable 36 . Relevance Explanation Screenshot Rating User Rate Excellent Starbucks location and locations that are within viewport in close proximity of the user or Excellent San within a fresh viewport with Francisco.

6 Few Possible Results When we have a query that would trigger only a few locations. A user is willing to travel longer distances for businesses with only a few locations in the area. Florida. Relevance Explanation Screenshot Rating User Zara locations that are within location close proximity of the user or and within a fresh viewport with Excellent viewport user location outside of the in Miami. viewport FL Locations that are further away from the user/viewport Good Locations that are significantly farther way from the user/viewport Acceptable 37 . a famous Spanish clothing brand. with a user location and viewport in Miami.3. Such an example would be the query [zara]. then we can be more lenient on distance.

close to Wartestraße in Siegen is Berlin.7 Few Possible Results and Far Distance For queries. Wartestraße in Geislingen is the fourth closest result but significantly further way. this result is rated Acceptable. Because of the limited number of results. Good Wartestraße in Wiesbaden is at a similar distance from the user as the one in Siegen and receives the same rating. Acceptable 38 . There are only 4 streets in Germany called “Wartestraße” that can satisfy the user’s intent and we return all of them. where there are few possible results we are more lenient on distance. each result’s relevance stays high over longer distances. Given all other results. A user close to Berlin queries for [Wartestraße] which is a street name. but Germany the second closest possible result. Relevance Explanation Screenshot Rating User Wartestraße in Gransee is location and Excellent the closest and is the most viewport relevant. far away from the user.3.

The criteria for rating are similar to the [zara] example under Few possible results section. Good Rate Acceptable locations that are significantly farther way Acceptable from the user/viewport. Rate Good locations that are farther away from the user/viewport. Because the results are so spread out. we should be more generous with our ratings.8 Rural Areas Results are often farther away in rural areas. but with an emphasis on distance.3. but can still be considered relevant results that satisfy the user intent. Relevance Explanation Screenshot Rating User Rate Excellent location and locations that are within viewport in close proximity of the rural user/fresh viewport or Germany within a fresh viewport with user location Excellent outside of the viewport. 39 . Here is an example for the query [museum] in rural Germany. if there is no reasonable result close or within the fresh viewport. In a rural area. the distance for which we consider a result Excellent is farther away.

User and Locations that are farther way viewport from the user and less around Good/ Acceptable prominent should be rated Naples. or if the viewport is fresh or stale. take the query [Hong Kong] in a test set to en_US with the viewport and user location around Naples. There is no real change in rating if the user is inside or outside of the viewport. For example.3. more Good/Acceptable .9 Location - User Intent Deviation When the location intent and user intent don’t allow for a clear result (either because the user/viewport is in an atypical location or in the middle of the ocean). rate with focus on high prominence. 40 . Bad The restaurant in Rome should be rated Bad because it is very far away from the user location in Naples. Italy. In this case. there is no real change in rating if the user is outside of the viewport or inside the viewport or the viewport is fresh or stale. Relevance Explanation Screenshots Rating The most prominent result is the territory of Hong Kong in Navigational Asia. Businesses/Locations with the same name that are within the Excellent viewport or close proximity to the user and prominent. Italy Locations that are too far away and less prominent to be considered relevant should be rated Bad .

For example. Wells Fargo Bank. Most likely this is a query for the user to find out if there are any results in Cuba for the bank. The chain doesn’t have any locations outside the United States and all results are therefore very far away. The results don’t need to be the closest ones possible. Given there are no results in Cuba. 41 . Miami. Atlanta. the expectation is to have broad results over a large area. a user located in Havana. but given the overall distance to the user still an Excellent result. Cuba looks for the bank chain [wells fargo bank]. FL is User and significantly further away and viewport Good therefore demoted to Good . Jacksonville. Viewport/ Relevance Explanation Screenshot User Rating location Well Fargo Bank. Wells Fargo Bank. or the viewport is fresh or stale. MO is too far to provide any useful context to the Bad user and is therefore rated bad. but they should also not so far that the context of the user/viewport location is getting lost. There is no real change in rating if the user is inside or outside of the viewport. FL is one of the closest locations to the user/viewport. St Louis. GA is very far and has very little relevance to the Acceptable user. Tampa. FL is not amongst the closest results. Excellent Wells Fargo Bank. around Havana. Cuba Wells Fargo Bank.10 Location – User Intent Deviation for Chain Business Situations where the location intent of the query given by user location and viewport does not include any relevant result should be treated with great generosity regarding distance. 3.

the results in Oakland and Redwood City are not supported by the postal authorities and no evidence can be found they exist.12 Associated Entities 42 . CA it doesn’t exist. Only the address in San Francisco is a valid address. The around address in Redwood is disregarded Half Moon for Distance/Prominence because Bay. the result is rated Excellent. a user in Half Moon Bay is looking for [2373 chestnut] and is presented with 3 residential addresses.11 Address does not Exist (Rate real world) Rate the relevance of each result independently of name and address accuracy issues it might have (e.g. wrong address/name or does not exist). Redwood City is closer to the user than the existing result in San Francisco. Good/ 2373 Chestnut St. For example. don’t demote because of closer non-existent addresses. Because data issues are disregarded for relevance. 3. Viewport/ Relevance Explanation Screenshot User Rating location User and Excellent 2373 Chestnut St. But when judging Distance/Prominence of a result. San Francisco viewport is the closest existing result. 2373 Chestnut St. Oakland is Acceptable significantly further away than the existing result in San Francisco and therefore demoted for relevance and marked Address does not exist .3. but the address accuracy is marked as Address does not exist .

ticket booth. If the user query and the result are considered associated entities. CA 95050 Sephora Good Sephora is a prominent store within the mall. cafés. Let’s take a look at a couple of examples and their association: Type Relevance Rating School Good /Acceptable : department. then the result will be rated as secondary intent with an initial rating of Good (further demotions can be applied for distance to user/viewport). A result can satisfy the user intent through its association or relationship with the queried POI/business. This association goes both ways: the user query may be for the smaller entity and the result is the larger entity or the user query is for the larger entity and the result is a smaller entity within it. visitor center. random businesses Hospital Good /Acceptable : wards. café POI/landmark Good /Acceptable : sightseeing spots. schools inside. CA 95050 43 . pharmacy. For any associated entity you still need to determine its usefulness and how well it satisfies the user intent. entrances Acceptable /Bad : offices. shops. random businesses. parking lots. Santa Clara. Examples for associated entities include: • Malls and the stores they consist of • Hospitals and the departments they consist of • Universities and the smaller colleges and facilities they consist of • Train stations and the stores and restaurants they consist of • Department stores and the other small businesses they contain (such as a Pharmacy within a Walmart). entrances. Santa Clara. random businesses. transit POIs Acceptable /Bad : dormitories. It will be up to you to determine the result’s usefulness based on local knowledge. This mall] Mall mall is unique in the area. important features. departments. Let’s look a some examples: Query Result Relevance Rating Explanation [valley fair Valley Fair Navigational Result satisfies the distinct user intent. 2855 Stevens Creek Blvd. 2855 Stevens Creek Blvd. experience and determining how well it satisfies the user’s intent. less important features Establishing the difference between Good and Acceptable or Acceptable and Bad is based on the prominence of the result and its usefulness in satisfying the user’s intent. transit POIs Acceptable /Bad : parking lot.

Creek Blvd. CA 94941 44 . The San Francisco Francisco Francisco Airport is a unique POI. CA 95050 Admin Bad Users do not associate the mall with the Office admin office. airport. Monument 1 Muir Woods Rd Mill Valley. Paulus Loot. CA 94128 Toilet Bad A toilet is not a prominent feature in the San Francisco. Airport] Airport San Francisco. 2042 Zandvoort. food and 2855 drinks stores are less significant and the rating Stevens can vary depending on prominence. Netherlands Beachclub 5 Acceptable/Bad Query is for a famous beach in the Strandafgang Netherlands and the result is a less important 5. 2855 Stevens Creek Blvd. Santa Clara. Boulevard café on the beach. This is a unique beach] Beach beach in the Netherlands. users do at the airport. Jamba Juice Good/Acceptable Shoppers go to malls for shopping. CA 94128 [zandvoort Zaandvoort Navigational Result satisfies user intent. Netherlands [muir Muir Woods Navigational Result is for the national park intended in the woods] National query. Santa Clara. CA 94128 Duty Free Good/Acceptable Duty free shopping is an activity that many San Francisco. CA 94128 Terminal 3 Good Terminals are very important for an airport. San Francisco. CA 95050 [San San Navigational Result satisfies a distinct user intent.

Office 1 Muir Woods Rd Mill Valley. Rd Mill Valley. Picnic Area Good Going for a picnic in a park is a prominent 1 Muir Woods activity. Anaheim. CA 92802 Red Rose Good /Acceptable Result is for a quick service café. Disneyland Dr. Anaheim. CA 92802 45 . CA 92802 Park Acceptable /Bad Park security is not a prominent feature of the Security park and not something users would be 1313 interested in. CA 94941 Operations Bad The result is for the admin office. Anaheim. Disneyland Dr. CA 94941 [Disneyland Disneyland Navigational Result is for the amusement park requested in park] 1313 the query. Disneyland Dr. CA 92802 Matterhorn Good Result is for a very prominent ride within the 1313 park. Anaheim. Tavern 1313 Disneyland Dr.

is very small. calling for further demotion for distance. if the query specifically requests state/county/municipality. the Bad starting grade for this result is Good. USA New York Good Result is for the state. State New York State. york] City New York. counties and municipalities will be treated as secondary intent and given an initial rating of Good . Let’s look at a single example in more detail with the added context of user location and distance demotions: Viewport/ Relevance Explanation Screenshot User Rating location The two Safeway locations in Sunnyvale are close to the user Excellent/ Good location. This result is also farther away from the user location. Here are some examples: Query Results Relevance Rating Explanation [new New York Navigational Result is for the city. Therefore.13 City vs. states. municipality In many cases the city and the state/county municipality (or other similar market specific components) have the same name. but still a possibility. which is less relevant. USA [santa Santa Clara Navigational Query is for the city. the likelihood that a user is looking for the state/county/municipality and not the city. According to CA Acceptable/ associated business rules. Safeway Pharmacy. which is less relevant County 46 . On the other hand. but usually the city is more prominent. 3. Consider the relationship between the city and the municipality in your own area and adjust if necessary. CA Santa Clara Good Result is for the county. In this case. clara] Santa Clara. [safeway] User and viewport in The result in Mountain View is for a Sunnyvale. that result will be rated Navigational and the city Bad .

Francisco. CA Santa Clara Bad Query is for the county and a result for the city is Santa Clara. ask yourself the user intent questions: • Is there a logical relationship between the query and the result? • How likely is the user to be looking for this result given the query and the location intent? A result can partially satisfy a secondary intent because of: • Prominence of the feature • Transit Intent In the examples below we provide two grades for some results: Good and Acceptable . The bus stop carries the name of the Stop intersection and it happens frequently that users Sunnyvale look for intersections. which at first glance might not fit the query intent. CA considered irrelevant for the query. CA CA 47 . [mission & Mission St & Navigational Query is for an intersection and the result satisfies 14th street] 14th St the user intent. user and El Camino & viewport in Poplar Ave Sunnyvale CA . The differentiating factor between the two grades is how well it satisfies the user intent: Good if there is a strong likelihood that it will satisfy the user intent and Acceptable if it is unlikely that it will satisfy the user intent. while looking for transit CA POIs. county] Santa Clara County. user and Mission St & viewport in 14th St.Sunnyvale CA El Camino & Good/Acceptable Result is for the bus stop at the queried Poplar Bus intersection.14 Unexpected results Straightforward queries can have unexpected results. Let’s look at a few examples: Query Results Relevance Rating Explanation [el camino & El Camino & Navigational Query is for an intersection and the result satisfies poplar ave] Poplar Ave the user intent. therefore clara County this result will be rated the highest grade. San San Francisco. CA [santa Santa Clara Navigational Query is specifically requesting the county. 3. For all results. Santa Clara County.

Carnaby. State Highway 10. therefore very unlikely to satisfy the user St. Mission St & Good/Acceptable Result is for the bus stop at the queried 14th St Bus intersection. UK Mildreds Bad Result is for a restaurant in the neighborhood of Restaurant Soho. CA San Good The result represents the airport within the Francisco queried locality. which carries the same name. San Francisco. the locality is best known because of the temple. The bus stop carries the name of the Stop intersection and it happens frequently that users San look for intersections. This temple is a center for pilgrimage and Temple. Maharashtra 423109. intent. [soho] Soho Navigational Query is for a neighborhood in London and the user and London. the result satisfies a secondary intent Maharashtra for the query. London W1F 9AN. viewport in London. The restaurant is not famous or well 45 Lexington known. while looking for transit Francisco. Kerala India Sree Dharma Good Result is for a prominent temple in the queried Sastha locality. San Francisco. UK result satisfies the user intent. India [san San Navigational Query is for the city of San Francisco and the francisco] Francisco result satisfies the user intent. CA 48 . returned. International The result satisfies the user intent in a lesser Airport degree. Shirdi. satisfies the user intent. UK [Sabarimala] Sabarimala Navigational Query is for a small locality in India and the result Sabarimala. CA POIs. Sabarimala Because of the prominence of the feature 80/3.

prominence and how well the result satisfy the user’s intent. Bloomington.3. MN 55425 United States [mall of Mall of Good/Acceptable Station has the same name as the POI.15 Multiple transit POIs with the same name Many large transit POIs include multiple different means of transportation at the same location. Airport Station 22335 Hamburg. or train stations can be a hub for trains. Germany Hamburg Good Result refers to the train station at Hamburg Airport. Establishing the relationship between the two entities is up to you and should be based on local knowledge. Here are some examples: Query Results Relevance Rating Explanation [mall of Mall of Navigational Result is POI requested in the query. 49 . Germany 3. Even America] America though the station has the same name as the POI. Additional demotions can be applied based on the prominence of the returned feature. but can also be considered Acceptable if the result is unlikely to satisfy the user’s intent. 22335 Hamburg. it Station is not prominent and therefore demoted. metros and buses. Query Results Relevance Rating Explanation [hamburg Hamburg Navigational Result is for the queried airport. For example. airport] Airport 22335 Hamburg. Other Transit POIs at the queried transit POI should be treated as secondary intent with a starting grade of Good . large airports can have within the same location metro or train service.16 POIs and transit intent Non-Transit POIs can have a transit POI associated with it that has the same name. Germany Lufthansa Acceptable/Bad Small bus stop that seems to service the Lufthansa Basis training center. America] America 60 E Broadway. You will have to establish if the query has distinct navigational intent or the prominence of the two POIs that share a similar name is so strong that both can be the intent.

Additionally. [Florida Navigational Florida mall is a popular mall in Orlando. prominence and therefore demoted. Amsterdam. it is hard to establish a distinct user intent. navigational query Deciding whether a query is a category or navigational query will be determined by your research based on the following factors. UK [dam Dam Square Navigational The result is for the famous square in Amsterdam.17 Category query vs. Station London. airport] query 50 . The square circus] Circus and the train station are both equally prominent London. [berlin Category The city of Berlin has two very prominent airports. As both features are equally prominent. The stop is on Line 2 an adjacent street to Dam Square and very low in Dam Square. Piccadilly Excellent Result is the famous station that is just as Circus prominent as the square. Here are some examples to help you make your decision: Query Type Explanation [Miami Navigational Miami beach is very famous and due to its prominence. MN 55425 United States [Piccadilly Piccadilly Excellent Result is for famous square in London. Netherlands 3. UK and local users would be looking for the station while tourists would be looking for the square. Florida. square] Dam Square. [Miami Category It is very unlikely that a user would type the plural form of the word beaches] query “beach” when looking for a specific beach. is the most beach] query likely intent. it is mall] query unlikely that a user would look for all the malls in the state of Florida. Amsterdam. Netherlands Dam Square Good/Acceptable Result is for the tram stop for line 2. but are not limited to: • Prominence • Local knowledge • Language intricacies • Available possible results You will have to decide if the query has distinct user intent. 8240 24th Ave S Minneapolis.

the farther away the results can be and still be considered relevant. CA 95110 Lawrence Good Result is for a station that runs on the same line. This result station] Diridon satisfies a distinct user intent because of Station prominence. 94086 51 . London SE1 8SW. the closer they need to be. station and less frequently used. this is a smaller train 1355 Lick Ave. Lambeth. Caltrain but is farther away. Even though the station is Station outside of the requested locality. CA the results can be and still be relevant. fewer choices there are available. the farther away Sunnyvale.[Amsterdam Navigational The city of Amsterdam has only one airport. Station Waterloo Rd.17. In general. if you decide a query has navigational intent. it provides 137 San Zeno choices of stations in the area for the user. 65 Cahill St. Station Although still in San Jose. San Jose. the fewer the results satisfy the user intent. San Jose.1 Transit queries The same criteria above should be applied to understand the transit queries. airport] query 3. other transit POIs that could potentially satisfy the user intent should be treated as secondary intent and downgraded further for distance and prominence. UK [san jose San Jose Navigational Prominent station in the city of San Jose. The Way. Additionally. The more available results are that can satisfy the user intent. CA 95110 Tamien Good Less prominent station in the city of San Jose. a station] Waterloo very prominent station in London. Here are a few examples to help you understand: Query Results Relevance Rating Explanation [waterloo London Navigational Result is transit station requested in the query.

CA 94086 Palo Alto Acceptable/Bad Result is far away from the queried station. CA 94301 Here is screenshot for the above example [san jose station] in order to better understand the distance and large distance it covers: 52 . The Train farther way the result is from the initial queried Station station. therefore the relevance grade should be Ave. Sunnyvale Good/Acceptable Result is for a station that is farther away and runs Caltrain on the same line. Palo Alto. Station 121 W Evelyn Ave. lowered. the less likely it is that it will be considered 95 University relevant. Sunnyvale.

transit location typically designated by a bench or covered bench area. San any bus stops and stations would Francisco. Greyhound Lines Excellent The query is for bus stops. where you can take san San Francisco. therefore returning a station for stop query is ok. 53 . Howard St & Spear Excellent The query is for bus stops. All stations are stops. the fewer the results satisfy the user intent. 94105 Line 7 Excellent The query is for bus stops. therefore 835 Market St. on the other hand. are typically larger stops that have a major structure associated with it. The more available results are that can satisfy the user intent. a posted sign. The more choices there are available. but are not limited to. All stations are stops. the closer the results should be in order to be considered relevant. but not all stops are stations. The term “station” is primary used to refer to transit locations that are larger and typically a terminal housing multiple routes. Stations A transit stop is a small. but returning a stop when the query is station should result in a rating Bad with User Intent issue checkbox selected. Transit stations.17. enclosed waiting/seating areas. Additionally. therefore 200 Folsom St #100 any bus stops stations would satisfy San Francisco. The more results satisfy the query in the requested locality. Query Results Relevance rating Explanation [bus Greyhound Lines Excellent This is a major bus station in San station in 200 Folsom St #100 Francisco. CA the intent. therefore St any bus stops and stations would San Francisco. or terminal buildings/structures encompassing the transit area. the closer they need to be. francisco] 94105 Main St & Folsom St Bad (User Intent This result is a small local stop that San Francisco. [bus stops Main St & Folsom St Excellent The query is for bus stops. the closer they need to be. CA 94103 satisfy the intent. the farther away the results can be and still be considered relevant. CA 94085 (Distance/Prominence city and very far away from the Issue) requested locality. CA Greyhound buses. ticketing offices.2 Stops vs. therefore in San San Francisco. or street markings.3. You will have to identify these corresponding terms in your locale and understand the relationship between them. CA Issue) does not satisfy the intent of a station 94105 Oakland Bus station Bad (User Intent This result is another Greyhound 2103 San Pablo Ave Issue) station in Oakland but it is too far Oakland. CA 94612 away to be considered relevant. CA satisfy the intent. which include. platforms. CA any bus stations would satisfy the Francisco] 94105 intent. but not all stops are stations. 94105 Maude & Sunnyvale Bad Bus stop is outside of the requested Sunnyvale.

Result is also outside of the requested locality. • If only one result is present in the explicit area. Consider the user intent when applying the relevance rating. Don’t mark them as “User Intent Issue ” simply because they are outside of the requested locality. The demotions range from no demotion (0) to too far (-3). the closer they need to be.18 Chain queries and location modifier In case of multiple possible results within and around the expected area. The 3 examples below for Trader Joe’s. The more results satisfy the query in the requested locality. CA 94086 Issue) station. Costco and Starbucks show how results are demoted according to their distance to the area of expected results. that particular result can be eligible for Navigational . Sunnyvale Station Bad (User Intent Result is not a bus station but a train Sunnyvale. 3. apply the following logic: • Results located inside the explicit area are not demoted for distance. Icon Rating Navigational – when a single result are present in the explicit area Excellent – when multiple results are present in the explicit area Good – closest to the explicit area 54 . • Results outside of the area are demoted for distance/prominence like any other rating.

User intent has been met and there is no need for demotions for service level. but rack] 55 E Grand Ave.g. Walmart Supercenter) o Outlet stores (e. but to a lesser degree. J. which is not reflected in the result should be rated with an initial grade of Good . Acceptable – Significantly further from the explicit area Bad – Too far from the explicit area 3.g. [walmart Walmart Good Query is for a store with specific level supercenter] Neighborhood of service. Walmart Supercenters are Market very large supermarkets that have a 5500 E 22Nd St. AZ 85711 merchandise. Common occurrences include: o Specific stores (e.19 Relevance – Service level mismatch Sometimes the query specifically requests a certain level of service. AZ 85716 store. 55 . IL 60611 result satisfies the query intent but in a lesser degree. [Nordstrom Nordstrom Good The query is for an outlet store. Walmart Neighborhood Market is generally smaller with a more limited array of grocery and general merchandise. full range of grocery and general Tucson. the result is for a full-price store. Situations where the query requests a type of business with generic level of service. providing a result that offers more service than requested should not be downgraded and considered secondary intent.Crew Factory) The situations where the query requests a specific level of service. as the result would still satisfy the user intent. Tucson. which may or may not be reflected in the result. The Chicago. Here are a few examples: Query Results Relevance rating Explanation [walmart] Walmart Excellent Query is for a generic Walmart and Supercenter the result is a Walmart store that 3435 East Broadway offers more service than your average Blvd.

but can still be immediately recognized. • Business Name: Every name used that refers to the specific business is considered Correct . A Partially Correct name differs from the official versions. When the business cannot be confirmed online. like the street name and number in the case of a residential address. 4. The corporate name by itself is therefore not automatically the correct name.2 Correct A result name is Correct when it is used on the official website or other official resources. 4. Can’t Verify is used.4 Name Accuracy The name accuracy is used to rate business/POI names. Other results like a residential address have no name and are rated n/a.1 Name not applicable (n/a) Address Results like residential addresses or other address type results don’t carry a name and are therefore not rated. You will identify the name as the first line/header in your result listing. These names can be listed in a variety of ways in different sections of the site: o Business locator page o Specific business page and about us section o Signs and storefronts o Claimed social media pages 56 . The name has to be used to directly refer to the particular business. Incorrect names are not recognizable with certainty because of severe misspelling or ambiguous and wrong parts in the name. In such cases other components are presented to the user as title. A Correct name is the officially used name and defined variations of it.

Polk Street” on the website as it refers to the Polk Street location. it is referred to as “Microsoft Store” or together with a location modifier such as “Microsoft Store – South Coast Plaza”. This depends on the particular company. rate Correct . can be considered Correct . If the result name differs from those versions significantly. Result Name Official Business Name Explanation and Rating The retail store misses the location modifier (Valley Apple Apple Valley Fair Fair) given on the official website. Peet’s Coffee Peet’s . When the store uses a logo only. Result Name Official Business Explanation and Rating Name McDonald’s McDonald’s The chain calls all stores McDonald’s and has the name in front of all locations as corporate branding. but the result is still considered Correct . the name has to align with the way the corporation refers to the store. The store is officially called “Peet’s . Old Navy doesn’t officially use the mall name as part of Old Navy – Belle Isle Old Navy the store name. It is always rated Correct when the corporate name is in letters on the storefront as part of their logo or branding. Best Buy Best Buy San Jose The chain Best Buy is also using a location modifier in their store names but their store sign (logo) is the corporate brand Best Buy and is therefore rated Correct .• Corporate Name: The corporate name (and sometimes brand or product name) is often used to refer to a particular store. 57 . On the webpage. Because of the close similarities between the result name and the store name. rate Partially Correct . the larger complex or organization they belong to as additional information. it is rated Correct .Polk The name is considered Correct . but might be not the most preferred name. even when not specifically used by the official resources. but the location modifier is correct Station and the business name therefore rated Correct . A missing modifier can also be considered Correct as long as the modifier isn’t crucial for understanding the particular result. because it is used on the sign on & Tea Street the storefront. while the store has the optional location modifier. The result name is Correct because it is used as the Peet’s Coffee Peet’s – Ferry Bldg SF name on the official website. • Location modifier or affiliation: Businesses can carry the name of the locality. Nike Niketown New Nike uses a corporate logo on the store front and the correct name York of the particular store is “Niketown New York”. Rate Correct . Microsoft Microsoft Store The Microsoft store front shows only the logo without any text. Even though Nursing Charity School of this form is not officially. Delgado Community The result for the Nursing School has the name of the Charity School of College – college that it’s affiliated with included. Such a modifier. Rate Partially Correct because the preferred store name differs significantly from the result name.

it is rated Partially Correct . Because it is still mostly recognizable. Official Business Result Name Explanation and Rating Name The business uses a special character outsider the regular set of Toys ‘R’ Us Toys Я Us letters and the name is therefore still considered Correct . • Stylized logos and letters o A variation is still valid. California Irvine Rate Partially Correct . but because they are lacking many formatting choices. Similar restrictions exist for certain social media such as Twitter. when the business uses stylized logos and letters (like the backwards “R” in Toys ”R” Us) that are outside the regular set of letters or when it consists of a play with lower case / upper case. • Article “The” missing or added 58 . Official Business Result Name Explanation and Rating Name The company’s name is confirmed by the url (att. Result Name Official Business Name Explanation and Rating Nursing Irvine is more than a location modifier and it is University of University of California important to differentiate it from other universities. Because the store can still be recognized. but is att AT&T clearly in a bad format. • Holding Name and Corporate Structures: Holding names or corporate structures are not considered correct if not explicitly used by the individual stores. • URL & Twitter Name: The url can give an indication of official names. Official Business Result Name Explanation and Rating Name The addendum LLC refers to the corporate structure and should IT’SUGAR LLC IT’SUGAR not be used for a store.com). it should generally not be used to confirm the official name. JAB Holding The holding company name is completely different than the store Peet’s Coffee Company name and is therefore rated Incorrect . Such names are rated Partially Correct or Incorrect depending on how recognizable the name is in context with the particular business. it is rated Partially Correct .

The name is in an unexpected form not used by the business itself.3 Partially Correct Partially correct is any result name that differs from the official versions but can still be recognized by the user. rate the uhaul uhaul U-Haul name as Partially Correct . o Added: A business/POI that does not officially include a definite article in their name should be displayed without it or else be rated Partially Correct . The result name is duplicated and in all lowercase with no “-”. but the name is still Home Depot The Home Depot considered Correct . TGIF • Minor and moderate misspellings that don’t influence the user’s understanding Official Result Name Business Explanation and Rating Name Macys Macy’s The result is missing the “ ‘ ” and is rated Partially Correct . Official Business Result Name Explanation and Rating Name Sears does not use “The” in any of their official webpages. Seven Eleven 7-Eleven Therefore rate Partially Correct . o Missing: The use of definite articles depends on the individual result. 4.1 Minor and Moderate Misspellings Rate Partially Correct for any issues that don’t prevent the user from identifying the business: • Name has redundant or missing information • Multiple repetitions of name parts • Incorrect or missing punctuation or special characters • Unexpected use of lower/upper case and ALL CAPS letters • Acronyms are often expected in ALL CAPS: YMCA. Official Business Result Name Explanation and Rating Name The business only uses The Home Depot. A company that is using “the” is often referred to without it and is therefore Correct with and without the article. Adding The Sears Sears it is considered Partially Correct .3. 4. Missing the “&” in H&M is a misspelling but still allows the user to HM H&M recognize the business and is rated Partially Correct . service level mismatch and missing or unnecessary name parts. MCDONALD’S McDonald's When the official resources for Mosjaw Moosejaw The outdoor store shows two misspellings but is still identifiable and is 59 . This includes minor and moderate misspellings.

The additional “superstore” is not used officially. but also does not change GAP Superstore GAP the user’s ability to identify the well formatted and correct corporate name and is therefore rated Partially Correct . Napoli The result name has additional parts not used by the business. it is rated Partially Correct . Ecofuture Buildng Ecofutures The business shows two misspellings and the incorrect business structure. 60 . Official Result Name Business Explanation and Rating Name rated Partially Correct . Co Building Inc Rate Partially Correct . Because Coffeehouse & Napoli Coffee the additional parts are in line with the business and don’t make the result Pastries ambiguous.

4. The user is expecting a vending machine where there is a store. it is considered a service level mismatch and is rated Partially Correct .2 Service Level Mismatch Chain businesses often indicate the level of service provided at that location in their name. o Example: In a German test and area "Gas Station" instead of "Tankstelle" 61 . which it isn’t. Address type suggestions will not have a classification. A Best Buy Express is a vending machine and not a store.3. Official Business Result Name Explanation and Rating Name The result name suggests that the store is an outlet.3. Patagonia Outlet Patagonia The name is demoted to Partially Correct . This includes broad or alternate classifications that are not the preferred choice. This is a Best Buy Best Buy Express service level mismatch and rated Partially Correct .3 Incorrect classification In the title portion of your data accuracy you will also evaluate the accuracy of the classification. Best Buy Express Best Buy This is a service level mismatch and rated Partially Correct . 4. The result Name would be rated Partially Correct for an incorrect classification. which refers to the category of the business or POI. Correct classification: Consider a classification correct as long as it is not wrong or misleading. o Example: Title "Yellowstone National Park" with the classification "Hardware Store" • Is in an unexpected language. Missing classification should not be rated with Partially Correct . A result with an incorrect classification gets rated Partially Correct for Name Accuracy. when it: • Does not match or cannot be associated with the business itself. If the result name does not reflect the correct type.

User intent not satisfied We differentiate between a bad classification and not satisfying the user intent.• Has any kind of misspellings. o Example: "Electroncs" instead of "Electronics" • Is incomplete (missing parts. the result Hog’s Breath Saloon for the query [Bar Key West] has a Partially Correct name and a wrong classification and is therefore rated Incorrect . • Query [hotel] returns "Butcher Joe's Meat House" because of the bad classification for hotel. o Example: "HIWAY" as abbreviation for "Highway" (Correct: HWY) Wrong classification vs. Not matching the user intent results in a bad suggestion. • Query [butcher] returns "Butcher Joe's Meat house" with an incorrect classification hotel. For example. while an incorrect classification is still of value to the user. uncommon/odd abbreviations). o Not providing the correct classification is rated Partially Correct in Name Accuracy. 62 . o Not satisfying the user intent makes the suggestion useless and is additionally rated Bad for Relevance. Wrong classification and Partially Correct Name Mark the Name Accuracy Incorrect when the name is partially correct and the classification is wrong. even when slightly confusing.

It is therefore rated Incorrect . which makes the name Taco Bull Taco Bell ambiguous: It could be a “Taco Bell” chain store or a different business named “Taco Bull”. By adding the unnecessary part “Pizza” the name becomes ambiguous and the user does not know if there is a pizzeria with Walgreens Pizza Walgreens the name Walgreens or a wrongly labeled Walgreens pharmacy. The misspelling is severe and does not allow the user to identify Zatas Tacos + Zacatecas Tacos + the business with certainty. Rate Incorrect for issues like: • Severe misspellings that prevent the user from identifying the business with certainty because of: o Change in meaning. • Official Business Result Name Explanation and Rating Name The misspelling changes the meaning of the word “Seasons” and Samsons Pizza Seasons Pizza gives the impression of a different entity.4. • Slang and inappropriate language. Rate Incorrect . In short business names. Such situations can be difficult to rate and it is advised to follow the proposed workflow for ambiguous situations described in the research section. Rate Incorrect . The user is likely under the Tequila Tequila impression that it is a different restaurant. Rate Incorrect . • Unnecessary or missing parts in the name that prevent the user from recognizing the business. o Misspelling that results in an entirely different word or gibberish. 63 . Slang and inappropriate language are also considered Incorrect . The misspelling changes the meaning. even small errors can prevent the user IEA IKEA from recognizing the business. Rate Incorrect .4 Incorrect An incorrect result name is not recognizable with certainty because of either severe misspelling or ambiguous and unnecessary/missing parts in the name.

Millbrae. The transit indication is considered optional and can be missing. This can be the case for small businesses that don’t maintain their own webpage or social media profile or the lack of other official resources or street imagery. USPS (United States Postal Service) and UPS (United Parcel UPS USPS Service) are both in the delivery business. but users have to walk outside to get from one building to another. but not for any particular store. If there are multiple transit systems at the same station. The classification of the result will help you identify the correct interpretation of the result. consider the results for the two stations as two separate POIs. but the classification includes “transit”. CA” has a transit indication for the BART system. If transit stations are close to each other. For example. Rate Correct • “Millbrae Amtrak. 4. any of the transit systems can be included in the name to be Correct . Millbrae. The rating remains Incorrect . It is used by the official Maccas McDonalds Australian website. 64 . Only BART and Caltrain operate in Millbrae. 4. The user query for [san jose station] can therefore return San Jose Diridon Station or simply San Jose to be Correct . the business name cannot be confirmed.6 Transit Names Transit stations are often named after the locality or street they are located on and can include a transit indication such as "Station" or "Subway". CA can return the following station names: • “Millbrae. CA” has no transit indication in the result name. Millbrae. CA” has an incorrect Amtrak transit indication. rate Can’t Verify . By switching Marks with Starbucks.5 Can’t Verify When due to a lack of available data online. • “Millbrae BART. Rate Correct . the result name “Cheesecake” is The Cheesecake Cheesecake not specific enough and the chain business cannot be identified Factory with certainty. the query [Millbrae station] with a user/viewport over Palo Alto. Maccas is Australian slang for McDonalds. Rate Incorrect . the business can no longer be Starbucks & Spencer Marks & Spencer identified and the name is rated Incorrect . Rate Incorrect . Rate Incorrect . but are entirely different companies. When missing the word “factory”.

Numbers without an associated building 65 . How street numbers are assigned varies by country and area. If the issue is not tied to individual components but to an issue pattern. Please check the Country Specific Guidelines for more details. Locality. Sunnyvale. Address components are the elements used to form the address details for each result. Result Expectation and Research to determine correctness. There might be variations for specific markets that are not directly handled. State. Here are examples of typical addresses and their components: Address example Components 1384 Navarro Dr. Street Number. Language/script or other issues can occur within parts or the entire address. This makes it sometimes difficult to understand the logic of it. Depending on what is at that location. Street Number. It refers directly to the checkboxes presented in the rating interface when Incorrect is selected. Postal Code. 5. Street Type. like in the case of “10 Downing St” in London that is also referred to as simply “Number 10”. Street Type. Street Number. CA 94087. Choose all incorrect or missing components you identify. Postal USA Code. 1053 XX Amsterdam Street Name. Street Name. a number can be more important than others. Locality.5 Address Accuracy: Components & Issues The Address Accuracy is split into 3 main parts: Components & Issues. Street Type. France Country Potgieterstraat 34. This chapter covers address components and possible issues that are associated with an address. Locality 5. Street Name. Never select issues and components at the same time to report the same issue. Postal Code. 75004 Paris.1.1 Address Components Each component is defined with a global approach in mind.1 Street Number The street number points to a specific building or location on a street. Here are some patterns you may detect in your country. Checkboxes should be marked for either incorrect or missing information. choose the appropriate issue instead. Country 54 Rue Saint-Louis en l'Île.

There are multiple reasons why not all numbers point at a building: • There might be an empty lot with an assigned street number. • The street number of the query is within the address range of the suggestion. USA 55 Rue Saint-Louis en 54 Rue Saint-Louis This address has a different l'Île. 1384 Navarro Dr. 75004 Paris. odd numbers are on the right and even numbers are on the left. Incorrect Check the Street number XX Amsterdam 1053 XX Amsterdam Street number checkbox because the street 66 . United street number in the result is Kingdom within the range provided. London EC3N Street number checkbox because the UK is an United Kingdom 2AE. This may vary from country to country or even from locality to locality. Sunnyvale. 39 Crutched Friars. London EC3N Street number checkbox because the street United Kingdom 2AE. 45 Crutched Friars. 1053 Potgieterstraat 34. often when driving south on a road in the US. United number in the result is outside Kingdom of the range provided. Address Range Address ranges are used to assign numbers to a stretch of road. • Address ranges are given to segments of a road for various reasons. • The numbers are assigned proportional to a determined distance. Street number checkbox should be selected. which results in skipping numbers. 39-41 Crutched Incorrect Check the Street number London EC3N 2AE. Correct This is a correct address. 39-41 Crutched Incorrect Check the Street number London EC32AE. not all numbers have a building assigned to it. CA USA 94087. Here are some examples: Address in Result Address in reality Rating Explanation 1384 Navarro Dr. CA 94087. Friars. As an example. Friars. • The range or number matches the odd/even numbering system for left/right side of street required by the country. Potgieterstraat. Friars. consider it correct. When an address range is given by the query or returned as a result. 75004 Paris. Odd/Even Side of Road Many countries divide the sides of the roads into even and odd numbers to allow for a quicker search of a number. 39-41 Crutched Correct No need to select the street London EC3N 2AE. and number Kingdom 40 is even while the address in reality is odd. United odd/even country. London EC3N number checkbox since the United Kingdom 2AE. when: • The street number of the result is within the given range of the query. Given the nature of such ranges. 40 Crutched Friars. en l'Île. Sunnyvale. Incorrect street number than it is in France France Street number reality.

CA 95128 Suite #1110 exists in reality as displayed on San Jose. All 3 cases are rated Incorrect – Unit/Apt when incorrect or missing. 67 . 5. A unit number should be correct and present when: • The user query contains a unit number • The official address of a business/POI has a unit number Unit numbers can stand for a different house (Example 1). apartment or building numbers. When the official business or address query does not list a unit number and the unit number cannot be confirmed otherwise. CA 95128 San Jose.1. no unit number should be given. The unit/apartment number can be given by a user query or by official resources for a business/POI. San Jose.2 Unit/Apt A building number can be further split into units. In both cases. A common form is the use of letters: A. a separate entrance (Example 2) or simply apartments within a single building (Example 3). B. the Unit or Apartment number has to be present and correct. number is missing altogether in the result. Rate Incorrect – Unit/Apt when unit number is present in the rating tool. C as well as the character # in front of a number like: #420. Less common are forms like ½. CA 95128 the official website. CA 95128 Free People Free People Incorrect This result address has a 333 Santana Row 333 Santana Row Unit number missing unit number that San Jose. Here are some examples: Address in Result Address in reality Rating Explanation Free People Free People This is a correct address as 333 Santana Row 333 Santana Row Correct displayed on the official Suite #1110 Suite #1110 website of the business.

CA 95128 San Jose. The name becomes unique in association with the state. Some stretches of the road can carry multiple names and multiple road numbers at the same time. 68 .Free People Free People Incorrect This result address has a 333 Santana Row 333 Santana Row Unit number different unit number than the Suite #2490 Suite #1110 one displayed on the official San Jose. CA 95128 website.3 Street Name Each road or street has in most cases at least one name. Street names are subject to change and the old name can either be kept as an alternate name or deprecated. that stays with the road for a longer distance than the name. 5. Larger streets often carry a road number (shield). city or neighborhood and can change once it crosses a border. Alternate Street Names A street can have alternate names or route numbers.1. Unit number checkbox should be selected. as well as multiple names in different languages in bilingual areas. Consider a street name correct when the name used is still valid and in the language expected given the test language or the user query.

West (W)) as well as street types (Street (St). 1071 DJ Amsterdam. 1071 DJ types. Address in Result Address in Rating Explanation reality Van Gogh Museum Van Gogh Correct This is a correct address as Museumplein 6. Museumplein and “kade” (quay) are street Netherlands 6. If they are incorrect or missing. Santa Clara. Santa Clara. which is wrong and 3530 E El Camino Real. 1071 Museum displayed on the official website DJ Amsterdam. East (E). Netherlands 6. Boulevard (Blvd). Netherlands Van Gogh Museum Van Gogh Incorrect This address has the wrong type Museumkade 6. 6. Avenue (Ave)) are part of the street name. 1071 DJ Amsterdam. Choi’s Korean Choi’s Korean Incorrect This result has additional Restaurant Restaurant Street name direction. 3530 El does not exist in real life. 118 E El Incorrect This address is missing the Sunnyvale. Museum Street name street name. South (S). (Museum quay) in Amsterdam. Street name direction. 1071 DJ Amsterdam. 1071 Museum Street name of street: both “plein” (square) DJ Amsterdam. the street name is wrong and rated Incorrect . CA 95051 Camino Real. Netherlands Van Gogh Museum Van Gogh Incorrect This address has the wrong Van Baerlestraat 6. Museumplein checkbox should be selected. CA 94087 Camino Real. There is no Museumkade Amsterdam. Netherlands 6. Exceptions are when such elements of a street name are used interchangeably for the same street.Street Directions and Types Street directions (North (N). Street name 1071 DJ Amsterdam. therefore the street name Netherlands Museumplein checkbox should be selected. Netherlands Van Gogh Museum Van Gogh Incorrect This address has a missing street 6. CA 95051 69 . therefore the street Sunnyvale. 1071 DJ Amsterdam. Netherlands therefore the type of street is considered wrong and we select the checkbox for street name. 118 El Camino Real. CA name checkbox should be 94087 selected. Museum Street name name. Museumplein of the business.

In case of local government reforms or other changes in naming. for example. large POI) rate Correct . business. more than one postal code applies – as long as the returned postal code is correct for at least a part of the feature (street. selected. Address in Result Address in reality Rating Explanation Van Gogh Museum Van Gogh Correct This is a correct address as displayed Museumplein 6. Netherlands Van Gogh Museum Van Gogh Incorrect This address has the wrong locality. 70 . Columbus OH. 1071 Museum Locality therefore locality checkbox should DJ Netherlands Museumplein 6.1. 1071 Museum Locality Locality checkbox should be DJ Utrecht. the result has to reflect the official name. Museumplein 6. Netherlands 1071 DJ Amsterdam. Please refer to the Country Specific Guidelines for more details. 1071 DJ Amsterdam. contains 45 postal codes. Every result requires the correct locality component within their address detail.5.4 Locality & Administrative Divisions Administrative divisions and mandatory address components vary from country to country. For many localities.5 Postal Code The postal code accompanies the locality name and provides further detail to where a feature is located. Museumplein 6. Netherlands Van Gogh Museum Van Gogh Incorrect This address has a missing locality Museumplein 6.1. Netherlands 1071 DJ Amsterdam. Netherlands 5. 1071 Museum on the official website of the DJ Amsterdam. Museumplein 6. Exceptions are made in cases where alternate names are accepted. locality. be selected. Some countries or areas require additional sub-locality or municipality components for correct address information.

In the US. 1071 DJ correct “DJ”. but if present has to be correct. USA Sunnyvale.Address in Result Address in Rating Explanation reality Van Gogh Museum Van Gogh This is a correct Museumplein 6. Sunnyvale.6 State or Region When it comes to a state or a region. Postal Amsterdam. Museumplein on the official website Netherlands 6. CA 94087. Amsterdam. Brabant.1. Sunnyvale. therefore the region checkbox will be selected. Sunnyvale. Address in Result Address in reality Rating Explanation 1384 Navarro Dr. code checkbox Netherlands should be selected. Region/State checkbox will be selected for missing state. Van Gogh Museum Van Gogh Museum Correct Region is not a mandatory Museumplein 6. Museumplein “DM” instead of the Netherlands 6. USA component in the USA. the state is always expected in either full (California) or abbreviated form (CA). Van Gogh Museum Van Gogh Incorrect This address has a Museumplein 6 Museum Postal code missing postal code. North. 1071 DJ should be selected. USA 1384 Navarro Dr. Holland. 1071 Museumplein 6. DJ Amsterdam. but if present has to be correct. 71 . 1384 Navarro Dr. 1071 DJ Amsterdam. each country has its own understanding of what is expected (correct) or unusual (incorrect). Amsterdam. 1071 Museum Correct address as displayed DJ Amsterdam. component in the Netherlands. Netherlands Van Gogh Museum Van Gogh Incorrect This address has the Museumplein 6. Museumplein Postal code checkbox Netherlands 6. DJ Amsterdam. This is a correct address. 1071 DJ of the business. 1071 Museumplein 6. 1071 DJ Amsterdam. CA Region/State which is a mandatory 94087. Amsterdam. Netherlands Netherlands The correct region for the city of Amsterdam is North-Holland. Netherlands Netherlands Van Gogh Museum Van Gogh Museum Incorrect Region is not a mandatory Museumplein 6. 94087. 1071 Museum Postal code wrong postal code DM Amsterdam. Region/State component in the Netherlands. North. Incorrect This address is missing the state. Netherlands 5. 1384 Navarro Dr. CA Correct USA 94087.

The suggestion for the search [Avenida] is the famous street “Avenida Revolucion” in Tijuana. an important piece of information for the user. This is the case when the official postal service acknowledges the existence of the address and/or there is other evidence like street imagery or an official webpage claiming the address. CA Correct since the test locale is 94087. which is the test locale. USA 94087 the USA. CA Correct the country name since USA 94087. This address includes Sunnyvale. Test Locale Address in Result Address in reality Rating Explanation en_US 1384 Navarro Dr. rate Incorrect and select the Country checkbox. de_DE 1384 Navarro Dr. mark it Incorrect – Address does not exist . the test’s locale. 72 . Sunnyvale. mark it Can’t Verify instead. The example shows the user south of San Diego. 5. United States. Museumplein 6. CA Sunnyvale.2 Address does not exist Residential Address results need to have a building associated with them in order to be useful to the user. The address details show the country. Country mandatory in this 1071 DJ Amsterdam 1071 DJ example because the Amsterdam. 1384 Navarro Dr. Mexico. If missing. 94087. en_US Van Gogh Museum Van Gogh Museum Incorrect The country is Museumplein 6. This is a correct address Sunnyvale. address is outside of the Netherlands US. If there is no evidence found that the address given actually exists.1. In case sufficient resources are not available to make an informed decision. but should be included when the result is located in another country other than the test locale.7 Country The country is often a “nice to have” piece of information.5. USA it is outside of the Germany. 1384 Navarro Dr. Checkbox for country should be selected.

73 . when it is matching: • Test language/script or • Language/script or of the query • Language/script of the result location Any combination of unexpected language or script is considered Incorrect . so do the best you can without doing more research than normal. Mark mixed languages and scripts of any address details as L an gu ag e /s cr ip t I ss uewhen it uses a different language or script than the query. use the check box for Country Specific Issue when there is an address problem that is very specific to the country you are rating. Use the normal research steps to confirm the address. It is not expected that you understand markets and address formats outside your local knowledge expertise.4 Country Specific issue The variety of address formats and distinctive country specific issues is broad. 1066 Hippy Hollow Rd. An exception can be made in cases when only special characters are added that are not used in the expected language. test and region. Red Boiling Springs. The address information needs to be in a language and script useful to the user. given the test language (like en_US). Note that the entire address must be in a unexpected language or script. 5. In general. the user query and the result region.3 Language/Script Issue in Address The Address Accuracy Incorrect – Language/Script Issue is used for all address components in the address details of any result. The address matches the expected language or script. TN 37150” with a user in the US on a phone set to English. please refer to the chapter on Result title/name is unexpected language. For business/POI names and address titles in unexpected language.5. Results located in a market with different scripts are hard to verify. The following examples show incorrect language and script for the result “Cafe Timber. otherwise it is considered a mixed language issue.

but are actually permanently located the same location. This chapter helps to form the appropriate expectations in order to rate the address accuracy.1 Business/POI Result The address details of a business consist of a street address: Street number. 6. Refer to the official webpage as well as common address formats in your country to determine the correctness of each given business or POI address. street name. The Amazon river has no street address but is accompanied by the country.1 Businesses/POI with moving locations Moving entities can either be on a fixed schedule or moving at random.5. while the fast food place “Wienerschnitzel” shows the complete address. postal code. In some cases.5 Other Issue Issues that appear outside of the address issues in these guidelines are reported using “Other issue”. locality and country when outside of the test locale. 74 . As an example. Please make sure to leave a comprehensive comment together with links to resources for further investigation. Some official addresses may have a vanity street name or don’t have an official street number and in rare cases they even lack of the complete street address. when an address is duplicated (shown twice within the same result). 6. 6 Address Accuracy: Result Expectation Each result type raises different expectations regarding its address details. mark it as Incorrect – Other Issue . entities appear to be moving because they are located in a truck or similar entities.1.

6.e. such as Burning Man or the Sziget Festival.3 Events Some events can be very prominent but happen only a few days out of a year.1. Fixed schedule Some entities.Random location Random moving entities cannot be predicted and should not be shown on the map. Mark any other address as Incorrect – Other Issue . The most accurate location is the address of the longest stay over a full cycle of the given schedule (i. Annual Events Events that happen once a year. but attract massive amounts of people and media attention. The vehicle does not need to be parked at the location after closing hours to be considered on a fixed location. 6.2 Temporarily Closed Businesses Businesses and POIs can close for remodeling.1. As such. only happen for a short period of time each year. if the query and location intent is clear. In cases of a tie. Regularly recurring (weekly/monthly) Rate events like weekly farmer’s markets like any other business. consider any of those locations as Correct . others are regularly recurring. Treat all temporary closed businesses as open when the closure is stated on the business/POI webpage or managed social media page. if a business has a weekly cycle and stays in one spot for 4 days that will be the only acceptable address for it). vacations and other reasons. assign an 75 . Rate such businesses as Result is closed or does not exist. Fixed location Businesses that operate out of a truck or bus that is stationary are evaluated as a standard business. such as Food trucks for example can move on fixed schedules. There is no time restriction to how long the closure can be. A user can be interested in such an event outside the time it is held. The stops are usually posted on the official webpage together with the schedule.

Street name. • P. the street number comes before the street name in the United States but after in Germany. there is no official address for the event location and you may end up treating some of them as landmark or natural features. CA 94087 Street Type. • The address given has to point at the physical location of the result. street name. Check your country specific list for a complete list. For example.2 Residential Address Result A residential address usually includes a house number. Locality country. California’s Great America theme park). Depending on the location.appropriate relevance rating. Spirit Halloween store) and seasonally open POIs (e. locality. Locality. Street Type. 6.2. It can be the same as the mailing address or other addresses provided by the official resources. Postal code. In case there is strong evidence that this is not the case. 6. Museumplein 5. Street Number. State.g. rate Incorrect – Address does not exist and leave a sufficient comment including links. the same way you’d treat annual events. but here are a few examples with an explanation for their respective markets. boxes are not valid addresses in the map context. The displayed address always uses a street number and street name.g. 76 . Check your country specific list for a complete list. Address Mandatory components Explanation 1383 Navarro Dr. Use the chapter Address Format below as well as your local knowledge to identify the necessary components and format. Street Mandatory components may vary per 1071DJ Amsterdam Number. Treat seasonal stores (e.O. Non-existent Residential Address A residential address needs a building associated with it and should be supported by the postal authorities. postal code and state/region. various address formats are used.1 Address Formats Depending on the country. Singular or non established Events Non-recurring events from the past don’t carry any map significance and are rated Business/POI closed or does not exist . unless the place itself became a POI due to its historical importance that carries the name of the event further. Street Name. but here are a few examples with code an explanation for their respective markets. Mandatory components may vary per Sunnyvale. The sequence of the components is adapted to match the local needs. Postal country.

Alternate address formats depend on the country and can differ by requiring an additional locality component or even an intersection addresses. If such components are present. State. different address components are expected: • Local roads: Longer roads that travel between cities or states don’t require a locality or state component. Here is a list of such alternate formats: • Km Address (Measured distance on a road as address) • Relational Address (“next to” or “in front of”) • Intersection Addresses (2 intersecting streets) • Additional components like sub-locality or municipality or region 6. they have to be accurate and pointing to section of the road that is close given the user location and viewport.It might be impossible to confirm an address on official resources when another format is used. Locality address Netherlands 6. 77 . Street Type. therefore. but here are a few examples with an explanation for their respective markets. The result usually includes the state it is within. Postal code. Postal codes are not mandatory address CA 94087 Locality. rate Can’t Verify if it points to the same location using the alternate format. Postal code components for a street result.3 Street Result Depending on the length of the street. Check your country specific list for a complete list. Street Name. Street Type. Sunnyvale. Mandatory address components for a street Amsterdam. • Highways/Interstates: Longer roads travel between cities or even states don’t require a locality or state component.4 Locality Result A locality result can be a city. Museumplein. municipality or neighborhood. but should be correct for that street if present. see the Country Specific Guidelines. Street name. Mandatory components may vary per country. village. Address Mandatory components Explanation Navarro Dr. There might be country specific components required.

but here are a few examples with an explanation for their respective markets. State Mandatory components may vary per country. Mandatory components may vary per country. CA Locality. Check your country specific list for a complete list. Locality Mandatory components may vary DJ Amsterdam.6 State/Region Result A state or region result has to be accompanied with the country. if the user is in a different country than the result. Mandatory components may vary per country. Netherlands 6. Query Address Mandatory Explanation components [94087] Sunnyvale. State. 78 . CA 94087 Locality. Amsterdam. per country. Address Mandatory components Explanation Sunnyvale. but here are a few examples with an explanation for their respective markets. 6.5 Postal Code Result Postal codes are returned when the user query matches the specific numbers or letters. Locality Mandatory address components for a Netherlands locality address. [1071 DJ] Museumplein. Postal Mandatory components may vary code per country. Check your country specific list for a complete list. 1071 Postal code.

Romania Country The country is the highest administrative level and has no other address components. Check your country specific list for a complete list. Address Mandatory components Explanation Netherlands Country The country is the highest administrative level and has no other address components. 79 . Natural features within a park may reference the park as address. Check your country specific list for a complete list. 6. but here are a few examples with an explanation for their respective markets. If an address is present. Ranger Station. such as Mount Rushmore. Visitor Center). North-Holland Region name Country name is a mandatory component if result is outside of test locale and should be rated as missing. mountains and other geological features do not have a street address and should not return any address components. Mandatory components may vary per country. Mandatory components may vary per country.g. Treat landmasses like islands and continents as natural features meaning that there is no expectation of an address. In some cases.8 Natural Features Natural Features like rivers. such an address is considered Incorrect – Other Issue . but here are a few examples with an explanation for their respective markets. 6. even when pointing to a building that is associated with the feature (e. If an address is returned.7 Country Result The country is the highest administrative level and has no other address components. the official address can be returned because the feature is also considered a POI.Address Mandatory components Explanation California State name Country name is a mandatory component if result is outside of test locale and should be rated as missing. rate it Incorrect – Other Issue .

1 Official Address Present Some POIs may have an official address listed on their website. bridges. 6. ferry ports.Result Mandatory components Explanation Mississippi River No mandatory Natural features do not have a street components address Mount Everest No mandatory Natural features do not have a street components address 6. a locality name may not even be necessary because they usually cover an area that overlaps several localities. Transit Stations are features like: airports. Examples are: Monuments. Use the following examples to determine the rating of features in this category when an official address is present. but a user wouldn’t necessarily expect one. (National) Parks & Other Features without Expected Address For the majority of results. 80 . transit POIs and other features clearly outside the address system. However there are a group of features that the user expects no address to be shown. the Embarcadero BART station has an official address listed on their website. or park like heritage sites.9. subway. we expect to show the official address. Theme parks and golf courses are not considered parks in that sense. For example.9 Transit Stations. Depending on their size. Parks and other park-like features are designated nature areas. train and bus stops. but users wouldn’t necessarily expect the address to be shown.

San Correct . San Name . However. CA 9411 Embarcadero 298 Market Street San The result misses the street address completely. CA 94111 street number. CA 94111 Therefore rate the address as Incorrect – Street 296 Market St. Francisco. Result Details Official Address Explanation & Rating Embarcadero Market Street The result provides an additional street number that is located at the San Francisco. For the following example. CA Rate result addresses that are more specific than given on the official webpage either Can’t Verify or Incorrect. Rate Correct . BART station. San Francisco. Francisco. CA 298 Market St. San Incorrect – Street Name . location of the station and therefore rated Incorrect . 298 Market St. CA 94111 refers to Market St. San 94111 Francisco. San Francisco. Therefore rate the address as Davis St. but misses the Francisco. CA Embarcadero 298 Market Street San The result contains a different address than the official address. 465 Market St. since no address is expected. assume the official address for the Embarcadero BART station does not provide a street number. CA Embarcadero 298 Market Street San Davis St. San CA 94111 Francisco Embarcadero Market Street The result provides a street number that is 250m away from the actual San Francisco. San CA 94111 Francisco 81 . Francisco. It is therefore not wrong and rated Can’t Verify . CA 94111 address is expected. is the cross street of Market St but the official address Francisco. Francisco. Because no Francisco. rate Correct ..Result Details Official Address Explanation & Rating Embarcadero 298 Market Street The result and official address are identical. CA Embarcadero 298 Market Street San The result matches the official street name. rate Market St.

An address that points to the feature or gives access to the feature. Result details Official Explanation Address Hoover Dam None The Kingman Wash Access Rd does provide access to the Hoover Dam from the Arizona side. Providing Access Pay attention if the street actually provides access. which has no official address. A person must be able to reach the result directly from the given street. Rate Can’t Verify because the street name is 82 . any address given that cannot be confirmed Incorrect will be rated Can’t Verify . Streets with driving or walking restrictions of any kind are still rated Can’t Verify or Correct . An address will be proven Incorrect the moment it points to a different feature. but is not an official address will be rated with Can’t Verify . In the example to the left.2 No Official Address When no official address is listed on the website.6.9. the Lighthouse Ave does not provide direct access to the Museum of Monterey as it goes underground and there is no place to exit. Follow the example below for the Hoover Dam. The street name is therefore rated Incorrect .

The street number given cannot be confirmed Incorrect and is 85 Hoover Dam therefore rated Can’t Verify . Rate the address as Incorrect – Region/State. Boulder City. Kingman Wash Access Rd. Hoover Dam None Boulder City is a locality in Nevada and not in Arizona. the address is either correct or incorrect. AZ 7 Address Accuracy: Research The research steps will determine the accuracy of the address for each result type by confirming it on official resources. not officially confirmed. 85 Hoover Dam Access Rd. Confirm if address is correct 3. depending on the available resources: 1. but is not in the expected format. Identify expected address components 2. Confirming the address accuracy is a process that can consist of up to 3 steps. Confirm if address is incorrect 83 . There are instances where the address cannot be confirmed or the address is correct. we cannot confirm the address as correct. NV Hoover Dam None Because there is no official address given. AZ Hoover Dam None The Hoover Dam Access Rd provides access to the dam from the Nevada side. Willow Beach. The information is not incorrect and is therefore rated Can’t Boulder City Verify . Boulder City. Access Rd. In general.

For example. etc.1. • Departments & Associated Entity Address: o When no official address for the large entity (mall. university. CA 94305 • Stanford School of Law. in the “contact us” section or in case of larger chain businesses.1 Confirm Correct Address The address given is confirmed Correct when it is identical to the physical address listed on the official webpage or on other official resources. consider the address as Correct . no database is perfect. follow the guidelines regarding Can’t Verify . beaches etc. • P. It usually has a distinct address.) can be found on the official webpage. Stanford.O. o In addition of a street address. Here two correct example for the Stanford School of Law: • Stanford School of Law. The address can often be found at the bottom of the page. accept the result address as Correct . corporate design and logo. This can be confirmed by consulting the official postal service (or closest to that depending the country) as well as street imagery and others. 559 Nathan Abbott Way. Rely on your local knowledge to determine the accuracy of the information given and share the link to the resource in the comment. USPS may not return an address even if it exists. Stanford.1. Here are a few of the most common situations: • Multiple Official Addresses Listed: Accept any physical official address for the feature listed as the official address as Correct . an associated entity can have the name of the larger entity to be rated Correct . when it matches the address of any department or associated entity at the same location.2 Official Web Page A web page owned and maintained by the business/POI is considered the official webpage. Keep in mind. rivers. Box and Mailing Address: Addresses located in a different location or building are not valid and are rated Incorrect . 7. Always use a second resource to validate (like street imagery or other services). rate the address as I nc or re c t – A dd re ss d oe s n ot e xi st . • Different Address Format: In case the address listed has a different address format. In case the residential address has no building assigned. 7.7. CA 94305 • Result misses the Street Address: o Correct : Both result and the official webpage are missing the street address (street name. street number or both) and the locality is correct. 84 . • Natural Features: There are often no official resources available for features like mountains. o Incorrect : The street address is missing but the official webpage has a street address. by using the store locator. lakes.1 Confirming Correct Residential Address Residential addresses are considered Correct when there is a building associated with the number or equivalent address. Stanford University.

7. Such resources are: • Social media sites claimed and recently updated within the last 6 months • Street imagery (any recent imagery showing images of streets and buildings) • Primary publications (news paper articles or similar publications) • Postal authorities for postal code and locality name If no such official resource can be found. localities. rate according to consensus from multiple sources. If three other sources have the same information. it is most likely Correct .1. 7. 85 . • Valid but redundant components (see Country Specific Guidelines for the market) • Duplicated components • Address component is duplicated more than once —> Consider this an Incorrect address and mark it under Other Issue . • Postal Code & Locality Name: Consider the information given by the postal authorities as well as the official web page as Correct .4 Resource Hierarchy in case of conflict • Valid Alternate Names: In case valid alternate addresses exist or street names. When the address stated by the official web page or resources is in a different format.3 Official Resources Official resources are used to confirm the address in case the official web page does not provide one. mark it as Correct with formatting issues . it is either Incorrect or Can’t Verify . • Unexpected component is present and correct 7. postal codes are used interchangeably.2 Correct with formatting issues In case all information is correct and present but not in the order expected. • Components are in unexpected order • Extraneous spacing • Double comma [. • Street Address: The official web page supersedes the official resources. If only two competitors agree.] —> Do not demote for double commas.3 Confirm Incorrect Address If the address cannot be confirmed as correct.. the information is less likely to be confirmed. consider all versions as Correct . 7. This includes issues such as the order of address components and other minor issues that are not necessarily considered wrong. Rate contradicting information between similarly reliable sources Can’t Verify .1. BUT rate Incorrect if required component is missing according to guidelines. confirm if the address given is Incorrect or Can’t Verify . Each address has to be presented in the appropriate format.

This is usually the case when there is a lack of resources or a different address format is given on the official website.7. • It points to a different feature that claims the address. • Incorrect address components 7.2 Can’t Verify: Address Pointing at Feature An address is marked Can’t Verify when it cannot be confirmed correct or incorrect.1 Incorrect Address An address can be Incorrect for multiple reasons: • It is different from the official address. The official address has to be for the physical location “(and not PO Box) of the business/POI and in the same address format.3. 86 . Rule and Explanation Example The street number has to fall within the possible range of addresses. The street number 165 falls within the possible house numbers ranging from 102 and 175. Ask yourself: Is the location given by the result address at least not wrong given all information I have found? This can impact street numbers and street names. Can’t Verify for Street Number The following examples have different address details for a business called Utopia. • Lack of resources: o No official webpage found o No official address listed o General lack of official resources • Different address formats used by official resources: o Intersection address (Main St and 2nd St) o Name of larger entity instead of street address The approach is simple. There is no information online to confirm the address and only a few house numbers can be confirmed with official resources. Rate the address Can’t Verify .3. Use the following examples to reach a conclusion for your particular case. Those are the houses closest to the result address that could have been confirmed.

The street number 166 is an even number and should therefore be located on the other side of the street. Rule and Explanation Example The result address has to provide access and be within the possible range of street numbers. This only applies in situations where the left or right side of the street is consistently used for odd or even numbers. Can’t Verify for Street Name The following examples have different address details for a business called Aztec.The street number 181 is outside the confirmed range and is therefore confirmed as Incorrect . The street W Babcock St provides access to the business and the number appears to be within the range of addresses we can confirm. MT” and therefore in a different format then the result addresses. 87 . The official address is “Granite Ave & W Babcock St. Rate the address Can’t Verify . Bozeman. This confirms the street number as Incorrect .

The issue could be: Wrong location (wrong pin and incorrect address). identify which business is the intended one). 88 . confirm if the business name is correct (in case of multiple names merged into one.4 Rating in Ambiguous Situations There are cases where it is unclear what the underlying issue is. The following steps help categorize the issue at hand. As a first step. incorrect business name or the business does not exist. Ravalli St does not provide access to the business. Rate the address Can’t Verify . A result is considered ambiguous when the business name can’t be identified with certainty or when the business does not correspond with the given location and it cannot be confirmed as closed. 7. The address is therefore rated Incorrect . This is done by reviewing all provided information and then searching for businesses nearby that match the different parts of the business name.The street Granite Ave provides access to the business and the number appears to be within the range of addresses we can confirm.

Investigate immediate surrounding area The business could be misplaced. Potential Outcomes: • The overwhelming majority of information aligns with the business name. consider the business as misplaced if there is an existing business with that name within that complex. Potential Outcomes: • A business with the same name is found in the immediate surrounding area. o Investigate address and pin location to find out if there is a business at the location that the information could be intended for. • The information is pointing at an entirely different business. Also disregard a change in locality name and postal code. State the incorrect address components and mark the location as wrong. § Example Pottery Barn: The result is within the Fashion Valley Mall and there is in fact a Pottery Barn store inside. as this is an expected consequence associated with the initial change of street address. This means that it either does not exist at the given location or is misplaced (incorrect address details or incorrect pin location). • In situations where the business falls within a larger complex or building that is adjacent to multiple streets with different names and ranges of numbers. § Example Papa John’s: There is no business at the given address. This is the case when there is an existing business with the same name in the immediate surrounding area of the pin location (or address) and: • The wrong location can be associated with either an incorrect street number or street name. The street type slightly changes from Ave to Pike. Continue researching the given address and location. but there is a Papa John’s located on a street with the same name. • The given details have conflicting information for different businesses. o The business has been misplaced. This can result in a location significantly further away which is still considered misplaced. Investigate all provided information Use all provided information (also information that is not rated. The information can be for a specific location of a business (business level) or referring to the overall corporation (corporate level). Continue with the investigation of the immediate surrounding. The mall has several adjacent streets it can use as its address. o The business name is correct. 89 . The result address points to the mall and the business is therefore misplaced. such as url and phone number – never call a business) to reach a conclusion. Information on a business level can be traced to an address and provides more information than information on a corporate level. but the business is still considered misplaced. o Disregard unit numbers and alternate street names at this point. even when considered incorrect in the later rating. o The result information could be for another business.

The result information could be for a different business. § The result has the Incorrect name as the details fit better with the other business. Investigate Address and Pin Location Before making a decision investigate the situation. • There is at least one business at the given address (or location) and: o The given result information at least does not contradict that business. url and classification). o The business does not exist at this location and is marked as Business does not exist . • No business can be found within the immediate surrounding area and no reliable resources exist to confirm such listings o The business might not exist or has the wrong name. Potential Outcomes: • No business can be found at the location. 90 . Example: The result The Lot turns out to have the wrong business name because at the given address is a bar that matches the category and also the phone number. Find all businesses that use the address and compare them with the information about the business (phone number. Example: The given address for the Southern Comfort Inn is pointing at a rural area where no business is located.

• Example: The given information of Shell has a phone number that points to the Mobil station at that address and a name and website supporting the Shell station a little north of the result location. as some of the information aligns with given business and some with the business found at the address (or location).o Some of the conflicting information aligns with the business. Rate Business does not exist . 91 . § The situation remains ambiguous.

such as a complete city or region. 8. The pin can be correct. In cases where the vector map does not show any building contours at all. there is no need to take any action. Types of features and expected pin location will be discussed below.1 Satellite Imagery vs. consider the following general considerations when evaluating the pin. use your best judgment to figure out the correct location of the pin.8 Pin guidelines Here is the scale for how to rate the pin: Please note that not all features are eligible for all the ratings.1 General considerations The following chapters will go into more details on how to evaluate the pin depending on the feature presented. 92 . Vector map When in doubt about where the pin drops between satellite imagery and the vector map. Rate as you would usually do. The pin should be a reflection of the result: the location represented by the pin should reflect the result. If there is a major shift between satellite imagery and the vector map in a larger area. always use the map layer that is more generous towards our pin. if satellite imagery is unavailable. Pin ratings should be evaluated individually and not influenced by relevance. use satellite imagery. If the pin drops on the rooftop in satellite imagery. 8. but in the parking lot in vector map.1. Before delving into more details. rate using satellite imagery because a pin on a rooftop is rated higher than a pin placed in a parking lot. but other rating components can be rated wrong.

In this case. Satellite imagery 93 . use your best judgment to figure out the correct location of the pin. the vector vs. so it is Imagery hard to figure out where each building is.Vector image Vector image As you can see in the screenshot. please use satellite imagery: if satellite imagery is unavailable. Satellite map does not have any contours.

In dense areas where boundaries are hard to detect. 8. 94 . oceans) • other dividers In case there is no divider: imagine and draw a 90-degrees line to the road.1. as described in the "Half 'n’ Half" subsection below.1 Half ‘n’ Half rule Use the "Half 'n Half" rule to determine the Approximate pin location. Here is an example to illustrate this.8. rivers. The small brick fence on the right and the concrete line on the left highlighted by the yellow line show a clear boundary between the two properties. or use the "Half 'n Half" rule below.1. 1556 Tobias Drive. CA 95118 Examples of Boundaries: • Fences • Walls • Garden plants and bushes • Bodies of water (lakes. The boundaries always include half of the road. San Jose. divide the space between the street or next building in half to create a line.2.2 Boundaries of the feature A boundary is a real or imaginary line that separates two things.

1. apply the Tennis Rule: • If the tip of the pin is still touching the line. More specifically. the pin is considered inside the boundary. To address close calls. it is outside of the boundary. the following criteria have to be met: • pin has to be on the same street as the intended property 95 . Approximate. Use natural boundaries as much as possible to draw the line between a Perfect.3 Next Door A pin will be considered Next Door if it drops on the immediate property next to the actual property intended. Next Door and Wrong pin location. • If the tip of the balloon points outside. The space between two buildings Half 'n' Half to can be divided into two parts to Next Building create a boundary for an Approximate pin placement.Example type Screenshot Explanation Extend the feature boundaries to Hal 'n' Half to the middle of the road(s) The Street example shows how Will Rogers Dr and Saratoga Ave is divided in half to define the outer limits. 8.

For example. Perfect cannot be given. NJ 07470. There is Street imagery in the area. we refer to the rooftop and the boundaries of the property as a whole. we determine 1401 and 1445 Valley Rd both exist. A pin outside of this area is considered Wrong. the result is for 1407 Valley Rd. You will determine the boundaries as explained in the section above. o the next door property has the same street address • pin has to be on the same side of the street as the intended property • pin has to be on the first immediate property to any side of the intended property • pin has to be on the same block as the intended property When we refer to the "immediate property".4 Can’t Verify (Smallest Identified Area) In cases where a rooftop cannot be identified. With more research. • All pins dropped within this teal area are Can’t Verify • All pins outside those areas are Wrong 96 . allowing us to establish a perimeter for where the pin should be dropped (teal box below). In these cases. but we can't determine the exact location of our address.1. United States. Wayne. 8. Can’t Verify can be used if the pin is within the smallest area that can be identified as a potentially correct location.

Can't Verify See Can’t Verify section Here are some examples to help us better understand these rules: 97 .Address does not exist . 8. The rating Can’t Verify will also be used for when an and address is rated Incorrect .2 Single rooftop Answer Explanation Perfect The pin falls on the rooftop of the property Approximate Pin falls within the boundaries of the property excluding rooftops Next Door The next door property Wrong The pin falls outside of the property boundaries or next door property.

A pin dropped within the property boundaries of the perfect rooftop will be Without Street Imagery: rated Approximate . CA 95118 Multiple Breitensteinstrasse 77. A pin dropped within that area will be rated Perfect . 8037 Zurich Available resources can have a big impact on street your ability to rate a pin when it is dropped numbers on a house with multiple house numbers with one With Street Imagery: within it. rooftop How many house numbers does this house have? The answer depends strongly on the available resources: With street imagery or other strong resources. 79 and 81. This allows you to apply the general rules of rating pins and be very specific in your rating. you can identify four entrances for the house numbers: 75. Perfect -> The pin is on correct portion of the rooftop (green area) Approximate -> The pin is within the boundaries of the feature (yellow area) Next door -> The pin is on the immediate 98 . The rest of the connected rooftop with the appropriate property boundaries will be rated Next Door .Type of Screenshot and Result Explanation Example Individual home Perfect -> The pin is on the rooftop (green area) Approximate -> The pin is within the boundaries of the feature (yellow area) Next Door -> The pin is on the immediate property next to the intended feature (purple area) Wrong -> The pin falls outside of the property boundaries or Next Door property. draw imaginary lines to delimitate that area. (everything else) Can’t Verify -> See Can’t Verify section 5507 Dent Ave. Once you have determined the rooftop area where your pin should be dropped. San Jose. 77.

Perfect -> The pin is on the rooftop (green area) Approximate -> The pin is within the boundaries of the feature (yellow area) Next door -> The pin is on the immediate property next to the intended feature (purple area) Wrong -> The pin falls outside of the property boundaries or Next Door property (everything else) Can’t Verify -> See Can’t Verify section 99 . (everything else) Can’t Verify -> See Can’t Verify section Without street imagery or strong evidence. In those cases.Type of Screenshot and Result Explanation Example property next to the intended feature (purple area) Wrong -> The pin falls outside of the property boundaries or Next Door property. The bounding property will be considered Approximate and the buildings to the right and to the left will be considered Next Door . you might find out the address range is from 75 to 81. a pin falling anywhere on the correct rooftop will be rated as Perfect even if you cannot determine the precise location on the rooftop. but you cannot determine where the middle numbers 77 and 79 start or end.

CA 94087 The result address is for a business within a d Rooftop strip mall. the whole connected rooftop becomes Perfect .Type of Screenshot and Result Explanation Example Connecte 1030 E El Camino Real. Without street imagery or other strong evidence. the shared parking lot will be Approximate and any other buildings within the shared parking lot that are not Without Street Imagery: connected to the perfect location will be Next Door . but not the exact location within a rooftop with multiple units. The parking lot will be rated as Approximate . Sunnyvale. 100 . The rest of the rooftop within the strip mall and the separate building will be considered your Next Door . with With street imagery and other strong shared With Street Imagery: evidence. Draw imaginary lines on that rooftop and that will be your Perfect . you can only determine the rooftop. In that situation. you can determine the exact parking lot location of the rooftop.

Type of Screenshot and Result Explanation Example Multiple Some multi-street numbers appear with street different rooftops or fronts. building There is no need to identify the exact with location within a rooftop for unit numbers. multiple For this address. Always try to roof with confirm the correct location with research. the entire rooftop will be units called Perfect . On the other hand. Norman. 101 . Consider them as separate rooftops under one and apply general rating rules. patchwork Perfect -> The pin is on the rooftop (green rooftop area) Approximate -> The pin is within the boundaries of the feature (yellow area) Next door -> The pin is on the immediate property next to the intended feature (purple area) Wrong -> The pin falls outside of the property boundaries or Next Door property (everything else) Can’t Verify -> See Can’t Verify section Nordstrasse 274. OK 73069 The result address contains a unit number. 8037 Zurich One 2205 W Main St Suite 1. if under one rooftop there are multiple street numbers. as in this numbers example. the rules described in the above examples apply.

Dallas. There are buildings three rooftops with the same street address.(everything else) Can’t Verify -> See Can’t Verify section 102 . TX 75254 This result contains a unit number. with same but the unit number designates one single street location. it will promoted to a rating of Perfect . There is no need to identify the exact location of the unit number within the rooftop. Ste 124.Type of Screenshot and Result Explanation Example Multiple 5290 Belt Line Rd. Perfect -> The pin is within the boundaries of the feature Approximate -> There is no Approximate Next door -> The pin is on the immediate property next to the intended feature (purple area) Wrong -> The pin falls outside of the property boundaries or Next Door property. In recent street imagery we can see that the area is under construction. Once the correct rooftop has been number identified. the entire rooftop will be considered Perfect . If the pin is dropped within the boundaries of the feature as defined in these guidelines as Approximate . TX 75205 rated as Perfect if the pin is dropped United States within the boundaries of the features. Perfect -> The pin is on the rooftop (green area) Approximate -> The pin is within the boundaries of the feature (yellow area) Next door -> The pin is on the immediate property next to the intended feature (purple area) Wrong -> The pin falls outside of the property boundaries or Next Door property (everything else) Can’t Verify -> See Can’t Verify section Empty 6000 Preston Rd All features that do not have a rooftop will be plot Dallas.

Also. as you can see in the screenshot. the boundaries of the Next Door property contain half of the street. Next Door will be considered to the left or right of the intended feature.Type of Screenshot and Result Explanation Example High Density In this example. England Perfect -> The pin is on the rooftop (green area) Approximate -> The pin is within the boundaries of the feature (yellow area) Next door -> The pin is on the immediate property next to the intended feature (purple area) Wrong -> The pin falls outside of the property boundaries or Next Door property (everything else) Can’t Verify -> See Can’t Verify section 103 . London. 57 Neal Street. we will not consider the urban area rooftop behind our intended feature to be Next Door . It does not contain the building behind it. because that one has a different street address.

therefore does not meet all the criteria for the rating of Next Door . Perfect -> The pin is on the rooftop (green area) Approximate -> The pin is within the boundaries of the feature (yellow area) Next door -> The pin is on the immediate property next to the intended feature (purple area) 100 Mulligan Rd. On the other hand. Laytonville CA Wrong -> The pin falls outside of the property boundaries or Next Door property (everything else) Can’t Verify -> See Can’t Verify section 104 . 44 Russel Square. for a property that is on the corner. the Next Door property will be larger and that is expected.Type of Screenshot and Result Explanation Example Corner For this example. The property marked with red in the screenshot is on another street (Montague Street). England Perfect -> The pin is on the rooftop (green area) Approximate -> The pin is within the boundaries of the feature (yellow area) Next door -> The pin is on the immediate property next to the intended feature (purple area) Wrong -> The pin falls outside of the property boundaries or Next Door property (everything else) Can’t Verify -> See Can’t Verify section Rural area In rural areas. the Next Door property can be behind as long as it has the same street address. there is only one property house that qualifies as Next Door . London.

CA 95118 area) Wrong -> The pin falls outside of the property boundaries or Next Door property Can’t Verify -> See Can’t Verify section 8. San Jose.Type of Screenshot and Result Explanation Example Pin on the This property has only one next door same neighbor because the property to the left is block not on the same block (property in red) as the intended property. Can't Verify See Can’t Verify section 105 .1 Residential property with multiple buildings. Perfect -> The pin is on the rooftop (green area) Approximate -> The pin is within the boundaries of the feature (yellow area) Next door -> The pin is on the immediate property next to the intended feature (purple 1491 Kooser Rd. Here is the breakdown of all ratings: Answer Explanation Perfect The pin falls on any of the rooftops within the boundaries of the property Approximate Pin falls within the boundaries of the property excluding rooftops Next Door The next door property Wrong The pin falls outside of the property boundaries or outside of the Next Door Property.2.

a single business spread out over multiple buildings. belong to the same entity and share an address. Next Door N/A . These include (but are not limited to) universities. apartment complexes and hospitals. Can't Verify See Can’t Verify section 106 .Campuses and business complexes do not have Next Door ratings.3 Multiple rooftops (Campus rule) Some POIs will be entire campuses or business complexes.Here are some examples to illustrate our rules: Type of Screenshot Explanation example Individual The property has two buildings: one being the home with a main house. the other building being a garage shed building.Campuses and business complexes do not have Approximate ratings. Answer Explanation Perfect The pin falls within the campus/complex boundaries. Approximate N/A . meaning that there are multiple buildings associated/owned by the POI. as determined by research. Both buildings are on the same property. Wrong The pin falls outside of the campus/business complex boundaries. Perfect -> The pin is on any of the rooftops (green color) Approximate -> The pin falls within the property boundaries excluding the rooftops (yellow color) Next Door -> The pin falls on the next door property (purple color) Wrong -> The pin is outside the boundaries (everything else) Can’t Verify -> See Can’t Verify section 1351 Navarro Dr Sunnyvale CA 94087 8.

A few examples of polygons below including missing polygon: POI type Screenshot Hospital Park 107 . Some of these types of POIs may have polygons outlining the boundaries of the POI on the map. These polygons may not always be present or perfect. so you should rate against the true boundaries of the campus or complex as determined by your research.

Tip: Start off by looking at the pin's location.Airport No Polygon available. Remember. so you should rate against the true boundaries of the campus or complex as determined by your research. Parking facilities may be included in the polygon if they are owned by the POI and contiguous to the campus (contiguous meaning that it is not separated by a street). then determine if the property surrounding the pin belongs to the POI we are looking at.1 Single Complex Campus Entities made up of a single cluster of buildings are the easiest to identify. 8. 108 .3. these entities can be represented by a single. the polygons on our map may not always be perfect or present. continuous polygon. On the map.

1: Vector view of Stanford University campus Fig.POI Screenshot Rating Explanations Stanford Perfect (green area in Fig. Wrong (everything else outside of green area in Fig. 2)-> If pin falls outside campus boundaries. Fig. 2) -> If pin falls University within campus boundaries. 2: Annotated vector view of Stanford University campus 109 . Remember. there is no Approximate or Next Door rating for campus and business complexes.

2)-> If the pin falls outside of hospital boundaries. 2: Annotated vector view of El Camino Hospital campus El Camino Hospital 110 . Fig. Wrong (everything else outside of green area in Fig. as determined by your research. 2) -> If the pin Hospital falls within the hospital boundaries. 1: Vector view of El Camino Hospital campus Fig.El Camino Perfect (green area in Fig.

1: Vector view of Disneyland Park premises are not included in the polygon. 2) represents the valid area for our pin to land in.3. non-parking facility.Disneyland There is no polygon available for this POI.2 Dispersed Campus In some cases. non-parking facilities are valid pins. but rather be spread out across a large area like a city. Pins that fall on campus-associated. Sometimes. You can apply the single rooftop rules to any standalone. We can see where the attractions within the amusement park are located and visualize the boundary of the park to determine where our pin should be placed. so we Park must imagine our own polygon according to the boundaries of the POI. The green area highlighted in satellite view of the POI (Fig. campus building. you will need to perform some research to determine where the polygon should be. a campus will not have a single. Utility buildings located outside of the public park Fig. 2: Annotated satellite view of Disneyland Park 8. If this occurs. A pin landing anywhere outside of this green area would be a Wrong pin. the pin will fall on this type of campus and we may not have a polygon for the campus. continuous location that a polygon can be drawn over. Fig. Note 1: Parking lots separated by a road should not be included in the polygon because they are not immediately next to the POI. 111 .

If two or more campus buildings are next to each other, you can apply the single complex campus
logic.

POI Screenshot Rating Explanation
Virginia Perfect -> If the pin falls on a rooftop of
Common a single, campus-associated, non-parking
wealth facility or within the satellite complex
University rules.
Wrong -> If the pin falls on a standalone,
campus-associated parking facility, or on a
non-campus-associated building.
In this example, Virginia Commonwealth
University (VCU) is a campus that is spread
out around the city (campus properties are
highlighted in green).
Fig. 1: Annotated vector view of Virginia A pin falling on the rooftop of the Virginia
Commonwealth University Commonwealth University - School of
Medicine building (in VCU Medical Center
complex) would be considered a valid pin
for this POI, but a pin falling on a VCU
parking lot would not be a valid pin for the
same POI.
When we zoom into the pin, we see that
the result is Perfect in this example.

Fig. 2: Zoomed in view of pin location

112

Boston Similar to the VCU campus, the Boston
University University campus is also spread out
across the city, as represented by the
highlighted green areas. Our pin is placed
on the Boston University Center for
Computational Neuroscience and Neural
Technologies building. The building is a
standalone, non-parking facility building
that is associated with the campus, so our
pin in this case is Perfect .
Fig. 1: Annotated vector view of the Boston
University campus

8.4 No rooftops

This chapter will describe pin rating for features with no rooftop.

8.4.1 Natural Features

Natural features include but are not limited to:

• lakes (Lake Victoria)
• oceans (Pacific Ocean)
• creeks (Bear Creek in Colorado)
• rivers (the Danube river)
• ponds (Antonelli Pond in California)
• wetlands (Laguna de Rocha)
• seas (Black Sea)
• parks (Yosemite Park)
• forests (Black Forest)
• mountains (Carpathian Mountains)
• hills (Chocolate Hills of the Philippines)
• plateaus (Colorado Plateau)
• valleys (Death Valley)
• plains (The North American Great Plains)
• fjords (Geirangerfjord in Norway)
• peninsulas (Indian Peninsula)
• volcanoes (Etna)
• deserts (Gobi Desert)
• glaciers (Patna Glacier in Iceland)
• waterfalls (Niagara Falls)
• beach (Bondi Beach)

113

A natural feature may have other natural features within or surrounding it. We will refer to the features
within or surrounding our natural feature listing as an associated feature. Examples of associated features
include, but are not limited to, lakes within parks, the shore of a lake, an island in a river, or a forest
surrounding a mountain.

The above lists should not be considered complete. Similar natural features, even if not listed above,
should be rated using these guidelines.

Answer Explanation

Perfect If the natural feature has a defining feature (cliffs/peak of mountain, water for a river/ocean,
the sand for the beach), pin should fall on that feature OR if the natural feature is defined by
an arbitrary area (parks, national forests), pin should fall in their polygon or where it would
be if we had that information.
Approxima The pin falls outside of the defining features of a natural feature but still on it (slope of a
te mountain) or on an associated feature (the shore of a river or lake). Not all natural features
will have an Approximate . If the natural feature exists within an urban or suburban area,
you may apply the Half 'n' Half rules.
Next Door N/A - Natural features do not have Next Door ratings.

Wrong The pin falls in an area that does not meet the criteria for Perfect or Approximate .

Can't See Can’t Verify section
Verify

114

In this case. 2) -> The shore of the lake. 2) -> water Anywhere on the defining feature of the lake. 2) -> Anywhere past the shore of the lake. 2: Annotated vector view of Lake Merritt 115 . 1: Vector view of Lake Merritt Fig. Fig.Here are some examples: Type of POI Screenshot Explanation Body of Lake Merritt Perfect (green area in Fig. Approximate (yellow area in Fig. Wrong (everything else in Fig. the defining feature would be the water.

Type of POI Screenshot Explanation Land Mount Rainier Land features. Fig. Approximate (area between green and yellow lines in Fig. a peak of a Fig. anywhere further out than the obvious slope. 2: Satellite view of Mount Rainier mountain can span a large area and may have a more gradual slope area. such as mountains. We'll want to use common sense to determine the pin rating for these types of land features. 1: Vector view of Mount Rainier Valley of the mountain. 4) - > Anywhere on the defining feature of the mountain (peak or ridge. Wrong (area below yellow line in Fig. 3: 3D view of Mount Rainier on Apple Maps Fig. )4 -> Anywhere on the slope of the mountain. Tip: If available. should use the following guidelines. so we want to make sure that we're not being too strict or too generous when rating the pin. 4: Annotated 3D view of Mount Rainier 116 . Perfect (area above green line in Fig. try using a 3D view of the mountain to determine where its peak or ridge is. or volcanoes. depending on the mountain). mountain feature ranges. For example. 4) -> Fig. Check to see if there is an Apple Maps' 3D view before using other sources.

1: Vector view of Douthat State Park Fig. 2: Annotated vector view of Douthat State Park 117 . 2) -> Falls feature within polygon (or where polygon should be) with but not inside an associated feature. polygon Approximate (yellow area in Fig. since the lake inside this polygon would be considered an associated feature.Type of POI Screenshot Explanation Land Douthat State Park Perfect (green area in Fig. Wrong (everything else in Fig. 2) -> Pin falling on the lake within the park. 2) -> Outside of the State Park polygon. or where the polygon should be. Fig.

and no associated Perfect (green area) -> Falls within features polygon (or where polygon should be) but not inside an associated feature. Wrong (everything else outside of green area) -> Outside of the park polygon. 118 . the Approximate rating will not polygon apply to the POI.Type of POI Screenshot Explanation Land This is an example of a natural feature POI feature Encinal Park that does not have any associated features.2 Administrative divisions In this chapter we are going to talk about how to evaluate the pin for administrative divisions.4. 1: Annotated vector view of Encinal Park 8. Approximate -> Does not apply in cases where there are no associated features. Fig. but not limited to: • Countries • States • Counties • Provinces • Cities • Neighborhoods • Streets Rating Explanation Perfect Pin should fall in their polygon of the feature or where it would be if we had the information Approximate N/A Next Door N/A Wrong The pin falls in an area that does not meet the criteria for Perfect . Administrative divisions can refer to. In with these cases. or where the polygon should be.

Can’t Verify See Can’t verify Examples Type Screenshot Country Perfect – the pin can fall anywhere within the country boundaries Approximate – not applicable Next Door – not applicable Wrong – everything outside of Perfect Can’t Verify – See Can’t Verify section Romania State Perfect – the pin can fall anywhere within the state boundaries Approximate – not applicable Next Door – not applicable Wrong – everything outside of Perfect Can’t Verify – See Can’t Verify section California Province Perfect – the pin can fall anywhere within the province boundaries Approximate – not applicable Next Door – not applicable Wrong – everything outside of Perfect Can’t Verify – See Can’t Verify section North Holland 119 .

County Perfect – the pin can fall anywhere within the county boundaries Approximate – not applicable Next Door – not applicable Wrong – everything outside of Perfect Can’t Verify – See Can’t Verify section Santa Clara County Cities Perfect – the pin can fall anywhere within the city boundaries Approximate – not applicable Next Door – not applicable Wrong – everything outside of Perfect Can’t Verify – See Can’t Verify section Berlin Neighborhoods Perfect – the pin can fall anywhere within the neighborhood boundaries Approximate – not applicable Next Door – not applicable Wrong – everything outside of Perfect Can’t Verify – See Can’t Verify section Tenderloin in San Francisco Street Perfect – the pin can fall anywhere on the street Approximate – not applicable Next Door – not applicable Wrong – everything outside of Perfect Can’t Verify – See Can’t Verify section Champs-Élysées in Paris 120 .

Roads within parking lots are also included and you don’t need to create boundaries as you would with regular roads. we do not split parking lots and instead assume that they belong to the feature. which is actually the address of the building. consider the whole structure a parking lot. Parking structures can be confusing because they combine parking lots (potential Approximate ) with buildings (wrong rooftop = Wrong ). In cases where you can verify the parking structure in satellite imagery (by either parked cars or parking lot striping). However. Shared parking lots are considered Approximate even though they do not belong entirely to the feature. 121 . In the example of Sourdough & Co in El Dorado Hills. The assumption is that there will be no businesses within the structure other than parking-related businesses. the approximate area extends up to Town Center Blvd.8.5 Parking Lots & Parking Structures In this chapter. we will discuss how to deal with parking lots and very large parking structures.

as such there's no need split them by applying the half n' half rule.5. Rating Explanation Perfect Rooftop of mall (green color) Approximate Parking structures (entire structure included) (brown color). Resulting Approximate boundaries when Half 'n Half rule is applied to the street and parking lots are included (yellow color) Next Door Neighboring property with same street address (purple color) Wrong Neighboring property with other street address (red color) Can’t Verify See Can’t Verify section 122 .1 Shopping Malls with a single rooftop Pins that fall within the building (rooftop) of the malls are Perfect . 8. Apply the Half 'n Half rule to the street to determine the area for Approximate as parking lots and parking structures are also Approximate . Cars can be parked on building = parking structure = potential A pp ro xi m at e area Always consider parking lots and parking structures as belonging to the feature.

ticketing offices. A transit stop is a small.within 50 meters on a non-associated rooftop . Transit stations.beyond half a city block (applies to bus stops only). please use the following criteria to rate. Can't See Can’t Verify section Verify 123 . POIs that are transit stops. or street markings. enclosed waiting/seating areas. The term “station” is primarily used to refer to transit locations that are larger and typically a terminal housing multiple routes. Wrong The pin is wrong if it falls: . platforms. a posted sign. All stations are stops. on the other hand.outside of the boundaries as allowed by the Half 'n' Half rule . and terminals. transit location typically designated by a bench or covered bench area. Next Door Transit POIs do not have Next Door ratings. are typically larger stops that have a major structure associated with it.farther than 50 meters from the ideal location . which include.6 Transit POIs Transit POIs include. stations. but are not limited to.8. but are not limited to. If a transit POI does not meet the criteria to be rated under the Single Rooftop or Campus/Complex guidelines. or terminal buildings/structures encompassing the transit area. but not all stops are stations. Answer Explanation Perfect The pin falls on the polygon for the transit POI or in the area where you would wait for transit or within the entrance polygon for an underground transit station Approxima The pin falls within 50 meters of where you would wait for transit or within station te parking lots and surrounding property up to where the Half 'n' Half rule allows.

Pins should therefore be placed on the spot where a user would wait or can be placed within half a block of the waiting spot and within the Half 'n' Half rule to be valid. Wrong (everything else in Fig. POI Screenshot Rating Explanation Noriega Perfect (green area in Fig.2 Transit POI with Multiple Rooftops/Platforms If your POI has multiple rooftops/platforms. so we will use the vector map to rate our pin. 1: Vector view of bus stop Can’t Verify – See Can’t Verify section Special Note: A satellite view shows that this pin might actually fall in the street for this bus stop. 2) -> Where a user St and would wait for the bus. we should favor the map view that gives a more generous rating for our pin in cases like this.1 Bus Stops Bus stops are generally on the side of the street and have one spot where users can wait to board the bus. Fig. 46th Ave bus stop Approximate (yellow area in Fig. 2: Annotated satellite view of bus stop 8. Remember. 2) -> Farther than half a city block from where user waits for the bus or on a rooftop.6.8. Fig. 124 . you can apply similar ideas from the campus/complex pin guidelines when determining the valid area for the pin to land on. 2) -> 50 m away from where a user would wait for the bus but no farther out than the Half 'n' Half rule allows and not on a building rooftop.6.

POI Screenshot Explanation San Jose Here. Fig. Wrong -> Anywhere outside of transit station boundaries. Approximate -> Within 50 meters of where you would wait for transit or within transit station Fig. a polygon was created using the boundaries of the campus. if there is a polygon available in vector view for the POI. For campuses/complexes. 1: Vector view of San Jose Diridon parking lots and surrounding property up to Station where the Half 'n' Half rule allows (yellow color). we are looking at the San Jose Diridon train Diridon station. we should rate against the polygon. Can’t Verify – See Can’t Verify section Remember. so we will rate the pin according to the Station train station platforms and rooftops. 2: Annotated satellite view of San Jose Diridon Station 125 . Perfect -> Polygon of the station or rooftop/platform of the station or area between rooftops/platforms of the station (green color). We'll adopt the same concept with transit POIs and create a polygon for the transit POI using the POI's multiple rooftop/platforms.

Fig. 2: Annotated satellite view of Solana Wrong (everything else in Fig. Both of these Amtrak areas are considered valid places for pins to fall Station on. 2) -> Where a user would wait for transit or the area between where a user would wait for transit. Can’t Verify – See Can’t Verify section Fig. 2) -> Within 50 meters of where you would wait for transit or within transit stop parking lots and surrounding property up to where the Half 'n' Half rule allows. Perfect (green area in Fig. Can’t Verify – See Can’t Verify section 126 . Fig. Approximate (yellow area in Fig. 2) -> Farther than Beach station 50 meters from where user waits for transit or farther out than the Half 'n' Half rule allows. Approximate (yellow area in Fig. 1: Vector view of Sunnyvale Station Wrong (everything else in Fig. 2) -> Pin falls on the platform(s) where the user would wait or the area Fig. Perfect (green area in Fig. 2) -> Farther than 50 meters from where user waits for transit or farther out than the Half 'n' Half rule allows. 2: Annotated satellite view of Sunnyvale Station Solana Some stations have both a building rooftop and Beach an open platform waiting area. 2) -> Pin falls within 50 meters of where you would wait for transit or within transit stop parking lots and surrounding property up to where the Half 'n' Half rule allows. 1: Vector view of Solana Beach station between the platforms or the rooftop.Sunnyvale Some transit stops only have a platform where a Station user can wait for the transit.

8. we may have underground transit stations.4 Underground Transit Stations In some cases. 1: Vector view of Grand Can’t Verify – See Can’t Verify section Central Terminal station Fig. 2: Annotated satellite view of Grand Central Terminal station 8.6. If a pin is placed on a building within the polygon.6. For stops that do not have polygons available. A pin dropped within 50 meters of this polygon is also a valid pin and should be rated Approximate . you can apply the single rooftop guidelines.3 Transit POIs with Single Rooftop If your POI has a single rooftop. we'll want to use similar rules to the satellite campus and draw a polygon using the entrances to the underground station as polygon coordinates. the building must contain an entrance to the transit stop for the pin to be valid. POI Screenshot Explanation Grand Perfect -> Rooftop of transit station or stop Central Terminal Approximate -> Transit POI parking lots and surrounding property up to where the Half 'n' Half rule allows Wrong -> Farther out than the Half 'n' Half rule allows from POI property Fig. 127 .

This will make it easier to determine whether or not the pin falls within the polygon. where each entrance is a point of the polygon. 1. If the underground transit station only has two entrances. Note: Entrances are designated by stars and property boundary polygons are designated by the letters A and B. Determine whether or not our pin falls within 50 meters of the polygon or within the property covered by the Half 'n' Half rule. Connect the entrance points to create an enclosed polygon. while other entrances may require more research. Imagine property boundaries around the underground transit station entrances using the Half 'n' Half rule.4. 2. if possible. Transit station in the example is "16th St & Mission BART Station". we'll use the following steps to create an entrance polygon. • Tip: A good place to start looking for transit entrances is near the pin's location. Connect the closest points of the two boundaries from step 1 to create an entrance polygon. 3.6. such as using street imagery of the transit station area to find entrances or a station map from the transit provider that shows entrances to the station. 128 . 8. Some entrances can be seen via satellite view of the station. 2. Find at least three entrances to the underground transit station.1 How to Draw an Entrance Polygon 1. • Use street imagery or an official source to determine where the transit station entrances are located.

Determine whether or not our pin falls within 50 meters of the polygon. 129 . we're taking points 1 and 2 from polygon A and connecting them with points 3 and 4 from polygon B respectively. 3. We exclude building rooftops that do not contain an entrance to the underground station from our entrance polygon. In this case.

6. Wrong (everything else in Fig. 2) -> Farther out Fig. the station does not have a station parking lot.8. we'll look at the pink-colored polygon on the map for this station. 2) -> Pin lands within 50 meters from the polygon or on transit station parking lots and surrounding property up to where the Half 'n' Half rule allows.4. 1: Vector view of Jingu Marutamachi than the Half 'n' Half rule allows from station Station property.2 Examples POI Screenshot Explanation Jingu If the underground transit station already has a Marutamachi polygon available. 2: Annotated vector view of Jingu Marutamachi Station 130 . In this case. Can’t Verify – See Can’t Verify section Fig. so we only look at the surrounding property within 50 meters of the polygon. In this case. 2) -> Polygon of station. we'll want to rate our pin Station against the polygon. Approximate (yellow area in Fig. Perfect (green area in Fig.

2). 3). Fig. Wrong -> Pin falls more than 50 meters outside of the entrance polygon or outside the Half 'n' Half rule area. 3: Annotated satellite view of 16th St Mission BART. We'll use the Half 'n' Half rule to determine the points for our entrance polygon (Fig. Our pin falls within the entrance polygon created. 2: Satellite view of 16th St Mission BART Station showing station entrances Fig.16th St and Perfect -> Pin falls within the entrance polygon Mission St and not on a building rooftop (unless there is an BART Station entrance within the building). 1: Vector view of 16th St Mission BART station In this case. Station with entrance polygon 131 . there are only two entrances to the transit station (Fig. so it is a Perfect pin. Stars represent the entrances. Approximate -> Pin falls within 50 meters of the entrance polygon or within the property that Half 'n' Half rule covers. Can’t Verify – See Can’t Verify section Fig.

132 . 1: Vector view of Tuileries Station Can’t Verify – See Can’t Verify section In this example.Tuileries Perfect -> Pin falls within the entrance Station polygon and not on a building rooftop (unless there is an entrance within the building). Wrong -> Pin falls more than 50 meters outside of the entrance polygon or outside the Half 'n' Half rule area. Fig. 2: Annotated satellite view of Tuileries Station. Stars represent the entrances. Fig. the pin falls within the Half 'n' Half rule area for the entrance polygon. so it is an Approximate pin. Approximate -> Pin falls within 50 meters of the entrance polygon or within the property that Half 'n' Half rule covers.

our pin is placed within the entrance polygon for this station. we'll need to use street station imagery or an online resource to find the transit entrances then draw a polygon using the entrances as points of the polygon. 3). and not on a building rooftop (unless there is an MetroTech entrance within the building) Approximate -> Pin falls within 50 meters of the entrance polygon Wrong -> Pin falls more than 50 meters outside of the entrance polygon Can’t Verify – See Can’t Verify section With underground transit stations that have Fig. Here. St-MetroTech station with entrance polygon In this example. 1: Vector view of Jay St-MetroTech multiple entrances. since satellite view does not clearly show entrances to this transit station as it does for other stops (Fig. These entrances were found via street imagery. 2: Annotated vector view of Jay entrances to this station.Jay Perfect -> Pin falls within entrance polygon Street. so we rate it as Perfect . 2). Fig. we were able to find 5 entrances represented by the yellow stars that were near our pin (Fig. 3: Satellite view of Jay St-MetroTech station 133 . There is also a transit station map available from the official transit website that shows the Fig.

FL.1 Specific address For queries with an explicit location a correct result receives a rating of Navigational .9 How to rate results In this chapter we are going to discuss in more detail different types of examples and how to rate them. so a result for this exact location should be rated Navigational . FL 33626. and the user explicitly states their location intent by including the name of a city and state: Tampa. consider the query [12112 sugarloaf key st tampa fl 33626]. For example. 134 . For each result you will need to answer questions for: • Relevance • Name accuracy • Address accuracy • Pin accuracy 9. Since this is an explicit location query. Pin location would be rated according to Campus rule guidelines. The query refers to an unambiguous location. Name Accuracy -> n/a st tampa fl United States Address Accuracy -> Correct 33626] Pin Accuracy -> Perfect This address belongs to an apartment complex. where all buildings have the same address. Tampa. Query Results Rating Explanation [12112 12112 Sugarloaf Key St Relevance -> Navigational sugarloaf key 12112 Sugarloaf Key St. The query is an address. the user’s viewport and location are irrelevant.

The user would be able to find the street but not the exact address s/he is looking for. Tampa. Sugarloaf Key St Relevance -> Acceptable – User Intent Sugarloaf Key St. The result though it provides some sort of information to the user is incomplete.Postal Code Pin Accuracy -> Perfect The result is missing a postal code and result is marked with incorrect address. 135 . United Name Accuracy -> n/a States Address Accuracy -> Incorrect . Tampa. United States Pin Accuracy -> Perfect The result includes the name of the business. FL Address Accuracy -> Correct 33626. The pin is dropped on the street. 12112 Sugarloaf Key St Relevance -> Navigational 12112 Sugarloaf Key St. FL. Tampa. The postal query is a mandatory component for a complete address.Camden Westchase Park Relevance -> Navigational Apartments Name Accuracy -> Correct 12112 Sugarloaf Key St. FL United States Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect The result is a street result instead of a full address. which is located at this address.

136 . square. Results for streets. Cupertino. 11244 Windsor Pl Relevance -> Bad . intersection and city queries are eligible for Navigational . which may not include all of the elements of a full address. CA.User Intent issue 11244 Windsor Pl Cir Name Accuracy -> n/a Tampa. intersection or city. Address queries can also be just the name of a street. The expectation is that we return the requested entity with the same level of broadness as the user requested it. The perfect pin can drop anywhere on the street. neighborhoods. The data and relevance will be considered separately. See below for a few examples: Query Results Explanation [stevens Stevens Creek Blvd Relevance -> Navigational creek Stevens Creek Blvd. FL 33626 Address Accuracy -> Correct Pin Accuracy -> Perfect The result does not satisfy the query and is not considered relevant. neighborhood. The postal code is optional for such results. but if returned any portion of the street has to belong to that postal code area. square. CA Name Accuracy -> n/a blvd Address Accuracy -> Correct cupertino] Pin Accuracy -> Perfect The query is for a street in Cupertino.

Stevens Creek Blvd Relevance -> Navigational Stevens Creek Blvd. Here the address and pin are correct and they both point to a result that does not satisfy the user intent. The pin is dropped on Stevens Creek Blvd in San Jose. Cupertino. The pin is dropped on Stevens Creek Blvd in Cupertino therefore the result clearly satisfies the query even though the locality listed in the result is incorrect. 137 . Stevens Creek Blvd Relevance -> Bad . CA Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect Result does not satisfy user intent as it’s for just the city when the query was for a street in the city. Looking at all the elements of the result will help you achieve this goal.Locality .User Intent Issue Cupertino. which does not satisfy the user intent. San Jose. CA Relevance -> Bad . Pin is dropped within the boundaries of the city of Cupertino. CA Name Accuracy -> n/a Address Accuracy -> Incorrect - Locality Pin Accuracy -> Perfect Understanding what sort of result we have is vital in order to be able to rate correctly. San Jose. CA Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect In this example the pin and address information point to a result in San Jose. The Address Accuracy for this result will be rated Incorrect .User Intent Stevens Creek Blvd.

Little Sheep Mongolian Hot Relevance -> Bad . which is not prominent.User Intent Issue 19062 Stevens Creek Blvd. 19062 Stevens Creek Blvd Relevance -> Bad . Pin is dropped on the result address. CA. A Perfect pin can drop anywhere within the boundaries neighborhood. The query is for the street itself. The postal code is correct and belongs to the requested neighborhood. Name Accuracy -> Correct 95014 Address Accuracy -> Correct Pin Accuracy -> Perfect The result is for a business on the street. NY 10021 Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect The result is the requested neighborhood. Name Accuracy -> n/a 95014 Address Accuracy -> Correct Pin Accuracy -> Perfect The result includes a street number when the query is just a street. [upper Upper East Side Relevance -> Navigational east side] Upper East Side. New York.User Intent Issue 19062 Stevens Creek Blvd. 138 . Cupertino. making this result too specific for the requested query. When the query is just a street. Cupertino. returning a business is too specific for the requested query. CA.

This result is too specific for the query. A perfect pin can drop anywhere within the city boundaries. Cork Relevance -> Navigational Ireland] Cork. New York. 139 . The business is not prominent enough in the area to be considered relevant for the query. NY 10028 Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect The result is for an address within the neighborhood. 1596 2nd Ave Relevance -> Bad . NY 10028 Name Accuracy -> Correct Address Accuracy -> Correct Pin Accuracy -> Perfect The result is for a business within the neighborhood. Duke’s Relevance -> Bad . New York.User Intent 1596 2nd Ave. The address is not prominent enough in order to satisfy the intent for the query. Ireland Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect The result is for the city of Cork in Ireland.User Intent Issue 1596 2nd Ave. [Cork.

Cork. [Stevens Stevens Creek and De Anza Blvd Relevance -> Navigational Creek and Stevens Creek and De Anza Blvd Name Accuracy -> n/a De Anza] Cupertino CA 95014 Address Accuracy -> Correct Pin Accuracy -> Perfect The query is for an intersection and we return the specific intersection.User Intent Issue Kinsale Rd. The address and pin are correct. This is not a prominent POI within the city and does not satisfy a secondary intent of the query. Cork. Ireland Name Accuracy -> Correct Address Accuracy -> Correct Pin Accuracy -> Perfect The result is for a Transit POI.User Intent Issue 57-61 Grand Parade. Cork City Library Relevance -> Bad . which satisfies a secondary intent.T12 NT99 Cork Airport Relevance -> Good . 140 . Ireland Name Accuracy -> Correct Address Accuracy -> Correct Pin Accuracy -> Perfect The result is for a POI within the city.

each location should be rated Excellent for Relevancy. pin should drop on the address provided in the result o if forced address or another set of coordinates are returned. Stevens Creek and De Anza Blvd. Stevens Creek Blvd Relevance -> Bad . pin is Correct if dropped within 50m of the exact location of the coordinates in the result. so returning either of the two distinct locations used for the route is the best experience we can offer in Search. otherwise rating should be Wrong . Relevance -> Good . In some countries.User Intent Issue Station Name Accuracy -> Correct Cupertino CA 95014 Address Accuracy -> Correct Pin Accuracy -> Perfect The query is for an intersection and we return the bus stop with the same name. 9. Here are some examples: • For a query with two distinct locations that are not near each other – The user was likely looking for driving directions. • For coordinate queries – we should be returning a forced address or another set of coordinates within 50m from the exact location implied by the query: o a forced address is automatically generated when there is no official address o a forced address may not include all components typical to a full address (minimum address components are locality and street name) o if returned address is a full address.User Intent Issue Stevens Creek Blvd Name Accuracy -> n/a Cupertino CA 95014 Address Accuracy -> Correct Pin Accuracy -> Perfect The query is for an intersection and we return just one of the streets from the query. Query Results Explanation 141 . bus stops carry the same name as the intersection they are located and can satisfy a secondary intent for the query.2 Other Address Types Addresses can sometimes be less obvious or even ambiguous.

95051. 66 Chandos Oxford Relevance -> Excellent Pl. United Kingdom Name Accuracy -> n/a WC2N 4HG Address Accuracy -> Correct oxford Pin Accuracy -> Perfect The query includes two separate locations. which are very away from each other. Other components are optional. The pin has to drop within the boundaries of the area the postal code belongs to. but if present they need to be correct. Santa Clara Santa Clara. The postal code is a mandatory component for a postal code query. The pin should be dropped on the address according to the pin guidelines. 142 . Returning either of the individual results is expected and should be rated Excellent . CA Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect The expectation for this result is to include locality.[95051] Santa Clara Relevance -> Navigational Santa Clara. so the user was likely looking for routing directions. The pin has to drop within the boundaries of the area the postal code belongs to. London Oxford. state and postal code. state and postal code. CA Relevance -> Navigational Name Accuracy -> n/a Address Accuracy -> Incorrect - Postal Code Pin Accuracy -> Perfect The expectation for this result is to include locality.

352067. Returning either of the individual results is expected and should be rated Excellent . The pin should be dropped on the address according to the pin guidelines. 3530 El Camino Real Relevance -> Navigational . 37.993558 Santa Clara. so the user was likely looking for routing directions. This result should be rated Navigational . London WC2N 4HG Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect The query includes two separate locations. Pin should be dropped on the address provided in the result. 3530 El Camino Real Name Accuracy -> n/a 121. 143 . 66 Chandos Pl Relevance -> Excellent 66 Chandos Pl. CA 95051 Address Accuracy -> Correct United States Pin Accuracy -> Perfect The result is an address that is within 50m from the location implied by the query.

1 Non-specific address For queries where the location intent is not explicitly stated in the query terms. 9.351896. therefore the relevance will be rated Navigational . 144 . In general for partial addresses: users are looking for the closest location to their position or within/near the fresh viewport. Here are some general considerations: • exact location that exists returned very close to the user is eligible for Navigational . unless other addresses satisfy the user intent that are very close.2. Pin has to be within 50m from the coordinates provided in the result. we need to infer the location intent from the user’s viewport and the user’s location.993526 Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect The result is another set of coordinates that are within 50m from the coordinates offered in the query. Pin should be dropped within 50m from the implied location of the query. -121. El Camino Real Relevance -> Navigational El Camino Real Name Accuracy -> n/a Santa Clara. which have multiple locations. One difficulty evaluating address queries has to do with partial addresses. This result should be rated Navigational . Relevance -> Navigational 37. CA 95051 Address Accuracy -> Correct United States Pin Accuracy -> Perfect The result is a forced address that is within 50m from the location implied by the query. This is the only example where pin location is implied by the query and not by the result.

• exact location returned within a fresh viewport is eligible for Navigational . unless other addresses satisfy the user intent that are very close. • results that are further away from an ideal result but can potentially satisfy the user’s intent can be rated as high as Good o results are demoted based on distance o results are demoted based on density of potential results in a given area • results too far away will be rated Bad (Distance/Prominence Issue) Let’s consider the query [154 orchard st] in different scenarios: 145 .

NY 10002-2221. United Prominence Issue States Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect The result is farther away from the viewport. Query Results Explanation [154 154 Orchard St Relevance -> Navigational orchard 154 Orchard St. Scenario 1: User recently moved their viewport (7 minutes ago) over Midtown Manhattan in New York City. although multiple locations with the same street address exist. Newark. Name Accuracy -> n/a st] United States Address Accuracy -> Correct Pin Accuracy -> Perfect The result is in Lower Manhattan. results within or very close to the user’s viewport are eligible for Navigational . Since this user’s viewport is fresh.Distance/ 154 Orchard St. United Prominence Issue States Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect The result is farther away from the viewport. but still matches the query 154 Orchard St Relevance -> Good Distance/ 154 Orchard St. very close to viewport location. NJ 07102-3329. 154 Orchard St Relevance -> Good . Garfield. New York. but still matches the query 146 . NJ 07026-2714.

NJ 07102-3329. Prominence Issue) st] United States Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect Results 1 . NY 10002-2221. PA. Pennsylvania 19054 Distance/Prominence issue Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect The result is in a different state and very far away from the user’s viewport. Query Results Explanation [154 154 Orchard St Relevance -> Bad (Distance/ orchard 154 Orchard St. New York. Newark.3: Too far away from the user’s location intent 147 . 154 Orchard Dr Relevance -> Bad - 154 Orchard Dr. Scenario 2: If the implicit location intent inferred from the user’s viewport or user’s location were very close to Levittown.3: Too far away from the user’s location intent 154 Orchard St Relevance -> Bad (Distance/ 154 Orchard St. United Prominence Issue) States Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect Results 1 . Levittown. result #4 would be rated Navigational and the New York and New Jersey results would be Bad .

154 Orchard St Relevance -> Bad (Distance/ 154 Orchard St. Levittown. all locations with this address are far from the location intent of the query. Scenario 3: Imagine that the location intent implied by the viewport/user’s location is in Maine. Distance/ Prominence Issue 148 . PA. NJ 07026-2714.e. Pennsylvania 19054 Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect Given the viewport over Levittown. New York. Garfield. NY 10002-2221. and there is no address in the vicinity that contains [154 Orchard St]. the user likely typed st (street) instead of dr (drive) by mistake.3: Too far away from the user’s location intent 154 Orchard Dr Relevance -> Navigational 154 Orchard Dr. i. Query Results Explanation [154 154 Orchard St Relevance -> Good - orchard 154 Orchard St. United Prominence Issue) States Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect Results 1 .

NJ 07102-3329. The result is still significantly far away.Distance/ Prominence States Issue Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect Results 2-4: Acceptable – these locations are equally unremarkable 154 Orchard St Relevance -> Acceptable 154 Orchard St.Distance/ Prominence States Issue Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect Results 2-4: Acceptable – these locations are equally unremarkable 154 Orchard Dr Relevance -> Acceptable 154 Orchard Dr. Newark. 154 Orchard St Relevance -> Acceptable 154 Orchard St. United . Pennsylvania 19054 . NJ 07026-2714. Levittown. Garfield.Distance/ Prominence Issue Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect 149 .st] United States Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect This location is the most prominent result as it is in Manhattan and several businesses are found there. United .

e. [1600 pennsylvania ave] 150 . it overwhelmingly refers to the location of The White House and should be considered the primary intent of the query unless an additional location modifier is provided (i. or postal code). Results 2-4: Acceptable – these locations are equally unremarkable Here is another example of an address query with implicit location intent. city. state. Although this is a common address in US cities. or a different 1600 Pennsylvania Ave than The White House is already in or very near the location intent.

151 . DC. The proximity of the user viewport to the Richmond location makes this location just as relevant as the prominent location in Washington DC. CA 94801. United States Address Accuracy -> Correct Pin Accuracy -> Perfect Both results are equally valid. The White House Relevance -> Navigational 1600 Pennsylvania Ave. CA (not near Richmond. Scenario 1: recent viewport on Los Angeles. Name Accuracy -> Correct United States Address Accuracy -> Correct Pin Accuracy -> Perfect This is the most prominent result for this address. so neither can get Navigational and should instead be rated Excellent. Name Accuracy -> n/a ave] 2848. United States Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect Technically a match. Richmond. Query Results Explanation [1600 1600 Pennsylvania Ave Relevance -> Excellent pennsylvania 1600 Pennsylvania Ave. therefore both examples from above would be Excellent . CA). CA (near Richmond. CA): Query Results Explanation [1600 1600 Pennsylvania Ave Relevance -> Acceptable/Bad - pennsylvania 1600 Pennsylvania Ave. Scenario 2: The recent viewport is in San Francisco. Distance/ Prominence Issue ave] 2848. but considering the user’s viewport it is less likely that the user is looking for this location. Richmond. CA 94801. Washington.

1099 Duncan St. or at least the major search engines cannot determine its exact location.3 Address does not exist If the full address in the query does not seem to exist after researching it. Name Accuracy -> n/a San 94131. The White House Relevance -> Navigational 1600 Pennsylvania Ave. the Maps Search algorithm may have 3 types of responses: • Response 1: Maps Search returns the closest verified address – Rate Excellent • Response 2: Maps Search returns the same address as specified in the query. CA Address Accuracy -> Correct Francisco] Pin Accuracy -> Correct 152 . DC. Washington.. so neither can get Navigational and should instead be rated Excellent. which should be rated Acceptable Let's look at an example: Query Results Explanation [2001 1099 Duncan St Relevance -> Excellent Duncan St. 9. the correct rating is Excellent . San Francisco. The pin should be rated Can’t Verify • Response 3: Maps Search returns the street without a street number. Name Accuracy -> Correct United States Address Accuracy -> Correct Pin Accuracy -> Perfect Both results are equally valid.

CA Issue Name Accuracy -> n/a Address Accuracy -> Correct Pin Accuracy -> Perfect The result returns only the street with a pin dropped within the boundaries of the street. the closest number that does exist. therefore it should be rated as Excellent .. San Francisco. 94131. but unlikely therefore should be rated Acceptable . If 2001 does not actually exist then selecting 1099. This result technically satisfies the user intent. Duncan St Relevance -> Acceptable . 94131. The pin has to be correctly dropped on the address presented in the result as explained in the Pin guidelines. is considered correct. The pin rating for addresses that do not exist should Can’t Verify . The result returned is the same as the queried address. San Francisco. CA. we need to return the closest existing address on the same side of the street as the query.User Intent Duncan St. but the query requests a non-existent number. 153 . If the rule of odds and evens does not apply then the closest numeric number will be considered correct. 2001 Duncan St Relevance -> Excellent 2001 Duncan St. Name Accuracy -> n/a United States Address Accuracy -> Incorrect (Address does not exist) Pin Accuracy -> Can’t verify Duncan Street only goes up to number 1099. For a locale that uses the rule of even numbers on one side of the street and the odd numbers on the other.

Although the query terms do not contain an explicit location. the Mount Rushmore monument is so prominent and unambiguous that its location should be considered the primary location intent.User Intent Hill City. This feature is considered an associated entity to the park.User Intent 13036 SD-244. referring to the famous US monument.9. Mount Rushmore KOA at Palmer Gulch Relevance -> 12620 Highway 244 Good/Acceptable . SD. The user viewport and user location are irrelevant for this query because the user is looking for the place of interest irrespective of where the user currently is. SD 57751 Issue Name Accuracy -> Correct 154 . Unite States Name Accuracy -> Correct Address Accuracy -> Correct Pin Accuracy -> Perfect The pin can drop anywhere within the boundaries of the park to be rated Perfect . Mount Rushmore History Association Relevance -> Mount Acceptable/Bad . Keystone. Query Results Explanation [mount Mount Rushmore National Memorial Relevance -> Navigational rushmore] 13000 S Dakota 244. SD 57745 Issue United States Name Accuracy -> Correct Address Accuracy -> Correct Pin Accuracy -> Perfect This result is a campground within the park. For example.4 Point of interest A correct location result should be rated Navigational for queries referring to a point of interest. Keystone. consider the query [mount rushmore].

[route 66] Route 66 Relevance -> Navigational Seligman. Route 66 Indian buffet all 7 days Relevance -> Bad .5 Understanding Multiple Query Interpretations: Beyond Viewport and User Position 155 . 9. but less prominent. AZ 86337 Name Accuracy -> Correct United States Address Accuracy -> Correct Pin Accuracy -> Perfect This result represents Route 66. TX 76134 Name Accuracy -> Correct United States Address Accuracy -> Correct Pin Accuracy -> Perfect This result matches the name. The pin can be dropped anywhere along the route.User 100 Altamesa Blvd Intent Issue Fort Worth. but the result is a random business along the route with no prominence. Address Accuracy -> Correct Pin Accuracy -> Perfect This result is a museum within the park.

Many address/POI queries have multiple interpretations. USA Name Accuracy -> N/A viewport Address Accuracy -> somewhere Correct in France Pin Accuracy -> Perfect Very prominent result that satisfies the user intent. It is critical to fully understand the query through research rather than guessing. 156 . New York State Relevance -> Good – User New York. Here are some general observations: • when the query is a prominent POI. US Intent Name Accuracy -> N/A Address Accuracy -> Correct Pin Accuracy -> Perfect This result refers to the state of New York and satisfies a secondary intent of the query. any other obscure result that randomly matches the name should be rated Bad with User Intent checkbox selected unless it is close to the user or within fresh viewport Here are some examples: Query Results Explanation [new york] New York City Relevance -> Navigational user and New York City. Understanding which interpretation is most likely often requires extra Internet research in addition to considering the viewport and user’s location.

so cafes in the city of Amsterdam are the expected results. CA 94109 Name Accuracy -> Correct user viewport Address Accuracy -> and location Correct in San Pin Accuracy -> Perfect Francisco Because the user and viewport are close to San Francisco. [amsterdam Cafe de Jaren Relevance -> Excellent cafe] Nieuwe Doelenstraat 20-22. Although this is still a possible interpretation. this well-rated cafe in San Francisco will be considered the main intent. [amsterdam Amsterdam Cafe Relevance -> Navigational cafe] 937 Geary St. but is not a very prominent street. Paris. San Francisco. 1012 CP Amsterdam. Name Accuracy -> Correct user viewport Netherlands Address Accuracy -> and location Correct in Pin Accuracy -> Perfect somewhere in Europe The user and viewport are in Europe.User Avenue de New York. Avenue de New York Relevance -> Good . it is not a perfect match to the query and is overshadowed by the prominence of New York City. 157 . France Intent Issue and Distance/Prominence Issue Name Accuracy -> N/A Address Accuracy -> Correct Pin Accuracy -> Perfect The result is within the fresh viewport.

so returning the continent should be rated Navigational . 1012 CP Amsterdam. Name Accuracy -> Correct user viewport Netherlands Address Accuracy -> and location Correct in Pin Accuracy -> Perfect somewhere in rural US The user and viewport are in a rural area and there is no relevant result in the area.[amsterdam Cafe de Jaren Relevance -> Excellent cafe] Nieuwe Doelenstraat 20-22. [europe] Europe Relevance -> Navigational user viewport Europe Name Accuracy -> N/A and location Address Accuracy -> in Correct somewhere Pin Accuracy -> Perfect in US The query is clearly for the European continent. so the strongest matches are cafes in the city of Amsterdam. If the name of a local business exactly matches the query with no extra words then that business may be a reasonable interpretation of the query and should be rated based on distance from the user or viewport. Any other businesses are all Bad . 158 .

Paris Relevance -> Acceptable/Bad Texas. CA The query [paris] can mean either the capital of France or one of more than 10 towns across the USA with the same name. the city in France should be rated Navigational unless the query’s location intent is within or very close to one of these small US cities. 159 . France Name Accuracy -> N/A and location Address Accuracy -> in Correct somewhere Pin Accuracy -> Perfect in San Francisco. USA – User Intent Issue Name Accuracy -> N/A Address Accuracy -> Correct Pin Accuracy -> Perfect This result is unlikely to satisfy the user intent.[paris] Paris Relevance -> Navigational user viewport Paris. Because of the small population and lack of tourism in these small towns.

Name Accuracy -> Correct school] Spring. United States Address Accuracy -> Correct user Pin Accuracy -> Perfect location and viewport Perfect result for the query. 2. Multiple interpretations .6 Business Queries There are some important questions to consider before you rate a business query: 1.e. 9. 3. A quick internet search shows that this query overwhelmingly refers to the cuisine rather than the desire to know where Hunan province is geographically.[hunan] Brandy Ho's Hunan Food Relevance -> Excellent user viewport 217 Columbus Ave.6. Population density . The correct location should be rated Navigational and any other results should receive Bad with User Intent issue checkbox selected. TX 77379. Starbucks) then the user expects to find locations in or very close to the user’s location intent. 9.Are there possible interpretations of the query terms other than a business name? French Laundry is both a famous restaurant in Napa and a type of Laundromat/cleaners.1 Non-chain businesses Some businesses have only one location. both user location and viewport are in the San Francisco bay area.Is the area of the business results urban. CA 94133 Name Accuracy -> Correct and location Address Accuracy -> in Correct somewhere Pin Accuracy -> Perfect in San Francisco. 160 . suburban or rural? City dwellers are less willing to travel longer distances than suburban and rural users. CA The query [hunan] represents both the 7th most populous province in China and a popular type of cuisine. Query Result Explanation [klein Klein High School Relevance -> Navigational high Klein High School.How many locations of this business exist? If there are many of them (i. San Francisco. Number of locations . 16388–16406 Lyons School Rd. so we treat and rate them as navigational queries. In this case.

User Intent Issue 800 North Point St. San Francisco. Name Accuracy -> Correct California 94109 Address Accuracy -> Correct Pin Accuracy -> Perfect This is a nationally famous restaurant in San Francisco with no other possible results. San Francisco. Spring. Name Accuracy -> N/A California 94109 Address Accuracy -> Correct Pin Accuracy -> Perfect 161 . United States Address Accuracy -> Correct Pin Accuracy -> Perfect The school district office is not relevant for the query.in Spring TX Klein Independent School District Central Relevance -> Bad . TX 77388. 800 North Point Relevance -> Bad . [Gary Restaurant Gary Danko Relevance -> Navigational Danko] 800 North Point St.User Intent Issue Office Name Accuracy -> Correct 20811 Ella Blvd.

For example: Query Result Explanation [lighthouse] The Lighthouse Relevance -> Excellent user location 4474 W Jefferson Ave. United Name Accuracy -> Correct and viewport States Address Accuracy -> Correct in Dearborn. Result is for the address and not the business therefore it does not satisfy the user intent. Pin Accuracy -> Perfect MI (suburb of Detroit) This is a nearby bar that seems like a better fit and more likely intent based on its popularity. MI 48229.User Intent Issue 1259 Mason St. In this case rate each business independently considering its relevance and distance from the location intent of the query. Ecorse. California Name Accuracy -> Correct 94108 Address Accuracy -> Correct Pin Accuracy -> Perfect Result is unrelated to the chef Gary Danko or to any of his restaurants. Often there are multiple unrelated businesses with the same name in the same area. DDS Relevance -> Bad . San Francisco. 162 . Garry Lee.

MI 48146-3493. You can determine that by doing the research. Distance/Prominence Issue United States Name Accuracy -> Correct Address Accuracy -> Correct Pin Accuracy -> Perfect This is a nearby church that is less well known. Lincoln Park. Lighthouse Baptist Church Relevance -> Good - 3324 DIX Hwy.Lighthouse Ministries of Free Methodist Relevance -> Good - Church Distance/Prominence Issue 2069 Chandler Ave. MI 48146. United Name Accuracy -> Correct States Address Accuracy -> Correct Pin Accuracy -> Perfect This is a nearby church that is less well known. Lincoln Park. 163 .

6. the more you can widen the distance for relevant results. 2847 Park Ave. Tustin. This is the closest Whole Foods location to Irvine. A Whole Foods store within the user’s California viewport. please do research to verify that it in fact exists at the address listed in the result.9. CA 92782 Name Accuracy -> Correct user Address Accuracy -> Correct viewport Pin Accuracy -> Perfect and user location in Irvine. Whole Foods Relevance -> Good - Fashion Island. For businesses with multiple locations such as chain stores and restaurants. 164 . Here are some general considerations: • closer results are more relevant than farther away results • the farther away a result is. CA 92660 Name Accuracy -> Correct Address Accuracy -> Correct Pin Accuracy -> Perfect Whole Foods store in the same metro area but outside the user’s viewport. the more you need to downgrade • the more locations the respective chain business has in the area. go to the business website and check the address of the result you’re rating. the closer the results should be • the fewer locations the respective chain business has in the area.2 Chain Businesses Important: For each branch of a chain business. Newport Distance/Prominence Issue Beach. 415 Newport Center Dr. Here are some examples: Query Result Explanation [whole Whole Foods Relevance -> Excellent foods] The District.

Whole Foods Relevance -> Acceptable - Aliso Village Shopping Center. Sunnyvale. [Chase] Chase Relevance -> Excellent 1234 W El Camino Real. CA 95051 Address Accuracy -> Correct Pin Accuracy -> Perfect This result is not for a bank. CA 94087 Name Accuracy -> Correct Address Accuracy -> Correct Pin Accuracy -> Perfect When the query is a specific bank. 23932 Aliso Creek Distance/Prominence Issue Rd. 165 . but just an ATM located in an AMPM store. Laguna Niguel. Chase AMPM Relevance -> Excellent 2800 Homestead Rd Title Accuracy -> Correct Santa Clara. CA 92677 Name Accuracy -> Correct Address Accuracy -> Correct Pin Accuracy -> Perfect Whole Foods store in a neighboring city. either an ATM or a bank from that specific brand are equally relevant. outside of the viewport and a considerable distance away – this is less relevant to the user.

6.6. For these type of results rate the address according to the official website or consensus of three sources. CA 94128 Address Accuracy -> Correct airport. the user is within. In this example. rate businesses run out of a home as Bad .9. 9.User Intent Issue user location San Francisco International Airport. Pin Accuracy -> Perfect viewport over SFO Results within limited access locations are relevant only if the user location is within that location or within close proximity. fresh viewport over entire San User location is not within immediate Francisco are proximity of the airport. [burger king] Burger King Relevance -> Bad . San Name Accuracy -> Correct in the SFO Francisco. • Home Business: Unless otherwise stated in the country specific guidelines.4 No Physical Location. locksmiths) have no relevance for maps and are rated Bad .g. Here is an example: Query Result Explanation [burger king] Burger King Relevance -> Excellent user location is San Francisco International Airport. therefore this including the result is not relevant even though it is airport within the fresh viewport. Consider how accessible a business is as part of your research. The user would not have access to the airport. otherwise use Can’t verify or if entire address is missing use Can’t verify as well. San Title Accuracy -> Correct and viewport Francisco. Back office & Operating out of Home • Businesses with no physical location (e. If an 166 . CA 94128 Address Accuracy -> Correct are in Pin Accuracy -> Perfect downtown San Francisco. You would expect that such businesses run on appointments only and therefore have no opening hours or a brick and mortar business. Rate them with a lower prominence.3 Business with Limited Access Businesses that are no accessible to users do not bring value to users. • Back offices are usually not open to public or on appointment only.

address is present rate pin according to the address in the result. This business will not be rated Business/POI does not exist because we want to reserve that option for businesses and POI that truly do not exist. Business/POI is closed/does and viewport in Sunnyvale. CA Relevance -> Excellent Researching this business shows that it is closed. if no address is present rate Can’t verify .6.5 Business/POI does not exist There are situations where the result returned is for a business that does not exist. UT 84604 Address Accuracy -> Correct and viewport United States Pin Accuracy -> Correct in Provo. The relevance rating for this location should be Bad . The checkbox for Business/POI is closed/does not exist should be selected and name. CA 94087 not exist Sunnyvale. For these businesses. Query Result Explanation [flower Wendy's Flower Affair Relevance -> Bad (User Intent) shop] 1175 E 930 N Name Accuracy -> Correct user location Provo. This business has no real maps intent as a user cannot navigate there. UT Researching this business shows that it is a business out of a residential home. Query Result Explanation [sushi] Ocean Blue Sushi Club user location 1010 E El Camino Real. would be a very good result for this query. 9. We have been able to identify the address and pin for this business and they will be rated with Correct . The relevance rating for this location should be Excellent based on the fact that if this business were open. 167 . you will still need to establish relevancy as if the business were open. address and pin accuracy questions should not be answered.

Primary intent refers to businesses the user is expecting to see for the given category and secondary intent refers to businesses that fit the category but would not be the user's immediate choice. so relevance plays a greater role than distance.9. 168 . You will need to determine the user’s intent based on the query you are presented with. McDonald’s Relevance -> Good .User Intent 6950 Greenville Ave Issue Dallas. Associated entities does not apply to category queries. Here are some examples of high-level categories: Query Result Explanation [restaurants Cheesecake Factory Relevance -> Excellent ] 7700 W Northwest Hwy Name Accuracy -> Correct user location Dallas.7 Category Queries Category queries are the broadest query type because they can return the greatest variety of locations. You will need to research and determine what sort of businesses a user might expect to see in that particular category. TX 75225 Address Accuracy -> Correct and viewport Pin Accuracy -> Perfect in Dallas. TX 75231 Name Accuracy -> Correct Address Accuracy -> Correct Pin Accuracy -> Perfect Fast food restaurants satisfy secondary intent for the query. Secondary intent results will receive a starting grade of Good . TX Full service restaurants are the main intent for the query.

they serve very limited types of food or specialize in a type of food other than main meals and entrees. CA 94128 Name Accuracy -> Correct and location Address Accuracy -> Correct in the Bay Pin Accuracy -> Perfect area.User Intent Half Moon Bay. Starbucks Relevance -> Acceptable .User 8687 N Central Expy Intent Dallas. making them less relevant to users issuing the query [restaurants]. TX 75217 Name Accuracy -> Correct Address Accuracy -> Correct Pin Accuracy -> Perfect While you can purchase food at Starbucks. CA 94019 Name Accuracy -> Correct Address Accuracy -> Correct Pin Accuracy -> Perfect Regional airports are less prominent for this query. [airports] San Francisco International Airport Relevance -> Excellent user viewport San Francisco. International and national airports are the primary intent Half Moon Bay Airport Relevance -> Good . 169 .

CA Intent Name Accuracy -> Correct Address Accuracy -> Correct Pin Accuracy -> Perfect Private airports are less prominent for this query. Pin Accuracy -> Perfect Germany This result is relevant because most banks have ATMs on premises. [ATM] Deutsche Bank Relevance -> Excellent user viewport Unter den Linden 13-15 Name Accuracy -> Correct and location 10117 Berlin Germany Address Accuracy -> Correct in Berlin. Moffet Federal Airfield Relevance -> Acceptable . as they provide limited query satisfaction. 170 .User Mountain View.

Sunnyvale. Chase AMPM Relevance -> Bad . located in an AMPM store. This result does not fully satisfy the result intent because it does not provide all the services a bank would. the intent of the user is a bank that has full service. CA 94087 Name Accuracy -> Correct viewport Address Accuracy -> Correct location in Pin Accuracy -> Perfect Santa Clara CA.User Intent 2800 Homestead Rd Title Accuracy -> Correct Santa Clara.[bank] Chase Relevance -> Excellent user and 1234 W El Camino Real. CA 95051 Address Accuracy -> Correct Pin Accuracy -> Perfect This result is for an ATM only. 171 . When the query is a bank.

172 . Query Result Explanation [ski Meier Skis Relevance -> Excellent shop] 970 Yuma St Name Accuracy -> Correct user Denver.” It’s often hard to define which businesses or business chains belong in any one soft category. Patagonia Relevance -> Good 1431 15th St Name Accuracy -> Correct Denver. such as the category [italian restaurant].8 Soft Categories Some categories are straightforward and may satisfy some categories exactly. so you’ll have to research the individual results provided to make your rating decisions.9. We call these types “soft categories. the query [ski shop] doesn’t satisfy a specific Maps Search category but is associated with the more general Sporting Goods category instead. For instance. which would satisfy the primary intent of this category. However. CO 80202 Address Accuracy -> Correct Pin Accuracy -> Perfect Stores that sell ski clothing would be considered secondary intent. sometimes categories are too small or have multiple interpretations where different types of result can satisfy the user’s intent. CO Business is for a dedicated ski shop. CO 80204 Address Accuracy -> Correct location Pin Accuracy -> Perfect and viewport in Denver.

Ste 2285A User Intent Hourston. Ste 190 Name Accuracy -> Correct fresh Houston. Ste 7315 Name Accuracy -> Correct Houston. Prada Houston Galleria Relevance -> Acceptable/Bad - 5015 Westheimer.[italian] North Italia Relevance -> Excellent User and 1700 Post Oak Blvd. Cafe Dolce Gelato Relevance -> Good . Texas 77056 Address Accuracy -> Correct viewport in Pin Accuracy -> Perfect Houston. Texas 77056 Address Accuracy -> Correct Pin Accuracy -> Perfect Italian ice cream café is mostly likely a secondary intent. 173 . Texas 77056 Name Accuracy -> Correct Address Accuracy -> Correct Pin Accuracy -> Perfect An Italian clothing store is an unlikely intent. This result satisfies the user’s intent.User Intent 5135 W Alabama St. TX Most likely user intent for this query is Italian restaurants.

However. the result’s name should clearly show that it is for parking. Any association a parking lot has with a particular business. permit only or parking in a gated community and should not be considered relevant unless specifically requested in the query By "parking" we refer very generally to any of the following: • Parking lots • Parking garages • Parking decks • Parking buildings Parking lots sometimes do not have a specific name. but it is not mandatory. building etc. staff only.8.1 Category: Parking There are a few things to take into consideration when evaluating [parking] queries: • Free or paid parking should not be a criteria for relevance • Limited time parking should not be a criteria for relevance • Private parking is strictly residents only. can be reflected in the parking lot’s name.9. We accept the following alternatives as correct names: • business name + parking • plaza name + parking • shopping area name + parking • parking 174 . location.

name. CA The query specifically requests free parking. but we will accept as the correct CA name also the generic name of just “Parking”. [parking] Rincon Center Garage Relevance -> Excellent free user 121 Spear St. so our results should reflect the user’s request. Paid vs. This parking lot is free and should be rated with Excellent . CA Issue user 95051 Name Accuracy -> Correct location Address Accuracy -> Correct and Pin Accuracy -> Perfect viewport in Santa Clara. Paid or free parking should not be a factor in considering the relevance of a parking lot to the query. CA Rincon Center Garage is a parking garage accessible to the public for a fee. 175 . CA 94105 Name Accuracy -> Correct location Address Accuracy -> Correct and Pin Accuracy -> Perfect viewport in San Francisco. Paid vs. Please see some examples below: Example Query Result Explanation Type Specific [parking] Parking Relevance -> Excellent Parking user 121 Spear St. Santa Clara. San Francisco.User Intent free free] 3705 El Camino Real. There should be no demotion if the parking lot/garage requires payment. [parking Parking Relevance -> Excellent . CA 94105 Name Accuracy -> Correct location Address Accuracy -> Correct and Pin Accuracy -> Perfect viewport in San Rincon Center Garage has a specific Francisco. San Francisco.

specific CA This parking lot has no specific name. then the correct rating should be Bad as it does not satisfy the user’s intent. therefore the name is Correct . name but it is associated with a nearby business. CA 94301 Name Accuracy -> Correct location Address Accuracy -> Correct and Pin Accuracy -> Perfect viewport in Palo Alto. Affiliate [parking] Stevens Creek Parking Relevance -> Excellent parking user 2899 Stevens Creek Blvd. If the result is a parking lot that requires payment. CA United States Name Accuracy -> Correct location Address Accuracy -> Correct 176 . San Jose. Airport [parking] Parking Relevance -> Excellent Parking user San Francisco. CA This result is a generic parking lot and there is no need for a specific name. Generic [parking] Parking Relevance -> Excellent Parking user 552 Waverley St. CA Name Accuracy -> Correct that location 95050 Address Accuracy -> Correct does and Pin Accuracy -> Perfect not viewport in have a San Jose. Palo Alto.

Private [parking] Parking Relevance -> Bad . private parking should be considered irrelevant and receive a rating of Bad . and Pin Accuracy -> Perfect viewport in San This result refers to the parking lot of Francisco. However. should be considered public. CA Name Accuracy -> Correct public location 95051 Address Accuracy -> Correct parking and Pin Accuracy -> Perfect viewport in Santa Clara.User Intent Issue vs. If you cannot confirm that parking is public or private. staff only. CA Generic name of “parking” is considered correct and pin has to be dropped on the SFO parking lot. permit only or parking in a gated community. short term parking or limited time parking (such as a 2h limit). give the result the benefit of the doubt and consider it public parking. Also. if the parking lot is specialized (such as motorcycle-only parking). or limited use parking. parking that is to be used specifically only when visiting a certain business. user 3600 Flora Vista Ave. Your relevance rating should not be influenced if the parking is for small cars. We define private parking as parking that is for residents only. and our Name doesn’t reflect 177 . San Francisco International Airport. Santa Clara. large cars. CA For the purposes of Maps Search. RVs or motorcycles. Your rating should not be influenced by the fact that the parking lot is long term. A parking lot that is mixed for residents/staff/permit and visitors and it is not in a gated community should be considered public parking.

178 . This should be rated Bad because the result is not useful for the general public. The result in this example is for a residents-only parking lot. then the result should be rated Incorrect for name accuracy.that specialization.