You are on page 1of 271

Maps Search

fr o m
IP Evaluation Guidelines

o rp
, 2 023 olica September 2022

10 P
1. Introduction ..............................................................................................................................................5
Tu

a ry ancy esd
1.1.The Rating Tool ....................................................................................................................................................................................................5
u N 1 72 y, J a

1.2.Rating Workflow Jan .9 by .16


...............................................................................................................................................................................................11

d a y ,
5 4 .25 anua
1.3.Rating Interface
s
e 16 ................................................................................................................................................................................................13
. 2 4 .9 r y

Tu 7“Navigational
1.3.1.Query-Level 2 . Result” Question by 10,
..............................................................................................................................................14

1 N an 2023
1.3.2.Result-Level Rating Checkboxes ...................................................................................................................................................................14

cy
Po from
1.3.3.Result Relevance Rating ..................................................................................................................................................................................15

lica IP
1.3.4.Result Relevance Demotion Checkboxes ...................................................................................................................................................16
rpo

1.3.5.Data Accuracy ...................................................................................................................................................................................................16

1.3.6.Comments ..........................................................................................................................................................................................................16

2. Understanding User Intent .......................................................................................................................17

2.1.Query Types .......................................................................................................................................................................................................17

2.1.1.Research Expectation ........................................................................................................................................................................................21

2.2.Result Types .......................................................................................................................................................................................................21

2.3.Location Intent ..................................................................................................................................................................................................22

2.3.1.Explicit Location ................................................................................................................................................................................................22

2.3.2.Implicit Location ..............................................................................................................................................................................................23

3. Rating the Query-Level Navigational Result Question ...............................................................................24

4. Rating Result-Level Issues ........................................................................................................................24

4.1.Result Name/Title in Unexpected Language or Script .....................................................................................................................24

4.1.1.Name of Business/POI Results ........................................................................................................................................................................25

4.1.2.Title of Address Results ....................................................................................................................................................................................28

4.2.Business/POI is Closed or Does not Exist .............................................................................................................................................28

4.2.1.Closed/Does Not Exist vs. Inaccurate Name and Address .....................................................................................................................29

4.2.2.Rating Relevance of Closed/Non-Existing Business/POI .......................................................................................................................29

4.3.Business/POI Status is PERMANENT_CLOSURE ................................................................................................................................29

4.3.1.No Status Shown ..............................................................................................................................................................................................30

4.3.2.Status Shown as PERMANENT_CLOSURE .................................................................................................................................................30

5. Relevance ................................................................................................................................................30

5.1.Query-Result Connection ..............................................................................................................................................................................31

5.1.1. General Connection .........................................................................................................................................................................................32

5.1.2. Abbreviation/Alternate Name Connection ...............................................................................................................................................32

5.1.3. Category Connection .....................................................................................................................................................................................32

5.1.4. Spell Correction Connection .........................................................................................................................................................................33

5.1.5. Transit Intent Connection ..............................................................................................................................................................................33

5.1.6. Special Character Connection ......................................................................................................................................................................33

5.1.7. Address-Result Connection ............................................................................................................................................................................34

5.1.8. Lack of Connection .........................................................................................................................................................................................34

5.2. Satisfying User Intent ....................................................................................................................................................................................36

5.3.Prominence .........................................................................................................................................................................................................37

5.4.Distance ................................................................................................................................................................................................................38

5.5.Distance vs. Prominence ...............................................................................................................................................................................40 IP

Tu
5.6.Many Possible Results m
....................................................................................................................................................................................40
e
17 sday, 3 fr rpo

o
5.7.Few Possible Results .......................................................................................................................................................................................43
2 a

2.1
6.2 Janu
5.8.Few Possible Results and Greater Distance , 20 olic
..........................................................................................................................................44
0

1 cy P
54 a.........................................................................................................................................................................................................45
5.9.Rural Areas r r y n

.9 y
by 10, n ua y Na
5.10.Location – User Intent Deviation
Na 202 ............................................................................................................................................................46
a
, J 4.9 b

ncy 3 f
5.11.Rating for User Inside and Outside Viewport y
...................................................................................................................................47
a

esd 16.25
Po rom ................................................................................................................................................................49
u
5.12.Partial Address Does Not Exist lica IP T 72.

5.13.City vs. Municipality .....................................................................................................................................................................................50


rpo 1

5.14.Unexpected Results ......................................................................................................................................................................................50

5.15. Multiple Transit POIs with the Same Name ......................................................................................................................................52

5.16.POIs and Transit Intent ...............................................................................................................................................................................53

IP
5.16.1.Transit Queries .................................................................................................................................................................................................54

o m
5.16.2.Stops vs. Stations ............................................................................................................................................................................................57
r rpo

f
3 ca
0 2
5.17.Parking Intent .................................................................................................................................................................................................59
l i

5.18.Relevance: Service-Level Mismatch 1 0, 2 y Po ......................................................................................................................................................59


T u

u ary Nanc
5.19.Rating Relevance When Result Status is PERMANENT_CLOSURE 1
esd
...........................................................................................62
a

an by 72 y, J
y , J
5.19.1.Expected PERMANENT_CLOSURE. 9 Status .
..................................................................................................................................................62
1 6 a n

a 4 .2 u
u esd 16.25
5.19.1.1.Expected PERMANENT_CLOSURE Status: Navigational Query 54 ary
......................................................................................................64
.9 10

T 7 2 .
5.19.1.2.Expected PERMANENT_CLOSURE Status: All chains closed in area b
............................................................................................66
y ,

2 N
1 PERMANENT_CLOSURE Status ............................................................................................................................................67
an 023
5.19.2.Unexpected c

Po rom f
5.19.2.1.Unexpected PERMANENT_CLOSURE Status: Open Options are Nearby ....................................................................................68

y
lica IP
rpo
6. Name Accuracy ........................................................................................................................................69

6.1.Name Not Applicable (n/a) .........................................................................................................................................................................69

6.2.Result Names .....................................................................................................................................................................................................70

6.2.1. Correct Name ....................................................................................................................................................................................................70

6.2.2. Partially Correct Name ..................................................................................................................................................................................73

6.2.2.1. Minor and Moderate Misspellings and Missing or Extra Words .....................................................................................................73

6.2.2.2. Service-Level Mismatch ....................................................................................................................................................................................76

6.2.2.3. Holding Name and Corporate Structure ....................................................................................................................................................77

6.2.3. Incorrect Name ................................................................................................................................................................................................78

6.3 Result Classification ........................................................................................................................................................................................80

6.3.1. Correct Classification ......................................................................................................................................................................................80

6.3.2. Incorrect Classification ..................................................................................................................................................................................81

6.4. Can’t Verify .........................................................................................................................................................................................................83

6.5 Transit Names ...................................................................................................................................................................................................84

6.6. Parking Names .................................................................................................................................................................................................84

6.7. Final Name Accuracy Rating (Summary Table) .................................................................................................................................86

7. Address Accuracy: Components and Issues ..............................................................................................87

7.1.Address Components .....................................................................................................................................................................................87

7.1.1.Street Number .....................................................................................................................................................................................................87

7.1.2.Unit/Apt ...............................................................................................................................................................................................................89

7.1.3.Street Name ........................................................................................................................................................................................................90

7.1.4.Sub-Locality and Administrative Subdivisions ..........................................................................................................................................91

7.1.5.Locality .................................................................................................................................................................................................................92

7.1.5.Region or State ...................................................................................................................................................................................................92

7.1.6.Postal Code .........................................................................................................................................................................................................93

7.1.7.Country .................................................................................................................................................................................................................93

7.2.Address Does Not Exist .................................................................................................................................................................................94

7.3.Language/Script Issue in Address ............................................................................................................................................................94

7.4.Country-Specific Issue ...................................................................................................................................................................................95

7.4.1.Country-Specific Issue vs. Correct with Formatting Issue .......................................................................................................................95

7.5.Other Issue ..........................................................................................................................................................................................................95

7.6.Correct with Formatting Issue ...................................................................................................................................................................96

7.7.Can’t Verify ..........................................................................................................................................................................................................96

7.7.1.Can’t Verify for Street Number ........................................................................................................................................................................97

7.7.2.Can’t Verify for Street Name ...........................................................................................................................................................................97

8. TAddress Accuracy: Result Expectations .....................................................................................................98 IP

ues
8.1.Business/POI Result .......................................................................................................................................................................................98 r o m o

f
da
18.71.1.Business/POI
2.1 y, Ja Address Research and Resources .........................................................................................................................................98 2 0 23 licarp

o
6.2 nu Official Addresses ........................................................................................................................................................................99
8.1.2.Alternative
54 ary y 10, cy P

8.1.2.1.Department Addresses
.9 a r n
.......................................................................................................................................................................................99
a

by 10, u
8.1.2.2.Result Missing the Street Address
Na 202 , J an by N
..............................................................................................................................................................101

ncy 3 f
8.1.2.3.P.O. Box, Mailing Addresses, and Management Offices ay 254.9
......................................................................................................................102
s d

.
P rom Locations ....................................................................................................................................................103
e
8.1.3.Businesses/POI withoMoving lica IP Tu 72.16

rpo 1
8.1.4.Events .................................................................................................................................................................................................................103

8.2.Address Type Results ..................................................................................................................................................................................104

2
8.2.1.Address Result ..................................................................................................................................................................................................104

IP
8.2.2.Address Formats ............................................................................................................................................................................................104

o m
8.2.3.Street Result ....................................................................................................................................................................................................105
r rpo

f
, 2 023 olica
8.2.4.Locality Result .................................................................................................................................................................................................105

1 0 yP T
8.2.5.Postal Code Result .........................................................................................................................................................................................106
u

y nc
arResult esd
8.2.6.State/Region/Territory u N a .....................................................................................................................................................................106
1 72 y, J a

, Jan .9 by .16
8.2.7.Country Result y.................................................................................................................................................................................................106
a

a 4 .25 nua
8.3.Features Without an Expected Address
esd 16.25 ..............................................................................................................................................106
4.9 ry

u .
8.3.1.NaturalTFeatures b 10
.............................................................................................................................................................................................106

2 y ,
17 an Expected Address ...........................................................................................................................................................108
Na 202
8.3.2.POIs Without nc 3

y
Po rom f
8.3.2.1.Minimum Address Component ....................................................................................................................................................................108

lica IP
8.3.2.2.Official Address Present ..................................................................................................................................................................................109
rpo

8.3.2.3.No Official Address ............................................................................................................................................................................................111

9. Pin Accuracy ..........................................................................................................................................113

9.1.General Considerations ..............................................................................................................................................................................114

9.1.1.Pin Resources .....................................................................................................................................................................................................114

9.1.2.Satellite Imagery vs. Vector Map ..................................................................................................................................................................114

9.1.3.Boundaries of the Feature .............................................................................................................................................................................115

9.1.3.1.Half ’n Half and Tennis Rules .........................................................................................................................................................................116

9.1.3.2.Boundaries in Shared Spaces ........................................................................................................................................................................118

9.1.4.Next Door ..........................................................................................................................................................................................................120

9.1.5.Can’t Verify (Smallest Identified Area) ........................................................................................................................................................121

9.2.Single Rooftop .................................................................................................................................................................................................122

9.2.1.Leaning Buildings ...........................................................................................................................................................................................137

9.2.2.Residential Property with Multiple Buildings .........................................................................................................................................139

9.3.Multiple Rooftops ..........................................................................................................................................................................................140

9.3.1.Multiple-Rooftop Rating ...............................................................................................................................................................................141

9.3.2.Campus Rating ...............................................................................................................................................................................................147

9.3.2.1.Single-Complex Campus ..................................................................................................................................................................................149

9.3.2.2.Dispersed Campus .............................................................................................................................................................................................152

9.4.Features Without a Rooftop ......................................................................................................................................................................155

9.4.1.Natural Features ..............................................................................................................................................................................................155

9.4.2.Administrative Divisions ..............................................................................................................................................................................158

9.4.3.Streets ................................................................................................................................................................................................................159

9.5.Parking Lots and Structures .....................................................................................................................................................................161

9.6.Transit POIs .....................................................................................................................................................................................................162

9.6.1.Bus, Tram, and Streetcar Stops ....................................................................................................................................................................164

9.6.2.Transit POI with Multiple Rooftops/Platforms .......................................................................................................................................165

9.6.3.Transit POIs with a Single Rooftop ............................................................................................................................................................168

9.6.4.Underground Transit Stations ....................................................................................................................................................................168

9.6.4.1.How to Establish an Entrance Polygon .....................................................................................................................................................169

9.6.4.2.Examples ................................................................................................................................................................................................................170

10.How to Rate Results ..............................................................................................................................174

10.1.Specific Address ..........................................................................................................................................................................................174

10.2.Non-Specific Address ................................................................................................................................................................................188

10.3.Query Address Does Not Exist ..............................................................................................................................................................196

10.4.Point of Interest ...........................................................................................................................................................................................198

10.5.Understanding Multiple Query Interpretations: Beyond Viewport and User Location IP


...............................................202
Tu
e r o m o

10.6.Business Queries
17 sday, .........................................................................................................................................................................................205
f

2.11.Non-Chain
10.6. Businesses 0 23 licarp

.................................................................................................................................................................................206
2
J o
6.2 anu
10.6.2.Chain
54 Businesses
a 10, cy P
.........................................................................................................................................................................................209
y

r r n
10.6.3.Chain y
.9 Business ua y Na
by 10, with Location Modifier ..................................................................................................................................................213
n

Na 202 J a b
10.6.3.1.General Location Modifier
ncy 3 f s d ay, 254.9
...........................................................................................................................................................................213

10.6.3.2.Specific Location Modifier


P rom ...........................................................................................................................................................................221
u e 6 .

o T 72.
lica IPwith no Physical Location ...................................................................................................................2251
10.6.4.Back Offices and Businesses 1

rpo
10.6.5.Business/POI does not Exist ......................................................................................................................................................................227

10.7.Category Queries ........................................................................................................................................................................................228

3
10.7.1.Demotion for Distance with User Inside Viewport ..............................................................................................................................229

10.7.2.Demotion for Distance with User Outside IPViewport ..........................................................................................................................231

10.7.3.Demotion for Distance with FewerfrPossible o m


2 a rpo Results ...........................................................................................................................233

3 ...........................................................................................................................................................235
10.7.4.Category Queries and User Intent 0 l i c

10.7.5.Category Queries and Prominence 1 0, 2 y Po.........................................................................................................................................................236


T u

ry anc Modifier ................................................................................................................................................236


esd
10.7.6.Category Query with uaLocation N 1 a

n 7 2.1 y, Ja
Ja .9forbyCategory Queries ............................................................................................................................................238
10.7.7.Navigational yResults

, 4 6.2 nu
a 2...........................................................................................................................................................................................242
es d
10.7.8.Clear Categories . 5 5 4 a r y

.9
Tu 72.16..............................................................................................................................................................................................243
10.7.9.Soft Categories by 10,

Na 202
10.7.10.Category1 Query: Parking ..........................................................................................................................................................................248
ncy 3 f

10.8.Rating Results with PERMANENT_CLOSURE Status ...................................................................................................................252 Po rom

lica IP
10.8.1.Expected PERMANENT_CLOSURE Status ...............................................................................................................................................252
rpo

10.8.2.Unexpected PERMANENT_CLOSURE Status ........................................................................................................................................253

10.9.Other Query Types .....................................................................................................................................................................................255

10.9.1.Routing Queries .............................................................................................................................................................................................255

10.9.2.Coordinate and “My Location” Queries ..................................................................................................................................................257

10.10.Unclear Results .........................................................................................................................................................................................259

11.Top Rating Tips ......................................................................................................................................266

11.1.What’s the relevance when query is business/POI name and address and the result is only the address? .......266

11.2.What’s the relevance when the query is a street name and the result is a single business on that street? ........266

11.3.How do I know what the location intent is when user is outside/inside a fresh viewport? ......................................267

11.4.How do I know what the location intent is when user is outside/inside a stale viewport? ......................................268

11.5.This full address result does not exist. How do I rate it? ...........................................................................................................268

Appendix: Release Survey ..........................................................................................................................270

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

4
1. Introduction
IP
o m
r rpo
Welcome to Maps Search Evaluation. 0 2 3 f caThese guidelines will teach you how to use the evaluation tool
, 2 o li
and rate Maps Search results.
1 0 P Tu
ry ancy e
n
a
u yN 17 sday,
Ja be 2.1
For each task, you a y,will 4 .9 bpresented with a search query and the results 6.2 Jthat
an are provided to Maps
u
d 5 5
s
users. The goals
Tu 72.of
2
e 16 this task are:

. 4 .9 ary 1
by 0
1 Na , 202
ncy 3 f
• Search Relevance and Search 2.0: To determine how well the results satisfy Po the romuser’s
query (result relevance)
l i c arp IP
• Search 2.0 only: To check the data accuracy (name, address, and pin location) of othe results

1.1. The Rating Tool

This is the web-based rating tool used to rate Search 2.0 and Search Relevance queries.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

5
Anatomy of the Tool

IP
r o m
0 2 3 f carpo
li
Name 1 0, 2 y Po
Screenshot Description
Tu
ry c e
n ua y Nan 17 sday,
a
y, J 54.9
b The task bar shows:
2.16. Jan
d a 25 ua
es .2 4.9 ry
Tu 72.16 • Task Type: The name of the
10
by task.

1 Na , 202
• Task ID: A number that identifies ncy the3
Po from
specific task item. Use this number lica IP
r
whenever you communicate about a po
task or rating.

Task Bar • Request ID: A reference number for


internal use only. Do not use this
number to communicate about a
task or rating.

• Estimated Rating Time: Time to


rate all results

Rating The Rating Guidelines shortcut button


Guidelines opens the guidelines for this task.

Allows you to skip a survey in rare cases


Release where a technical or other issue prevents
Survey you from rating. See Appendix for
complete instructions.
Viewport shortcut buttons provide
convenient controls to pan or zoom to
common map viewport settings. Show
Show User
User moves the result viewport to the
user’s location without changing the zoom
level (map scale).

Show Viewport moves the result


Show viewport to the center of the user
Viewport viewport and zooms in on the viewport
area.

Use Show All to return from any zoom


TuShow All level to the initial display showing the IP
e r o m o
17 sday, user, the viewport, and all the results. f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

6
Name Screenshot IP Description
m
3 fro rpo The query header shows:

a
202 olic Query: The term the
1 0 ,
y P Tuuser entered into the
u ary Nanc search bar.
e
17 sday,
Jan .9 by Viewport Age: How 2long .16 ago
J the user
a y , 4 .25 anua
esd .25 moved the viewport.
4.9 ry
Tu 72.16 • A fresh viewport is indicated 10
by by
1 Na ,the
2
word FRESH displayed in green ncy 023 f
Po rom
text.
lica IP
Query • A stale viewport is indicated by the rpo
Header
word STALE displayed in red text.

Locale: The country and language


combination this query is for.

Country: Should match the country in the


Locale field. If it does not, defer to the
country found in the Locale field.

User Lat,Lng: The user’s location.

Top-Level A top-level question that must be


Question answered once for each query.

The result returned for a user query.

The color of the result heading


corresponds to the color of the pin on the
map that marks that result’s location. (See
Result Pin on page 9.)

The result address, classification and


status (if included) will be shown beneath
Result the result name/title. (The classification of
the result refers to its category.)

You will evaluate the relevance of each


individual result. If you are rating Search
2.0, you will also rate the name/address/
pin accuracy for each result.

Tu Note: A query can generate more than IP


e r o m o
17 sday, one result. f
23 licarp
2.1 2 0
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

7
Name Screenshot IP Description
m
3 fro rpo
a
0 , 202 olic
1 y P Tu
ary Nanc A result may also display
esd its status. If the
u 1 ay,
Jan .9 by status appears and is2.set
7
16 to Ja
y , nu
Status esda .254 PERMANENT_CLOSURE,.2the 54 result
Tu 72.16 .9 ary 1
requires special treatment when by rating
0
1 Na , 202
relevance. ncy 3 f
Po rom
lica IP
rpo
` You may occasionally see one or more
normal looking or grayed-out results with
Result with
no rating fields beneath them. No rating
no Rating
is required for these results. This is
Choices
expected and is not a technical issue or
a reason to release the survey.

User viewport: A transparent purple box


centered over a device icon shows the
user’s viewport at the time the query was
issued (if known). The user viewport
represents the map area the user was
looking at when making the query.

The shape of the viewport may vary


depending on the size and orientation of
User
the device being used.

Viewport
Note: In some cases, the user viewport
may be so small that it cannot be seen,
but (if the viewport information is
available) the device icon will always be
visible, regardless of the map scale.

Note: The viewports you see in the


examples in these guidelines may be grey.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

8
Name Screenshot IP Description
m
3 fro rpo This device icon shows the center of the
a
202 olic user viewport at the
1 0 ,
y P Tu time of the user
u ary Nanc query. The purpose1ofesthed device icon is
72 ay, J
Jan .9 by to make it easier to find16the user
. viewport.
a y , 4 .25 anua
esd .25 It does not indicate the user's4.9 location.
ry

Tu 72.16 by 10,
1 Na 202
This icon should not be used forncy P 3 fro
Device Icon oli m I
measuring distance. To measure car P
distance, start from the outer edge of the po
user viewport.

This icon has no rating significance. Its


only purpose is to help you find the
viewport on the map.
A blue and white icon indicates the user
location at the time of the query (if
known).

User
Location
Note: Clicking on the icon reveals the
coordinates (latitude/longitude) of the
user’s location.
A pin indicates a result’s location. The
head of the pin is only an indicator. The
tip marks the actual location.

Each pin on the map has a unique


number and color, which matches the
Result Pin
number and color of its corresponding
result heading.(See Result, above)

Note: The pins you see in the examples


in these guidelines may look different
from the pin shown in this chart and the
ones in the tool.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

9
Name Screenshot IP Description
m
3 fro rpo Clicking any individual result or pin causes
a
202 olic a pop-up box to appear
1 0 ,
y P Tu over the pin. The
u ary Nanc text within the box may e
17 sdshow
ay, additional
, Jan .9 by 2
information and should16onlyJabe
. used for
a y 4 .25 nua
esd .25 research purposes to help understand
4.9 ry the
Tu 72.16 result:
b y 10
,
1 Na 202
Pop-up ncy 3 f
P ro
Information • Phone number (for research only, olic m IP
arp
Box never call a business)
o
• URL

• Coordinates (latitude/longitude)

Note: Do not rate the information in the


pop-up box. Rate only the information in
the result.

Map Layer Allows you to select which map layer is


Selector displayed.

Allows zooming in and out on the map.


Zoom
Change the zoom level by clicking the +
Controller
(zoom in) or – (zoom out) buttons.

Copy to
Click to copy information to a clipboard
Clipboard

Click the pin icon at the top right of the


map to place a pin anywhere on the map.

Drop
Location Pin

A purple pin and a pop-up window


showing the pin’s address and latitude/
longitude will appear.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

10
Name Screenshot IP Description
m
3 fro rpo
a To measure the distance, click the ruler
0 , 202 olic
1 y P icon at the top rightTof
ue the map.

ary Nanc
17 sday,
Measure
u
Jan by 2.1
6.2 Janu
Distance
day, 54.9 54 ary
es .2 You can now drop a start pin.9(green)
Tu 72.16 by 10, and
1 an end pin (red). The tool will display 2
Na the
ncy 023 f
distance between them. Po rom
lica IP
rpo

Draw Tool Click to draw custom polygons.

Click Submit to save your ratings and


Submit
display the next available task.

1.2.Rating Workflow

Complete each step of the following workflow before you assign a rating.

Evaluate and rate each rating drop-down independently of the others. Rate result Relevance based
on whether the result fits the query intent, even if the result is closed or does not exist or has
incorrect Name, Address, or Pin data. If you are rating Search Relevance you will stop after you’ve
rated result relevance. If you are rating Search 2.0, you will continue by rating Name Accuracy,
Address Accuracy, and Pin Accuracy individually.

Note: For any result in a Search 2.0 project, you may be asked to make all of the possible ratings, some of
them, just one, or none. This is expected and not a reason to escalate or release a task.

Rate each result on its own merits. Do not demote duplicate or very similar results.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

11
IP
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

12
1.3. Rating Interface

IP
o m
r rpo
Your ratings and comments will 2be 3 f collected in the rating interface pictured below. You will first
answer one top-level question , 2 0
about
o licathe query itself, then rate each individual result using the other
10 P Tu
checkboxes and drop-downs.
ry ancy e
n
a
u yN 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

13
1.3.1. Query-Level “Navigational oResult” IP Question

m
3 fr rpo
a
You will answer a top-level question 0 , 202 olicfor each query to indicate whether there are any results in the
1 P Tu
real world that would completely ry ancy satisfy the user intent.
e
n
a
u yN 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
Query-leveld
es question
.2 Explanation 54 ary Notes
Tu 72.16 .9
by 10,
1 Na 202
Is there a navigational result Are there any results in the real You will only ncyneed3 f to answer
P rom
for this query? world that can completely this question onceoli for
car Ieach
P
satisfy the user intent? query. po

Note: If you are presented with a query that has no results, you must still answer this question and
submit your answer.

1.3.2. Result-Level Rating Checkboxes

For each result, you will be presented with two high-level questions. These will allow you to highlight
any problems at the result level.

High-level
Explanation Notes
question
Result is not in the language of the If you check this box, your rating for this
Result name/
query, the test locale, or the result result will be complete (all other questions
title is in
region (the expected languages) or is will be unavailable).
unexpected
in a mix of expected and unexpected
language or
languages (unless it is an official
script
company, chain, or brand name).
If you check this box, only the relevance
needs to be rated.

Pay attention to the status of the POI. If


the result’s status is
PERMANENT_CLOSURE, refer to 5.19
Rating Relevance when Status is set to
PERMANENT_CLOSURE and 10.8
Permanently Closed Results for rating
Business/POI Research shows that the business is
instructions.

is closed or closed or that no such business exists


does not exist at the address listed in the result.
If the status is blank or displays any other
IP
Tu
e text, rate the relevance of the result ras o mif oit
17 sday, f
2.1 did exist.

2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, Use thorough researchnuand a your
y N best
a
Na 202 Ja b
judgement to determine , .9whether the
ncy 3 f s day .254
Po rom result is closed,e has
Tu 72.1 6 never existed, or the
lica IP
rpo result component(s)
1 are incorrect.See
Unclear Results for further guidance.

14
IP
o m
1.3.3. Result Relevance Rating
3 fr rpo
a
0 , 202 olic
The relevance rating will rtake P Tu as distance/prominence.
y 1 ninto
cy consideration user intent as well e
Relevance is always arated n
a a
u yindependently
N 17 sday, address, or pin)
of any data (name/classification,
2.1
inaccuracies. This a
J .9 b
y,means 4 that when rating relevance we always assume 6.2 Jthat
an the result exists (even if
u
d 5 5
research reveals
s
Tu 72.the
. 2
e 16 location is closed) and that the data presented is correct.
4 .9 ary 1
by 0
1 Na , 202
ncy 3 f
Always rate against the real world: If there is a better result available but it is not shown, Po rodemote
lica m IP the
existing result(s) while considering the missing one(s).
rpo

Relevance
Explanation Notes
Rating

The most likely result implied by the user’s


query, location, and/or viewport that
completely satisfies the user’s distinct
intent.

A distinct user intent is defined by a A rating of Navigational for one


combination of the following result does not prevent other
Navigational
characteristics:
results from satisfying the query to
• Extreme prominence (e.g. Eiffel Tower)
a lesser degree.
• Uniqueness (e.g. complete address)

• Proximity (e.g. incomplete address that


points to an unambiguous option that is
is extremely close)

Highest possible initial rating for


A high-quality result that clearly satisfies the
ambiguous queries as well as for
Excellent user’s intent. Multiple results can be
queries that are not eligible for a
considered high quality.
Navigational rating.
Only partially satisfies the user’s intent due
Good
to relevance, prominence, or distance.
Any relevance rating of Good or
Technically satisfies the user’s intent but below requires an indication of the
Acceptable
does so poorly due to relevance or distance. reason(s) for the demotion:

• User Intent Issue

Does not satisfy the user’s intent due to lack • Distance/Prominence Issue
Bad of relevance or great distance (when closer
satisfying results are available).
Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

15
1.3.4. Result Relevance Demotion Checkboxes

IP
o m
If you give a result a Relevance rating 3 f caof
r rpoGood or below, you will be presented with two checkboxes.
0 2
Use them to select the reason(s) 0, 2 y Pfor
oli your rating:

1 Tu
ry anc e
a
u yN 17 sday,
• User Intent ,issue
a n 2.1
y J 54.9
b 6.2 Janu
• Distance/Prominence
es d a
.2 issue
54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Checkbox Explanation Notes
Po rom
lica IP
User Intent Select when the demotion is due to a result only rpo
issue partially fulfilling the query intent.
Select when the demotion is due to a distance
issue based on the user or viewport location or If both issues were reasons for
Distance/ when you demoted for a result that is less your relevance rating, select both
Prominence prominent based on the initial query intent. You checkboxes.
issue can also select this option when the query asks
for something at a specific location and the
result is not at or near the requested location.

1.3.5. Data Accuracy

If you are rating Search 2.0, once you've rated relevance, you’ll evaluate three result components for
data accuracy: Name, Address, and Pin.

1.3.6. Comments

Comments are mandatory for any result relevance rating of Good or below and for any data issues
not rated Correct/Perfect and should explain the reasons for all rating demotions. Be sure to:

• Include user intent: Indicate what you think the user intent is.

• Refer to the guidelines: If the demotion is due to a guideline instruction, note the guideline
section you used to make your decision.

• Include sources: If you find incorrect information in a result, your comment should include
the correct information and its source. Be sure that any links you include lead directly to the
information you provide. If they don’t, include a link to the source you used and explain how to
get to the information from there.

• Use URL shorteners when inserting long links into your comments

• Be concise: Don’t write elaborate comments. Be short and specific.

• Comment in English: Your comments will sometimes be reviewed or used by people who are IP
Tu mby o
esdnot familiar with your test locale or its language. Comments in English can be understood f r o
17 ay,
2.1 theJawidest possible audience.
2 0 23 licarp
o
6.2 nu
54 ary y 10, cy P
r n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

16
Issue Expectations IP Example Rating and Comment
o
r po m
The comment should
0 2 3 f carexplain the Relevance -> Good (Distance/
2 l i
reasoning 1behind
0 y P your rating. A demotion
, o Prominence)

Tu
Relevance may beuadue ry to c e
n N an distance from the user’s Comment:
17 sday,Demoted -1 for a few closer
Demotions location a by 2.1 locations
a y, J 54.9 compared to similar results/ real world6.2 Janu in the Middletown/
es potential
d .2 results, secondary intent, or Anchorage5area4.9 ary
.16 reasons.
Tu 72other by 10,
1 Na 202
ncy 3 f
Address Accuracy -> Incorrect
Po rom — Street
Include a comment when you rate a lica IP
Number
rpo
Name, Address, or Pin something other
Comment: Correct street number is: 332
than Correct or Perfect or you give a
Data Issues W El Camino Real, Sunnyvale, CA 94087

rating of Closed/Does not Exist or


Pin Accuracy -> Wrong

Unexpected Language.

Comment: Wrong pin: correct location is:


52.368067, 4.895389

2. Understanding User Intent

Before evaluating any results, you’ll need to understand what the user wanted to find when they
typed in their query. To determine user intent, use a combination of your own research and local
knowledge plus the information found in the rating interface, which includes:

• User location

• User viewport

• Viewport age

User intent refers to the interaction between query, user location, user viewport, and viewport age.

2.1. Query Types

The queries you are evaluating are real queries submitted by users. Because they are real, they can:

• Be misspelled

• Contain mistakes

• Be inconsistent

• Be ambiguous

• Be badly formatted

• Be, or contain, emojis

• Have no maps intent

The
Tu first step in the rating process is to make sure you understand the query.
IP
esd r o m o
f
17 ay,
2.1 2 0 23 licarp
J a , an o
If you6.see
25 nauforeign-language query, do not release the survey. Research the query or y 10use c y P online
4.9 ary ua
r n
by 10, translation tool to find out what it means, then rate it as usual. an by N
a

Na 202 , J
ncy 3 f s d ay 254.9
Po rom e .
lica IP Tu 72.16
rpo 1

17
You will see several types of queries, IP
including:

r o m
0 2 3 f carpo
li
Address queries
1 0, 2 y Po Tu
ry anc e
n
a
u yN 17 sday,
Address queries contain a 2
y, J 54.9 all or part of a complete address, including.1street
6.2 Jannumber, street name,
b
d a 54 uary
locality, state,uecountry,
s 6.2 and postal code.
.9
T 72.1 by 10,
1 Na 202
ncy 3 f
Query Explanation Po rom
lica IP
rpo
[717 E El Camino
This is an address query in the form of a full address. It contains a street
Real, Sunnyvale,
number, street name, locality, state and postal code.
CA 94087]
[Stevens Creek
This is an address query for a street. The user is looking for the location of
Blvd, Cupertino
this particular street.
CA]
This is an address query for a country. The user is looking for the location of
[Ireland]
the country of Ireland.

This ambiguous query could refer to New York city or New York state. You
[New York] will find more information on prominence, user location, and the viewport in
the following sections to help you determine the intent of this query.

Point of Interest (POI) queries

A point of interest (POI) is a location that people find interesting or useful. POIs can be locally or
internationally known. These guidelines use a very broad definition of POI in which businesses are
also considered POIs.

Query Explanation
[London Bridge] This is a query for a famous POI in London.
[Danube River] This is a query for a river in Europe.
[Charing Cross
This is a query for a transit station in London.
Station]
[Union Square, SF] This is a query for a location in San Francisco.
Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

18
Business queries
IP
r o m
0 2 3 f carpo
Business queries contain the 2 li
1 0, name
y Po of a specific business.
Tu
ry anc e
n
a
u yN 17 sday,
Ja 2.1
Query day, 54.9
b
Explanation 6.2 Janu
es .2 54 ary
Tu 72.16 .9
by 10,
1 This is a business query with a location modifier (Palo
Na Alto).
2 The user is
[Zola Palo alto] looking for a specific restaurant (Zola) in Palo Alto, CA. Queriesncy 023 f can include
Po rom
location modifiers, like city names, that make them more specific. lica IP
rpo
This is a business query with a request for a specific store in Sunnyvale, CA.
[Bookasaurus] The viewport and user location can help pinpoint the desired location for
such a query.
[Starbucks, 7 This is a query for a chain business followed by a specific address. Chain
Boulevard businesses are businesses that have more than one location, and include
Poissonnière, everything from national chains, like Starbucks, down to small local chains,
75002 Paris, like Burrito Boyz. Target, Auchan, Albert Heijn, and Boots are all chain
France] businesses.
This is a business query with a request for the chain business Target and
[Target sunnyvale]
location modifier of Sunnyvale, CA.

Category queries

A category refers to a group of entities that share a set of characteristics.

Query Explanation
This query is for locations where fast food is served. Assume the user
[fast fod] wanted the correct version of the query when the actual query contains a
simple misspelling.
[bus stop] This query requests the locations of bus stops.
[coffee] This query requests the locations of businesses that sell coffee.
[gym] This query requests the locations of fitness centers.
[gas San This query requests the locations of gas stations with a location modifier
Francisco] of San Francisco.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

19
Coordinate and “My location” queries

IP
o m
fr rpo
Some queries are simply a set of23coordinates or the words ”my location” (or something similar).

, 2 0 o lica
10 P Tu
ry ancy e
Query n
a
u yN 17 sday,
Explanation
a 2.1
a y, J 54.9
b 6.2 Janu
[36.082857,
es d .2 54 ary
Tu 72.16 .9
The user has specified a location using lat/long coordinates.
by 10,
-115.172916]
1 Na 202
ncy 3 f
ro
Po they
[my location] The user has typed these (or similar) words to find out where lica m are.
I
rpo P

Emoji Queries

Some queries are not made using words. Emojis represent the category they picture. Use the most
literal meaning.

Query Explanation

⛽ The fuel pump represents a search for places to get gas.

🍕 The pizza slice stands for the query “pizza.”

☕ The coffee cup represents the query “coffee.”

Queries with no maps intent

Some queries have no maps intent. This includes, but is not limited to, queries that:

• Do not refer to a physical location

• Do refer to a physical location but have an information intent rather than a location intent

• Refer to a brand or company with a predominantly online intent, like Groupon or LinkedIn

• Ask about the time or weather in a specific location

Rate all results for these queries Bad.

Query Explanation
Tu IP
e o m o
[eureka
17 sday, f r
temperature]
2.1 This is a weather query with no maps intent. Rate all results Bad.
2 0 23 licarp
J o
6.2 anu
54 ary y 10, cy P
r n
[time in new.9 york
by 10, ua a
N 2 This is a “time in” query with no maps intent. Rate all results J an by N
Bad.
city] an 023 , .9
cy s day .254
Po from e
u .1 6
[facebook]
licThis IPa query about a company that is mainly usedTonline.
arp is 172
It does not have maps
location
o intent. Rate all results Bad.

20
Query IP Explanation
m
[is cucumber a fruit This is an 3 fro rpo
information-seeking query that has nothing to do with finding a location.
or a vegetable] Rate0,all
2
20results
o licaBad.
1 P Tu
ry ancy e
n
a
u yN 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
d 54 ary
Tues .16.2 .9
by 10,
2.1.1. Research
1 7 2Expectation
Na 202
ncy 3 f
Research will help you understand the user’s query and intent:
Po rom
lica IP
rpo
• Use a search engine to investigate and understand the query intent

• Use official resources like businesses’ official websites, national postal service websites, and
government websites whenever possible

• Use your own local knowledge

• Use the information provided in the rating interface

2.2. Result Types

A query can return one of three types of results.

Result Type Explanation Example


Businesses and POI type results
will show a name in the top field,
followed by an address and a
Business/POI
classification. The same rating
rules will apply to both Business
and POI results.
These results can be one of
multiple address types, including
residential address or locality.
Instead of a business or POI name,
this kind of result will show the first
line of the address in the top field,
followed by the entire address
below. This type of result will not
Address
include a classification. 


Note: If a result does not include a
classification, don’t assume the
Tu result type is an address. You must IP
m o
esd still do research to verify this, as f r o
17 ay, 0 23 licarp
2.1 J not all POIs will have a 2 o
6.2 anu
54 ary classification. y 10, cy P
r n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

21
Result Type Explanation IP Example
o m
The results for fr rpor
3 POIs o features
0 2 l i c a
without 1an 0, 2expected
y Po address, like Tu
busustops, y c
ar Nanbridges, or mountains, e
17 sday,
y , Jan .9sometimes
may by look like address 2.1
6.2 Janu
d a 5 4
es type
. 2 results. Check to see if the 54 ary
.9
Tu 72.16result includes a classification. If it by 10,
1 Na 202
does, the result refers to a feature ncy 3 f
Po rom
or POI, not an address.
lica IP
rpo

Features At first glance, the result on the


without an right might look like it’s for an
expected intersection. However, since it
address includes a classification, you can
see that it actually refers to a POI
— in this case, a bus stop.
This result for a landmark square
might be mistaken for a result
referring to a street with the same
name. Since it contains a
classification, in this case “Park,”
you can see that it actually refers to
a POI.

2.3. Location Intent

A result is considered most relevant when it is located in the user’s area of expected results. There
are two types of Location Intent:

• Explicit: The query is made clearly and indicates a specific location or area where results are
expected.

• Implicit: The location expectation is not as clear, so you must use context clues, in the form
of user location and viewport, to discover the area in which the user is expecting results.

2.3.1. Explicit Location

When there is an explicit location mentioned in the query, you can ignore the user and viewport
locations. The user has told you exactly where they want to find results. If the query contains words
like “near me” or “nearest,” the user’s location, not the viewport location, should be considered the
explicit IP
esd location intent.

Tu o m o
f r
17 ay,
2.1 2 0 23 licarp
J o
6 a
Query.254 nuar Expected results Notes y 10, cy P
r n
.9 y
by 10, ua a
J an by N
Na 202 Places to buy this drink , 9
[bubble tea tully ncyroad
3 san User and viewports 54.
day locations should be
Po from on Tully Road in San u e 6 . 2
jose] lica IP ignored. T 72. 1
rpo Jose. 1

22
Query Expected IP results Notes
m
3 fro rpo in the city of
Museums User and viewport locations should be
[Boston museums] 2
20 Boston ca
0 , P oli ignored.
Tu
1 y
u ary Nanc e
17 sday,
Jan .9 by The queried chain 2.1 viewport
y , User and 6.2 Janu locations should be
[kfc Philadelphia]
a 4 business within the
esd .25 ignored. 54.9 ary 1
Tu 72.16 stated locality. by 0
1 Na , 202
ncy 3 f
Relevant POIs near the Viewport location should Poberignored,
o
[food near me] lica m IP
user’s location even if fresh. rpo
[nearby/nearest Relevant POIs near the Viewport location should be ignored,
starbucks] user’s location even if fresh.
Result placed on the Viewport location should be ignored,
[my location]
user’s location even if fresh.

2.3.2. Implicit Location

If the user’s location intent is not expressly stated in the query, for example [chinese] or [479
margarita ave], use the user location, viewport location, and viewport age to determine the area of
expected results.

Viewport User Location Location Intent


When the user is within a fresh viewport, take the user
location as location intent. Results are generally expected in
Inside Viewport
or near the viewport, and results inside the area cannot be
rated Bad because of distance alone.
Fresh Results are expected in or near the viewport area. All relevant
Outside results inside the viewport are eligible for a rating of
Viewport Excellent. If no results can be found in or near the viewport,
consider the user location a secondary location intent.
Missing When the user is missing, the viewport is the location intent.
Inside Viewport
When the viewport is stale, consider only the user location as
Outside location intent.
Stale Viewport
Use the stale viewport as location intent when the user
Missing
location is missing.
Viewport
Tu Age Present or IP
esd Consider the viewport fresh when the viewport age is missing. r o m o
Missing
17 ay, Missing f
23 licarp
2.1 J 2 0 o
6.2 anu
54 ary Present The user location sets the location intent when y 10, viewport
the c yP is
r n
.9
by 10, not present. n ua y Na
Na 2 0 y, Ja 4.9 b
Missing entirely ncy P 23 fro When the user location and viewport
a 5
esdare.2missing, the test
oli m I Tu 72.16
Missing
car P
po locale becomes the location intent 1with a strong focus on
prominent results.

23
3.Rating the Query-Level Navigational
IP
Result Question

m
fro rpo
Once you have identified user intent, 3 ayou will need to answer a query-level question. You must decide
, 202 olic
whether the intent is unique y 1 and
0
cy clear enough that there is only aTusingle
P (navigational) result in the
r n esd
real world that could fully u a satisfy
N a it.
1 a
72 y, J
Jan .9 by .16
d a y ,
5 4 .25 anua
You will answer s 2
e 16 question before you rate any results, since you don’t4.need
Tu 7this 9 b ryto10 know what the
.
2 . y ,2
results are in order
1 to learn if there’s a real-world result that could fully satisfy the N an user’s
0 intent:

cy 23 fr
Po om
• If there is a real-world navigational result for the query, answer Yes
lica IP
rp
• If there are no possible real-world navigational results for the query, answer No
o

You will answer this question once for each query, whether or not any results are shown.

4. Rating Result-Level Issues

For each result, you must check to see whether:

• There is an issue with the language/script of the result name/title

• The business/POI is closed or does not exist

4.1.Result Name/Title in Unexpected Language or Script

A result name or title is in an expected language or script when it is:

• In the language/script of the test locale

• In the language/script of the query

• In a language/script of the result region

• Any combination of any of the languages or scripts described above

• An official company, chain, or brand name commonly used in the market, even if this is not
any of the languages or scripts described above

When all or part of a result name or title is in an unexpected language or script, users will not
understand it. In these cases, select the Result name/title is in unexpected language or script
checkbox. No further rating is required.

Note: When the address details, found below the name/title, are in an unexpected language or script,
the result can still be understood and rated for relevance and name accuracy. For more on what to do
when the address details (not the name or title) are in an unexpected language or script, see
Language/Script Issue in Address.

Tu IP
BelowesLeft: Result name is Atlantis Casino Resort (in red box), address details are below (in blue box).
r o m o
f
da
17 Right:
Below
2.1 y, JaResult is an address, so the first line of the address appears in the red box as the Address title. 2 23thelicarp
All
0 o
address6.details
25 nuappear below it in the blue box.

y 10, cy P
4.9 ary ua
r an
by 10, an by N
Na 202 , J .9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

24
IP
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

Minor Differences in Spelling

Don’t consider minor spelling issues, such as missing or added diacritics (e instead of é), as
Unexpected Language/Script. This also applies to unnecessary or less relevant parts of a name or
title. Use this checkbox only to report issues that interfere with understanding the name/title and
issues listed in your Country Specific guidelines.

4.1.1. Name of Business/POI Results

Pay special attention to the language and script of brand and chain names. See your Country
Specific guidelines for more information.

Expected Language Explanation Example


Expected language/script:

• Test locale: en_US

The query gives clues as to the


• Result in California, USA

language in which the user


• Query: [mystery]

expects results. Any result that


• Result name: Mystery Spot

matches the most specific part


of the query or corrects a
Result name is in English and satisfies
spelling issue in the query is
the query.

considered to be a result in an
Query expected language. This also
Unexpected language/script:

includes remote results in


• Test locale: en_US

foreign countries.

Tu • Result in California, USA


IP
o m o
e • Query: [market]
f r
17 sday, But: Consider official result 0 23 licarp
• Result name: ေစျးကွက်
10, y Po
2.1 2
6.2 Janu name variations and default to
54 ary ry c
.9
by 10, the test locale for very short n ua y Nan
Na 202 queries. Ja .9 b
ncy 3 f ay,“Market”
The result namesdis 4 in Burmese
Po rom u e 16.25
lica IP script. T 72.
rpo 1

25
Expected Language Explanation
IP Example
m
The language 3 fro rof po the test locale
0 2 l i c a Expected language/script:

1 0, 2 y Po considered an
is generally Tu locale: es_ES

• Test
ry anc language and script.

expected e
a 17 sdain
Result
2.1 y, California, USA

n u yN •
, Ja .9 b 6 Ja
a y 4 • Query: . [college]

25 uan
esd .25 If the query is so short that the • Result name: 4.9 ry
Tu 72.16 language cannot be identified, byColegio
10 Skyline

1 Na , 202
assume that the query language ncy 3 f
Po romwhich
The result name is in Spanish,
is that of the test locale.
lica IP
matches the language of the rtest
po locale,
so this result title is expected and
Test Locale
When the test locale and the
acceptable.

and
query locale differ, consider the
Query Locale query locale an expected
Unexpected language/script:

language, as it provides more • Test locale: en_US

detailed information.
• Result in California, USA

For example, here the Query • Query: [college]

Locale is set to English in • Result name: Colegio Skyline

Indonesia. Therefore English,


not Indonesian, is an expected
“Colegio” is in Spanish, but the test
language:

locale is in English, so the result title is in


• Query Locale: en_ID

an unexpected language.
• Test Locale: id_ID
Expected language/script:

• Test locale: en_US

• Result in Rio de Janeiro, BR

• Query: [beach]

• Result name: Praia de Copacabana

Result satisfies the category “beach” and


the result’s name is in Latin script and the
Portuguese language, which is the
language of Brazil.

The language/script of the


Result region result’s region is expected as
Unexpected language/script:

the result language. • Test locale: en_US

• Result in Rio, BR

• Query: [beach]

• Result name: Playa de Copacabana

Though the result name is in the same


script as the test locale and query
language, returning the name in SpanishP
I
Tu
e is unexpected language because the r o m o
17 sday, f
2.1 language of Brazil is Portuguese.
2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

26
Expected Language Explanation
IP Example
r o m
0 2 3 f carpo Expected language/script:

li
1 0, 2 y Po • Test
Tu locale: ar_SA

ry c e
• Suggestion
n ua y Nan 17 sday, in Riyadh, SA

a 2.1 [‫
]ماكدونالدز‬
• Query:
a y, J 54.9
b 6.2 Janu
es d .2 54 aMcDonald's

• Result name:
Tu 72.16 .9 ry 1
by 0
1 Na , 202
ncy 3 f
The name of this restaurant
Po riso in the
Any official brand, chain , or lica m
language of the official brand rpname.

IP
business name in the language o
of the result’s region or the Expected language/script:

official brand name commonly • Test locale: ar_SA

used in the market, even if it is • Suggestion in Riyadh, SA

not in the language of the • Query: [‫


]ماكدونالدز‬
query, test locale, or result • Result name: [‫
]ماكدونالدز‬
Brand, chain, and
region, is expected.

business names
The name of this restaurant is in the
In bilingual areas, official
language of the region

names in any of the languages


of the area are expected,
Unexpected language/script:

unless otherwise specified in


• Test locale: ar_SA

the Country Specific


• Suggestion in Riyadh, SA

Guidelines.
• Query: [‫
]ماكدونالدز‬
• Result name: [マクドナルド]

The name of this restaurant is in


Japanese, which is not the language of
the query, the locale, the result region,
or the official brand name.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

27
4.1.2. Title of Address Results

IP
o m
Unlike business/POI results, address 3 f caresults
r rpo do not have an actual name. Instead, the first line of the
0 2
address appears as the title.0,Rate 2 Result
ol i name/title is in unexpected Language or Script when
the title (first line of the aaddress)
y 1 cy Pis in an unexpected language orTuscript.

e
r
n u y Nan 17 sday,
a 2.1
y, J 54.9
b 6.2 Janu
Localized and es Non-Localized
d a
.2 Components
54 ary
Tu 72.16 .9
by 10,
1 Na 202
Address results often cannot be translated and are accepted in the original version ncy of3thefro result
location. Some features, however, are translated into the test locale’s language, especially P oli mfor
ca IP
bilingual or English-speaking areas. Although the preferred language is the test locale’s rlanguage, po the
query language and language of the result’s location are also accepted.

Localized components may include:

• City

• State

• Country

Appropriate localization depends on the result itself and the language it is translated into. Research
and local knowledge will help you decide if the translation has been done appropriately.

Components that are not typically localized include:

• Feature type (square, bridge, roundabout, or intersection)

• Street names and street addresses including building names

Use the Address Accuracy Incorrect – Language/Script Issue checkbox if you find issues of this
nature in any of the address components in the address details (not the address title) of any result.

4.2. Business/POI is Closed or Does not Exist

Use this checkbox when, after careful research you determine that a result is:

• Closed/non-existent

• Randomly moving (like a food truck without a fixed schedule)

• A non-recurring past event with no further significance that does not carry any maps intent

Important: If you rate a result as Business/POI is closed or does not exist, you must still give a
relevance rating as if the place were open or did exist.

Remember, this rating can only be applied to business or POI results, not to address type results.
P
Tu I
esd r o m o
f
17 ay,
2.1 2 0 23 licarp
J o
6.2 anu
54 ary y 10, cy P
r n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

28
Use this checkbox to indicate a POI has IP closed only if there is evidence to prove the business
indicated in the result is no longerfroperational.
om po

2 3 a r
When you can’t make a decision 0 olic business closure due to lack of resources, assume the
1 0, 2 y Pabout Tu
business could exist and ryrate n cthe name, address, and pin accuracy e as Can’t Verify (unless there is
a
u yN a 17 sday,
an obvious data issue a like
n b a missing mandatory address component 2.1 or aJapin in the ocean).
d a y, J 54.9 6.2 nu

es 16.2 54 ary
u .9
T 72. by 10,
1 N 20
Note: Businesses and POIs can close for construction, remodeling, vacations, aor ncother
2 reasons. Treat
y P 3 fro
all temporarily closed businesses as if they were open when the closure is announced oli m I on the
car P
business/POI webpage or managed social media page. There is no limit to how long pthe
o closure
can be.

4.2.1. Closed/Does Not Exist vs. Inaccurate Name and Address

It is important to understand what the result really is before making your rating. If your research
reveals that the business has an incorrect name or address, use the drop-down rating options to
signal precisely what is wrong. Use the Business/POI is closed or does not exist checkbox only for
the specified purposes. See Unclear Results for more guidance and examples.

4.2.2. Rating Relevance of Closed/Non-Existing Business/POI

Special consideration is required when rating a closed/non-existing business/POI. Please review


section 4.3 carefully with regards to the status and permanently closed vs. open.

Never automatically demote to Bad simply because of closure. (You may find other reasons to
demote to Bad, but closure should not be the sole reason for the demotion.)

4.3. Business/POI Status is PERMANENT_CLOSURE

The following chapter offers a high-level introduction to rating closed/non-existing businesses/POIs


in relation to their status (displayed as part of the result information). It addresses Relevance and
Data rating. Please also review the more specific guidance in the associated relevance chapter.

Note: No matter what is displayed in the status section of the tool, you must always research the
business/POI to determine whether it is open or not.

This chart shows the possible combinations of status displayed in TryRating plus a result’s actual
state based on your research.

Real-World State Confirmed by P


Tu TryRating Status Comments rom I
Research
esd
3 f carpo
17 ay, 0 2
2.1
6.2 Janu 2 oli
Open/Exists
54 ary None Rate as usual y 10, cy P
r
.9
by 10, n ua y Nan
2 a
J .9 b
Closed/Does not Na Exist
ncy 023 f None Rate as ay,usual
4
Po rom u e 16.25
s d
lica IP T 72.
rpo 1

29
Real-World State Confirmed by P
ITryRating Status Comments
Research f o m
r rpo
2 023 olica
,
10 y P Tu Rate relevance based on
Closed/Does not Existuary Nanc PERMANENT_CLOSURE1 esda whether result is expected/
72 y, J
Jan .9 by .16 unexpected. See 5.19.
d a y ,
5 4 .25 anua
es . 2 4 r y
.9 relevance
Tu 72.16 Rate by 10, based on
1 N 20
Open/Exists PERMANENT_CLOSURE whether result
a ncy 23isf expected/
unexpected.PSee rom
oli 5.19.
car IP
po
4.3.1. No Status Shown

When no result status shown or the status is blank, you must research to determine whether the
business/POI is open or closed/does not exist in the real world. Use the Business/POI is closed or
does not exist checkbox when needed.

Rate the result relevance as if the business/POI were open or did exist. Use your best judgement to
determine how well the result satisfies user intent within the area of expected results.

4.3.2.Status Shown as PERMANENT_CLOSURE

When the result status is PERMANENT_CLOSURE, follow the research steps to determine if the
business in fact is open in real world or not, and use the Business/POI is closed or does not exist
checkbox when needed.

The relevance rating for a result with PERMANENT_CLOSURE status depends on whether this result
is expected or unexpected based on the specific relevance guidance in 5.19. Rating Relevance when
Status is set to PERMANENT_CLOSURE and 10.8. Permanently Closed Results

5. Relevance

Relevance for each result is found by assessing the relationship between:

• Satisfying user intent

• Prominence

• Distance

Complete each step of this workflow before assigning your relevance rating.

General
Tu Rating Rules
IP
esd r o m o
f
17 ay,
2.1 2 0 23 licarp
• 6Rate J
.25 aneach
ua result individually and demote based on relevance and distance.
ry 10 cy P
, o
• Always4.9 rate
r y 1 against the real world: If there is a better result available but it isuanotNshown,
a n
b 0, an by
demotey Nthe existing
2
an 023 result(s) considering the missing one(s).
y , J .9
• Ignore the order cy frothe results and evaluate each one individually.
uesda 6.254
Po of m 1
• Ignore duplicateliresults
car IP and rate them individually. Do not demote 1 72.repetition.

T for
po
• If there are results that are extremely inappropriate or illegal, rate Bad. Identify such content
by determining if the result is likely to be embarrassing if seen by users.

30
IP
r o m
2 3 f carpo
Rate the relevance of each 0resultli without considering the accuracy of the name/classification,
1 0, 2 y Po address, or pin.
Tu
a ry anc esd
WhenJjudging u y Ndistance/prominence, ignore closed1or ay,
a n b 7 2.1non-existent
Ja results.
a y , 4 . 9 6 . 25 uan

esd .25 4.9 ry


Tu 72.16 by 10,
1 Na 202
ncy 3 f

Po rom
lica IP
rpo

Adult Content

Businesses and POIs with legal adult content are rated:

• Navigational to Bad if the query clearly requests this type of content

• Bad if the query does not imply such an intent

Tu IP
esd r o m o
f
5.1.
17 Query-Result
a
2.1 y, Ja
Connection

2 0 23 licarp
o
6.2 nu
54 toasatisfy y 10, cy P
For a result .9 r y a query to any degree, there must be some kind of relationship rbetween
ua y Na n them.
by 10, n
Your first task isNato understand
2 what this connection is.
Ja b
ncy 023 f s d ay, 254.9
Po rom ue .16.
Satisfying the user intent IP the first step in the rating process and Tcovers
lica is only
172 the minimum
rpo
requirements for a result to be considered relevant.

31
5.1.1. General Connection

IP
o m
A result can satisfy user intent for3 fmultiple r rpo reasons, but most often the result satisfies the most
specific part of the query’s intent. , 2 0 2 lica kind of relationship between query and result is called a
oThis
0 P Tu
General Connection.
ary 1 ancy e
n u yN 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 Type of 54 ary
Tu 72.16 .9
User Query Result Description
by 10,
1 Connection Na 202
ncy 3 f
Satisfies Intent: Users are likelyPo torostart
lica m IP their
San Francisco rpo
search with the name of the brand “Marriott”.
[marriot] Marriott Union General Result satisfies user intent by providing a
Square Marriott close to a user/viewport located in the
San Francisco area.
Satisfies Intent: The user is looking for an
[Houston George Bush
General airport in the city of Houston. This is an airport
airport] Intercontinental
in Houston, which satisfies user intent.
Satisfies Intent: The query contains two
[london, different cities, so it’s likely a routing query.
London General
brighton] Returning either of the individual results is
expected and should be rated Excellent.

5.1.2. Abbreviation/Alternate Name Connection

The query is an abbreviation or alternate name and the result provides the full and currently accurate
name.

Type of
User Query Result Description
Connection
Newark Liberty
Satisfies Intent: The international airport code
[ewr] International Abbreviation
for Newark Liberty International Airport is EWR.
Airport
Alternate Satisfies Intent: The result is the correct name
[sears tower] Willis Tower
Name of what was formerly known as the Sears Tower.

5.1.3. Category Connection

The query is a category and the result satisfies that specific category, which may or may not be
displayed within the information provided in the result.
IP
Tu o m o
esd f r
17 ay,
2.1 2 0 23 licarp
J an
6.2Query Type of , o
User 54 uary Result Description ry 10 ncy P
.9 Connection ua a
by 10, an by N
Na 202 , J
ncy 3 f Satisfies Intent: A category
s 4.9
day .25search for "food"
P rom u e 6
[food] La
o licaCiccia Category in a viewport over San
T 7Francisco
. 1 returns an
I
rpo P 1 2
Italian restaurant there.

32
5.1.4. Spell Correction Connection

IP
o m
The query is misspelled and the result 3 f carcorrects
r po that issue. This kind of connection only applies to
0 2
obvious issues when no result 2 for the
ol actual query exists at the user’s
i location or when the user intent
is clearly satisfied by the 10, cy P
spell-corrected
y results.

Tu
e
ar n 17 sday,
a nu by Na 2.1
J
y, 54.also
9 6.2 Janu
This kind of correction
d a happens when a query address does not exist
54 but the result address
u es 16.2 .9 ary 1
does, correcting
T the issue and creating a match.

. b y N 0, 2
172 an 023
cy
Po from
Type of lica IP
User Query Result Description rpo
Connection
Spell Satisfies Intent: The result corrects the user's
[aple store] apple store
Correction spelling mistake.
Satisfies Intent: This query suggestion for the
Spell
Lodz Łódź Polish market adds the diacritics the user may
Correction
have missed when typing the query.
Satisfies Intent: When there is no "Clair St"
[23 Clair 23 Clair Spell within or around the viewport/user, consider a
street] Boulevard Correction “Clair Boulevard" that is close to the viewport/
user as the most likely intent.

5.1.5. Transit Intent Connection

The result satisfies the transit intent of the query. If the query indicates a specific transit system, the
result must match that system. There is also a transit intent connection when a station provides
access to more than one transit service and the queried one is included.

Type of
User Query Result Description
Connection
Satisfies Intent: Result satisfies user intent by
Richmond BART Transit providing a close station that runs the requested
[bart]
Station Intent transit service for a user/viewport located in the
Richmond area.

5.1.6. Special Character Connection

Always consider the specific language conventions. In general, user intent is satisfied when:

Tu IP
m o
•esdThe query contains a special character and the result is a valid variation (if applicable).
r o
3 f carp
17 ay, 2adds
•2.1 TheJaquery does not include a special character but the result with special characters 2 0 li
6.2 nu 1 0, y Po
value
54 toarthe
.9 y 1 user and is therefore considered spell corrected.
ary Nanc
• The country u
b y N , or
0
2 language does not have the special character and it is generally
n y perceived as
ncy 023 f or style (like “café” in English).
, Ja 4.9 b
a form of aexpression a y
Po rom esd .25
lica IP Tu 72.16
rpo 1

33
User Query Result IPType of Description
f ro Connection
m
rp o
2 023 olica
10 , P Satisfies Intent: "oe"
Tu is a valid variation for the
ry ancy Special esd "ö" in the country/language of
[möllersdorf] Moellersdorf
a special character
u
an by N Characters 17 ay,
2.1
, J
y 54. 9 the result (Germany/German).
6.2 Janu
d a 54 ary
es .2 .9
Tu 72.16 by 10,
5.1.7. Address-Result
1 Connection
Na 202
ncy 3 f
Po rom
When a query address and a result address are not exactly the same, the kind of connection lica IPthey
rpo
have depends on their relationship:

• Street number is the same in both query and result but the unit number is different or missing:

• If neither address is a street extension, rate result relevance Good when:

▪ The query contains a unit number and the result does not.

▪ The result contains a unit number and the query does not.

▪ The query contains one unit number and the result contains another.

• The query is full address including street number and name and the result is the street name
only:

• Since this result is an unlikely secondary intent, rate relevance as Acceptable.

• Query is for a street [Main Street, Pleasanton, CA] result is just the locality (Pleasanton, CA).

• Rate the result relevance Bad as it does not satisfy the user intent.

Type of
User Query Result Description
Connection

357 Western Satisfies Intent: The result does not include


[357 western
Ave
Address the unit number requested in the query so its
ave suite 1]
St. Johnsbury, VT relevance is rated Good.

Satisfies Intent: The result has the same


357 Western
[357 western street number but a different unit number from
Ave Suite 2
Address
ave suite 1] the address in the query, so its relevance is
St. Johnsbury, VT
rated Good.
Satisfies Intent: Instead of returning the full
address requested, the result provides only the
[357 western Western Ave

Address street name. This is an unlikely secondary


ave suite 1] St. Johnsbury, VT
intent, so relevance is demoted to an initial
rating of Acceptable.
Does not satisfy user intent: Instead of
[357 western
Tu ave st. St. Johnsbury, returning the full address requested, the resultIP
Address m
esd VT provides only the locality. This does not satisfy fro rpo
1johnsbury]
a
72 y, J 2 3 a
.16 a the user intent, so relevance is rated, Bad.
0 20 olic
.25 nua 1 P
4.9 ry a ry ancy
b 10 u N
5.1.8. Lack ofy N ,
Connection

an 2023 y, Jan .9 by
a 4
cy
Po from u esd 16.25
If the result does not satisfy
lica Ithe P user intent either because there is no relationship
T 72. between the query
r p 1
intent and the result or because o the connection between the query intent and result will not be
immediately obvious to the user, rate the result relevance Bad.

34
IP
fr rpo Type of
o m
User Query Result 2 3 a Connecti Description
0 , 20 olic
1 y P on Tu
u ary Nanc e
17 sday,
y , Jan .9Santa
by Cruz 2.1 user
Does not satisfy 6.2 Janu intent: Research
d a 5 4
[airport]
es . 2 Boardwalk
None shows that there is54no ary
.9 connection between the
Tu 72.16 b 10
1 Santa Cruz query and the result. Rate Bad.
y ,
Na 202
ncy 3 f
ro
Does not satisfy user intent:PoResult
lica m IisP for
[Raging Waters

2333 South the correct address, but does not include


rpo the
2333 South
White Rd
None business named in the query, so users will
White Rd

San Jose have no way of knowing if this is truly


San Jose]
connected to the business or not. Rate Bad.
Does not satisfy user intent: Query is the
name of a business and result is for the
2333 South correct address, but does not include the
[Raging Waters] White Rd
None business name. Users will have no way of
San Jose knowing whether or not this address is
connected to the business they asked for.
Rate Bad.
Does not satisfy user intent: Result is for a
Macy’s

store, not a mall. This store is inside the


2801 Stevens
[valley fair mall] None requested mall, but does not satisfy the intent
Creek Blvd,
of the query, which is the whole mall.
Santa Clara
Rate Bad.
Westfield Does not satisfy user intent: Result is for a
Valley Fair
mall, not a store. This mall contains the
[macy’s] 2855 Stevens None requested store, but this result is the whole
Creek Blvd, mall, not the single store the user asked for.
Santa Clara Rate Bad.
Does not satisfy user intent: Result is for a
Costco
Costco gas station, not a Costco store. The
Gasoline

store and the station are at the same address


[costco] 1601 Coleman None
and share a brand name, but the result is not
Ave, Santa
what the user asked for and does not satisfy
Clara
the query intent. Rate Bad.
Does not satisfy user intent: Result is for a
Costco
Costco store, not a Costco gas station. The IP
Tu 1601 store and the station are at the same address m
esd
17 [costco
a gas] None 3 fro rpo
2.1 y, Ja Coleman Ave, and share a brand name, but the result 20 isonot
2 lica
6.2 nu 0, P
54 ary Santa Clara what the user asked for and does ry not
1 csatisfy
ny
.9 the query intent. Rate Bad.an y N u a a
by 10, b
Na 202 J
ncy 3 f s d ay, 254.9
Po rom e .
lica IP Tu 72.16
rpo 1

35
5.2. Satisfying User Intent

IP
o m
r rpoconsidering the query, the user’s location/viewport, and your
The user’s intent can be determined 2 3 f cby
a
local knowledge. Sometimes0, queries 2 0 oli are ambiguous or can haveTmultiple interpretations.

1 y P ues
u ary Nanc d
In order to determine na query’s primary and secondary intent,
172at athe
look y
y , J a
. 9 b y . 16 , Jarelationship
nu
between the
a
query and theeresult. 4 . 2
s d .2 Ask yourself:

5 5 a
4.9 ry
Tu 72.16 by 10,
1 Na 202
• Is there a logical relationship between the query and the result?
ncy 3 f
Po rom
• How likely is the user to be looking for this result given the query and the location lica intent?

I
rpo P

Intent Type Definition Highest Initial Rating


Primary Intent Result satisfies the most obvious and likely user Navigational or
intent Excellent
Secondary Intent A result which is less likely to be the user’s intent. Good (User Intent)
Results matching secondary intent are often not as
prominent as the originally queried entity but still
satisfy the intent of the query.
Unlikely Intent A result which matches the query but is very Acceptable (User Intent)
unlikely to be the user’s intent.
Non-Relevant There are issues that make the result useless for the Bad (User Intent)
Intent user.

For any Relevance Rating of Good or below, you must select the appropriate check box(es) to
indicate the reason(s)for demotion: User Intent and/or Distance/Prominence. If both reasons apply,
use both checkboxes.

When determining intent, keep in mind:

• It is rare that a navigational query will have multiple primary intents.

• Rating one result Navigational and one Excellent within the same set of results is also rare,
but possible (see examples in Navigational Results for Category Queries).

• A navigational query will most often produce one result that satisfies the distinct intent and
multiple other results that satisfy a secondary intent or do not satisfy the intent at all. This
means there will be one result rated Navigational and all other results will be rated Good or
Acceptable for secondary intent or Bad for not satisfying user intent.

• Most non-navigational queries will produce results that are rated from Excellent to Bad.

Tu• Since the queries were made by actual users, there will be cases where a query is gibberish IP
esdhas no maps intent. Do your best to understand it and see how well the results fit the user’s r o m or
17 ay, 0 2 3 f carpo
2.1 intent, li
6.2 Janubut don't be shy about assigning a Bad rating if a result doesn’t fit.
10, 2 y Po
54 ary ry c
.9
by 10, n ua y Nan
a
, Jthe b
Satisfying theNuseran 2intent
02
3 is only the first step in the rating process and covers a y 4.9minimum
cy f s d . 2 5
Po roto
requirements for a result lica m be considered relevant. The rating determined Tu 72by
e 16deciding how well
I .
intent is met is called therpInitialP Rating. Distance and prominence will be1considered next in order
o
to establish the final rating.

36
5.3. Prominence
IP
r o m
0 2 3 f carpo
Once you’ve made an initial0rating , 2 Poby li establishing that there is a relationship between the query and
1 y Tu
cintent type, consider the result’s prominence.
the result and determining a ry the
u yN a n e
17 sday,

J a n b 2.1 J
y, 54.9
aof 6.2 anu
The prominence s d a
. 2 feature refers to its popularity, including the number 54 of apeople
.9 ry 1 visiting and media
Tue .16 b
sources referencing
17 2 it. Prominence can vary based on the test locale and even
y Na 20knowledge.
local
0 ,
Consider the following list to get a general idea how to establish prominence, ordered ncy 23from the most
Po from
prominent to the least prominent:
lica IP
rpo
• The feature is known internationally

• The feature is known in the country

• The feature is known in the region

• The feature is known locally

• The feature may not even be known locally

A result that may not directly appear to be user intent can be promoted for being internationally
prominent.

Query Result Rating and Explanation


Relevance Navigational
Sydney, Australia The city of Sydney is clearly the user's primary
intent.
Relevance Good (User Intent)
Sydney Opera House
The Opera House does not satisfy primary intent.
Sydney, NSW, Australia However, it is promoted to secondary intent due
[Sydney]
to its international prominence.
Relevance Bad (User Intent)
Sydney Town Hall

483 George St,


The Sydney Town Hall does not satisfy primary
Sydney, NSW, 2000 intent. While the civic center is historically
Australia important, it is not internationally prominent and
will not be promoted to secondary intent.
Relevance Bad (User Intent)
Sydney Buses Depot The depot matches the query string but is
Randwick
unlikely to be the user’s intent and has very low
34-36 King St, Randwick prominence given how many other internationally
Tu NSW 2031, Australia prominent POIs Sydney has to offer. IP
m o
e f r o
17 sday, 0 23 licarp
2.1 2
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, Relevance Navigationalua a
Na 202 , Jan by N
.9
ncy Agra

3 s day .254
Po from e 6
u .1 in India and the result
Query is for a small Tlocality
Uttar
lica Pradesh, India
I
rpo P 172
satisfies the user intent.

37
Query Result P Rating and Explanation
I
f romrpo Relevance Good (User Intent)
, 2 023 olica
[Agra] 10 P Tu
ry ancy e
u a 17 sday,
an by N 2.1
Result is for a prominent
, J
ay 2Taj 4.9Mahal
6.2 Janu site in the queried
5 locality. The Taj Mahal54 does
.9 ary 1not satisfy the user’s
es d .
Tu 72.16 Agra, Uttar Pradesh, India primary intent. However, by it is0promoted to
1 Na , 202
secondary intent due to the ninternational
cy 3 fr
P o
lica m IPlocality.
prominence of the feature in the oqueried
rpo

Relevance Navigational
Japan The country of Japan is clearly the user’s
primary intent.
[japan]

Relevance Bad (User Intent)


(User is in
Seattle) Sarku Japan

401 NE Northgate Way


A chain restaurant with “Japan” in its name does
Seattle, WA 98125 not satisfy the query’s primary intent (the
country of Japan) or any secondary intent
(entities with international prominence).

5.4.Distance

Generally, the farther away the result is from the area of expected results, the less desirable it
becomes. This is especially true for queries highly driven by distance to the user/viewport, such as
chain businesses, hospitals, pharmacies, or grocery stores.

Because the user can be offered many possible results that are all very similar, the closest entities
providing the expected service can be considered the best options. Results which are farther away
are less relevant and should be demoted according to their additional distance. Defining what is close
and what is far depends on the context of each individual query. Factors affecting distance include:

• Number of possible results in the real world

• Distribution of all possible results

• Population density (rural, urban, or suburban)

Distance IP
esd refers to the direct distance from one point to another and is measured via a straightfrline.
Tu om po
There
17 is
2.1 yno
a , need to account for the actual distance required to travel from one point to the0other, 3 asuch
r
J , 2 2 olic
as driving
6 .25 distance.

anu 10 P
4.9 ary a ry ancy
by 10, u N
Na 202 y, Jan .9 by
ncy 3 f a 4
Po rom u esd 16.25
lica IP T 72.
rpo 1

38
Viewport Location Intent (see section 2.3.2)
IP
m
3 fro rpo
2 a
0 , 20 olic
1 P Tu
ry ancy e
n
a
u yN 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 When the user is within a fresh viewport, 5the ary location should be
4.9 user’s
Tu 72.16 by 10,
1 used as the location intent. All ratings made should Na be2 based on the
ncy 023 f
user’s location. Results inside the fresh viewport mayPbe demotedr
oli om I
based on distance to the user but they cannot be demoted car byP3 (to
po
Bad) for distance alone.

Note: Consider the viewport fresh when the viewport age is missing.

Fresh Viewport, User Inside

When the user is outside the fresh viewport, the fresh viewport should
be used as the location intent. All ratings should be based on the
fresh viewport’s location and any results within the fresh viewport
receive No demotion for distance.

Note: If no results can be found in or near the viewport, use the user
location as a secondary location intent.

Fresh Viewport, User outside

When the viewport is stale, the user’s position is considered the


location intent whether the user is inside or outside of the viewport.

Tu IP
esd r o m o
17 ay, Note: If the user is missing, use the stale viewport as location23intent. f rp
0 ca
2.1 J
6.2 anu 0, 2
Poli
1
54 ary
.9 a ry ancy
by 10, u N
Na 202 y, Jan .9 by
ncy 3 f a 4
Po rom u esd 16.25
lica
IP T 72.
Stale Viewport rpo 1

39
Do not demote a result for distance when:
IP
• This is the closest possiblerresult, o m o even if it is far away from the area of expected results.

• Other, closer results are02found 3 f carto


p
be closed or non-existent.

, 2 o li
1 0 yP Tu
ry anc e
Demote a result for adistance
n
a
u y N when:
17 sday,
2
• Other results a 4 6.2 Januservice are closer.
.9 b satisfy the query and provide the same or.1similar
y, J 5that
es d .2 54 ary
.9

Tu 72.16 by 10,
1 Na 202
ncy 3 f
Po rom
5.5. Distance vs. Prominence
lica IP
rpo
Once you’ve decided how relevant the result is based on user intent, consider the result in the
context of all possible results in the real world. Use the distance to the user or viewport and the
prominence of the result to decide if a demotion should be applied.

A result’s fit to user intent, prominence, and distance should all be relative to the query and the
context around the query. Before deciding whether to demote because of prominence or distance, it’s
important to look at:

• The type of area around the result – rural, urban, or suburban

• The number of businesses that satisfy the query

• The distance to the user or viewport

The following examples of multiple query/result pairs will demonstrate how to interpret the
relationship between distance, prominence, and satisfying the user’s intent. The examples address
common rating situations and explain how to evaluate the relevance of the results.

5.6. Many Possible Results

Some queries, like [starbucks], have many results that could satisfy the user. In cases like this,
distance is more important than prominence, so results that are closer to the user’s location/viewport
should be rated higher than results that are farther away. To illustrate the high density of Starbucks,
possible results are shown as purple dots.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

40
User Inside Fresh Viewport

IP
o
r rpom
When the user is inside the viewport,
0 2 3 f caconsider all possible results, including real-world results not
2 l i
returned for rating (purple dots),10 , Pand demote by distance from the
o Tu user.

ry ancy e
n
a
u yN 17 sday,
a b 2.1 Ja
y, J 54.9
Query anddScreenshot
a Result Rating 6.2 and nuExplanation
es 16.2 5 4.9 ary
u
T 72. by 10,
1 ① Starbucks
 Relevance Excellent Na 202
ncy 3 f
865 Market Rate Excellent for Starbucks locations Po romthat are in
lica IP
Street close proximity to the user. rpo

Relevance Good (Distance/Prominence)


[starbucks]
② Starbucks

170 O’Farrell St Rate Good for locations that are a bit farther
User and fresh viewport in San away from the closest relevant locations to the
Francisco, CA
user.
Acceptable (Distance/
Relevance
Prominence)
③ Starbucks

264 Kearny St Rate Acceptable for relevant locations that are
even farther away from the user but still inside
the viewport.

Relevance Bad (Distance/Prominence)


④ Starbucks

580 California
St When there are many locations close to the user,
rate Bad for locations that are significantly farther
away and outside the viewport.

Relevance Excellent
⑤ Starbucks

140 Mason
Rate Excellent for Starbucks locations that are in
Street
close proximity to the user, even if they are
outside the viewport.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

41
User Outside Fresh Viewport

IP
o
r rpom
When a user is outside the viewport,
0 2 3 f caresults are expected in or near the viewport. In cases where
2 l i
there are a large number of10possible, P results inside the viewport, T
o even if they are not returned for
rating (purple dots), rate a y nfor
rBad cy those outside it.
ues
u a d
a n by N 172 ay, J
J . 16
d ay, 254.9 .25 anua
es . 4.9 ry
Tu 72.16 by 10,
Query and1 Screenshot Result Na 202
Rating and Explanation
ncy 3 f
Po rom
Relevance Excellent lica IP
rpo
① Starbucks

865 Market Rate any Starbucks within the fresh viewport
Street Excellent when the user is outside the viewport.

[starbucks]

Relevance Excellent
User in Alameda with fresh ② Starbucks

viewport in San Francisco, CA
170 O’Farrell St Rate any Starbucks within the fresh viewport
Excellent when the user is outside the viewport.

Relevance Excellent
③ Starbucks

264 Kearny St Rate any Starbucks within the fresh viewport
Excellent when the user is outside the viewport.

Relevance Bad (Distance/Prominence)


④ Starbucks

580 California
St When there are many possible results within the
viewport, including those not returned for rating
(purple dots), rate Bad for results outside it.

Relevance Bad (Distance/Prominence)


⑤ Starbucks

140 Mason
Street When there are many possible results within theP
Tu I
e viewport, including those not returned for rating f r o m o
17 sday, (purple dots), rate Bad for results outside 0 23it.licarp
2.1 2
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

42
IP
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
5.7. Few Possible Results ry
anc e
n
a
u yN 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
When the query d has only a few results in the real world, be more lenient54when
.9 aryconsidering distance.
T ues .16.2 by 10[zara]
Because there17are
2 only a few Zara clothing stores in Miami, results for the query ,
Na 202 are demoted
more leniently for distance than the many Starbucks locations in the example above.
ncy 3
Po from
lica IP
rpo
Query and Screenshot Result Rating and Explanation

① Zara
Relevance Excellent
19501 Biscayne
Blvd, Aventura Rate Excellent for the closest Zara location, even
when outside the fresh viewport.

Relevance Good (Distance/Prominence)


② Zara

420 Lincoln
[zara]
When there aren’t any possible results in the
Rd, Miami
Beach fresh viewport, rate Good for locations that are a
User and fresh viewport in North bit farther away from the user/viewport.
Miami Beach, FL

Relevance Good (Distance/Prominence)


③ Zara

590 Collins
Ave, Miami When there aren’t any possible results in the
Beach fresh viewport, rate Good for locations that are a
bit farther away from the user/viewport.

Relevance Good (Distance/Prominence)


④ Zara

701 S Miami
When there aren’t any possible results in the
Ave, Miami
fresh viewport, rate Good for locations that are a
bit farther away from the user/viewport.

Acceptable (Distance/
Relevance
Prominence)
⑤ Zara
IP
Tu
e 7535 N Kendall r o m o
17 sday, f
2.1 Dr, Miami The Zara store is located significantly 2further
0 23 licarp
6.2 Janu away than the second closest stores 10,and
o
y Pis
54 ary a r y n c
.9 therefore rated Acceptable. anu y Na
by 10, b
Na 202 , J
ncy 3 f s d ay 254.9
Po rom e .
lica IP Tu 72.16
rpo 1

43
IP
o m
5.8. Few Possible Results and23Greater fr rpo Distance

0 ca
0 , 2
P oli Tu
1
ry ancy
Leniency on distance isuaacceptable when there are only a few possibleesd results for the query in the
N 1 a
n
requested area. For, Jexample, 7 2.1 y, Ja
y a user close to Berlin queries for [Wartestraße],
6.2 nu which is a street
a b
a y 54. 9
name. There are d only four streets in Germany called “Wartestraße” that54can .9 asatisfy the user’s intent
Tues .16.2 b
ry
10 each result’s
and all four streets
17 2 are returned as results. Because of the limited number of y results,
,
Na 202
relevance remains fairly high even over longer distances.
ncy 3 f
Po rom
lica IP
rp
Query and Screenshot Result Rating and Explanationo
[Wartestraße]
Relevance Excellent

User and

① Wartestraße, Wartestraße in Gransee is the closest to the


fresh viewport close to Berlin, Gransee user and viewport and is therefore the most
Germany
relevant.
Relevance Good (Distance/Prominence)
② Wartestraße, Wartestraße in Siegen is far away from the
Siegen
user, but is the second closest possible result.

③ Wartestraße, Wartestraße in Wiesbaden is at a similar


Wiesbaden distance from the user as the one in Siegen
and receives the same rating.

④ Wartestraße, Acceptable (Distance/


Relevance
Geislingen
Prominence)
Wartestraße in Geislingen is the fourth closest
[Wartestraße]
result but significantly farther away. Given all
other results and their distances, this result is
User and
rated Acceptable.
fresh viewport

close to Berlin,
Germany

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

44
5.9. Rural Areas
IP
r o m
0 2 3 f carpo
Results are often farther away 0, 2iny P oli areas, but can still be considered
rural Tu relevant if there are no
1 c
reasonable results close y
arto N oranwithin the fresh viewport. In a rural1 area, e sda generosity can be applied to
ratings with respect tonudistance. The criteria for rating are similar 2.1they, [zara]
7to
6.2 Janu example in the Few
J a b y
a y, 54.9
possible results dsection, but with an emphasis on distance. Here is an example 54 ary for the query
T ues .16.2 .9
by 10,
[american legion]
1 7 2 in North Dakota.
Na 202
ncy 3 f
Po rom
Query Result lica IP
Rating and Explanation rpo
Relevance Excellent
① American
Legion This result is closest to the user
based in Bismarck, ND.
[american legion]

Relevance Good
② American The second-closest result is
Legion significantly further north than the
closest result.

Relevance Acceptable

③ American While quite remote from the user, this


Legion result is still a good option for the
user given that there are only two
closer results.

Relevance Acceptable

④ American Like result 3, this location quite far


Legion away but is still an acceptable result
given that there are only two
significantly closer results available
to the user.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

45
5.10. Location – User Intent Deviation

IP
o m
r rpodo not allow for a clear result (because either the user or
When the location intent and user 3 fintent
0 2 ca
viewport are in an atypical location,
0 , 2
P olilike the middle of the ocean),T rate with a focus on high
1 cy uset
prominence. For example, u ary thea nquery [Hong Kong] in a test locale 1
esd to en_US with the viewport and
ay,
n N 7
user location around , J aNaples,
9 b y Italy. There is no real change in rating2.if1 the
6.2 Juser
an is inside or outside of
a y 54. u
the viewport, or
es if the
d .2 viewport is fresh or stale.
5 4.9 ary
Tu 72.16 by 10,
1 Na 202
ncy 3 f
Query and Screenshot Relevance Rating Explanation
Po rom
lica IP
[Hong Kong]
The most prominent result rpo is the
Navigational
territory of Hong Kong in Asia.
User and

Fresh Viewport close to Naples, Italy


Businesses/locations with the same
name that are within the viewport or
Excellent
close proximity to the user and
prominent. (This will be rare.)

Locations that are too far away and



less prominent to be considered
relevant should be rated Bad. A
Bad (Distance/
restaurant in Rome named “Hong
Prominence)
Kong” should be rated Bad
because it is very far away from the
user location, which is in Naples.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

46
5.11. Rating for User Inside and Outside Viewport

IP
o m
r rdifferences
The following two examples show 2 3 fthe a po in rating when a user is inside and outside a fresh
0 i c
viewport. The query is for a 0chain , 2 business
o l called Great Wolf Lodge
Tu found across the United States.
1 cy P
The examples show allupossible y
ar Nan results within and around the large 1
esviewport.

da
J a n b y 7 2.1 y, Ja
y, 54.9
athe 6.2 nu
In general, when e 16.2user is outside the fresh viewport, no result within5the
s d 4.9 viewport
ary is demoted for
T u . b 10 an unusually
distance. The 1only
7 2 exception to this is when the viewport is large enough to include
y ,
Na 202
large area, like an entire continent, and the results within it would not realistically ncbe
y P useful
3f
r or
interesting to a user with this query.
oli om I
car P
po
(Note that even though the viewport in the example below is large, because of the limited number of
Great Wolf Lodges with it, the results still might be useful or interesting to a user with this query.)

Query and Screenshot Result Rating and Explanation


Relevance Excellent
① Great Wolf Lodge

Atlanta The result is within the fresh viewport


and fulfills the primary user intent.
[great wolf lodge]
Relevance Excellent
② Great Wolf Lodge

User in Savannah outside large, Charlotte The result is within the fresh viewport
fresh viewport
and fulfills the primary user intent.
Relevance Excellent
③ Great Wolf Lodge
Williamsburg The result is within the fresh viewport
and fulfills the primary user intent.
Relevance Good/Acceptable
(Distance/Prominence)

④ Great Wolf Lodge The result is outside the fresh viewport.


Pocono Mountains Because there are a limited number of
possible results within the viewport and
this one is relatively close, demote to
Good or Acceptable.
Relevance Excellent
⑤ Great Wolf Lodge
Niagara Falls The result is within the fresh viewport
and fulfills the primary user intent.

Tu Relevance Good/Acceptablem IP
e
17 sday,
(Distance/Prominence)
2 3 fro rpo
a
2.1
6.2 Janu , 20 olic
54 ary
.9 ⑥ Great Wolf Lodge The result is outside the rfresh
a
0
a
cy
P
y 1 nviewport.
by 10, Traverse City Because there are a alimited
u Nnumber of
Na 202 , J n .9 by
ncy 3 f possible resultsdwithin
y
a 254 the viewport and
Po rom e s .
lica IP this one is relatively
Tu 72.1 close, demote to
6
rpo Good or Acceptable.
1

47
When the user is inside the fresh viewport, the user's location is used as location intent and results
are demoted for distance.
IP
r o m
0 2 3 f carpo
li
Query and Screenshot 1 0, 2 y Po Result Tu Rating and Explanation
ry anc e
a
u yN 17 sday,
a
a n
y, J 54.9
b ① Great Wolf Lodge
Relevance
2.1
6.2 Janu Excellent
es d .2 Atlanta 54 ary
Tu 72.16 .9
This result is amongst
by 10, the closest
1 N 20
possible to the useranand
cy is23 inside the
fr
fresh viewport. P oli om I
car P
p
② Great Wolf Lodge
Relevance Excellent o
[great wolf lodge]
Charlotte
This result is amongst the closest
User in Savannah inside large, possible to the user and is inside the
fresh viewport
fresh viewport.
③ Great Wolf Lodge Relevance Good (Distance/
Williamsburg Prominence)
Though still inside the fresh viewport,
this result is significantly farther away
from the user location with closer
options available.
④ Great Wolf Lodge Relevance Bad (Distance/
Pocono Mountains Prominence)
This result not only is very far away from
the user, it is also outside the fresh
viewport.
⑤ Great Wolf Lodge Relevance Acceptable
Niagara Falls (Distance/Prominence)
While very far away from the user, this
suggestion is still within the fresh
viewport and therefore rated
Acceptable.
⑥ Great Wolf Lodge Relevance Bad (Distance/
Traverse City Prominence)
This result is not only very far away from
the user, it is also outside the fresh
viewport. IP
Tu o m o
e f r
17 sday, 0 23 licarp
2.1 2
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

48
5.12. Partial Address Does Not Exist

IP
r o m
Relevance is always rated independently
0 2 3 f carpo of any data (name, address, or pin accuracy) issues the
result may have. This includes li
1 0, 2 results
y Po for addresses that do not exist
Tu in real life.

ry c e
n ua y Nan 17 sday,
When judging distance a forb existing addresses do not factor in any 2returned
.16 Jan non-existent addresses.
y, J 54.9
Evaluate distance d a
es 1separately
6 .2 for existent and non-existent addresses..2Do u
54 not
.9 ardemote
y1 existing
Tu . b
address results 17when
2 closer, non-existent addresses are returned.
y 0 ,
Na 202
ncy 3 f
Po rom
For example, a user in Half Moon Bay, CA is looking for [2373 chestnut] and is presented lica withIP three
residential addresses. The address in San Francisco is the only one that actually exists. The r p o results in
Oakland and Redwood City are not supported by the postal authorities and no evidence can be found
that the addresses in either city exist.

Note: For cases where the query is a unique full address that does not exist and the result matches
the query, see Query Address does not Exist.

Query and Screenshot Result Rating and Explanation


Relevance Excellent
This is the closest existing result. The address
2373 Chestnut St, in Redwood City is disregarded and its
[2373 chestnut]
San Francisco relevance is not promoted nor demoted for
User and Fresh Viewport Distance/Prominence because it does not
around Half Moon Bay, CA
exist.

Relevance Excellent

This is closer to the user than the existing


2373 Chestnut St, result in San Francisco. Because data issues
Redwood City are not part of the relevance rating, the result
is rated Excellent due to proximity and user
intent. Address accuracy is rated Incorrect –
Address does not exist.

Relevance Good/Acceptable
(Distance/Prominence)

2373 Chestnut St, This is significantly farther away than the


Oakland existing result in San Francisco and the non-
existent result in Redwood City, and is
IP
Tu
esd demoted in relevance. Address accuracyrois m o
f
17 ay,
2.1 rated Incorrect – Address does not0exist.
2 23 licarp
J o
6.2 anu
54 ary y 10, cy P
r n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

49
5.13. City vs. Municipality

IP
r o m
0 2 3 f carpo
In many cases, a city and a state/county/municipality (or other similar market-specific components)
have the same name, but the , city
2 is
o litypically more prominent. In this case, the chances that a user is
10 P Tu
ry ancy
looking for the state/county/municipality and not the city, are very
17 small,
ay, but still a possibility.
a esd
n u yN
Therefore, states, counties,J a b and municipalities will be treated as a 2secondary
. 16 Jan intent and given an
a y, 54.9 .25 municipality
u
initial rating ofeGood.
s 6.2 Consider the relationship between the city and the
d 4.9 ary in terms of their
T u . 1 b 10 the state/county/
locale and adjust 17 2 if necessary. On the other hand, if the query specifically requests
y ,
Na 202
municipality, that result’s relevance should be rated as Navigational and the city ncyshould
3 be rated
Po from
Bad.
lica IP
rpo
See your Country Specific guidelines for more information.

Query Result Rating and Explanation


Relevance Navigational
New York City

New York, USA The result is for the city, which is considered more
prominent than the state.
[new york]
Relevance Good (Distance/Prominence)
New York State

New York State, USA Result is for the state, which is less prominent than the
city.
Relevance Navigational
Santa Clara

Santa Clara, CA Query is for the city, which is considered more


prominent than the county.
[santa clara]
Relevance Good (Distance/Prominence)
Santa Clara County

Santa Clara County, CA Query is for the city, which is considered more
prominent than the county.
[santa clara Relevance Navigational
county] Santa Clara County

Santa Clara County, CA Query is specifically requesting the county, so the


result for the county will be rated Navigational.
Relevance Bad (User Intent)
Santa Clara

Santa Clara, CA Query is for the county and a result for the city is
considered irrelevant for the query.
5.14.Unexpected Results

Straightforward
Tu queries can have unexpected results which at first glance might not fit the query IP
esd r o m o
intent.
17 aFor these kinds of results, consider:
f
2.1 y, Ja 2 0 23 licarp
o
• 6Is.25there
nu a logical relationship between the query and the result?

y 10, cy P
4.9 ary r
a and n
a location
• How likely by 1is0, it that the user is going to be looking for this result given theJaquery
nu by N
N
intent?
anc 023 2 , .9
y P fro e s day .254
oli m I Tu 72.1 6
car P
A result can partially satisfy poa secondary intent due to:
1

50
• Prominence of the feature

• Transit intent
IP
r o m
0 2 3 f carpo
li
Promoting for prominence 1should 0, 2 y Poonly occur for internationally prominent
Tu POIs.

a ry anc esd
u yN 17 ay,
In the examples below, an two ratings are provided for some results: 2.1
Good
a , J
y 54. 9 b 6.2 and
Ja Acceptable. The
nu
difference betweend
es 16.2the two ratings rests in how well the result satisfies user 54.9 aintent.
ry Choose Good if
Tu . b 10
there is a strong
17 likelihood that it will satisfy user intent and Acceptable if it is
2 y Naless20likely
, to satisfy.

ncy 23 f
Po rom
lica IP
Query Result Rating and Explanation rpo
Relevance Navigational
Mission St & 14 St
th

San Francisco, CA Query is for an intersection and the result


[mission & 14th satisfies the user intent.
street]

Relevance Good/Acceptable (User Intent)


User and fresh
viewport in San Mission St & 14th St Bus Result is for the bus stop at the queried
Francisco, CA Stop
intersection. The bus stop carries the name of
San Francisco, CA the intersection and users tend to look for
intersections when seeking transit POIs.

Relevance Navigational
[soho]

Soho

User and viewport in London, UK Query is for a neighborhood in London and the
London, UK result satisfies the user intent.

Relevance Bad (User Intent)

Mildreds Restaurant

45 Lexington St, Carnaby, Result is for a specific restaurant in Soho. It is


London W1F 9AN, UK very unlikely to satisfy the user intent.

Relevance Bad (User Intent)

Happy Lamb Hot Pot


The query is for a street and the result is a
[stevens creek
19062 Stevens Creek Blvd, specific business on that street. This specific P
blvd
Tu cupertino]
Cupertino, CA, 95014 I
e result is unlikely to satisfy the broad intent rof o mthe
17 sday, query. 0 2 3 f carpo
2User
.16 andJ fresh li
.25 anuain 10, 2 y Po
viewport Relevance Bad (User ry anc
4.9 ry
Cupertino,by CA
10, 19062 Stevens Creek n ua Intent)
N
Na 202 , Ja .9 by
ncy Blvd
3
The result includes a street
da number
y 54 when the
Po from
Cupertino,
lica IP CA, 95014 ues .16.2this result too
query is for a street,Tmaking
rpo 172
specific for the more general query.

51
Query Result IP Rating and Explanation
r o m
[The Slanted
0 2 3 f carpo Relevance Bad (User Intent)
Door
oli
0, 2 y PBuilding Tu
One 1Ferry #3

One Ferry ary Nanc Result is for 1the


esd
nOne Ferry Building #3 San
u 72 address
ay, and not the business
Building #3
y, Ja .9 by . 1
requested in the 6query, J
a 4Francisco, CA 94111 .25 nuso
a it does not satisfy the
San Francisco,
u esd 16.25 user intent. 4.9 ary
CaliforniaT94111]. by 10,
172 Na 202
ncy 3 f
Relevance Po rom
Navigational
[One Ferry lica IP
The Slanted Door
rpo
Building #3 San The query is for an address and the result is the
One Ferry Building #3

Francisco, business at this address. Including the business


San Francisco, CA 94111
California 94111] name provides additional correct information.
Relevance Navigational
San Francisco

[san francisco]
San Francisco, CA Query is for the city of San Francisco and the
result satisfies the user intent.
User and fresh
viewport in San Relevance Good (User Intent)
Francisco, CA
San Francisco
International Airport
The result represents the airport within the
San Francisco, CA queried locality, which satisfies the secondary
transit intent.

The Pruneyard
Relevance Navigational
1875 South Bascom Ave
The query is for a mall and the result is the mall
Campbell, CA the user asked for.

The Pruneyard Relevance Bad (User Intent)


The Pruneyard Cinema
The query is for an entire mall and the result is
1875 South Bascom Ave
for a cinema inside the mall. Even though the
Campbell, CA cinema shares the mall’s name and address, it
does not match the query intent.

5.15. Multiple Transit POIs with the Same Name

Tu IP
esd r o m o
Many
17 large transit POIs include multiple means of transportation at the same location. For example, f
a
2.1 y, Ja 2 0 23 licarp
large airports
6.2 nu can have metro or train service within the same location, or train stations1can 0, ybe Poa hub
5
for trains, metros,a y and buses. Other transit POIs at the queried transit POI should be y c
ua treated
a as
4.9 r r n
by 10, an by Nif the result is
secondary intent Na with
20 an initial rating of Good, but can also be considered Acceptable
, J
ncy 23 f 4.9
day .25on
less likely to satisfy the
Po user’s
rom intent. Additional demotions can be applied e based
s 6 the prominence
of the returned feature.lic
ar IP Tu 72.1
po 1

52
IP
Query Result o m
fr rpo Rating and Explanation
2 3
0 olic a
Hamburg1 0, 2 y PAirport
Relevance Tu Navigational
a ry anc esd
an22335
u y N Hamburg, Germany 17 isafor
Result
J b 2.1 y, Jathe queried airport.
a y , 4 . 9 6.2 nu
esd 16.25 Relevance
54 ary
.9 Good
u
T 72. by 10, (User Intent)
1 Na 202
[hamburg airport]
Hamburg Airport Station
ncy 3 f
Po atro
22335 Hamburg, Germany Result refers to the train station
lica mHamburg
I
Airport. rpo P
User and fresh
viewport in Germany

Relevance Bad (User Intent)

Lufthansa Basis
The result is for a small bus stop that seems to
22335 Hamburg, Germany service the Lufthansa training center. The result
does not share the same name as the queried
transit. Therefore, the result is not relevant.
Relevance Navigational
The query is for a unique transit station. The
Embarcadero Station
result (a unique BART station) fully satisfies the
San Francisco, CA user’s intent.
Acceptable (User Intent &
Relevance
Distance/Prominence)
[Embarcadero Ferry Building &
Station]
The result (a historic streetcar) name includes
Embarcadero Station
the queried station name, but has low
San Francisco, CA prominence, given that there is a unique
User and fresh
viewport in San Jose, Embarcadero Station. Therefore, the result
CA
should be demoted based on user intent.
Washington St & Acceptable (User Intent &
Relevance
Embarcadero Station
Distance/Prominence)
San Francisco, CA
The result (a historic streetcar) name includes
the queried station name, but has low
prominence, given that there is a unique
Embarcadero Station. Therefore, the result
should be demoted based on user intent.

Tu IP
5.16.esdPOIs and Transit Intent
r o m o
f
17 ay,
2.1 2 0 23 licarp
J o
6.2 anuPOI can be associated with a transit POI with the same name. You can establish
A non-transit
54 ary y 10, cy P the
r n
relationship .9 between
by 10, the two entities by using local knowledge, researching prominence, ua a
N 2 J an by N and
understanding how an well
cy 23 fthe
0 result satisfies user intent. This way you will learn ,
day whether
54.
9 the query has
r e s . 2
a distinct navigationalointent
P
li a m Ior
o if the prominence of the two POIs that share
Tu 72a.1similar name is so
6
strong that both can be cthe P
rpointent.
1

53
Query ResultIP Rating and Explanation
r o m
[mall of America]

0 2 3 f carpo Relevance Navigational


Mall
0, 2 of PoAmerica

li
1 y Tu
User and fresh viewport ry 60 EcBroadway, e
n ua y Nan 17 sday,
in
a b Bloomington, MN 2.1
Result is POI requested
6.2 Januin the query.
y, J 54.9
Minnesota
es d a
.2 55425 United States 54 ary
Tu 72.16 .9
by 10,
1 Na 202
nGood/Acceptable
cy 3 fr
Mall of America Po om
Station
Relevance (User
lica Intent
I &
rpo P
8240 24th Ave S
Distance/Prominence)
Minneapolis, MN Even though the station has the same name as
55425
the POI, it is not prominent and therefore
United States demoted.
Relevance Excellent

Result is for famous square in London. The


square and the train station are both equally
Piccadilly Circus
prominent and local users would be looking for
[Piccadilly circus]
London, UK the station while tourists would be looking for
User and viewport in the square. As both features are equally
London, UK
prominent, it is hard to establish a distinct user
intent.

Piccadilly Circus Relevance Excellent


Station
Result is the famous station that is just as
London, UK prominent as the square.
Dam Square
Relevance Navigational
Dam Square,
Amsterdam, The result is the famous square in Amsterdam.
[dam square]
Netherlands
User and viewport in
Dam Square Line 2
Good/Acceptable
Relevance
Amsterdam
Dam Square, (Distance/Prominence)
Amsterdam,
Netherlands Result is for the tram stop for line 2. The stop is
on a street adjacent to Dam Square. However, it
is not prominent and should be demoted.

IP
5.16.1.
Tu
esd Transit Queries
r o m o
f
17 ay,
2 2 0 23 licarp
The criteria
. 16
.25 andescribed
J above should be applied to understand the transit queries. Additionally, 10, cy P if it is
o
ua ry a[12th
determined 4.9 that
ry a query has a clear navigational intent, all other results will be Badua(see n st
by 10, a n y N
oakland bart]Nexample a 2023 below). If a result is promoted to Navigational, other ,results
J .9 bthat could
potentially satisfyncthe y P user
fro intent should be demoted further for distanceuand ayprominence
4 (see
oli m I e 16.25
s d
[BART daly city] and [stockport T
station] examples below). In general, the .
car P 17 fewer the results that
2
satisfy the user intent, the pfarther o away the results can be and still be considered relevant. The more
available results that can satisfy the user intent, the closer they need to be.

54
IP
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
Query ua y NanResult 17 sdaand
Rating
a n b 2.1 y, JaExplanation
d a y, J 54.9 6.2 nu
54 Navigational
es
Tu 72.16
.2 Relevance .9 ary 1
by 0
1 Na , 202
n cy 3 frwith a
The query is for a specific BART station
12th St. Oakland Po om
unique name that is not the same as the lica name
rpo P of
I
Station
the locality where the station is found. (Compare
Oakland, CA this to the examples below). This result matches the
[12th st oakland query exactly and fully satisfies the user’s intent for
bart]
this specific station.

User and viewport in Relevance Bad (User Intent Issue)


California
The query intent is for a specific BART station with a
19th St. Oakland unique name that is not the same as the name of the
Station
place where the station is located. The result
Oakland, CA returned is for a different BART station and does not
satisfy the user intent. This result should receive a
rating of Bad.
Relevance Navigational

Daly City Station


The query intent is for a BART station in Daly City.
Daly City, CA Research shows that there is only one BART station
in Daly City and its name is Daly City Station, so this
result fully satisfies the user’s intent.
Relevance Good (Distance/Prominence)

The query intent is for a BART station within Daly


City. This result fits intent as it is a BART station.
[BART daly city]
Colma Station
This station is in a neighboring locality just outside
Colma, CA of the requested locality. Even though the station is
User and viewport in outside of the requested locality, it provides a
California
choice of BART stations in the area for the user.
This result is demoted due to distance.

Tu Relevance Acceptable (Distance/Prominence) IP


e r o m o
17 sday, San Francisco f
23 licarp
2.1 J International Airport , 2 0 o
6.2 anu 10Daly y PCity.
54 ary Station
The query intent is for a BART station r yin n c
.9
by 10, San Francisco This result fits intent as it is a BART ua y Na This
an station.
Na 202
ncy International
3
, J .9 b is farther
ay 254but
station is in a neighboring locality,
Po from Airport, s d
e 16.
CAca
IP
l i away than the Colma stationTu 72.and is demoted due to
rpo distance. 1

55
Query Result IP Rating and Explanation
m
3 fro rpo Relevance Navigational
a
0 , 202 olic
1 y P Tu
u ary Nanc esd
The query intent1is 72foraa
.16 , station in Stockport.
y J
y , JanStockport
.9 b
y Station
an
d a 5 Stockport,
4 England Research shows that there . 25 are
4.9 aryseveral stations in
u
es .2
Tu 72.16 Stockport, but only one named by Stockport
10 Station,
1 Na , 202
so this result fully satisfies the user’s
ncy intent.
3
Po from
lica IP
r
Davenport Station
Relevance Excellent po
Stockport, England
[stockport The query intent is for a station in Stockport. There is
station]
one station with a name that matches the query
Heaton Chapel exactly, which receives the Navigational rating. All
User and viewport in Station
other stations within the queried locality should
Stockport, England
Stockport, England receive Excellent.

Relevance Good (Distance/Prominence)

This station is just outside of the requested locality,


in a neighboring locality. Even though the station is
Burnage Station
outside of the requested locality, it provides a choice
Manchester, England of stations in the area for the user. The fewer choices
there are available, the farther away the results can
be and still be relevant. This result is demoted due to
distance.

Relevance Excellent
San Jose Diridon
Station

[san jose station]


San Jose, CA The query intent is for a station in San Jose. There
are several stations in San Jose, but no stations with
User and viewport in a name that matches the query exactly, so we should
California rate every station within the queried locality equally.
Tamien Station
There are two stations that match the user’s intent,
San Jose, CA so both results should be rated Excellent.

Relevance Good (Distance/Prominence)

Tu IP
e This station is just outside of the requested locality, r o m o
17 sday, f rp
2.1 Lawrence Caltrain in a neighboring locality. Even though the, 2station 023 olicais
6.2 Janu Station
10 cyaPchoice
54 ary outside of the requested locality, it provides
r y
a Nan
by 10, Sunnyvale, CA
.9 uThe
of stations in the area for the user. a n y fewer choices
Na 202 y, J 4.9 b
ncy 3 f there are available, the farthera away the results can
Po rom u esd 16.25
lica IP be and still be relevant. T 2.
rpo 17

56
Query Result IP Rating and Explanation
m
3 fro rpo Relevance Acceptable (Distance/Prominence)
a
0 , 202 olic
1 P Tuoutside of the requested locality,
y This station is just
ary Nanc Caltrain
Sunnyvale
u
esd
72 ay, JEven though the station is
in a neighboring 1locality.
y , JanStation

.9 b
y .16 an
d a 5 4 outside of the requested .25 locality,
4.9 ary it provides a choice
u
es .2
Tu 72.16 Sunnyvale, CA of stations in the area for theby user.
10 The fewer choices
1 Na , 202
there are available, the farther awayncy the
3 results can
be and still be relevant. Po from
lica IP
rpo
Relevance Bad (Distance/Prominence)
Palo Alto Train Result is far from the queried station. The farther
Station
away the result is from the queried station, the less
Palo Alto, CA likely it is that it will be considered relevant, so the
relevance rating should be lowered.

5.16.2. Stops vs. Stations

A transit stop is a location typically designated by a bench or covered waiting area, a posted sign, or
street markings. Transit stations, on the other hand, are typically larger areas associated with major
structures including, but not limited to, platforms, ticketing offices, enclosed waiting/seating areas, or
terminal buildings/structures encompassing the transit area. The term “station” is primarily used to
refer to transit locations that are larger and typically a terminal housing multiple routes. All stations
are stops, but not all stops are stations.

Since all stations are stops, but not all stops are stations, returning a station for a stop query is ok, but
returning a stop when the query is station should result in a rating of Bad with the User Intent
checkbox selected. Try to identify these corresponding terms in the test locale and understand the
relationship between them.

For the category [bus stops], relevance should be based mainly on distance from the user location
or fresh viewport and the physical size of the bus stop. If the result is a small bus stop in a rural area
and the bus stop is among the closest ones to the user’s location intent, it should be rated Excellent.
On the other hand, if the result is a large bus hub that is a bit farther away from the user, it should still
receive an Excellent because of its size, regardless of the fact that there are closer, smaller bus
stops. Results close to the user should not be demoted because there is a larger bus stop farther
away, instead, the large bus stop should be promoted because of its importance.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

57
Query Result IP Rating and Explanation
r o m
0 2 3 f carpo Relevance Excellent
Greyhound li
1 0, 2 y Po Lines
Tu
c
u200
ary NFolsom St

an esd
This is a major
17 bus a station in San Francisco
J a n San
b y Francisco, CA 94105 2.1 y, Ja
ay, 254.9 where a user can6.take
25 nGreyhound
u buses.
es d . 4.9 ary
Tu 72.16 by 10,
1 Main St & Folsom St
Na 202
ncy 3 f
San Francisco, CA 94105 Relevance Po rom
Bad (User Intent)
[bus station in san lica IP
rpo
francisco]

User and viewport in


San Francisco, CA These results are small local bus stops and do
5th St & Howard St
not satisfy the user intent for a bus station.
San Francisco, CA 94103

Relevance Bad (Distance/Prominence)


Sacramento Bus This result is another Greyhound station, but it is
Station 
in Sacramento, quite far from San Francisco.
420 Richards Blvd
There are closer real world results we could
Sacramento, CA 95811 return. This result is too far and should be
demoted due to distance.

Relevance Excellent
Chicago Bus Station

630 W Harrison St
The query intent is for a bus stop. This result is
Chicago, IL 60607 a Greyhound station, which fully satisfies the
user's intent. This result is close to the user.

Relevance Excellent
[bus stop]
W Harrison St & S The query intent is for a bus stop. This result is
Jefferson St
a Greyhound station, which fully satisfies the
User and viewport in Chicago, IL 60607
Chicago, IL user's intent. This result is close to the user.

Relevance Bad (Distance/Prominence)


The query intent is for a bus stop. This result is a
Harlem Ave & W 115th bus stop and matches the user's intent, but
St
there are many bus stops closer to the user in IP
Tu Worth, IL 60482 the real world we should be returning instead. m
e
17 sday, 3 fro rpo
Therefore, this result should be demoted 2
20 due ca
2.1
6.2 Janu 0, P oli to
distance. 1 y
54 ary
.9 u ary Nanc
by 10,
Na 202 y, Jan .9 by
ncy 3 f a 4
Po rom u esd 16.25
lica IP T 72.
rpo 1

58
5.17. Parking Intent
IP
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
When evaluating [parking] n c
ry queries, note that:
e
n
a
u yN a 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
• Free and dpaid parking are equally relevant.
54 ary
Tues .16.2 .9 10 changed by the
72 limits do not affect relevance rating. Your rating should bnot
• Parking1time y N be
a
,2
0
fact that a parking lot is long term, short term, or limited-time (like a two-hour
ncy 2limit)
3 parking.

Po from
• Parking for small cars, large cars, RVs, or motorcycles is equally relevant.
lica IP
• If you can find evidence that a result is for private parking that cannot be used byrthe po general
public, give it a rating of Bad.

Public parking vs Private Parking

Public parking is:


• Parking that is a mix of residential/staff/permit and visitor parking and is not in a gated
community

• Parking that can be used only when visiting a certain business (limited-use parking)

Private parking is:

• Parking that is residents only, staff only, or by permit only

• Parking in a gated community

If you cannot confirm whether parking is public or private, give the result the benefit of the doubt
and consider it public parking.

5.18. Relevance: Service-Level Mismatch

Sometimes a query specifically requests a certain level of service, which may or may not be reflected
in the result. Common requests include:

• Specific stores (e.g. Walmart Supercenter)

• Outlet stores (e.g. J. Crew Factory)

When the query requests a specific level of service which is not reflected in the result, give an initial
rating of Good and demote as necessary depending on how well the result would satisfy the user
intent.
IP
Tu o m o
esd r
f rp
17 the
When a
2.1 y, Jquery requests a type of business with a generic level of service, providing a result 2 0 23 that
lica
6 a 0, P o
offers more
.25 nservice
u than requested still satisfies user intent and should receive an initial ry arating
1 cy of
4.9 ary a n
Excellent.
by 10, a n u y N
Na 202 J b
ncy 3 f s d ay, 254.9
When the query doesPonot rom e be .
lica specify
IP
the type of service, any relevant resultTucan
7 2.16 rated Excellent.

rpo 1

59
IP
Query Resultfrom po Rating and Explanation
r
2 023 olica
10 , P Relevance Tu Excellent
a ry ancy esd
u a
17 Walmart
an by N
Walmart
, J Supercenter
Query is for a generic
2.1 y, Ja and the result is a
y 54.9 6.2 that
Walmart Supercenter store n
a
es 3435
d 2 East Broadway 54 uaroffers more
16. Tucson, AZ 85716
Tu 72.Blvd, .9
services than the average Walmartb
y1
y N 0store.
,2 User
1 intent has been met and there is no 02 to
an need
cy 3
demote for service level. Po from
lica IP
[walmart]
rp
Relevance Excellent o

Walmart Neighborhood
Market
The query does not specify the type of Walmart,
5500 E 22nd St, Tucson, and any Walmart can be rated Excellent. Demote
AZ 85711 further for distance.

Relevance Good (User Intent)

Walmart Neighborhood Query is for a store with specific level of service.


[walmart Market
Walmart Supercenters are very large stores that
supercenter] 5500 E 22nd St, Tucson, have a full range of grocery and general
AZ 85711 merchandise. A Walmart Neighborhood Market is
generally smaller with a more limited array of
grocery and general merchandise.
Relevance Good (User Intent)
Nordstrom
The query is for an outlet store, but the result is for
[Nordstrom 55 E Grand Ave, Chicago,
rack] a full-price store. The result satisfies the query
IL 60611 intent, but to a lesser degree.
Bank of America
Relevance Excellent
10900 Orangewood Blvd,

Orlando, FL 32821

[bank of When the query is for a bank or a general bank


Tuamerica] Bank of America ATM
brand, an ATM or a branch location of that specificm IP
esd
17 ay, 10900 Orangewood Blvd,
brand are equally relevant. 3 fro rpo
2 a
2.1
6.2 Janu Orlando, FL 32821 0, 20 olic
1 P
54 ary
.9 a ry ancy
by 10, u N
Na 202 y, Jan .9 by
ncy 3 f a 4
Po rom u esd 16.25
lica IP T 72.
rpo 1

60
Query Result IP Rating and Explanation
r o m
0 2 3 f carpo Relevance Excellent
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
The result is a bank branch location. Since lica many
IP
Citibank
branches contain ATMs, and would be ablerpto o
3333 E Tropicana Ave
provide the same level of service as an ATM, this
Las Vegas, NV 89121 result usually fulfills the user’s intent.

[ATM] Note that if research indicates the result does not


offer cash services, rate it Bad.

Relevance Excellent
Citibank ATM 7-Eleven

3421 E Tropicana Ave


This is an ATM located inside a 7-Eleven
Las Vegas, NV 89121 convenience store. It satisfies the primary intent of
the category.
Relevance Bad (User Intent)
A user has asked for a specific fast food restaurant
McDonald’s
and the result is another fast food restaurant that
[burger king] 6875 Sand Lake Rd, offers similar food and service. Even though the
Orlando, FL 32819 service level in the two restaurants is similar, this
result does not match the user intent for the
named restaurant.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

61
5.19. Rating Relevance When Result IPStatus is PERMANENT_CLOSURE

r o m
0 2 3 f carpo
li A business/POI thatThas its status set to
1 0, 2 y Po ues requires special consideration
y
ar Nan c PERMANENT_CLOSURE
u d
a n by when rating
172
ay, J
relevance.
J . 16
d ay, 254.9 .25 anua
es . 4.9 ry
Tu 72.16 Note: A result without any status 10
by indicated
1 Na , 202 should be
rated as usual, including when research ncy indicates
3 the
Po from
business/POI is closed or does not exist.
lica IP
rpo
There are some situations where you can expect to see results with the status
PERMANENT_CLOSURE and others where such results are not expected. The following sections will
describe how to identify and rate them.

5.19.1. Expected PERMANENT_CLOSURE Status

Tu IP
m o
Sometimes
esd you can expect to see results whose status is shown as PERMANENT_CLOSURE.
f r o
17 ay,
2.1 2 0 23 licarp
J o
6.2 anu
This can 5happen 10, cy P
4.9 ary when:
ua
r y
an
by 10, an by N
Na 202 , J 9
• The permanently
ncy 3closed
fro result satisfies the user intent completely.
sday .254.
P e 6
AND
oli m I
car P Tu 72.1
• There is/are no other presult(s)
o that satisfy the actual user intent in the1 area of location intent.

62
Examples of results where PERMANENT_CLOSURE status is expected

IP
r o m
• Navigational queries:

0 2 3 f carpo
li
• Queries that can only 1 0, 2 return
y Po a single result, which is permanently
Tu closed. This could be
because the POI a n c
ry or abusiness name is unique or the query econtains
s location intents like
d
a nu by N 17 ay,
2
locality or street components.

J . 16 J
d ay, 254.9 .25 anua
• Chain queries
s
ue .16 .for closed chains:
4.9 ry
T 10
by closed
• All chain
17 locations within the area of location intent are permanently
2 Na , 202and the closest
open chain result is significantly farther away.
ncy 3 f
Po rom
lica IP
rpo
Rating Approach

Rate results with an expected status of PERMANENT_CLOSURE as if they were open. This means
that in most cases the rating will be either Navigational or Excellent, because even though they are
closed, these are the best or only results that could ever be returned.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

63
5.19.1.1. Expected PERMANENT_CLOSURE Status: Navigational Query

IP
r o m
The user is looking for a unique02business 3 f carpo in a specific location.

li
1 0, 2 y Po Tu
a ry anc esd
u yN
Query 1User a,
J a n b 7 2.1 yand Ja Viewport
y , . 9 6 . 25 nua
da 54
ues .16.2santa cruz]
[99Tbottles User and fresh viewport 4.9 in rSan
by 10, Luis Obispo, CA
y
7 2
1 N an 2023
cy
Po from
lica IP
rpo

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

64
IP
Result r o m Rating and Explanation
0 2 3 f carpo
2 ol i
y 10, cy P Relevance Navigational
Tu
e
r an
n
a
u yN 17 sday,
a Business/POI 2.1
y, J 54.9
b 6.2 Janu
① 99 BottlesesOf Beer
d a On The Closed/Does not Yes 54 ary
u .16.2 .9
by 10,
Wall
T 7 2 exist Na 202
1 ncy 3 f
PERMANENT_CLOSURE

This permanently closed restaurant is the only Presult


oli omthat
r
110 Walnut Ave, Santa Cruz, CA
meets the user intent, which makes it expected. Choose c arp IP the
o
Business/POI Closed/Does not exist checkbox and rate the
business as if it were open.
Relevance Bad (User Intent)
② 99 Cents Only Stores

260 E 10th St, Gilroy, CA The 99 Cents store does not match the user intent and is rated
Bad.
Relevance Bad (User Intent)
⓷ 99 Bottles & Cocktails
While also a restaurant with a name that starts with 99 Bottles,
8901 Katella Ave,
this is not in Santa Cruz, does not match the user intent, and is
Anaheim, CA rated Bad.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

65
IP
5.19.1.2. Expected PERMANENT_CLOSURE Status: All chains closed in area

r o m
0 2 3 f carpo
li
Chico’s has closed all of its 0, 2 y Po in Canada. The closest locations
locations esd to the user are across the
1 Tu
a ry anc
border in the United aStates.
u
n by N 172 ay, J
J .16
d a ,
y 54. 9 .25 anua
es . 2 4.9 ry
Tu 72.16 Query User and y N 10, 2
bViewport
1 an 023
cy
[chico’s] Fresh viewport in Toronto, ON, user Poin fHamilton,
ro ON
lica m IP
rpo

Result Rating and Explanation


Relevance Excellent
Business/POI Closed/
① Chico’s
Yes
Does not exist
PERMANENT_CLOSURE

100 City Centre Dr, The permanently closed location for Chico’s is in the center of the
Mississauga, ON
fresh viewport. Since there are no open locations anywhere close
to the area, this result is expected. Choose the Business/POI
Closed/Does not exist checkbox and rate the business as if it
were open.
Relevance Excellent
Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
② Chico’s
.9 The open Chico’s closest to the user is just across ua y Nborder.
a
by 10,
N 2 , Jan theb
5151 Main St,
anc 023 Because it is the closest open result, it is rated
day .25Excellent.
4.9
y P fro e s 6
Williamsville, NY
oli m I Tu 72.1
car P 1
United States
po

66
Result Rating and Explanation
IP
m
⓷ Chico’s
3 fro rpo
Relevance Good (Distance/Prominence)
2 0 olica
2
3349 Monroe Ave Ste 45, 10 y P , Tu
ry nc e
Rochester, NY
n
a
u yN a As the second-closest open 17 sday,the Chico’s in Rochester is
location,
United States
y, Ja .9 b 2.1
a 4 demoted to Good. 6.2 Janu
es d .2 5 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
5.19.2. Unexpected PERMANENT_CLOSURE Status
rpo
These are results whose status is shown as PERMANENT_CLOSURE, but are not expected to be
shown at all.

Results with the status PERMANENT_CLOSURE are unexpected when there are also open results in
the area of location intent that would satisfy the actual user intent fully without changing or altering
the user query.

Examples of situations where results with PERMANENT_CLOSURE status are not expected

• Category queries:

• There are always a large number of possible results for category queries like [restaurant]
or [hair salon]

• Note: In cases where there is only one match for the category query within a large area and
it is marked with the PERMANENT_CLOSURE status, consider it an exception and choose
Business/POI is closed or does not exist, then rate it as if it were open. This should be
extremely rare.

• Queries with several possible interpretations:

• These are queries could have several possible results and/or result types available, and do
not depend on PERMANENT_CLOSURE results.

• Most chain queries:

• There are often multiple locations of a chain available within the area of location intent, and
a permanently closed result does not need to be shown in these cases.

Rating Approach

Unexpected permanently closed results should be demoted by 2 for relevance which means the
highest rating starts at Acceptable.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

67
IP
5.19.2.1. Unexpected PERMANENT_CLOSURE Status: Open Options are Nearby

r o m
0 2 3 f carpo
oli
0, 2 y Pnear
There are many options available 1 the user for this category Tquery,
ues so there is no reason to show
a ry anc d
a permanently closed a business.

u
n by N 1 72 ay, J
J . 16
d ay, 254.9 .25 anua
es . 4.9 ry
Tu 72.16 Query User and y N 10, 2
bViewport
1 an 023
cy
[vintage store] Po from DC
User and fresh viewport in Washington,
lica IP
rpo

Result Rating and Explanation

Relevance Excellent
① Meeps Vintage

2104 18th St NW, Washington, Meeps Vintage matches the user intent and is close to the user
DC within the fresh viewport.

Relevance Excellent
② Miss Pixie's

1626 14th St NW, Washington, Miss Pixie’s sells vintage clothing and is among the closest
DC results for this category query.
Tu IP
esd r o m o
⓷ Bad or Acceptable
f
17 Buffalo
2.1 y, Ja Exchange

a Relevance 2 0 23 licarp
PERMANENT_CLOSURE

6 .25 nua (User Intent) 10, cy P


o
4.9St NW,
ry r y n
1318 14th by 10Washington, ua a
Na , 202 Business/POI Closed/
Yes Jan by N
DC , .9
ncy 3 f Does not exist s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

68
Result IP Rating and Explanation
o m
r rpo
0 2 3 f The
ca permanently closed Buffalo Exchange did sell vintage
, 2 oli
1 0 P clothing, but since there are other
Tu open stores that do this in the
ry ancy e
a area of location intent, this 17 sdis
result
2.1 yunexpected. The relevance
n u yN a,
J a b J
ay , 4. 9 rating starts at Acceptable. Given 6.2the nabundance
a of nearby
esd 16.25 54 uary
u
T 72. results, this could be rated Bad, as well.
. 9 by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

6. Name Accuracy

The Name Accuracy rating is used to evaluate the accuracy of a Business/POI name. Your final
rating will take into consideration both the accuracy of the Business/POI name and the classification
assigned to it. Inaccuracies in either or both of these elements will result in rating demotions.

Business/POI Name Accuracy can be rated as:

• n/a

• Correct

• Partially Correct

• Incorrect

• Can’t Verify

6.1. Name Not Applicable (n/a)

The n/a rating should be used for all address type results, including residential addresses, streets,
localities, and so on.

Unlike Business/POI type results, address type results do not actually have a result name. Instead, the
first line of address type results appears as the result title because this field is meant to present the
most relevant part of the address information.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

69
Since address results do not have a name, their Name Accuracy cannot be evaluated. This is why the
n/a rating should be selected.
IP
r o m
0 2 3 f carpo
li
Result 1 0, 2 y Po Rating andTExplanation
ues
a ry anc d
u
n by N 172 ay, J
1703 NW Taylory,St
.9
J a Name Accuracy . 1n/a
a 254 6.2 anu
1703 NW Taylor
es d St

. 54 ary
Tu 72.16 .9
Topeka, KS 66608 This is a residential address, not the name y N 1of
orbtitle 0, a business or POI.
1 an 2023
cy
Name Accuracy n/a Po from
1600 Pennsylvania Ave
lica IP
rp
1600 Pennsylvania Ave, Although this is the address of a well-known POI (the WhiteoHouse), it
Washington, DC, 20500
is still an address result and contains no name or title. It cannot be
United States rated for Name Accuracy.
Name Accuracy n/a
Paris, France

Paris, France This is the name of a locality and country, not the name of a business
or POI.

6.2. Result Names

Your final Name Accuracy rating will take into consideration both the accuracy of the Business/POI
name and the classification assigned to it.

First, consider the name.

6.2.1. Correct Name

A business/POI result name is accurate when it is used on the POI’s official website or on other official
resources. Even if the official website does not use the name, if it is used on other official sources, the
name is correct. Note that the name has to be used to refer to the particular POI. The corporate name
by itself is not automatically the correct name.

Business Name

Every name that a specific business location uses to refer to itself is considered correct. These
names can be listed in a variety of ways in different sections of the entity's official website or official
social media website(s):

• Chain business locator page on the official website

Tu• About/About Us section on an entity’s official website


o
IP
m o
•esdSigns and storefronts seen on official sites or social media pages
f r
17 ay,
•2.1 Claimed 0 23 licarp
J social media pages
2 o
6.2 anu
54 ary y 10, cy P
r n
.9
by 10are ua a
If these resources Na , 202not available, other reliable sources that can be used for , an by N business
researching
J .9
names include:
ncy 3 fr e s day .254
Po om Tu 72.1 6
lica IP
r 1
po seen on recent street or online imagery or crowdsourced
• Signs and storefronts review pages

70
• Recent articles in primary publications (newspapers or similar publications that do their own
reporting)
IP
o m
• Official restaurant menus23(user fr rphotos po or scanned images from restaurants)

0 l i c a
, 2 o
10 P T
If the name cannot be confirmed ry ancy with these resources and there isuenothing objectively wrong with it,
a
nu by N 17 sday,
rate it Can’t Verify.
J a 2 . 16 J
d ay, 254.9 .25 anua
es . 4.9 ry
Tu 72.16 by 10,
1 Na 202
ncy 3 f
Po rom
Corporate name
lica IP
rpo
The corporate name (and sometimes brand or product name) is often used to refer to a particular
entity, but might be not the preferred name for a specific location. This depends on the particular
company and the specific result.

Some official websites have a local language and an international (English) version. Consider the
name given in the international version only if English is the language/script of the test locale, the
query, or the result region, or if the official company, chain, or brand name is commonly used and
understood in English in this market. If it is not, select the Result name/title is in unexpected
language or script checkbox. No further rating is required.

Result Name Official Business Name Rating and Explanation


Name Accuracy Correct

McDonald’s McDonald’s The chain calls all stores McDonald’s and has the
name in front of all locations as corporate
branding.
Name Accuracy Correct

Peet’s Coffee & The name is considered Correct, because it is


Peet’s - Polk Street used on the sign on the storefront. The store is
Tea
officially called “Peet’s - Polk Street” on the
website as it refers to the Polk Street location.
Name Accuracy Correct

IP
Tu
e The chain Best Buy uses a location modifier rinom o
Best
17 sdBuy
a Best Buy San Jose their store names but their store sign (logo)
f rp
23 islicthe
a
2.1 y, Ja , 2 0 o
6.2 nu corporate brand Best Buy and is therefore 10 y rated
P
54 ary
.9 Correct. u ary Nanc
by 10,
Na 202 y, Jan .9 by
ncy 3 f a 4
Po rom u esd 16.25
lica IP T 72.
rpo 1

71
Result Name Official Business IP Name Rating and Explanation
m
3 fro rpo Name Accuracy Correct
, 2 0 olica
2
10 P
The Microsoft Tstorefront shows only the logo
a ry ancy ues
da
n u N without any 1
text.
7 On ythe webpage, it is referred to
by
Ja Microsoft 2.1 , Ja
Microsoft y , . 9 Store 6
as “Microsoft Store”25or n
4.9together with a location
a 4 . ua
esd .25 ry
Tu 72.16 modifier such as “Microsoft by Store
10 – South Coast
1 N , 202
Plaza”. Because of the close asimilarities
ncy 3 f between
the result name and the store name, ro
Po rate
lica m ICorrect.
rpo P

Location modifier or affiliation

Businesses can include the name of the locality or the larger complex or organization they belong to
as additional information. These modifiers, even when not specifically used by the official resources,
can be considered correct. A name with missing modifier can also be considered correct as long as
the modifier isn’t crucial for understanding the particular result. If a modifier is present, it must be
spelled correctly. If it is misspelled, the name is partially correct.

See your Country Specific guidelines for cases where the location modifier is essential for
understanding the result.

Result Name Official Business Name Rating and Explanation


Name Accuracy Correct

Apple Apple Valley Fair The result name is missing the location modifier
(Valley Fair) given on the official website, but is still
considered Correct.

Name Accuracy Correct

Peet’s Coffee Peet’s – Ferry Bldg SF The result name is Correct because it is used as
the name on the official website, while the specific
Tu store has an optional location modifier. IP
m o
e f r o
17 sday, 0 23 licarp
2.1 2
6.2 Janu 10, Po
54 ary
.9 Name Accuracy Correct ary ancy
by 10, u
Old Navy – Belle Na 202 , J an by N
ncy Old
3 Navy Old Navy doesn’t officiallyduse
ay 2the54. mall name as
9
Isle Station Po from e
part of the store name,Tbut
s
u the .
1 location modifier is
6
lica IP
rpo 72.
correct and the business1name is rated Correct.

72
Result Name Official Business IP Name Rating and Explanation
m
3 fro rpo Name Accuracy Correct
2 a
Delgado
0 , 20 olic
1 cy P Tu
Community ary NanSchool esd
Charity
u of a
17 Nursing
The result for the
College –
J an by 2.1 y, Ja School includes the name
,
ay 254. Nursing
9 of the college that it6.is
25affiliated
nu with. Even though
Charity School
esd 1of . 4.9 ary
Nursing T 72. 6
u this form is not official, it isbyrated
10 Correct.
1 Na , 202
ncy 3 f
Po rom
lica IP
rpo
Stylized logos and letters

A variation is still correct when a business uses stylized logos and letters (like the backwards “R” in
Toys ”R” Us) that are outside the regular set of letters.

Result Name Official Business Name Rating and Explanation


Name Accuracy Correct

Toys ‘R’ Us Toys Я Us This business uses a special character in its name,
so the name is still considered Correct.

“The” is missing or added

• Missing: The use of definite articles depends on the individual result. When a company using
“the” is often referred to without it, the name is correct both with and without the article.

• Added: A business/POI that does not officially include a definite article in its name but has one
included in the result should be considered partially correct.

Result Name Official Business Name Rating and Explanation


Name Accuracy Correct

Home Depot The Home Depot The official name of this business is “The Home
Depot,” but since it is so often referred to as
“Home Depot” the name is considered Correct.

6.2.2. Partially Correct Name

A partially correct name differs from the official versions but can still be recognized by the user.
Partially correct names can include minor and moderate misspellings, service level mismatches, and IP
Tu
esd or unnecessary name parts, including holding names/corporate structures. When the from po
missing
17 ay, name on the storefront does not include the corporate status (Ltd., Inc., etc.) seen
business 3 car
2.1
6 Ja 0, 202 inothe
li
. 2 n
result, it 5is4 partially
u correct.
1 y P
ry c
.9 ary 1 ua y Nan
by 0, n
Na 202 y, Ja 4.9 b
6.2.2.1. Minor and Moderate Misspellings and Missing or Extra Words

ncy 3 f a
Po rom esd .25
lica IP Tu 72.16
rpo 1
Consider names partially correct when they contain issues that don’t prevent the user from
identifying the business:

73
• Name contains repeated, redundant, IP or missing information or parts

o m
• Incorrect or missing punctuation 3 fr rpoor special characters

2 lica
20spaces

• Unnecessary or missing 0 ,
1 cy P
o Tu
• Unexpected useuaof y
r lower/upper
n case and ALL CAPS letters
esd
N a 1 a
• Acronyms J n
a areb y often expected in ALL CAPS: YMCA, TGIF
7 2.1 y, Ja
,
ay 254. 9 6.2 nu
• esd 1moderate
Minor uand 6 . misspellings that don’t influence the user’s 5understanding.
4.9 ary
10
See your
T 2 .
Country-Specific guidelines for more information on misspellings.
b y ,
17 Na 202
• Mix of expected languages in the result title. Expected languages are thenlanguages cy 3 fr of the
Po om
query, test locale, or region, or of an official business name.
lica IP
rpo

Result Name Official Business Name Rating and Explanation


Name Accuracy Partially Correct
Macys Macy’s
The result is missing an apostrophe.

Name Accuracy Partially Correct

HM H&M
Missing the “&” in H&M is a misspelling but the
name is still recognizable.

Name Accuracy Partially Correct

uhaul uhaul U-Haul


The result name is duplicated and in all lowercase
with no “-”.

Name Accuracy Partially Correct


Seven Eleven 7-Eleven The name is in an unexpected form not used by the
business itself.
Name Accuracy Partially Correct
GAMESTOP GameStop The name written in ALL CAPS is not expected for
this business and demoted.
Name Accuracy Partially Correct

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
Mosjaw6.2 Janu Moosejaw yP
o
10, missing
54 ary The name of this outdoor store hasrtwo y n c
.9 a a
by 10, letters but is still identifiable. Janu by N
Na 202 , .9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

74
Result Name Official Business IP Name Rating and Explanation
m
3 fro rpo Name Accuracy Partially Correct
, 2 0 olica
2
0 P Tu
Ecofuture ry 1 ncy e
Ecofutures
a a Building Inc The business 17 sdatwo
shows
2.1 y, Ja misspellings and the
Buildng Co n u yN
, Ja .9 b
a y 4 incorrect business structure
6.2 nu (Co. vs. Inc.).
u esd 16.25 54 ary
.9
T 72. by 10,
1 Na 202
Name Accuracy Partially Correct ncy 3 f
Po rom
lica IP
rpo
Napoli The result name has additional parts not used by
Coffeehouse & Napoli Coffee the business. Because the additional parts are in
Pastries line with the business and don’t make the result
ambiguous, it is considered Partially Correct.

Name Accuracy Partially Correct

The additional “superstore” is not used officially,


GAP Superstore
GAP but also does not change the user’s ability to
identify the well formatted and correct corporate
name and is therefore considered Partially
Correct.

Name Accuracy Partially Correct

BerkeleyLaw
BerkeleyLaw
The query [law] was issued in a cz_CZ (Czech)
Univerzitní of
University of
locale and the result locale is the US (English).
California California Consider this Partially Correct due to the mix of
expected languages: English and Czech.

Name Accuracy Partially Correct

Aqua Spa 夢幻⽔ Aqua Spa - Ocean


The query [aqua spa] was issued in the zh-Hant_HK
都 City (Hong Kong) test locale and the result locale is in P
I
Tu
e the US (English). Consider this Partially Correct r o m o
17 sday, f
2.1 due to the mix of expected scripts. 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

75
Result Name Official Business IP Name Rating and Explanation
m
3 fro rpo Name Accuracy Partially Correct
2 a
0 , 20 olic
1 y P Tu
u ary Nanc esd
a
Jan .9 by URLs can give an17 indication
2.1 y, Ja of a businesses’ official
, name, but because 6a.2URL54 ulacks
ary formatting choices,
a y 4 n
esd .25 .
it should generally not be bused
Tu 72.16 y N 10to, 2confirm the
9
1 official business name. Similar anrestrictions
0 exist for
att AT&T cy 23 fr
certain social media such as Twitter.
Po om
lica IP
rpo
The company’s name is confirmed by the URL
(att.com), but the name stated in the URL, “att”, is
clearly poorly formatted, but still recognizable.

Name Accuracy Partially Correct

University of University of California Irvine is more than a location modifier for this
California Irvine university. The city name differentiates the Irvine
location from other universities in the University of
California network.

Name Accuracy Partially Correct

Even though the Nike symbol appears on this


Nike NIKELAB 21M NYC store’s official website, the preferred store name
for this specific location is not the general brand
name but the NIKELAB name seen on the store
sign and website.

Name Accuracy Partially Correct

The Sears Sears Sears does not use “The” in any of their official
webpages. Adding it to the company name gives
the name a rating of Partially Correct.

6.2.2.2. Service-Level Mismatch

Chain
Tu businesses often indicate the level of service provided at that location in their name. If the IP
esd r o m o
result
17 namea does not reflect the correct type, it is considered a service-level mismatch and02is 3 f carp
2.1 y, Ja 2 li
considered
6.2 npartially
u correct.
10, y Po
54 ary ry c
.9
by 10, n ua y Nan
Na 202
ncy 3 f a y, Ja 4.9 b
Po rom esd .25
lica IP Tu 72.16
rpo 1

76
Result Name Official Business IP Name Rating and Explanation
m
3 fro rpo Name Accuracy Partially Correct
, 2 0 olica
2
10 P Tu
ry ancy e
a
u yN
Patagonia Outlet JanPatagonia 17 sday,
2.1
The result name suggests
a y, 54.9
b 6.2 Januthat the store is an outlet,
es d .2 which it isn’t. 54 ary
.9
Tu 72.16 by 10,
1 Na 202
ncy 3 f
P rom
Name Accuracy PartiallyolCorrect
ica IP
rpo
Depending on its size and the services available,
Delhaize Delhaize Supermarkt this chain business comes in five varieties. The
result is missing part of the name indicating its
service level.
Name Accuracy Partially Correct

Best Buy Best Buy Express A Best Buy Express is a vending machine and not a
store. This is a service-level mismatch and
considered Partially Correct.
Name Accuracy Partially Correct

Best Buy Express Best Buy The user is expecting a vending machine where
there is a store. This is a service-level mismatch
and considered Partially Correct.

6.2.2.3. Holding Name and Corporate Structure

Holding names or corporate structures are not considered correct if they are not explicitly used by
the individual stores. Holding names or names that include corporate structure are considered
partially correct or incorrect depending on how recognizable the name is in context with the particular
business.

Result Name Official Business Name Explanation


Name Accuracy Partially Correct

IT’SUGAR LLC IT’SUGAR The addendum “LLC” refers to the corporate


structure and should not be used for the store,
However, this name is still recognizable. IP
Tu o m o
e f r
17 sday, Name Accuracy Partially Correct 0 23 licarp
2.1 2
6.2 Janu 0, Po
54 ary
.9 y 1 ncy
The addendum “Inc.” refers to thearcompany’s
Nordstrom, byInc.
10 Nordstrom u y Na
Na , 202 corporate structure and should , Jannotbbe used for
ncy 3 f y . 9
the store. However, the store
esd .can
a 25 still be
4
Po rom Tu 72.16
lica IP recognized.
rpo 1

77
6.2.3. Incorrect Name
IP
r o m
0 2 3 f carpo
An incorrect result name is one 0, 2 ythat
Po can’t be recognized becauseTuof severe misspelling or ambiguous
li
or unnecessary/missingaparts 1 in
c the name.

ry e
n u y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
d
es 16.2 54 ary
u .9
Consider names
T 7 2incorrect when they contain issues including:

. by 10,
1 Na 202
ncy 3 f
• Severe misspellings that prevent the user from identifying the business because Po rof:

o
lica m IP
• Change in meaning
r po
• Misspelling that results in an entirely different word or gibberish

• Holding names that are completely different than the recognized name

• Unnecessary or missing parts in the name that prevent the user from recognizing the
business

• Slang and inappropriate language

• Using the previous name of the same entity that is not a variation of the current name and
therefore cannot be identified

Note: If a result name is incorrect, the final Name Accuracy rating will always be Incorrect, even if
the classification is correct.

Result name Official Business Name Rating and Explanation


Name Accuracy Incorrect

JAB Holding
Peet’s Coffee The holding company name is completely
Company
different than the store name.

Name Accuracy Incorrect

Samsons Pizza Seasons Pizza The misspelling changes the meaning of the word
“Seasons” and makes this seem like a totally
different business.

Tu Name Accuracy Incorrect IP


e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
IEA
.9
by 10, IKEA ua Na
Na 202 In short business names, even , Jan byerrors
small can
ncy 3 f a y 4. 9
prevent the user from recognizing
esd .25 the business.
Po rom Tu 72.16
lica IP
rpo 1

78
Result name Official Business IP Name Rating and Explanation
m
3 fro rpo Name Accuracy Incorrect
2 a
0 , 20 olic
1 y P Tu
ary Nanc Tacos + The misspelling17isessevere
Zatas Tacos + Zacatecas y, J and does not allow the
u da
JanTequila y 2
user to identify the16business
.9 b .25 anua with certainty. The
Tequila y , .
d a 5 4
es .2 user is likely under the 4impression
.9 ry 1 that it is a
Tu 72.16 by 0
1 different restaurant. Na , 202
ncy 3 f
Po rom
Name Accuracy Incorrect licar IP
po

The misspelling changes the meaning, which


Taco Bull Taco Bell makes the name ambiguous: It could be a “Taco
Bell” chain store or a different business named
“Taco Bull”.

Name Accuracy Incorrect

With the unnecessary word “Pizza,” the name


Walgreens Pizza Walgreens becomes ambiguous and the user does not know if
this is a pizzeria named Walgreens or a wrongly
labeled Walgreens pharmacy.

Name Accuracy Incorrect

Cheesecake The Cheesecake Factory When missing the word “factory”, the result name
“Cheesecake” is not specific enough and the chain
business cannot be identified with certainty.
Name Accuracy Incorrect

UPS USPS USPS (United States Postal Service) and UPS


(United Parcel Service) are both in the delivery
business, but are entirely different companies.

Name Accuracy Incorrect

Tu IP
e r o m o
17 sday, f
2 0 23 licarp
Starbucks
.16 Jan& 2 o
.25 ua Marks & Spencer By switching Marks with Starbucks, 10, business
the c yP
Spencer 4.9 ry a r y
a n
by 10,
Na 202 can no longer be identified. Janu by N
, .9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

79
Result name Official Business IP Name Rating and Explanation
m
3 fro rpo Name Accuracy Incorrect
2 a
0 , 20 olic
1 P Tu slang for McDonald’s brand.
Mickey D’s McDonald’s y Mickey D’s is British
u ary Nanc esd
17 an ay,
Jan .9 by However it is not 2.1 official
Ja variation of the brand
y , 6 25 nua
a 4 name. .
esd .25 4.9 ry
Tu 72.16 by 10,
1 Name Accuracy Incorrect
Na 202
ncy 3 f
rom
Bridgestone
Returning a previous name that is Pnot oli used
car IPon the
Sommet Center arena’s official webpage is not a good experience.
po
Arena
Even when it might still be in use among users, if
the result shows a former name, rate it Incorrect.

6.3 Result Classification

Once you have determined the correctness of a result’s name, you will have to evaluate the accuracy
of its classification in order to determine the final Name Accuracy rating. The classification of a result
refers to the category of the Business/POI.

Not every result will include a classification, but when one appears, you will find it below the address
details

If the classification is missing or listed as N/A, make your final Name Accuracy rating based on the
name alone.

6.3.1. Correct Classification

When a business or POI is classified correctly, the classification accurately reflects the business,
service, or function of the entity. This includes broad or alternate classifications that are not the
preferred choice but are not misleading.

A correct name paired with a correct classification is rated Correct for Name Accuracy.

• Not every result will include a classification. If the classification is missing or listed as N/A, do
not demote.

• Some classifications may seem slightly too specific or too general. As long as the
classification is not misleading, consider it correct.

• Classifications can vary for similar POIs and vary per market. Localization of categories
Tu should be taken into account when deciding if a classification is appropriate.
IP
esd r o m o
f
17 ay,
2.1 2 0 23 licarp
J o
6.2 anu
54 ary y 10, cy P
r n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

80
Result Name and IP Rating and Explanation
Classification f o m
r rpo
2 023 olica
10Name
, P Accuracy Correct Tu
a ry ancy esd
Restaurant Toqué
anu y NRestaurants are commonly classified17by ay, respective cuisines.
2.1their
French a , J
y 54. 9 b
‘French’ refers to French cuisine or a 6.2 Jrestaurant
French
an
u and is an
d 5
es
Tu 72.16
. 2
appropriate classification for the result.
4 .9 ary 1
by 0
1 Na , 202
ncy 3 f
Name Accuracy Correct Po rom
Jocko’s World Famous lica IP
rpo
Chicken and Seafood
This classification may seem a bit too specific but it is not misleading.
Seafood Although this restaurant sells more than just seafood, categorizing it as a
seafood restaurant still properly reflects the nature of this entity.
Name Accuracy Correct

Walmart
As long as research shows that the particular Walmart location
Grocery represented by the result sells groceries, this would be an appropriate
classification. This is because grocery is a major department in this store
and represents a large part of what it sells.
Name Accuracy Correct
Walmart

Discount Store This classification accurately represents the POI. Walmart is known to
offer merchandise at low prices.

6.3.2. Incorrect Classification

When the classification is wrong, the final Name Accuracy rating is always Incorrect. This is true
whether the result name is Correct, Partially Correct, or Incorrect.

Consider the classification incorrect when it is:

• Wrong

• Misleading

• Misspelled

• Incomplete (missing parts or has uncommon/odd abbreviations)

• In an unexpected language/script. The classification must match the language/script of the


query, test locale, or result region

Tu IP
esd Name and
r o m o
17Result Expected f rp
ay
.16 , Jan
2Classification Rating and Explanation 2023 lica
.25 ua Classification 10, cy P
o
4.9 ry a r y n
a
by 10, Name Accuracy Incorrect Janu by N
Na 202 , .9
ncy 3 f s day .254
Denver Zoo
Po rom e
Classification is wrong since
Tu 72the 6
.1 result is a zoo. This
licZoo
arp IP
Active Life 1
classification does not represent the nature of the
o
result. Final Name Accuracy rating is Incorrect.
81
Result Name and
Expected IP Rating and Explanation
Classification Classification
r o m
0 2 3 f carpo
li
1 0, 2 y Po Name Accuracy T Incorrect
ue
ry c
Macy’s
n ua y Nan 17 sday,
a b The result is a department
2.1
6.2 Janstore and should not be
Bar a y, J 54.9Department Store u
es d .2 categorized as bar. Final 4Name
5
.9 ryAccuracy
a rating is
Tu 72.16 Incorrect. by 10,
1 Na 202
ncy 3 f
Name Accuracy Incorrect Po rom
lica IP
rpo
Classification is misleading. The result is a
department store and it should be categorized as
one. Although this store does sell shoes, the
Macy’s

classification does not reflect the wide variety of


Shoes Department Store
other merchandise it offers. It is misleading to
categorize this result as simply a shoe store. Final
Name Accuracy rating is Incorrect.

Name Accuracy Incorrect


Classification is misleading. Pondok Djaja is a
Pondok Djaja
restaurant in Jakarta famous for its chicken dishes,
Daging Ayam
Restoran Ayam
but the classification “Daging Ayam” or “Chicken
Meat" is more appropriate for a poultry butcher than
translation of translation:
a restaurant. The classification “Restoran Ayam” or
classification:
Chicken Restaurant “Chicken Restaurant” is more appropriate. Final
Chicken Meat Name Accuracy rating is Incorrect.

Name Accuracy Incorrect


Classification is misspelled. Any misspelling in the
classification should be considered wrong. Final
Name Accuracy rating is Incorrect.

Fry’s Electronics

Electronics
Electrnics
Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

82
Result Name and
Expected IP Rating and Explanation
Classification Classification
r o m
0 2 3 f carpo
li
1 0, 2 y Po Name Accuracy T Incorrect
ue
ry c
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo
Macy’s
Classification is incomplete. The classification shown
Department Store is not a common abbreviation for “Department Store”
Depart Store
and appears incomplete. Final Name Accuracy rating
is Incorrect.

Name Accuracy Incorrect

Test Locale: Germany

Classification is in unexpected language or script.

Aral
The classification “Gas Station” is in English instead
Tankstelle of the expected German word “Tanskstelle.”

Gas Station
English should be considered an unexpected
language in this locale (even if it could be understood
by a user there). Final Name Accuracy rating is
Incorrect.

Name Accuracy Incorrect


The result name should be considered partially
correct because it does not include the proper
Macys
Macy’s
punctuation: Macys should be Macy’s. The
Bar Department Store classification of Bar for this department store is
wrong.

When the name is partially correct and the


classification is wrong, rate Name Accuracy
Tu Incorrect. IP
esd r o m o
f
17 ay,
2.1 2 0 23 licarp
J o
6.2 anu
54 ary y 10, cy P
6.4. Can’t.9Verify
r n
by 10, ua a
Na 202 , J an by N
.9
ncy of 3available
When, due to a lack data online, the business or POI name cannot s day be 54confirmed, rate
Po from T
e
u .1 6 . 2
Can’t Verify. This can bel i carbecause
IP of a lack of official resources or street 1imagery
7 2 or can be the case
for small businesses that don’t po maintain their own webpage or social media profile.

83
6.5 Transit Names
IP
r o m
0 2 3 f carpo
Transit stations and other transit oli
0, 2 y Presults (like airports and shipping
Tu ports), are often named after the
1 c
locality or street whereuthey y
ar Nare an located and can include a transit17indication
esd
ay, such as "Station" or
“Subway.” The transit nindication in the result name/title is considered
2.1 optional
6.2 anu and can be missing
J a b y J
a y, 54.9
and still be considered
d correct. The user query for [san mateo station] 54 canartherefore return the
T ues .16.2 .9
b
y1
name San Mateo 17 2 Station or simply San Mateo to be Correct. The classification y of
0 ,
Na 202 the result will help
you correctly interpret the result because classifications for transit POIs should be n cy a reference
3 to
Po from
transit.
lica IP
rpo
Keep in mind that some transit POIs located on street intersections may have a result title that is the
name of the street intersection (e.g. “Lincoln Way & 19th Avenue”). This is also considered Correct.

If there are multiple transit systems operating out of the same station, any of the systems can be
included in the name to be Correct. If transit stations are close to each other, but users have to walk
outside to get from one building to another, consider the results for the two stations as two separate
POIs.

Query Result Rating and Explanation


Millbrae
Name Accuracy Correct
Millbrae, CA
“Millbrae” has no transit indication in the result
Classification: Train Station name, but the classification indicates it is a train
[Millbrae station.
station]
Millbrae BART
Name Accuracy Correct
Millbrae, CA
“Millbrae BART” has a transit indication for the
User and Classification: Train Station
viewport
BART system in the result name.
in Palo Alto, CA
Millbrae Amtrak
Name Accuracy Incorrect
Millbrae, CA
“Millbrae Amtrak” has an incorrect Amtrak transit
Classification: Train Station
indication. Only BART and Caltrain operate from
Millbrae station.

6.6. Parking Names

A parking lot may or may not have a name. Confirm this on the lot’s official webpage:

• The generic names “Parking,” “Garage,” or “Lot” (or any other words that indicate parking P
Tu can take place at the location) are considered Correct when no official name can be found. I
esd r o m
o
17• aIfy,an official name can be found, rate the generic names “Parking,” “Garage,” or “Lot” f rp
2.1 2 0 23(orlicany
a
J
6other , o
a
.25 nuwords that indicate parking can take place at the location) as Partially Correct. 1 cy

0 P
• If the
ary
4.9 parking lot is specialized (for instance, motorcycle-only parking), and the
a ry result’s
n name
by 10, a n u y Na
doesn’t reflect
N an 02that
2 specialization, the result should be rated Incorrect , J
for name
.9 b accuracy.

cy 3 fr e s day .254
Po om Tu 72.1 6
lica IP
Accept the following combinations
rpo of names as Correct if no official name 1 is found:

84
• (Business name/Plaza name/Shopping area name) + (parking/ garage/lot)

• Without the addition of IP


parking/garage/lot, the name is Incorrect

o m
• Parking/ Garage/Lot (or any 3 frother
r p o words that indicate parking can take place at the location)

a
0 , 202 olic
1 P Tu
ry ancy e
n
a
u yN 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Query Result Rating and Explanation Po rom
lica IP
rpo
Name Accuracy Correct
Union Square Garage
This garage’s official website confirms its name.

Parking
Name Accuracy Partially Correct
(Result is for the Union Research shows that the official name for this
Square Garage) parking location is Union Square Garage
Safeway Parking
Name Accuracy Correct
(Result is for the parking
[Parking]
lot attached to a This parking lot has no official website or name, but
Safeway store in San is associated with a Safeway store.
User and viewport
Francisco)
in San Francisco, CA

Parking
Name Accuracy Correct
(Result is for the parking
lot attached to a
Safeway store in San This parking lot has no official website or name.
Francisco)
Safeway
Name Accuracy Incorrect
(Result is for the parking
lot attached to a Without the words “Parking,” “Garage,” or “Lot,”
Safeway store in San users will have no way to know they can park at this
Francisco) Safeway.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

85
6.7. Final Name Accuracy Rating (Summary Table)

IP
r o m
0 2 3 f carpo
This table shows the final ratings oli
0, 2 y Pproduced by different combinations
Tu of name correctness and
1 c
classification accuracy.
ary n e
17 sday,
a nu by Na 2.1
a
J
y, 54.9 6.2 Janu
d 5
Name/Title es 16.2
TuCorrectness
. Classification Accuracy .9 ary 1 Rating
Final Name4Accuracy
by 0
172 Na , 202
Correct Correct or N/A Correct ncy 3 fr
Po om
lica IP
Correct Incorrect Incorrect rpo

Partially Correct Correct or N/A Partially Correct

Partially Correct Incorrect Incorrect


Incorrect Correct or N/A Incorrect
Incorrect Incorrect Incorrect

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

86
7. Address Accuracy: Components
IP
and Issues

m
fro rpo
Address Accuracy is split into two 3 main
a parts: Components and Issues and Result Expectation. This
, 202 olic
section will discuss Components y 1 ncy and Issues and the next section uwill
0 P T discuss Result Expectations.

r esd

u a N a 1 a
72 y, J
7.1. Address Components
Jan .9 by .16
d a y ,
5 4 .25 anua
es . 2 4.9 ry
Tu 72.16 by 10,
1 Address components are the elements used to Nform
an 2the
02 address details
for each result. These components include street number,c y P 3 frounit/apt,
oli m I
street name, locality, region/state, postal code, and country. car TheP
p
components are defined in these guidelines with a global approach in o
mind. There may be variations for specific markets that are not
addressed here. See your Country Specific guidelines for more
information on the address component requirements for each type of
result.

This section covers the issues that can be associated with the address
components as well as the possible issues that can be associated with the address itself. It refers to
the checkboxes presented in the rating interface when Incorrect is selected. Checkboxes should be
selected for incorrect or missing information. Issues can occur within parts of the address or the
entire address.

Choose all identified incorrect or missing components. If the issue is not tied to individual
components but to an issue pattern, choose the appropriate issue instead.

Never select issues and components at the same time to report the same problem. That is, do not
rate Incorrect —Language/Script issue for the entire address and also Incorrect—Street Name
because street name is in an incorrect language.

When a Language/Script issue is present, make sure to check the address components for
accuracy and to select the appropriate checkbox. For instance, if you select language issue for the
entire address, you can also mark street number as incorrect, since this is an error that's not
language related.

7.1.1. Street Number

If the result address has an incorrect or missing street number rate Address Accuracy as Incorrect –
Street Number.

Tu IP
e r o m o
17 sdayResult f p
2.1 , Ja Official Address Rating and Explanation 2023 licar
6.2 nu 0, y Po
54 ary
.9 Address Accuracy y 1 ncNumber
Incorrectu–arStreet a
7-Eleven
by N 10, 2 834 E Fremont Ave, Jan by N
ncy 023 fSunnyvale, CA , .9
836 E Fremont aAve, ro day .254 because the
Select the Street number checkbox
s
Po 94087, e 6
Sunnyvale, CA 94087 lica m IP USA street number in the result
Tu address
.1 is incorrect.
rpo 172

87
Result Official AddressIP Rating and Explanation
m
fro rpo Address Accuracy Incorrect – Street Number
Defour
Potgieterstraat
0 olica 47,
2 3
, 2
Potgieterstraat, 1053 1053 0 XSP Select the Street Tnumber checkbox because the
ry 1 ncy ues
XS Amsterdam, u a Amsterdam,
a street number is d
missing
172 y, J the result address.
a in
an y N
Netherlands ay, J 4.9 bNetherlands .16
.25 anua
es d . 2 5 4.9 ry
Tu 72.16 by 10,
1 Na 202
The way street numbers are assigned varies by country and area. Some patterns ncyou
y P 3may
fro see:

oli m I
car P
Street Number Extensions
po

Some markets use a street number extension system. Street number extensions are part of the street
number, not a further breakdown of it like building or unit numbers. If a street number extension is
incorrect or missing from a POI address it should be treated as an incorrect/missing street number.
Refer to Country Specific Guidelines for more details.

Result Official Address Rating and Explanation


Address Accuracy Incorrect – Street Number
Elkjøp Halden
Walkersgate 8c, In Norway, street number extensions are part of the
Walkersgate 8, 1771 1771 Halden, street number and are not unit numbers. The street
Halden, Norway Norway number in the result is missing a street number
extension ‘c’ which is listed as part of the official street
number.
Address Accuracy Incorrect – Street Number
REMA 1000 Tynset
Elfengveien 4 B, In Norway, street number extensions are part of the
Elfengveien 4 A, 2500 Tynset, street number and are not unit numbers. The street
2500 Tynset, Norway Norway number in the result has an incorrect number
extension ‘A’ when ‘B’ is listed as the official street
number extension.

Address Range

Address ranges are used to assign numbers to a stretch of road. Given the nature of these ranges,
not all numbers will have a building assigned to them.

When an address range is given by the query or returned as a result, consider it Correct when:

• The result street number is within the queried range

• The result address range exists and contains the queried street number
IP
Tu m o
•esdThe range or number matches the odd/even numbering system for left/right side of street f r o
17 ay,
2.1 required by the country
2 0 23 licarp
J o
6.2 anu
54 ary y 10, cy P
r n
.9
The same criteria
by 10apply to POI addresses.
ua a
Na , 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

88
Suggestion Official Address Rating and Explanation
IP
m
3 fro rpo Address Accuracy Correct
The Crutched Friar
, 2 0 olica
2
39 Crutched Friars, ary 1 ancy
0 P No need to select
Tu the Incorrect – Street Number
esd
London u N checkbox since
1 thea street number in the
J a n b y39-41 Crutched Friars,
7 2.1 y, Ja
ay , 9
4. London EC3N 2AE, suggestion is within 6.2 thenofficial address range.
esd 16.25 54 uary
u . 9
T 72. United Kingdom
Address Accuracy by 10, – Street Number
Incorrect
1 Na 202
The Crutched Friar
ncy 3 f
45 Crutched Friars, Select the Incorrect – Street Number
Po rom checkbox
lica IP
London because the street number in the suggestion rpo is
outside of the official address range.
Address Accuracy Incorrect – Street Number
26 Winchester
25-27 Winchester
Avenue
Select the Incorrect – Street Number checkbox
Avenue, Burpengary
Burpengary East Qld
East Qld 4505 Australia because the number 26 is even while the official
4505 Australia address range is odd.

Address Accuracy Incorrect – Street Number


Select the Incorrect – Street Number checkbox
Rua de Dom Hugo 17
because the street range in the suggestion does
Apartamentos Oporto
4050 Porto

Rua de Dom Hugo 1-45


Portugal not exist. This is a random address range and
Porto
should be considered incorrect even if it contains
the official street number.

7.1.2. Unit/Apt

A street number can be divided into unit, apartment, or building numbers. Commonly seen forms
include the use of letters: A, B, C as well as the character # in front of a number: #420. Less common
are forms like ½.

A unit number should be correct and present when the official address of a business/POI contains a
unit number.

When a business does not list a unit number and the unit number cannot be confirmed, no unit
number should be given in the result. Rate Incorrect – Unit/Apt when unit number is present in the
rating tool in these cases.

Result Official Address Rating and Explanation


Free
Tu People
Address Accuracy Correct IP
o m o
333
17 sSantana
ed Row
This is the correct address listed on the official f r
ay, 0 23 licarp
Suite
2 .16#1110

Ja website of the business. 2 o


.25 nua
San Jose, 10, cy P
4.9CA r95128
y ua
r y
an
by 10, an by N
Na 202 , J
Address Accuracy Incorrect
day .254– Unit Number
.9
Free People
ncy P 3 f333rom Santana Row
e s 6
333 Santana Row
olicSuite Tu 72.the
This result address is missing 1 unit number listed
arp IP#1110
1
San Jose, CA 95128 Sano Jose, CA 95128 on the official website. Unit number checkbox should
be selected.
89
Free People
IP Address Accuracy Incorrect – Unit Number
333 Santana Row
o m
r This result address has a different unit number than
3 f carpo
Suite #2490
0 2 li the one listed on the official website. Unit number
0, 2 y Po Tu
San Jose, CA 95128 ry nc 1 checkbox should be e selected.
a
nu by Na 17 sday,
a 2.1
J
ay, 254.9 6.2 Janu
es d . 54 ary
Tu 72.16 .9
by 10,
1 Na 202
7.1.3. Street Name
ncy 3 f
Po rom
lica IP
rpo
If the result address has an incorrect or missing street name rate Address Accuracy as Incorrect –
Street Name.

Result Official Address Rating and Explanation


Van Gogh Museum
Address Accuracy Correct
Museumplein 6, 1071
DJ Amsterdam, This is a correct address as displayed on the official
Netherlands website of the business.

Van Gogh Museum


Address Accuracy Incorrect – Street Name
Museumplein 6,
Van Baerlestraat 6,
1071 DJ Amsterdam,
1071 DJ Amsterdam, This address has the wrong street name. Street
Netherlands
Netherlands name checkbox should be selected.
Van Gogh Museum
Address Accuracy Incorrect – Street Name
6, 1071 DJ
Amsterdam, This address has a missing street name. The street
Netherlands name checkbox should be selected.

Alternative Street Names

A street can have alternate names or route


numbers, as well as multiple names in different
languages in bilingual areas. Consider a street
name correct when the name used is still valid and
in the language expected given the test language,
result region, or user query. If the street name has
changed and the older name is no longer in use,
consider the old name to be Incorrect – Street
Name if returned.

Tu IP
esd r o m o
f
17 ay,
2.1 2 0 23 licarp
J o
6.2 anStreet
Misspelled 54 uary Names
y 10, cy P
r n
.9
by 10, ua a
N 2 , J an by N
Misspellings in the an street
cy 23 frname, including missing diacritics (e instead of é,
0
dl ainstead
y 54.9 of ł) may be
e s .2
rated Incorrect – Street P oli Name.
o m See your Country Specific guidelines forTumore 2 . 16information.

car IP 17
po

90
Result Official Address IP Rating and Explanation
r o m
Van Gogh Museum
0 2 3 f carpo Address Accuracy Incorrect – Street Name
Museumplein
2 li 6,
Musuemplein 6, 1071 y 10, cy Po The result streetTname
ues is misspelled (“ue” instead of
r1071 DJ Amsterdam,
DJ Amsterdam, ua y Nan 1
“eu”), so the street
da
72 name
.16 , Jacheckbox should be
a n Netherlands y
Netherlands ay, J 4.9 b selected . 25 uan
es d .2 5 4.9 ry
Tu 72.16 by 10,
1 Address Accuracy Incorrect
Na 2–02Street Name
ncy 3 f
Bozego Ciala
Po rom
Bożego Ciała, The result street name is missing diacritics
lica IinP two
Bozego Ciala,
r
letters (ż and ł) which should be treated aso ap
Wrocław, Poland
Wrocław, Poland misspelling in the Polish market. The street name
checkbox should be selected.

Street Directions and Types

Street directions (North (N), East (E), South (S), West (W)) as well as street types (Street (St),
Boulevard (Blvd), Avenue (Ave), etc.) are part of the street name. If they are incorrect or missing, the
street name is wrong and rated Incorrect – Street Name. Exceptions are when such elements of a
street name are used interchangeably for the same street.

Result Official Address Rating and Explanation


Address Accuracy Incorrect – Street Name
Van Gogh Museum
This address has the wrong type of street: both
Museumplein 6,
Museumkade 6, 1071
1071 DJ Amsterdam, “plein” (square) and “kade” (quay) are street types.
DJ Amsterdam, The official street type is listed as ‘plein’, therefore
Netherlands
Netherlands the type of street is considered wrong and the
checkbox for street name should be selected.

118 El Camino Real


118 E El Camino Address Accuracy Incorrect – Street Name
118 El Camino Real, Real, Sunnyvale, CA This address is missing the direction. Therefore, the
Sunnyvale, CA 94087 94087 street name checkbox should be selected.
Blue Stones
Address Accuracy Incorrect – Street Name
3530 El Camino
3530 E El Camino
Real, Santa Clara, This result address has additional direction, which is
Real, Santa Clara, CA
CA 95051 wrong and does not exist in real life.
95051

7.1.4.
Tu Sub-Locality and Administrative Subdivisions
IP
esd r o m o
f
17 ay,
2.1 countries 0 23 licarp
Some J or areas require an additional subdivision, like sub-locality, for correct address
2 o
6.2 anu 10, cy P
information.
54 See
.9 a r y your Country Specific guidelines for specific guidance. The general r guidance
y
ua y Na n is to
y N 10, 2
rate a wrongbsub-locality as Incorrect – Sub-Locality. This is also true if the n
sub-locality
Ja b is required
but missing.

an 023
cy f s d ay, 254.9
Po rom e .
lica IP Tu 72.16
rpo 1

91
IP
r o m
7.1.5. Locality

0 2 3 f carpo
li
1 0, 2 y Po T
Misspellings within the locality
a ry ancname, including missing diacritics u(eesinstead of é, l instead of ł) may be
u yN 17 day,
rated Incorrect – Locality.
a n b See your Country-Specific Guidelines for2.1 more information.

a y, J 54.9 6.2 Janu


d
es 16.2 54.9 ary
u
Every result requires the correct locality component within its address details. by In10cases
Na , 202 of local
T .
172
government reforms or other changes in naming, the result has to reflect the official ncy name.
3f
r
Exceptions are made when alternate names are accepted.
P oli om I
car P
po
Result Official Address Rating and Explanation
Van Gogh Museum
Address Accuracy Incorrect – Locality
Museumplein 6, 1071 Museumplein 6, 1071
DJ Utrecht, DJ Amsterdam, This address has the wrong locality. Locality
Netherlands Netherlands checkbox should be selected.

Address Accuracy Incorrect – Locality


Van Gogh Museum
Museumplein 6, 1071
Museumplein 6, 1071 DJ Amsterdam, This address has a missing locality therefore
DJ Netherlands Netherlands locality checkbox should be selected.

Jana Matejki
Jana Matejki
Address Accuracy Incorrect – Locality
Jana Matejki
90-237 Łódź

Polska The locality within the street result is missing


90-237 Lódz
diacritics in two letters (Ł and ź) which should be
Polska treated as a misspelling in the Polish market.

7.1.5. Region or State

Each country has its own understanding of what is expected (correct) or unusual (incorrect) for
region or state components. See your Country Specific guidelines for more information.

Result Official Address Rating and Explanation


Incorrect – Region/
Address Accuracy
1384 Navarro Dr, State
1384 Navarro Dr

Sunnyvale, CA 94087, This address is missing the state, which is a


1384 Navarro Dr,
USA mandatory component in the USA. Region/State
Sunnyvale, 94087, USA
checkbox will be selected for missing state.
Tu IP
e Correct with 3 fromrpo
17 sday, Address Accuracy 02 olica
2.1 formatting, 2issue
6.2 JanMuseum

Van Gogh 0
1 cy P
54 uary Museumplein 6, 1071 r y
Museumplein.9 6,11071
by 0, Region is not a mandatory component n ua y Nan in the
2
NaNorth- DJ Amsterdam, Netherlands, but if present
a
J .9tob be correct.
DJ Amsterdam, ncy 023 f Netherlands ay, has 4
Holland, Netherlands Po rom Since the region is not
u s d
16 .25
e necessary, it is a
lica IP T 72.
rpo redundant address component
1 and should be
flagged as a formatting issue.

92
Result Official Address
IP Rating and Explanation
r o m
0 2 3 f carpo Address Accuracy
Incorrect – Region/
li
1 0, 2 y Po Tu State
Van Gogh Museum
ary anc esd
u Museumplein 6, 1071 ay
Region is not17a2.mandatory component in the
Museumplein 6, 1071 J an by N 16 , Jan
y 54.9 DJ Amsterdam,
,
Netherlands, but if25present
4 ary has to be correct.
DJ Amsterdam, d aNorth- . u
es .2 Netherlands
Tu 72.16
Brabant, Netherlands The correct region for.9the
by city
10 of Amsterdam is
1 Na , 202
North-Holland, therefore thencregion/state
y P 3 fro
checkbox will be selected. oli m I
car P
po
7.1.6. Postal Code

The postal code accompanies the locality name and provides further detail about where a feature is
located. See your Country Specific guidelines for more information on when postal codes are a
mandatory address component.

If a postal code is not mandatory but is present in the result address, rate Correct as long as the
postal code applies to at least part of the feature (street, locality, large POI without an expected
address, etc.).

For many localities, more than one postal code may apply. As long as the returned postal code is
correct for at least a part of the feature (street, locality, large POI) rate Correct. Columbus, OH, for
example, contains 45 postal codes.

Postal code standards differ between locales so be sure to consult your Country Specific guidelines
for details.

Consider any country specific conventions when it comes to the use and correctness of shortened
postal codes. For example, the US postal code does not need the four-digit extension that follows the
five digit main code. Ignore it if it appears.

Result Official Address Rating and Explanation

Van Gogh Museum


Address Accuracy Incorrect – Postal Code
Museumplein 6,
Museumplein 6, 1071
1071 DJ Amsterdam, This address has the wrong postal code “DM”
DM Amsterdam, instead of the correct “DJ.” Postal code checkbox
Netherlands
Netherlands should be selected.
Van Gogh Museum
Address Accuracy Incorrect – Postal Code
Museumplein 6,
Museumplein 6

1071 DJ Amsterdam, This address has a missing postal code. Postal code
Amsterdam, IP
Tu Netherlands checkbox should be selected. m o
Netherlands
esd f r o
17 ay,
2.1 2 0 23 licarp
J o
6.2 anu
54 ary y 10, cy P
r n
.9
by
10, ua a
7.1.7. Country Na 202 , Jan by N
.9
ncy 3 f
r e s day .254
The country is a “niceotoP
licahave”
o m piece of information, but should always Tbe u included
16 when the result is
IP 72.
located in a country other than r po the test locale. If missing, rate Incorrect and select the Country
1
checkbox.

93
IP
Test o m
r rpo
Address in Result 3 f Address in Reality Rating and Explanation
Locale 2 0 2 lica
, o
10 P Tu
ry ancy Address esd
1384 Navarro a 17 Accuracy Correct
an by NDr, 1384 Navarro Dr,
u a
J 2.1 y, Ja
en_US Sunnyvale,
y , . CA
9 Sunnyvale, CA 6.2 naddress
This is a correct since the test
u sda 6.254
e94087 94087
54 uary
.9
T 72.1 locale is the USA.y b 10
1 Na , 202
ncy 3 f
Address Accuracy Correct Po rom
1384 Navarro Dr, 1384 Navarro Dr, lica IP
This address includes the country rpo name
de_DE Sunnyvale, Sunnyvale, CA
CA,94087, USA 94087, USA since it is outside of Germany, which is the
test locale.
Address Accuracy Incorrect – Country
Museumplein 6, The country is mandatory in this example
Museumplein 6,
en_US 1071 DJ
1071 DJ Amsterdam, because the address is in the Netherlands,
Amsterdam which is outside the user's US test locale.
Netherlands
Country checkbox should be selected.

7.2. Address Does Not Exist

An address-type result needs to be associated with a building or with a plot of land that has been
officially assigned that address. If you find strong evidence that there is no building at the address or
that no plot of land has been officially assigned the address, rate Incorrect – Address does not exist
and leave a detailed comment including links. If there are not enough resources available to make an
informed decision, rate Can’t Verify.

Within markets that use street number extensions, if the result offers an address with a generic street
number, but the street number alone does not exist without an extension (e.g. result returns “163
Main St.”, but only “163A Main St.” and “163B Main St.” exist), rate the address as Incorrect –
Address does not exist, since the street number without the extension is not a valid, real-life address.

Note that street number extensions differ from the building numbers referred to in Unit/Apt section.

In rare cases, an existing street address can be found in a different locality. Always mark such cases
as Incorrect – Address does not exist and not as Incorrect – Locality.

Use the Incorrect – Address does not exist checkbox for any address result that doesn’t

exist, like a street or sub-locality result. This rating should not be applied to POI addresses.

Tu IP
e r o m o
7.3.
17 Language/Script
sda Issue in Address
f
23 licarp
2.1 y, Ja 2 0 o
6.2 nu 10, cy P
The address
54 details
a r must be in a language and script that matches the test language r y(likenen_US), the
.9 y
bythe10result n ua y Na
user query, or Na 202, region.
Ja b
ncy 3 f s d ay, 254.9
Po rom e 6.
Tu 7if2.1you
Use the Address Accuracy lica Incorrect
IP – Language/Script Issue checkbox find issues of this
rpo 1
nature in any of the address components in the address details of any result. (For business/POI
names and address titles in unexpected languages, see Result title/name in unexpected language.)

94
These examples show incorrect language IP and script for the result “Cafe Timber, 1066 Hippy Hollow
o m
r rpo a user in the US using English.

Rd, Red Boiling Springs, TN 37150”


0 2 3 f cwith
a
0 , 2
P oli Tu
1
ry ancy e
n
a
u yN 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

Any combination of unexpected language or script is considered Incorrect. An exception can be


made in cases when only special characters are added that are not used in the expected language.

Results located in a market with different scripts are hard to verify. Use the normal research steps to
confirm the address. It is not expected that you understand markets and address formats outside
your local knowledge expertise, so do the best you can without doing more research than normal.

Rate mixed languages and scripts found in any address details as Language/script Issue when
they use a different language or script than the one used in the query, test, or result location.

7.4. Country-Specific Issue

The variety of address formats and distinctive country specific issues is broad. In general, use the
checkbox for Country Specific Issue when there is an address problem that is not covered by the
available checkboxes. This includes things like instances when an address also requires a
municipality in addition to locality and state, but those components are either missing or incorrect.
See your Country Specific guidelines for more information.

7.4.1.Country-Specific Issue vs. Correct with Formatting Issue

Any additional components beyond the regular address format for a country are rated:

• Correct with formatting issue if correct

• Incorrect – Country Specific Issue if very unusual or wrong

7.5. Other Issue

Issues not mentioned in these guidelines are reported using the Incorrect – Other Issue checkbox. If
P
Tuchoose this option, be sure to leave a comment as well as links to the resources you used toom I
you
esd r
identify
17 aythe issue. The checkbox is also used for:
0 2 3 f carpo
2.1 , Ja li
6.2 nu 10, 2 y Po
54 ary ry c
• Duplicate
.9
by 1address components
n ua y Nan
0,
• Name ofNPOI an 2reappears
02 in the address details

a y , Ja 4.9 b
cy 3 sd 6.25

• Natural features Po thatfro contain street address elements (see NaturalueFeatures)


m 1
• P.O. Box addresses
l i car IP T
1 72.
po

95
You may also use this checkbox if you notice formatting issues along with any Incorrect
components you’ve already selected. IP is because once you mark a component Incorrect, you
This
o m
r rpo
can no longer choose Correct with 3 f Formatting issue.

2 0 2 l ica
 
10 , P o Tu
7.6. Correct with Formatting ry ancyIssue
e
n
a
u yN 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
When all the result
d address information is correct and present, but not in 54 theaformat expected, mark it
T ues .16.2 .9 ry 1
b
as Correct with
17 2 Formatting issue. Formatting issues include the order of address
y 0 ,
Na 202 components and
other minor issues that are not necessarily considered wrong. They do not include ncy misspellings
3
Po from
which are addressed under the relevant individual components. Some reasons to rate liCorrect
car IP with
formatting issue:
po

• Components are in unexpected order

• Non-required but correct address components

• Extra spacing

• Double comma [,,]

• Rate Incorrect if a required component is missing

• Valid but redundant or unnecessary components (See your Country Specific guidelines for
more information)

If optional components already discussed in this chapter appear in the address, use the guidance
provided in the section that applies to those components, not the Correct with formatting issue
rating. If your market has additional address components, consult your Country Specific guidelines
before demoting.

7.7. Can’t Verify

An address is rated Can’t Verify when it cannot be confirmed as Correct or Incorrect. This is
usually the case when there is a lack of resources or an unexpected address format is given on the
official website.

• Lack of resources:

• No official webpage found

• No official address listed

• General lack of official resources

• Lack of street imagery

• Unexpected address formats used by official resources can include:

• Intersection address (Main St and 2nd St)

• Exit address (Exit 5, Hwy 101)

• Descriptive address (Main St between 6th and 7th Streets)

Ask yourself: Is the location given by the result address at least not wrong given all information I IP
Tu found? Use the following examples to learn how reach a conclusion.

have m
e
17 sday, 3 fro rpo
2 a
2.1
6 Ja 0, 20 olic
Note: If.2an P
54 address contains missing or incorrect components, it can be confirmed asy Incorrect.
nu 1
. ary a r ancy
Mark the individual
9 by 10, incorrect components. See your Country Specific guidelinesafor u moreN information
Na 202 components.
J n .9 by
on missing or incorrect
ncy 3 f a y, 4
Po rom u esd 16.25
lica IP T 72.
rpo 1

96
7.7.1. Can’t Verify for Street Number

IP
o m
The following example shows address 3 f cardetails
r po for a business called “Utopia.” No information online
0 2
confirms the address and only 2 a fewol street numbers can be confirmed
i with official resources.

y 10, cy P Tu
e
ar n 17 sday,
J a nu by Na 2.1 Ja
Rule
a y, and 4 .9Explanation 6.2 Example
nu
d
es 16.2 5 54.9 ary
u
T 72. by 10,
1 Na 202
The street number has to fall within the possible ncy 3 f
range of addresses.
Po rom
lica IP
rpo
The street number 165 falls within the possible
street numbers ranging from 103 to 175.

Those are the houses closest to the result


address that could have been confirmed.

Rate the address Can’t Verify.

7.7.2. Can’t Verify for Street Name

The following examples give different address details for a business called Aztec. The official address
is “Granite Ave & W Babcock St, Bozeman, MT” and is in a different format than the result addresses.

Rule and Explanation Example

The result address has to provide access and


be within the possible range of street numbers.

W Babcock St provides access to the business


and the number appears to be within the range
of addresses we can confirm.

Rate the address Can’t Verify.

Granite Ave provides access to the business


and the number appears to be within the range IP
Tu addresses we can confirm.

of o m o
e f r
17 sday, 0 23 licarp
2.1 Ja 2 o
Rate6.the nu
25 address 10, cy P
4.9 ary Can’t Verify. ua
r y
an
by 10, an by N
Na 202 , J .9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

97
8. Address Accuracy: Result
IP
Expectations

m
3 fro rpo
a
, 202 olic
You will see three kinds ofy results:

1 0 y P Tu
u ar Nanc e
17 sday,
n by
Jaresults
2.1
• Business/POI ,
a 254.9
y 6.2 Janu
s d 54 ary
• AddressTu 7type
e 16. results

. .9
by 10,
• Features 1 2without an expected address
Na 202
ncy 3 f
Po rom
Different address details are expected for each result type. For example, the Amazon lriver
ica has
rpo P no
I
street address but its name is accompanied by the country, while the fast food place Wienerschnitzel
shows a complete address. You will need the appropriate expectations in order to rate addresses
accuracy.

Wienerschnitzel
Eiffel Tower

75 Saratoga Ave
5 Avenue Anatole France

Santa Clara, CA 95050


75007 Paris

United States France


1 Church St
Grand Central Terminal

1 Church St
Manhattan

Burlington, VT 05401
New York, NY

United States United States


Amazon
Yellowstone National Park

Brazil Natural Feature Yellowstone National Park

WY 82190

United States

8.1. Business/POI Result

The address details of a business or POI generally consist of: street number, street name, locality,
region, postal code, and country.

The address given is confirmed Correct when it points to the same physical location listed on the
official webpage or other official resources and all mandatory components for your market are
present. See your Country Specific guidelines for details on mandatory address components.

8.1.1. Business/POI Address Research and Resources

Use official resources to confirm an address when a business or POI’s official website does not
provide a full address or if there is a conflict with the address in the result. These resources can
include:


T IP
u•es Social media sites claimed by the business/POI and updated within the last 6 months
from o
17 day, 0 23 licarp
•2.16Street
Ja imagery (any recent online imagery showing streets and buildings)
2 o
.25 nuauthorities
• Postal (for postal codes and locality names)
y 10, cy P
4.9 ary ua
r an
by 10, property registries

• Government an by N
Na 202 , J .9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
If a business or POI has licamore
rpo P than one official address for the same location, accept any of them
I 1
as Correct.

98
If no official resources can be found,omrate IP according to consensus from multiple reliable sources.
r
Reliable resources include:

0 2 3 f carpo
li
1 0, 2 y Po Tu
• Articles in primary c
rypublications (newspapers or similar e
publications
n
a
u yN a n 17 sday, that do their own
reporting)
y, Ja .9 b 2.1
a 4 6.2 Janu
• Crowdsourced
es d 5
.2 user review sites
54 ary
Tu 72.16 .9
by 10,
1 Na 202
When no official resources are available and address components are missing orncclearly y P 3 froincorrect,
check to see if those components are required in the market or region of the result and m
oli select
car IP the
appropriate checkboxes under Incorrect. See your Country Specific guidelines for more pinformation.
o

Some resources, like data aggregators, spammy directory sources, and so on, are unreliable, and
consensus between unreliable resources should be disregarded.

• Valid alternate street and locality names When valid alternate names for streets or
localities are used interchangeably, consider all versions Correct.

• Valid alternate street addresses: When valid alternate addresses are returned, consider all
versions found on the official website or confirmed by official sources as Correct.

When the address listed by the official website or resources is in a different format than the one seen
in the result, confirm if the address given is Incorrect or Can’t Verify. See Can't Verify for more
information.

If there is any obvious error in an official source, like a misspelled country or city name, and the
same error appears in the result, rate the erroneous component Incorrect.

8.1.2. Alternative Official Addresses

Some official addresses may contain a vanity street name or have no official street number. In rare
cases they may even lack a complete street address. Refer to the official webpage as well as to
common address formats in your country to determine the accuracy of each business or POI address.

8.1.2.1. Department Addresses

When the official webpage does not give a complete address with street number and name for a
large entity (mall, university, etc.):

• Rate the result address Correct when it matches the address of any department or entity at
the same location complex or campus.

• Rate the result address Correct when it lists the correct locality for the entity. If the exact
locality is unclear because the entity borders multiple localities, rate Can’t Verify.
IP
Tu m o
•esdThe locality is always expected, even when no complete address is provided. If missing,frorate
17 aIncorrect
2.1 y, Ja – Locality.
2 0 23 licarp
o
6.2 nu
• Region
54 aand postal code must also appear in countries where they are mandatory y 10, cy P
.9 r y a r n
by 10, See your Country Specific guidelines for more information.
anu by Na
components.
Na 202 , J .9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

99
IP
Result Address Officialr o m Address Rating and Explanation
0 2 3 f carpo
li
1 0, 2 y Po Address Accuracy
Tu Correct
ry c esd
ua y Nan 1 a
Dartmouth College
a n b 2.1 y, Jahas no official street
Dartmouth 7College
y, J 54.9 6.2 nu
address listed on
10 N Main St, d a 5their
4.9 awebsite. The address
ues .16.2 in the result belongs to
ry
1
T
Hanover, NH 103755
72 b y Nthe0,Office
20 of
Admissions, which is partanof cy the
2 3 larger
university, therefore the address Po fis ro
Correct.
lica m I
rpo P
Dartmouth College
Address Accuracy Correct
Dartmouth College
Hanover, NH
The college lists only the locality as its
Hanover, NH
03755
official address and the result matches that
03755
USA
address and is therefore Correct (even
though it is missing a street number and
name).
Address Accuracy Incorrect – Locality
Dartmouth College

NH
A locality is expected in the address details
03755
for most POIs. Rate Incorrect – Locality
when the locality is given by the official
webpage but missing in the result.

In addition to a street address, a store or department can have the name of the complex or campus
that contains it and be rated Correct.

Result Address Official Address Rating and Explanation


Address Accuracy Correct

Stanford School of 559 Nathan Abbott This result is a department within Stanford
Law
Way, Stanford, CA University. The address is Correct because the
Stanford University, 94305 larger entity name and correct locality is listed
Stanford, CA 94305 as the address.

Address Accuracy Correct


The
Tu Cheesecake 3041 Stevens Creek IP
e r o m o
17 sday,

Factory Blvd
This result is a business within Westfield 2Valley
0 3 f carp
2.1 J Fair shopping mall. The address is Correct 2 li
Westfield
6 .25 Valley
anu Fair, Santa Clara,  10, y Po
ary because the larger entity name and ry anc
Santa Clara,4.9 CA
by 10, CA 95050 n ua ycorrect
N
95050 N 2
an 023 locality are listed as the address.
y, Ja .9 b
a 4
cy
Po from u esd 16.25
lica IP T 72.
rpo 1

100
IP
o m
r rpthe o result address belongs to another entity in the same
If the entity has an official address
0 2 3 f andc a
2 ol i
complex or on the same campus, 10, cy Prate Incorrect.
Tu
y
r an e
n
a
u yN 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
d
es 16.2 54 ary
ResultTuAddress
2 . Official Address Rating and
.9 Explanation
by 10,
1 7 Na 202
ncy – Street
Incorrect 3
Address Accuracy Po from Number
& Street Namelica IP
Stanford School of rpo
559 Nathan Abbott The result address belongs to the larger entity
Law

Way, Stanford, CA (Stanford University). The department has an


450 Serra Mall,
94305 official address that is different from the
Stanford, CA 94305
university’s address, so the result address is
rated Incorrect.
Incorrect – Street Number
Address Accuracy
Stanford University
& Street Name
559 Nathan Abbott 450 Serra Mall, The result address belongs to a smaller entity
Way, Stanford, CA Stanford, CA 94305 within the university (Stanford School of Law).
94305 The university has an official address that is
different, so this address is rated Incorrect.
Address Accuracy Incorrect – Street Number
The Cheesecake
3041 Stevens Creek The result address belongs to the larger entity
Factory

Blvd
(Westfield Valley Fair mall) that contains the
2855 Stevens Creek
Santa Clara,  restaurant. The Cheesecake Factory’s official
Blvd

CA 95050 website lists a different address, so the


Santa Clara, CA 95050
address Incorrect.
Address Accuracy Incorrect – Street Number
Westfield Valley Fair
2855 Stevens Creek
3041 Stevens Creek Blvd
The result address belongs a business (The
Blvd
Santa Clara,  Cheesecake Factory) within the mall. the
Santa Clara,  CA 95050 CA 95050 shopping mall has an official address that is
different, so the address is rated Incorrect.

8.1.2.2. Result Missing the Street Address

When both the result and the official webpage show identical but incomplete street addresses
(missing
Tu street name, street number, or both) and the locality is correct, consider the address IP
o m o
Correct.
17 sday,

e f r
2.1 2 0 23 licarp
J o
6.2 anu
54 ary y 10, cy P
r n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

101
Result Address Official IAddress
P Rating and Explanation
r o m
0 2 3 f carpo Address Accuracy Correct
li
Pilot Thomas 1 0, 2 y Po Tu
ry anc This result is foresda self-serve gas station for
Cardlock
ua y NState Hwy 115 & 1
commercial vehicles. a
Ja n b 7 2.1 y, JaWhile we would normally
State Hwy 115 d&ay, 54.9 Mustang Drive, 
 expect a full address6.2 forn
54 uathis type of result, the
es
Mustang Drive, 
 .2 Andrews, TX 79714 .9 ry 1
Tu 72.16 official website lists onlyy an intersection.
b 0 The
Andrews, TX 179714 Na , 202
result listing matches the official
ncy website,
3f so
P rom
the result is rated Correct. oli
car IP
po
Address Accuracy Can't Verify

Strand Central Park This result is for a automated book kiosk.


E. 60th St & 5th Ave, While we would normally expect a full address
Kiosk

Manhattan, NY for this type of result, the official website lists


789 5th Ave

10065 only an intersection. The result listing is a full


Manhattan, NY 10065
street address, so the result is rated Can't
Verify.

When the street address is missing from the result but the official webpage has a street address,
consider the address Incorrect.

Result Address Official Address Rating and Explanation

Address Accuracy Incorrect – Street Name

Pilot Thomas State Hwy 115 & This result is for a self-serve gas station for
Cardlock
 Mustang Drive, 
 commercial vehicles. The official website lists
Andrews, TX 79714 Andrews, TX 79714 an intersection as the address. The result
address is missing the two streets (State Hwy
115 & Mustang Dr). Mark the result Incorrect
– Street Name.

Address Accuracy Incorrect – Street Number


Stanford University

450 Serra Mall, The result address is missing the street


Serra Mall, Stanford, CA
Stanford, CA 94305 number given on the official website, therefore
94305
the address accuracy is Incorrect – Street
Number.

Tu IP
8.1.2.3. P.O. Box, Mailing Addresses, and Management Offices

esd r o m o
f
17 ay,
2.1 2 0 23 licarp
J o
6.2 anu
Addresses 54 that
a point to a different location or building, such as management offices,ryP.O. 10, Boxes,
c yP
.9 r y a Na n
by 10,or shared office spaces, are not valid and are rated Incorrectan–uOther
mailing addresses, by Issue.

Na 202 y, J . 9
ncy 3 f a 4
Po rom u esd 16.25
lica IP T 72.
rpo 1

102
IP
r o m o
Result Address 0 2 3 f carpAddress
Official Rating and Explanation
2 ol i
y 10, cy P Tu
e
ar n Address Accuracy
17 sday, Incorrect – Other Issue
a nu by Na 2.1
J
ay, 254.9 6.2 Janu
John F. Kennedyd The address on the 54official airport site is for
s
e 16.
Tu 7Airport
4 World Trade .9 ary 1
International . The Port Authority of NY b y N& NJ
0, corporate
1 2 Center, 150 an 20of
4 World Trade Center, office, which is not the location cy 23 fthe actual
Greenwich St.,
airport. Even though the result addressP oli
rom
150 Greenwich St.,
car IP
New York, NY 10007 matches the address listed on the official po site,
New York, NY 10007
it is a different location and does not refer to
the location of the result POI.

8.1.3. Businesses/POI with Moving Locations

Moving entities can either be on a fixed schedule or move at random. In some cases, entities appear
to be moving because they are located in a truck or similar vehicle, but are actually permanently
based at the same location.

Random location

The location of randomly moving entities cannot be predicted and should not be shown on the map.
Rate such businesses as Result is closed or does not exist.

Fixed schedule

Some entities, such as food trucks, move on fixed schedules. Their stops and schedule are usually
posted on their official webpage. The most accurate location for these entities is the address of their
longest stay over a full cycle of the given schedule (i.e. if a business has a weekly cycle and stays in
one spot for four days, that spot will be the only acceptable address for it). Mark any other address as
Incorrect – Other Issue. In cases of a tie, consider any of those locations Correct.

Fixed location

Businesses that operate out of a truck or bus that is stationary are evaluated like a standard business.
The vehicle does not need to be parked at the location after closing hours to be considered at a fixed
location.

8.1.4. Events

Some events can be very prominent but happen only a few days a year, others are regularly recurring.

IP
Regularly
Tu
esd recurring (weekly/monthly)
r o m o
f
Rate
17 events
2.1 y, Ja like weekly farmer’s markets like any other business.

a
2 0 23 licarp
o
6.2 nu
54 ary y 10, cy P
Annual Events
r n
.9
by 10, ua a
Na 202 , Jan by N
.9
nc 3 s day .254
Po fraomyear, such as Burning Man or the Sziget Festival,
Events that happeny once e
Tu 72.1 only
6 occur for a short
lica IP
time each year, but attractrpmassive amounts of people and media attention. 1 Users can be interested
o
in these kinds of events outside the time they are held.

103
If the query and location intent are clear, IP assign an appropriate relevance rating, otherwise rate Bad.
r o m
Treat seasonal stores (like Spirit2Halloween
0 3 f carpo store) and seasonally open POIs (like California’s Great
li
America theme park) the same 1 0, 2 way
y Po as annual events.
Tu
ry anc e
n
a
u yN 17 sday,
2.1 This
a , Ja 4.9 b an event may not have an official address.
Depending on its ylocation, 6.2 Jankind
ua
of event should be
es d
treated like aulandmark . 2 5 or natural feature.
54 r y
T 72.16 .9
by 10,
1 N an 2023
Singular or Non-Established Events
cy
Po from
lica IP
rpo
Non-recurring events from the past don’t carry any map significance and are rated Business/POI
closed or does not exist, unless the location of the event became a POI (due to its historical
importance) that carries the name of the event further.

8.2. Address Type Results

Address type results generally include:

• Street number, street name, postal code, locality and country (when outside of the test
locale).

8.2.1. Address Result

An address usually includes a street number, street name, locality, postal code and state/region. It
can be the same as the mailing address or other addresses provided by the official resources. Use
the chapter Address Formats, below, as well as your local knowledge, to identify the necessary
components and format.

• The address given has to be associated with a building or a plot of land officially assigned
that address.

• P.O. boxes are not valid addresses in the map context. Rate such addresses as Incorrect –
Other Issue.

If your research shows that the address does not exist, see Address Does Not Exist.

Address Mandatory components Explanation


13 Navarro Dr, Street Number, Street Name,
Sunnyvale, CA Street Type, Locality, State, Mandatory components may vary by
94087 Postal code country. Check your country specific
Museumplein 5, Street Name, Street Type, guidelines for a complete list.
1071DJ Amsterdam Street Number, Postal code,
Tu Locality IP
esd r o m o
f
17 ay,
2.1 2 0 23 licarp
J o
a
8.2.2.6.Address
25 nua Formats
y 10, cy P
4.9 ry r n
by 10, ua a
Various address Naformats
20 are used in different countries. The sequence and presentation
, Jan by N of the
ncy 23 f y .9
components is adapted Po torom sda 6.254comes before the
match the local needs. For example, the streetuenumber
street name in the United lica States T 72.1
rpo P but after it in Germany. See your Country1Specific Guidelines for
I
more information.

104
It might be impossible to confirm an address on official resources when another format is used. Rate
Can’t Verify if the address points to IP same location using an alternate format and there are no
the
r o m
missing or incorrect components.

0 2 3 f carpo
li
1 0, 2 y Po Tu
ry anc e
n
a
u yN 17 sday,
8.2.3. Street Result
a 2.1
a y, J 54.9
b 6.2 Janu
d
es 16.2 54 ary
.
Tu
Depending on the 7 2 . length of the street, different address components are 9expected.
by 10,
Na 202
1 ncy 3 f
ro
Mandatory components may vary per country. See your Country Specific guidelinesPofor licaa mcomplete
I
list.
rpo P

• Local roads: Local roads that stay within a certain locality or county should carry the
appropriate locality and state name.

• Highways/Interstates: Longer roads that travel between cities or even states don’t require a
locality or state component. If such components are present, they must be accurate.

U.S. Route 395 covers almost the entire distance from Canada to Mexico. It passes through four
states and connects countless towns, such as Big Pine, CA. Within that locality, it carries for a short
distance the name N Main St. The two results have different expectations regarding components.

There are several forms that are appropriate for the result
U.S. Route 395 because of its length:

• U.S. Route 395 or US 395

• U.S. Route 395, California

• US 395, Big Pine, California, United States

For the result N Main St, there is only one expected form
because the road is short and stays within the locality:

• N Main St, Big Pine, CA United States

8.2.4. Locality Result

A locality result can be a city, village, municipality or neighborhood. In the U.S. the result usually
includes the state it is part of.

Mandatory
Address Explanation
components IP
Tu o m o
esd f r
17 Sunnyvale,
a
2.1 y, Ja
CA Locality, State Mandatory components may vary per 2country. 0 23 licarp
o
6.2 nu
Amsterdam,
54 ary Check your country specific guidelinesy 10, cfor
yPa
r n
.9
by 10, Locality complete list. ua a
Netherlands Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

105
IP
o m
8.2.5.Postal Code Result
r
3 f carpo
0 2 li
Postal codes are returned 0, 2 ythe
when
1 Po user query matches the specificTu numbers or letters.

ry anc e
n
a
u yN 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 Mandatory 54 ary
Query
Tu 72.16 Address .9
by Explanation
10
1 components Na , 202
ncy 3 f
Sunnyvale, CA Locality, State, Postal Po rom
[94087] lica IP
Mandatory components
94087 code rpo may
vary per country. Check your
Museumplein, 1071 Country Specific guidelines for
[1071 DJ] DJ Amsterdam, Postal code, Locality a complete list.
Netherlands
8.2.6.State/Region/Territory Result

If the user makes the query from a country outside the state or region result, that result must be
accompanied by the country name.

Mandatory
Address Explanation
components
California State name
If the result is outside of the test locale, country
North-Holland Region name
name is a mandatory component.
Puerto Rico Territory name

8.2.7. Country Result

The country is the highest administrative level and has no other address component.

Mandatory
Address Explanation
components
Netherlands Country The country is the highest administrative level
Romania Country and has no other address components.

8.3. Features Without an Expected Address

There are several kinds of features where no address is expected by the user. This could mean no P
I
street
Tu name or number or, in some cases, no address components of any kind, are expected to obe
esd r m o
f
shown.
17 aThese
2.1 y, Ja types of results have different rating criteria when it comes to Address Accuracy.
2 0 23 licarp
o
6.2 nu
54 ary y 10, cy P
8.3.1. Natural
.9 Features
r n
by 10, ua a
Na 202 , Jan by N
ncy specific
3 y 54.9
dajungles,
Natural features are Po from landforms or ecosystems like rivers, mountains, s
u .16.2
e and other
geological features. They carhave T
IP names that can be rated, but typically do not
17 have a street address, so
l i 2
natural feature results should po be returned without any street address components. If a street address

106
is present, it is considered Incorrect – Other Issue, even when pointing to a building that is
associated with the feature (like a ranger IP station or visitor center).

r o m
0 2 3 f carpo
li address if it is appropriate for the size of the feature, as it can
• A locality may be an1acceptable 0, 2 y Po Tu
help locate a small c like a hot spring, within the locality.
ryfeature, e
n
a
u yN a n 17 sdaFor
y, J
larger features, such as a
a
mountain, ay, locality may not make sense and would be rated 1Incorrect2
J
a 254.9
b . 6.2 anu – Other Issue.

• The state s d the. feature is in can also be provided as the feature’s 54 aryand rated Correct.

address
T ue .16 .9
by 10,
• If a postal1 7 2 code is included, it must be correct
Na 202
• If a very large or expansive natural feature, like a river or mountain, spansnmore cy 3than
Po from one
country, any one of these countries can be a Correct address. If no country atliall carappears,
IP
this is also Correct.
po

Parks and other protected areas are artificial boundaries created to help protect the natural feature.
Those POIs are often named after the natural feature they contain. In cases where a feature can be
considered a POI, such as Mount Rushmore or a state park beach, the official address can be
returned. There might be other natural features within a park that reference the park name as part of
their address details.

Treat landmasses like islands and continents as natural features with no expectation of a street
address. If one is returned, rate it Incorrect – Other Issue.

Result Details Official Address Rating and Explanation


Wreck Beach
The beach can be confirmed as located within
No official address
Vancouver Vancouver and is therefore rated Correct.
The result contains the name of a street that
Wreck Beach

provides access to the beach. But the street is


NW Marine Dr, No official address
not expected and therefore rated Incorrect –
Vancouver
Other Issue.
The result contains the name of a street that is
Wreck Beach

nowhere near the beach. The street is not


W King Edward Ave, No official address
expected and therefore rated Incorrect – Other
Vancouver
Issue.
This glacier is located in the borough of Juneau.
Mendenhall Glacier
The postal code in the address is associated
No official address
Juneau, AK 99801 with that locality, therefore both components
should be considered Correct.
Mendenhall Glacier
The given address belongs to the overseeing
8510 Mendenhall Loop No official address Forest Office. The glacier should not have this
Rd,
Tu Juneau address and is rated Incorrect – Other Issue. IP
e r o m o
17 sday, f
0 23 licarp
2.1
6.2 Janu Mount Rushmore is both a mountain 0, y Poa
and
2
Mount 5Rushmore
13000 Highway 244
monument within its own national 1
4.9 ary r park.
y c The
10#31-1, Building 31, Suite 1
ua y Nan
13000 HWYby244 , address given on the official n
, Ja 4National Parks
N 20 9b
Keystone, SD ancy 23 fr Keystone, SD 57751 Service website confirms y
esd the
a .
.25 result address as
Po om Tu 72.16
lica IP Correct.
rpo 1

107
8.3.2. POIs Without an Expected Address

IP
o m
POIs without an expected address 3 f differ
r rpo from regular POIs and businesses in that the user would not
0 2 a
licbe
expect a street name and number 0 , 2
P oto shown.

1 cy Tu
y
r an e
a
u yN 17 sday,
These types of POIs ainclude,
n but are not limited to:
2.1
a y, J 54.9
b 6.2 Janu
d
es 16.2 54 ary
u .9
• Parks (Golf
T 7 2 . courses and theme parks not included)
by 10,
1 Na 202
• Monuments
ncy 3 f
• National Landmarks
Po rom
lica IP
• Park-like heritage sites
rpo
• Bridges

• Squares

• Parking lots

• Transit POIs - these can include airports (including airport terminals), ferry ports, subways,
bike share stations, train and bus stops

The rating criteria described in the sections below apply to all features without an expected address.

See Official Address Present if this kind of POI has an official address

8.3.2.1. Minimum Address Component

Whether there is an official street address or not, POIs without an expected address do not need to
show it. The locality must be returned whenever a POI is small enough to fit entirely within it. A POI
that covers an area overlapping several localities does not require a locality component.

See your Country Specific guidelines for more information on mandatory address components.

Result Official Address Rating and Explanation


Address Accuracy Correct

Tu IP
e r o m o
17 sday, Station
f
Quincy
2.1 220 S. Wells St, 2 23 licarp
This is a transit POI so no street address is0expected.
6.2 JIL
Chicago, an
u Chicago, IL 60606 The result address is just the locality. yThe 10, POI
o
y P is
54 ary r n c
.9
by 10, physically located within the givennulocality
a Na and it
a y
Na 202
ncy 3 f , J
4. 9 b address.
matches the one listed withinaythe official
Po rom esd .25
lica IP Tu 72.16
rpo 1

108
Result Official Address IP Rating and Explanation
r o m
0 2 3 f carpo Address Accuracy Correct
li
1 0, 2 y Po Tu
ry c esd
ua y Nan This is a heritage17site aso no street address is
Stonehenge
a n b 2.1 y, Ja
a y, J 54.9 None expected. The result 6.2 nu is just the locality.
address
Amesbury, Salisbury
es d .2 There is no official street 54 address
.9 ary 1 but since the POI is
Tu 72.16 by 0,
1 physically located only within Ngiven
an 20locality
23 it can be
considered correct. c y P ro f
oli m I
car P
po
Address Accuracy Correct

Tongariro National This is a park and heritage site POI so no street


Park
None address is expected. No locality is listed for this
New Zealand result. Since this POI covers an area that overlaps
several localities no locality component is required.

Address Accuracy Incorrect – Locality


351 N Union St, This is a park POI so no street address is expected.
Founders Park

Alexandria, VA No locality is listed for this result. Since this park fits
Virginia
22314 into only one locality, Alexandria, the missing locality
component must be considered incorrect.

8.3.2.2. Official Address Present

Official address is a full street address:

Some of these features have an official street address listed on their website or found on other official
sources, but users wouldn’t necessarily expect the address to be shown. Since a full address is not
expected, the result does not need to contain a full address even if there is one found via official
sources. Do not automatically consider any missing street address components as incorrect.

Full Address: When the result contains a full address it should be rated Correct if:

• The result and official addresses are identical

Street: When the result address is just a street it should be rated Correct if:

• The result address street is the same as the street within the official address

Consider the following examples for Embarcadero Station in San Francisco:

Tu IP
e r o m o
17 sdayResult Official Address Rating and Explanation 023 f carp
2.1 , Ja li
6.2 nu 10, 2 y Po
54 ary Address Accuracy Correct ry c
Embarcadero.9
by 10, n ua y Nan
Station
Na 202
ncy 3 f a y, Ja 4.9 b
298 Market St, San Po rom esd that
The result has a full address .25is the same as the
li Tu 72.16
Francisco, CA 94111 carp IP address listed on the official
1 website.
o

109
Result Official Address IP Rating and Explanation
r o m
0 2 3 f carpo
Address Accuracy Correct
Embarcadero li
1 0, 2 y Po Tu
Station
ry c
The result address e
n ua y Nan 17 issdjust
ay, a street. Since the street
Market St,
a 2
matches the street listed
16 Jwithin
.25 anua the official address it
b .
y, J 54.9
San Francisco,
es dCA
a
.2 should be considered correct.
4.9 ry
Tu 72.16 by 10,
1 Na 202
n 3 f Number
Address Accuracy Incorrectc–y PStreet
r
Embarcadero 298 Market St, San oli om I
car P
Station
Francisco, CA 94111
po
The result has a full address. The street number does
388 Market St, San not match the number listed within the official
Francisco, CA 94111 address and should be considered incorrect.

Embarcadero Address Accuracy Incorrect – Street Name


Station
The result address is just a street. The street is not
Davis St,
the same as the street listed within the official
San Francisco, CA address and should be considered incorrect.

Embarcadero Address Accuracy Incorrect – Locality


Station
The result has no address details at all. Locality is the
minimum component required for this kind of result
and should be rated Incorrect – Locality if missing.

Official address is a partial street address

When the result address is more specific than the official address it can be rated as Can’t Verify or
Incorrect, unless another official source can be found to confirm the returned address.

Full Address: When the result contains a full address it should be rated Can’t Verify if all of the
following apply:

• It does not belong to another POI/entity

• The street within the result address matches the street listed as the official address

If the full address belongs to another building not associated with the POI it should be rated
Incorrect.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

110
Consider St Nicholas’ Church in Berlin, Germany:

IP
r o m
0 2 3 f carpo
li
Result 1 0, 2 y PoAddress
Official Rating
Tu and Explanation
ry anc e
n
a
u yN 17 sday,
a
y, J 54.9
b Address Accuracy 2.16. Jan Can’t Verify
s d a 2 25 ua
e 16 . 4 .9 r y1
Tu 7Church

St. Nicholas’ 2 . The result POI is a landmark bychurch


0, and museum.
1 N 20
Nikolaikirchplatz 3,
The result has a full address. The
an street
cy 23 frnumber is
not associated with any other POI orPoentity o
10178 Berlin, lica m and
IP the
Germany street within the address matches the official
r p o street
address.
Address Accuracy Incorrect – Street Number
St. Nicholas’ Church
Nikolaikirchplatz
The result has a full address. The street number
Nikolaikirchplatz 5,
10178 Berlin, belongs to a building not associated with the POI and
10178 Berlin, Germany
should be considered incorrect. The street within the
Germany address matches the official street address.
Incorrect – Street Number,
Address Accuracy
St. Nicholas’ Church
Street Name
Poststraße 1,
The result has a full address. The street name does
10178 Berlin, not match the official street name, so both address
Germany components should be considered incorrect.

8.3.2.3. No Official Address

If no official street address is found, the result street address can be rated as Can’t Verify or
Incorrect unless another official source, like street imagery, can be found to confirm the returned
address. When there is no official address the returned street address cannot be confirmed and
therefore cannot be considered correct. (Please see your Country-Specific guideline for more
details.)

Full Address: If the full address belongs to another building not associated with the POI (even if they
are on the same street) it should be rated Incorrect. When the result contains a full address it should
be rated Can’t Verify if all of the following apply:

• It belongs to a building associated with the intended POI/entity

• The street provides access to the intended POI

Tu IP
Street:
esd When the result address is just a street it should be rated Can’t Verify if:
f r o m o
17• aThe
2.1 y, Jastreet provides access to the intended POI
2 0 23 licarp
o
6.2 nu
54 ary y 10, cy P
r n
Determining .9 Access:
by 10,
ua a
Na 202 , Jan by N
.9
ncy 3 f
r e s day .254
A person must be ableolto
P
ica reach
o m the POI directly from the given street byTwalking
u .1 or driving. This
6
includes:

I
rpo P 172
• Streets providing access by following the boundaries of the feature or leading into it.

111
• T-intersections:

• A street ending at an intersection IP does not provide access to the feature on the other
o m
side of it.
3 fr rpo
2 lica
20access
• A street provides 0 ,
1 cy P
o to a feature when it continues
Tu through the feature (even as a
different road y
type
r awith or without a different name) as esd as it keeps its original name on
a
u yN n 17long a
the other J n
a of
side b the feature, and by doing so provides 2.1 y, Jaaccess.

physical
ay , 4. 9 6.2 nu
• esd 16.25restrictions when considering whether a street provides
Ignoreuaccess 54 araccess
.9 y or not.

T 72. by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

Result Rating and Explanation


Address Accuracy Can’t Verify

Grosvenor Square Garden


The result address is the street in front of the result POI. Like the
Grosvenor Square,
example illustrated above, this street provides direct access to the
London
result POI.

Tu IP
e r o m o
17 sday, Address Accuracy Incorrect – Street Name f
2.1 2 0 23 licarp
6.2 JanuSquare Garden

Grosvenor 10,other
o
y P side.
54 ary The street ends in a T-intersection with the park on rthe
a Nay n c
N Audley .St.

9b
y N 10, 2 The street does not continue on the other sideJaasnuit bbecomes
y S
London
an 023 Audley St. and is therefore rated Incorrect. a y, 4. 9
cy
Po from esd .25
lica IP Tu 72.16
rpo 1

112
Result IP Rating and Explanation
m
3 fro rpo Accuracy
Address Incorrect – Street Name
, 2 0 olica
2
0 P Tu The street does not provide
ry 1 ncy The result address is just a street. ed
Charles de Gaulle Airport
a
u yN a 17 sshould
a
n direct access to the result POI and
2.1 y, Ja be considered Incorrect.
Rue A. Parreux,
y, Ja 4.9 b 6.2 nu
a
Mauregard uesd 16.25 54 ary
.9
T 72. by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
Address Accuracy rpo
Incorrect – Street Number
Charles de Gaulle Airport
The result has a full address. The street provides direct access
4 Rue de la Fossette,
however, the street number belongs to a building not associated
Mauregard with the result POI and should be considered Incorrect.

Address Accuracy Incorrect – Street Number, Street Name


Charles de Gaulle Airport
The result has a full address. The street does not provide direct
64 Rue de Claye,
access to the suggestion POI and the street number is associated
Mauregard with another entity. Both address components should be
considered Incorrect.
Address Accuracy Incorrect – Locality

Zurich Airport Since the airport is associated with a distinct locality “Kloten” it
requires at least a locality name and is rated Incorrect – Locality if
this is missing.

9. Pin Accuracy

For each result returned, you will find a pin on the map. Rate the accuracy of each pin’s placement
using this scale:

• Perfect

• Approximate

• Next Door

• Wrong

• Can’t Verify

The pin should be a reflection of the result: The location represented by the pin should reflect the
result.
Tu Pin ratings should be evaluated individually and not influenced by address or other data.oA m pin
IP
can e r
17 besdacorrect when other rating components are rated wrong.

2 3 f carpo
2.1 y, Ja 0 li
6.2 nu 10, 2 y Po
5 ry c
.9 ary 1
Missing4Pins
ua y Nan
by 0, n
Na 202
ncy 3 f a y, Ja 4.9 b
If a pin for a result does
Po rnot
o appear on a map, rate the pin Wrong. If this esd .25 five or more
happens
lica m IP Tu 72.16
times in a row, release the rpotask for technical reasons and explain why in the
1 comments box.

113
9.1. General Considerations
IP
r o m
0 2 3 f carpo
The following chapters will provide li
1 0, 2 y Po more detail on how to evaluate
Tu pin placement based on the
feature presented. They c
uadescribe
y
r an issues to consider when evaluating esd the pin.

N 1 a
J a n b y 7 2.1 y, Ja
ay , 4. 9 6.2 nu
9.1.1. Pin Resources

esd 16.25 54 ary


.9
u
T 72. by 10,
1 Na 202
Rate pin placement according to consensus from multiple reliable online resources. ncy These
3 resources
should include both aerial and street-level views whenever possible. Reliable resources Po frinclude:
om

lica IP
rpo
• Reliable online map resources, including vector and hybrid views

• Hybrid views may provide additional points of reference including the locations of
streets

• Street imagery

• Accurate street-level imagery can also be found on claimed social media sites,
crowdsourced user review sites, and articles in primary publications (newspapers or similar
publications that do their own reporting)

• Official venue maps and directories, which can contain information not available in street
imagery

• Government property registries

Note: After consulting these research resources, always verify pin placement using the layers
provided in the TryRating tool. This means that even if you have gathered coordinates elsewhere, you
must rate pin placement based on what you can actually see in the TryRating layers.

Leave comments including coordinates and links to resources if the pin rating was difficult to
determine or if you could not verify the pin’s placement.

9.1.2. Satellite Imagery vs. Vector Map

When there is a difference between where the pin drops in satellite imagery and the vector map,
always use the map layer in the TryRating tool that is more generous toward the pin. For example, if
the pin drops on the rooftop in satellite imagery, but in the parking lot in vector map, rate using
satellite imagery because a pin on a rooftop will get a better rating than a pin placed in a parking lot.
Even if there is a major shift between satellite imagery and the vector map in a larger area, such as a
complete city or region, rate according to the most generous layer.

Note: When deciding between the generosity of the vector and satellite views for pin rating, use only
the vector/satellite views provided in the TryRating tool.

InTcases IP
ues where the vector map is more generous toward the pin but does not show any building r o m o
contours,
17 day, use satellite imagery as a reference to locate buildings on the vector map to allow 23forlicarp
f
2 2 0
rooftop
. 16 ratings.
.2 anua If satellite imagery is unavailable, use your best judgment to determine
J
10the
, correcto
c yP
location 5of 4.9the rpin.
y
ua
r y
a n
by 10, an by N
Na 202 , J 9
In the screenshotnbelow,cy 3 frthe vector map does not provide any contours, so
e s 2 54.
ditayis .difficult to determine
Po om T u .1 6
where each building is. Satellite
l i car IP imagery should be used instead.
17 2
po

114
IP
Vector Image from po Satellite Image
r
, 2 023 olica
10 P Tu
ry ancy e
u a 17 sday,
an by N 2.1
, J
ay 254.9 6.2 Janu
es d . 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

9.1.3. Boundaries of the Feature

To rate a pin for a feature, you must first understand where the feature begins and ends. Some
features have rooftops (houses, businesses, malls, and so on) and sit on a parcel of land that belongs
to or is associated with them. Other features do not have rooftops (mountains, parks, waterfalls), but
there is still a place where they begin and where they end.

A boundary is a real or imaginary line that separates one feature, or the parcel it sits on, from another.
The boundaries of a feature always include half of the road when a road is present (see the Half 'n
Half rule below).

Boundaries can include:

• Fences

• Walls

• Garden plants and bushes

• Bodies of water (lakes, rivers, oceans)

• Other dividers

• Property boundaries confirmed by official sources

If there is no divider, draw an imaginary 90-degree line to the road or use the Half 'n Half rule below.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

115
Example IP Explanation
o m
r po
EXAMPLE TYPE: SINGLE RESIDENTIAL 0 2 3 f carPROPERTY
li
1 0, 2 y Po Tu
1556 Tobias Dr
ary Nanc e
San Jose, CA 95118 n u 17 sday,
a by 2.1
6.2 Janu
d a y, J 54.9
es .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
The property boundary is defined Po byrohalf of the
lica m IP
road on one side and physical dividers rpo like brick,
concrete, and wooden fences on the others.

EXAMPLE TYPE: SHOPPING CENTER

2086 NewPark Mall

Newark, CA 94560

The property boundary is defined by the roads


surrounding the shared parking lot.

9.1.3.1. Half ’n Half and Tennis Rules

In dense areas it may be difficult to find boundaries between parcels. In these cases, divide the space
between the street or next building in half to create a boundary. Use this "Half 'n Half" rule to
determine the Approximate and Next Door pin locations.

Tu IP
esd r o m o
f
17 ay,
2.1 2 0 23 licarp
J o
6.2 anu
54 ary y 10, cy P
r n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

116
Example IP Explanation
o m
r rpo
EXAMPLE TYPE: HALF ’N HALF0TO 2 3 f STREET
ca
0 , 2
P oli Tu
1 y
u ary Nanc e
17 sday,
y , Jan .9 by 2.1
6.2 Janu
a 4
esd .25 54 ary
.9
Tu 72.16 by 10,
1 Na 202
ncy 3 f
P rom
Extend the feature boundaries toolthe
ica middle
I of
r o P
the road(s). The example shows howpWill Rogers
Dr (to the south) and Saratoga Ave (to the east)
are divided in half to define the outer limits of the
Approximate area.

EXAMPLE TYPE: HALF ’N HALF TO NEXT BUILDING

The space between two buildings can be divided


in half to create a boundary for an Approximate
pin placement.

Use natural boundaries as much as possible to draw the line between a Perfect, Approximate,
Next Door, and Wrong pin locations.

To address close calls, apply the Tennis Rule:

•If the tip of the pin is still touching the line, the pin is considered inside the
boundary.
IP
Tu •If the tip of the pin points outside, it is outside of the boundary.
from po
esd
17 ay, 3 ar
2.1
6.2 Janu 0, 202 olic
1 P
54 ary
.9 a ry ancy
by 10, u N
Na 202 y, Jan .9 by
ncy 3 f a 4
Po rom u esd 16.25
lica IP T 72.
rpo 1

117
9.1.3.2. Boundaries in Shared Spaces

IP
o m
r rpo
When a feature shares a parcel02or 3 fparking
ca lot with other entities and the same space is used to
access many entities, it can10be P oli to determine a feature’s boundaries.
, 2 difficult Tu In cases like this:

a ry ancy esd
u yN 17 ay,
• Use the guidance an bprovided in Boundaries of the Feature
2.1
a , J
y 54. 9 6.2 Janu
d .2parcel contains any through roads, apply the Half ’n54Half
• If the shared
es
Tu 72.16 .9 arule
ry to them:

by 10,
• Through
1 roads are part of the public road network that can be usedNto an go20to places other
23
than the specific parcel
c y P fro
oli m I
• The Half n‘ Half Rule may also be applied to the parcel’s internal access roads car ifPthey
meet all three of these conditions:
po
• They must continue all the way through the parcel and

• They must have an exit and entrance to public roads at both ends and

• They must be continuously and clearly separated from the shared parking areas by
curbs, barriers, road markings, do not cross lines, or similar features

Note: If all three of the conditions above do not apply, then an internal access road cannot be
considered a boundary.

Example Explanation
EXAMPLE TYPE: BOUNDARIES OF AN ENTIRE CAMPUS

Stanford Shopping Center

This is the Stanford Shopping Center, a campus


containing multiple buildings and POIs. When
this shopping center is the result, the entire
parcel is Perfect. This includes all buildings,
parking lots, and parking structures on both the
north and south sections of the mall on either of
side Arboretum Rd, the public road that cuts
through the parcel.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

118
Example IP Explanation
o m
EXAMPLE TYPE: BOUNDARIES OF fr POI
3A rpoIN A SHARED SPACE WITH THROUGH ROADS
0 2 i c a
2 ol
y 10, cy P Tu
esd
Nordstrom @ StanforduShopping
ar Nan Center 1 a
J a n b y 7 2.1 y, Ja
ay , 4. 9 6.2 nu
u esd 16.25 54 ary
.9
T 72. by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

The Nordstrom department store is located in


the south section of the shopping center’s
parcel.

When Nordstrom (shown in green) is the result,


only the south part of the mall up to 1/2 of
Arboretum Road is rated Approximate (shown
in yellow). This is because Arboretum Road is a
public road that can be used to access places
outside the parcel. The north side of the parcel
(shown in red) is rated Wrong since the public
road acts as boundary to Nordstrom’s
Approximate area.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

119
Example IP Explanation
o m
EXAMPLE TYPE: BOUNDARIES OF fr POI
3A rpoIN A SHARED SPACE WITH NO THROUGH ROADS
0 2 i c a
2 ol
Pho 2 Love
y 10, cy P Tu
e
r an
a
6593 W Colfax Ave
Janu by N 17 sday,
2.1
Lakewood, CO 80214
a y, 54.9 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

Pho 2 Love is a Vietnamese restaurant in a strip


mall with shared parking that has no public or
internal access roads passing through it. The
entire shared parcel is rated Approximate
(yellow area) and only the section of the rooftop
over the restaurant is rated Perfect (green
area). This is because the exact location of the
business can be confirmed with street imagery
or other strong evidence.

9.1.4. Next Door

A pin is considered Next Door if it drops on the immediate property next to the intended one. A Next
Door pin must be:

• On the same street as the intended property

• The Next Door property must share the same street name as the intended property

• On the same side of the street as the intended property

• The first property to any side of the intended property

Tu• On the same block as the intended property


o
IP
m o
esd f r
17 ay, 23 licarp
"Immediate
2.1 J property" refers to the boundaries of the property as a whole, even if there is 2no
0 rooftop.
o
6.2 anu
Determine 54 thearboundaries as explained in Boundaries of the Feature.
y 10, cy P
r n
.9 y
by 10, ua a
Na 202 , J an by N
9
Note that the Half nc’n
y PHalf
3 f rule explained in Section 9.1.3.1 also applies to Next
rom e s day Door
. 2 54. properties

oli Tu 72.1 6
car IP 1
po

120
No Next Door for Shared Spaces
IP
m
3 fro rpo
A feature cannot be Next Door 202 to another
ca feature within the same property boundaries. This
0 , P oli
means that two buildingsy 1in the y same shared parking lot or parcel
Tu can never be rated as Next
r anc e
Door to one another.
n
a
u yN 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
d
es 16no .2 Next Door ratings made outside the parcel or shared 54 ary
There will also
Tu 7be . .9 space.
by 10, Any pin falling
2 Na 202
outside of the1 Approximate area will be marked Wrong.
ncy 3 f
Po rom
lica IP

rpo

9.1.5. Can’t Verify (Smallest Identified Area)

When a specific rooftop or boundary cannot be identified, Perfect cannot be given. In these cases,
Can’t Verify can be used if the pin is within the smallest area that can be identified as a potentially
correct location. A pin outside of this area is considered Wrong.

The Can’t Verify rating will also be used when an address is rated Incorrect (Address does not
exist).

Example Explanation
920 Remour Ln

Mount Shasta, CA 96067

There is no street imagery in the area, so the


exact location of 920 Remour Ln cannot be
determined, though its existence is confirmed
by the postal service. Remour Ln is a dead-end
street, and satellite imagery allows us to confirm
the location of the the last properties on the
street. The last building number that can be
confirmed is 912. We can now create a
Tu perimeter within which the pin should be m IP
e
17 sday, dropped (teal area).
3 fro rpo
2 a
2.1
6.2 Janu 0, 20 olic
1 cy P
54 ary Can’t Verify -> All pins dropped ary within
n the teal
.9 u Na
by 10, n y
Na 202 area
a
J .9 b
ncy 3 f
Wrong -> All pins dropped ay, 2outside
4 the teal area

Po rom u e 16. 5
s d
lica IP T 72.
rpo 1

121
Example IP Explanation
o m
350 352 Bukit Batok Street 34
23 fr arpo
Singapore, 650352 0 lic
1 0, 2 y Po Tu
ry c e
ua y Nan 17 sdaimagery
There is satellite for this area, but
a n b 2.1 y, Ja
d a y, J 54.9 6
clouds cover the the. 25 exact
n u location of the
es .2 4.9 ary
Tu 72.16 address. Using evidence by from
10 other reliable
,2
1 resources, a perimeter for Nawhere
ncy 023the
fro
pin should
be dropped can be establishedPo(teal m
lica IParea).

rpo
Can’t Verify -> All pins dropped within the teal
area

Wrong -> All pins dropped outside the teal area

9.2. Single Rooftop

Rating Explanation
Perfect Pin falls on the rooftop of the intended property.

Approximate Pin falls within the boundaries of the property, including on any rooftop that’s not
the intended one.
Next Door Pin falls on the next door property.
Pin falls outside of the property boundaries or next door property. Any pin falling
Wrong
outside of the Approximate area in a shared space will be rated Wrong.

Can't
Tu Verify See Can’t Verify IP
esd r o m o
f
17 ay,
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

122
IP
Best Available Evidence
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tubest available evidence for that
Pin rating for most features a ry afound
n c under rooftops is based on the esd
feature's location. That u is,y N
the more evidence that can be found1to ay, a feature’s location, the
J a n b 7 2.verify
1 Ja
,
ypin’s 9
. location must be in order to be rated Perfect.6.(This nu
more precise the d a 5 4 2 54.9 isartrue whether or not the
u es 16.2 y
feature's address
T 72. includes a unit number because the goal is to find the location by 10,of the feature.)

1 Na 202
ncy 3 f
If street imagery or other strong evidence can be found to confirm a feature’s specific ro
Po location
lica m IP
under a shared rooftop, only that location will be considered Perfect.
rpo

If a shared rooftop can be identified but there’s no strong evidence to confirm the feature’s specific
location under it, the entire rooftop will be considered Perfect.

If several rooftops share an address and there’s no strong evidence to confirm which rooftop the
feature is under, all rooftops will be considered Can’t Verify.

Note: This general pin rating rule does not apply to transit POIs, which have their own pin rating
rules.

Example Explanation

EXAMPLE TYPE: INDIVIDUAL HOME


5507 Dent Ave

San Jose, CA 95118

Perfect -> The pin is on the rooftop specified in


the query address (green area)

Approximate -> The pin is within the boundaries


of the feature (yellow area)

Next Door -> The pin is on the immediate property


next to the intended feature (purple area)

Tu Wrong -> The pin falls outside of the property IP


m
e
17 sday, boundaries or Next Door property (everything 3 fro rpo
2 a
2.1
6.2 Janu else)
0 , 20 olic
P
54 ary
.9 Can’t Verify -> See Can’t Verify ary 1 ancy
by 10,
u
an by N
Na 202 , J .9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

123
Example IP Explanation
m
fro rpo
EXAMPLE TYPE: MULTIPLE STREET 3 UNDER ONE ROOFTOP WITHOUT SHARED PARKING
0 , 20 olNUMBERS
2 ica
1 P Tu
a ry ancy esd
Breitensteinstrasse a77, n u 8037y N Zurich 1 7 a
2.1 y, Ja
, J 9 b 6.2 nu
ay 4.
u esd 16.25 54 ary
.9
Available resources
T 7 2 . can have a big impact on rating when a pin is droppedbon y N a10rooftop
, with multiple
1
street numbers under it.
an 2023
cy
Po from
This result is a residential townhouse without shared parking.
lica IP
rpo
Note that the same rating principles apply to buildings with patchwork rooftops.

Using street imagery or other strong evidence, four


entrances for the street numbers can be identified:
75, 77, 79 and 81. Once the rooftop area where the
pin should be dropped is determined, draw
imaginary lines to delimitate that area. A pin
With evidence
dropped within that area will be rated Perfect. A
pin dropped within the property boundaries of the
perfect rooftop will be rated Approximate. The
rest of the connected rooftop with the appropriate
property boundaries will be rated Next Door
(purple area) or Wrong (red area) if the
corresponding rooftop portion is farther than the
Next Door property.

Perfect -> The pin is on correct portion of the


rooftop (green area)

Approximate -> The pin is within the boundaries


of the feature (yellow area)

Next Door -> The pin is on the immediate property



next to the intended feature (purple area)

Wrong -> The pin falls outside of the property


boundaries or Next Door property. (everything else)

Can’t Verify -> See Can’t Verify

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

124
Example IP Explanation
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

Without street imagery or other strong evidence,


research may indicate that the address range under
the rooftop is 75 to 81, but the locations where the
middle numbers 77 and 79 start and end cannot be
determined. In this case, a pin falling anywhere on
Without evidence
the correct rooftop will be rated as Perfect, even if
the precise location on the rooftop for #77 cannot
be determined. A pin falling within the property
boundaries will be considered Approximate and
the buildings to the right and to the left will be
considered Next Door.

Perfect -> The pin is on the rooftop (green area)

Approximate -> The pin is within the boundaries


of the feature (yellow area)


Next Door -> The pin is on the immediate property
next to the intended feature (purple area)

Wrong -> The pin falls outside of the property


boundaries or Next Door property (everything
else)

Can’t Verify -> See Can’t Verify

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

125
Example IP Explanation
m
ro rpo
EXAMPLE TYPE: ONE BUILDING02WITH 3 f caMULTIPLE STREET NUMBERS IN A SHARED PARKING LOT
0 , 2
P oli Tu
1
Supercuts
ry ancy e
n
a
u yN 17 sday,
2.1
a , Ja 4.9 b
1054 E El CaminoyReal
6.2 Janu
Sunnyvale, CA es94087
d .2 5 54 ary
.9
Tu 72.16 by 10,
The result is a1 business (or an address) under a connected rooftop with multiple 2
Na street
ncy 023 f numbers
under it. This result shares a parking lot with other features.
Po rom
lica IP
rpo
Note: If there are any other buildings within the shared parking lot that are not connected to the
Perfect location, they will also be rated Approximate.

This guidance also applies to residential buildings with shared rooftops, like townhouses.
With evidence

With street imagery or other strong evidence, the


exact location of the business (or address) can be
confirmed. Draw imaginary lines on that part of the
shared rooftop to create the area for Perfect. The
rest of the connected rooftop and the shared
parking lot are rated Approximate.

Remember: Make no Next Door ratings outside


the parcel or shared space. Any pin falling outside of
the Approximate area in a shared space will be
rated Wrong.

Without evidence

Without street imagery or other strong evidence,


only the location of the entire rooftop under which
the business (or address) is located can be
determined. The business’ exact location under the
rooftop cannot be determined. In this situation, the
whole rooftop becomes Perfect. The shared
parking lot will be Approximate.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

126
Example IP Explanation
m
ro rpo
EXAMPLE TYPE: ONE BUILDING02WITH 3 f caA SINGLE STREET NUMBER AND MULTIPLE UNIT NUMBERS IN A
, 2 oli
SHARED PARKING LOT y 1 0 P Tu
r ancy e
n
a
u yN 17 sday,
a 2.1
Subway
a y, J 54.9
b 6.2 Janu
1923 59th Ave d
es#155
.2 54 ary
Tu 72.16 .9
by 10,
Greeley, CO 80634
1 Na 202
ncy 3 f
The result is a business (or an address) under a rooftop that has a single street number, Po romultiple
lica m IP
unit numbers, and shares a parking lot with other features. It will be rated exactly the same rpo way as a
result whose address does not include a unit number. Whether a result contains a unit number or
not, the goal is to use the best available evidence to find the result’s location.

Note: If there are any other buildings within the shared parking lot that are not connected to the
Perfect location, they will also be rated Approximate.

This guidance also applies to residential buildings with shared rooftops, like townhouses.
With evidence

With street imagery or other strong evidence, the


exact location of the business (or address) can be
confirmed. Draw imaginary lines on that part of the
shared rooftop to create the area for Perfect. The
rest of the connected rooftop and the shared
parking lot are rated Approximate.

Without evidence

Without street imagery or other strong evidence,


only the location of the entire rooftop under which
the business (or address) is located can be
determined. The business’ exact location under the
rooftop cannot be determined. In this situation, the
whole rooftop becomes Perfect. The shared IP
Tu m o
e parking lot will be Approximate.
f r o
17 sday, 0 23 licarp
2.1 2
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

127
Example IP Explanation
m
EXAMPLE TYPE: MULTIPLE ROOFTOPS 3 fro rpWITH o THE SAME STREET NUMBER AND MULTIPLE UNIT
0 2 l i c a
NUMBERS , 2 o
10 P Tu
a ry ancy esd
u N 1 a
Samurai Sam’s
J a n b y 7 2.1 y, Ja
,
y 5Suite . 9 6.2 nu
4801 Washington sda 6St, 2 4 5
54 ary
u e . .9
Phoenix, AZT 85034 2 . 1 by 10,
1 7 Na 202
ncy 3 f
The result is a business (or an address) under a rooftop that's one of several rooftops Po sharing
ro a
lica m IP
single street number and containing multiple unit numbers. All the buildings share a parking rpo lot.
(The small rectangles on the bottom right are solar parking covers, not buildings.)

This guidance also applies to residential buildings with shared rooftops, like townhouses.

With evidence for rooftop and unit With street imagery or other strong evidence for
locations
the location of the rooftop and the unit under it, the
exact location of the business (or address) can be
confirmed. Draw imaginary lines on that part of the
shared rooftop to create the area for Perfect. The
rest of the connected rooftop and the shared
parking lot are rated Approximate.

Note: If there are any other buildings within the


shared parking lot that are not connected to the
Perfect location, they will also be rated
Approximate.

When there is street imagery or other strong


With evidence for rooftop location only
evidence for the location of the specific rooftop at
the address where the unit is, but no evidence for
the location of the unit under it, only the location of
the entire rooftop can be confirmed. In cases like
this, the entire rooftop will be Perfect. The shared
parking lot will be Approximate.

Note: If there are any other buildings within the


shared parking lot that are not connected to the
Perfect location, they will also be rated
Approximate.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

128
Example IP Explanation
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry anc or unit e
Without evidence for n ua rooftop
N 17 sday,
locations, but with , . 9 by
Ja evidence for parcel

2.1
6.2 Janu
d y
a 254
es . 54 ary
Tu 72.16 .9
by 10,
1 Na 202
When there is no strong evidence ncy for
3 the location
Po from
of the rooftop or the specific unit under
lica it,Ibut
P there
r
is evidence for the location of the parcel,oall
p
rooftops within the parcel will be rated Can't Verify
and the parcel will be rated Approximate.

EXAMPLE TYPE: ONE BUILDING WITH SINGLE STREET NUMBER AND MULTIPLE BUSINESSES UNDER
THE ROOFTOP

Circle K

925 Wonderland Rd South

London, Ontario, Canada N6K 2V8

The result is a business under a single rooftop that has one street number and contains multiple
business.

A nail salon, a pharmacy, a dental office, and other businesses all share this address.

With evidence

With street imagery or other strong evidence, the


exact location of the result under the shared rooftop
can be confirmed. Draw imaginary lines on that part
of the shared rooftop to create the area for Perfect.
The rest of the connected rooftop and parcel, IP
Tu m o
e including all other rooftops that are not the intended r o
17 sday, 3 f rp
2.1 one on the parcel, if they exist, are rated, 202 olica
6.2 Janu 10 cy P
54 ary Approximate.
r y
.9
by 10, n ua y Nan
Na 202 Ja b
ncy 3 f s d ay, 254.9
Po rom e .
lica IP Tu 72.16
rpo 1

129
Example IP Explanation
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

Without evidence

Without street imagery or other strong evidence,


only the location of the entire rooftop under which
the business is located can be determined. The
business’ exact location under the rooftop cannot
be determined. In this situation, the whole rooftop
becomes Perfect. The parcel will be Approximate.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

130
Example IP Explanation
m
fro rpo
EXAMPLE TYPE: SHOPPING MALL 3
0 , 20 oWITH
2 lica A SINGLE ROOFTOP
P Tu
ry 1 ncy esd
Westfield Valley Fair
nu a N a 1 a
2855 Stevens Creek J aBlvd

b y 7 2.1 y, Ja
,
ay 254. 9 6.2 nu
esd 95050
Santa Clara,uCA 6 . 54 ary
.9
T 72.1 by 10,
1 Na 202
This large shopping mall contains many stores under one rooftop at the same address.ncy 3 f
Po rom
lica IP
rpo

Perfect -> The pin is on the rooftop (green area)

Approximate -> Parking structures (entire


structure included). Approximate boundaries are
found when Half 'n Half rule is applied to the street
and parking lots are included (yellow area)

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

131
Example IP Explanation
o m
r rpo
EXAMPLE TYPE: STORE IN A MULTI 0 2 3 f -STORY
ca MALL
0 , 2
P oli Tu
1 y
H&M
u ary Nanc e
17 sday,
1004 Stoneridge yMall
, JanRd y
.9 bSuite A 105

2.1
6.2 Janu
d a 5 4 54 ary
Pleasanton, u
CAes 94588.2 .9
T 72.16 by 10,
With evidence
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

The exact location of this POI cannot be determined


by using street imagery, but the official mall
directory provides strong evidence for the H&M's
location. Using this evidence, the exact location of
the result under the shared rooftop can be
confirmed. Draw imaginary lines on that part of the
shared rooftop to create the area for Perfect. The
rest of the connected rooftop and parcel are rated
Approximate.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

132
Example IP Explanation
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

Without evidence

Without street imagery or other strong evidence,


only the location of the entire rooftop under which
the business is located can be determined. The
business’ exact location under the rooftop cannot
be determined. In this situation, the whole rooftop
becomes Perfect. The parcel will be Approximate.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

133
Example IP Explanation
m
fro po
EXAMPLE TYPE: EMPTY PLOT 023 licar
2 o
y 10, cy P Tu
e
r n
86 Liberty St.
n
a
u yN a 17 sday,
Binghamton, NY y, Ja .9 b 2.1
a 4 6.2 Janu
d 5 5 ary
ues .do
All featuresTthat 6.2not have a rooftop will be rated as Perfect if the pin4.is
9 bdropped
1 72
1 y N 10, 2 within the
boundaries of the feature. an 023
cy
Po from
lica IP
rpo

Perfect -> The pin is within the boundaries of the


feature (green area)

Approximate -> There is no Approximate

Next Door -> The pin is on the immediate property


next to the intended feature (purple area)

Wrong -> The pin falls outside of the property


boundaries or Next Door property (everything else)

Can’t Verify -> See Can’t Verify

EXAMPLE TYPE: HIGH-DENSITY URBAN AREA

57 Neal Street

London, England
IP
InTuthis
esd example, the rooftop behind the intended feature will not be considered Next Door. Next f r o m o
Door
17 will
2.1 y, Jbe
a considered to the left or right of the intended feature.
2 0 23 licarp
o
6.2 anu
54 ary y 10, cy P
r n
.9
The screenshot by 1shows that the boundaries of the Next Door property contain half ua y the
Na street. The
N
0,
2 Jan of b
building behindathency Perfect
02
3f building is not considered Next Door because aity has4.a9 different street
,
d 5
address. P ro
oli m I T ues .16.2
car P 17 2
po

134
Example IP Explanation
r o m
0 2 3 f carpo
li
1 0, 2 y Po Perfect -> TheTpin is on the rooftop specified in
ue
ry c the address (green
n ua y Nan 17 sdarea)

ay
a
y, J 54.9
b Approximate ->2.The 16 ,pin
J is within the boundaries
a .25 anua
es d .2 of the feature (yellow area)

4.9 ry
Tu 72.16 Next Door -> The pin is on
10
by the
1 Na immediate
,2
0 property
n cy 23area)

next to the intended feature (purple f


Po rom
Wrong -> The pin falls outside of the licaproperty
I
rpo P
boundaries or Next Door property (everything
else)

Can’t Verify -> See Can’t Verify

EXAMPLE TYPE: CORNER HOUSE

44 Russel Square

London, England

Here there is only one property that qualifies as Next Door. The property marked in red is on
another street (Montague Street) and does not meet all the criteria for the rating of Next Door.

When a property is on a corner, the Next Door property can be behind it as long as that property
shares the same street name.

Perfect -> The pin is on the rooftop specified in


the address(green area)

Approximate -> The pin is within the boundaries


of the feature (yellow area)

Next Door -> The pin is on the immediate property


next to the intended feature (purple area)

Wrong -> The pin falls outside of the property


Tu boundaries or Next Door property (everything IP
m
e
17 sday,
else)
3 fro rpo
2 a
2.1
6.2 Janu Can’t Verify -> See Can’t Verify
0, 20 olic
1 y P
44 Russel 54 Square,
.9 ary 1 London, England
ary Nanc
by u
0
Na , 202 y, Jan .9 by
ncy 3 f a 4
Po rom u esd 16.25
lica IP T 72.
rpo 1

135
Example IP Explanation
ro om
EXAMPLE TYPE: RURAL AREA 23 f carp
0 li
1 0, 2 y Po Tu
100 Mulligan Rd
ry anc e
Laytonville CA n
a
u yN 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
d
es 16.2 54 ary
In rural areas,
Tu the Next Door property will often be quite large. This is .9
expected.
7 2 . by 10,
1 Na 202
ncy 3 f
Po rom
Perfect -> The pin is on the rooftop lispecified
car IP in
the address (green area)
po
Approximate -> The pin is within the boundaries
of the feature (yellow area)

Next Door -> The pin is on the immediate property


next to the intended feature (purple area)


Wrong -> The pin falls outside of the property
boundaries or Next Door property (everything
else)

Can’t Verify -> See Can’t Verify

EXAMPLE TYPE: PIN ON THE SAME BLOCK

1491 Kooser Rd

San Jose, CA 95118

This property has only one next door neighbor because the property to the left, in red, is not on the
same block as the intended property.

Perfect -> The pin is on the rooftop specified in


the address (green area)

Approximate -> The pin is within the boundaries


of the feature (yellow area)

Next Door -> The pin is on the immediate property


next to the intended feature (purple area)

Wrong -> The pin falls outside of the property


boundaries or Next Door property


Can’t Verify -> See Can’t Verify

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

136
9.2.1. Leaning Buildings
IP
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c ed
Normal ua y Nan
Building 17 sBuilding
Leaning a
a n b 2.1 y, Ja
d a y, J 54.9 6.2 nu
es .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

Sometimes a building or buildings seem to be leaning in satellite view. They do not


appear to be standing straight and their rooftops are not aligned with their bases.

When a building or buildings appear to be leaning in satellite view, the satellite photos do not always
give accurate information about their shape or location. This is why even when a pin appears to land
on a leaning building, you cannot rely on satellite photos alone to rate pin placement.

Research the leaning building’s true location using consensus from multiple reliable resources,
including:

• Vector views

• Hybrid views, which may provide additional points of reference, including the locations of
streets the buildings lean over

• Street imagery

• Reliable online map resources

Always rate the pin based on the building’s actual location as confirmed by reliable resources, not on
the appearance of leaning caused by satellite photography.

If no reliable resources are available and the pin is not objectively wrong, rate Can’t Verify and leave
a comment.

Rating Explanation
Tu IP
esd r o m o
Pin falls on the building’s actual location as confirmed by consensus f
Perfect
17 ay,
2.1 0 23 licarp
J among multiple reliable sources. 2 o
6.2 anu
54 ary y 10, cy P
.9 a r n
by 1Pin nu by Na
Na , 2falls within the boundaries of the property including on anyJarooftop
0
Approximate ,
ncy 023not
that’s the intended one. s day .254
.9
Po from e
Tu 72.1 6
lica IP
Next Door See Next rpDoor.
o
1

137
Wrong Pin falls outside of theIPproperty boundaries or next door property.
m
3 fro rpo
a
, 202 olic
Can't Verify See Can’t 1Verify.
0 P Tu
ry ancy e
n
a
u yN 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
d 54 ary
ues .16.2 View

TSatellite Vector View


.9
by 10,
1 7 2 Na 202
Langham Tower and Jollibee Langham Tower and Jollibee ncy 3 f
Po rom
lica IP
rpo

The tallest building seen in satellite view, above left, is Langham Place Office Tower,
located at the corner of Argyle and and Portland streets in Hong Kong.

While in satellite view the building appears to lean over both Argyle and Portland
streets, the vector view, above right, shows the building’s actual location.

The fast food restaurant Jollibee, circled in red on vector diagram, above right, is
located at 16 Argyle Street. It cannot be seen in satellite view because the tower leans
over it.

Target Screenshot Pin Rating


Location
Research shows that the pin lands
across the street from the building’s
actual location (green area), making
it Wrong.

Langham IP
Tu Office
Place o m o
e f r
17 sday,
Tower 0 23 licarp
2.1 2
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

138
Target ScreenshotIP Pin Rating
Location m
fro rpo
3 a
0 , 202 olic Research shows that the pin lands
1 P Tu
ary Nanc
y off the building’s
esdrooftop (green
u area), but on1its ay
72 property,
y , Jan .9 by .16 , Jan making it
a 4 Approximate.
.254 uar
esd .25 .9 y
Tu 72.16 by 10,
1 Na 202
Langham ncy 3 f
Place Office Po rom
lica IP
Tower rpo

Although this pin appears to land


on Langham Place Office Tower in
the satellite photo, research shows
that the pin actually lands across
Jollibee,
the street from the Tower on the
16 Argyle
rooftop of the Jollibee at 16 Argyle
Street,
Street (green area), making it
Mong Kok, Perfect.

Kowloon,
Hong Kong Note that while Jollibee cannot be
seen in satellite view, its location
can be confirmed by reliable
resources.

9.2.2. Residential Property with Multiple Buildings

Some residential properties consist of more than one building associated with a single address. A pin
falling on any house(s) on the property will be rated Perfect. If the evidence shows that any other
structure on the property could also be a dwelling, it can also be rated Perfect.

In cases where the property also contains support or auxiliary buildings, including, but not limited to,
sheds, garages, greenhouses, playhouses, pergolas, and doghouses, these structures should be
considered
Tu part of the Approximate area.
IP
esd r o m o
f
17 ay,
2.1 2 0 23 licarp
J o
6.2 anu
54 ary y 10, cy P
r n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

139
Rating IP Explanation
m
o po
Pin falls on any frof the rooftop(s) of the house(s) within the boundaries of the
Perfect 2 3 car
property.0, 20 Poli Tu
1
a ry ancy esd
Pin n ufalls N within the boundaries of the property
17(or
2.1 on
ay, support or auxiliary
Approximate , Ja 9 by 6.2 Janu
d a y buildings
5 4 . within it)
es .2 54 ary
Tu 72.16 .9
by 10,
Next Door 1 The next door property. Na 202
ncy 3 f
Po rom
lica IP
Pin falls outside of the property boundaries or outside of the Next Door rpo
Wrong
property.

Can’t Verify See Can’t Verify

Example Explanation
EXAMPLE TYPE: INDIVIDUAL HOME WITH SEPARATE GARAGE

1351 Navarro Dr

Sunnyvale CA 94087

This property contains two buildings: the main house and a garage. Both buildings are on the same
parcel, belong to the same entity, and share an address.

Perfect -> The pin is on the rooftop of the house (green


area)

Approximate -> The pin falls on the garage or within


the property boundaries (yellow area)

Next Door -> The pin falls on the next door property
(purple area)

Wrong -> The pin is outside the boundaries (everything


else)

Can’t Verify -> See Can’t Verify

Tu IP
esd r o m o
f
17 ay,
2.1 2 0 23 licarp
J o
6.2 anu
54 ary
y 10, cy P
r n
.9 10 ua a
9.3. Multipley N
b
Rooftops
,2
, Jan by N
an 023 .9
cy s day .254
Po from e 6
Tua7single
.1
Some POI results consist lica of multiple
I buildings associated with/owned by 1 2 business or POI. To
rpo P
rate the pins for these results correctly, you must research and understand the relationship of the
structures within the boundaries of the property (or parcel of land) to the POI.

140
Two kinds of ratings are possible forom IP
multiple rooftop POI results:

3 fr rpo
202resultca
1. Multiple-Rooftop: When 0 the
, P oli is a POI that contains no other
Tu POIs and consists of more than
1 cy
one building with multiple ry rooftops on the property. In cases like esd primary rooftops will be rated
n
a
u yN a n 1this,
7 ay,
Perfect. The parcel aof land inside the boundaries of the POI will be 2.1rated
a , J
y 54. 9 b 6.2 JaApproximate.
nu Properties
next door to the
e s dintended
. 2 one will be rated Next Door.
5 4 a r y
Tu 72.16 .9
by 10,
1 N a 2023
2. Campus: When a multiple-rooftop result is a higher education institution likenacyuniversity Po from or a
medical, retail, or other type of business complex, most often containing other public-facing lica IPPOIs. In
r
cases like this, the entire parcel or property inside the boundaries of the POI, including allporooftops,
will be rated Perfect. There will be no Approximate or Next Door ratings.

9.3.1. Multiple-Rooftop Rating

Single entities with multiple rooftops are single businesses or POIs that operate out of more than one
building. This category includes, but is not limited to, entities like factories, gas stations, apartment
complexes, company headquarters, lumberyards, and breweries, and other types of POIs that
generally do not contain additional businesses or POIs within them.

Every primary rooftop on the property will be rated Perfect. The parcel of land inside the boundaries
of the POI will be rated Approximate. Properties next door to the intended one will be rated Next
Door.

In cases where the property also contains support or auxiliary buildings, including, but not limited to,
guardhouses, dumpsters, storage sheds, donation bins, utility buildings, and toilets, these buildings
should be considered part of the Approximate area.

Rating Explanation

Perfect Pin falls on rooftops within the boundaries of the property.

Pin falls within the boundaries of the property (or on support or


Approximate
auxiliary buildings within it)

Next Door The pin falls on the Next Door property.


Tu IP
e Pin falls outside of the property boundaries or outside of the Next r o m o
Wrong
17 sday, f
23 licarp
2.1 J Door property. 2 0 o
6.2 anu
54 ary y 10, cy P
r n
.9
by 1See ua a
Can’t Verify Na , 20Can’t
0 Verify , Jan by N
.9
ncy 23 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

141
Example IP Explanation
m
fro rpo
EXAMPLE TYPE: BUSINESS WITH 2 3 MULTIPLE
a ROOFTOPS AT SAME ADDRESS (GAS
, 20 olic
STATION) 1 0 P Tu
ry ancy e
n
a
u yN 17 sday,
a 2.1
Super Gaz

a y, J 54.9
b 6.2 Janu
700 Chambly d 54 ary
TueRoad

s 6.2
. 1 .9
by 10,
Longueuil, QC17J4H
2 3M1
Na 202
Canada ncy 3 f
Po rom
lica IP
This business (or address) is a gas station with a main building and a canopy over the rpo
pumps. All structures are on the same property, belong to the same business, and
share an address.

Perfect (green area in Figure 2) -> If the


pin falls on any rooftop.

Approximate (yellow area in Figure 2) ->


If the pin falls within the property
boundaries.

Next Door (purple area in Figure 2) -> If


the pin falls on the immediate property
next to the intended one.

Figure 1: Satellite view of a gas station

Tu IP
e r o m o
17 sday, f
2.1
2 0 23 licarp
6 Janu 10, cy P
o
Figure.22:
54Annotated
a satellite view of gas r y n
.9 ry 1 ua a
station b 0
yN ,2 Jan by N
an 023 , .9
cy s day .254
Po from e
Tu 72.1 6
lica IP
rpo 1

142
Example IP Explanation
m
fro rpo
EXAMPLE TYPE: BUSINESS WITH 2 3 MULTIPLE
a ROOFTOPS ON A SHARED PARCEL (GAS
, 20 olic
STATION) 1 0 P Tu
ry ancy e
n
a
u yN 17 sday,
Canadian Tire Gas+
a 2.1
a y, J 54.9
b 6.2 Janu
401225 ON-401
d 54 ary
Tues .16.2 .9
by 10,
Woodstock, ON1 7 2N4S 7W8
Na 202
Canada ncy 3 f
Po rom
lica IP
rpo
This business is also a gas station with a canopy over the gas pumps, but it shares a
parcel with other businesses and a wooded picnic area.

With street imagery or other strong


With evidence
evidence for the location of the rooftops,
the exact location of the business (or
address) can be confirmed. When the
exact location of the rooftops can be
found, the green area is Perfect and the
rest of the parcel is Approximate.

Without evidence
Without strong evidence for the location
of the gas station’s rooftops, all rooftops
are Can't Verify (since there is not
enough evidence to narrow the location
down to specific rooftop or rooftops). The
rest of the parcel is Approximate.

EXAMPLE TYPE: BUSINESS COMPLEX CONTAINING A GAS STATION

When the result is the entire business


complex that contains the gas station
seen above as well as restaurants and IP
Tu other services under multiple rooftops, o m o
e r
f rp
17 sday, the result is considered a campus. In cases 2023 olica
2.1
6.2 Janu ,
like this, the entire parcel is consideredry 10 ncy P
54 ary
.9
by 10, Perfect. ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

143
Example IP Explanation
m
fro rpo
EXAMPLE TYPE: BUSINESS WITH 2 3 MULTIPLE
a ROOFTOPS AT SAME ADDRESS
0 , 20 olic
1 P Tu
Bremac
ry ancy e
n
a
u yN 17 sday,
8133 Mechanicsville a 2.1
a y, J 5Tpke

4 .9 b 6.2 Janu
Mechanicsville, dVA 23111
54 ary
Tues .16.2 .9
by 10,
United States1 72 Na 202
ncy 3 f
P rom
The business has three buildings. All buildings are on the same property, belong to othe lica IP
same business and share an address. rpo

This business consists of three buildings.

Perfect (green area in Figure 2) -> If the


pin falls on any of the buildings

Approximate (yellow area in Figure 2) ->


If the pin falls within the property
boundaries.

Next Door (purple area in Figure 2 ) -> If


the pin falls on the immediate property

next to the intended one.
Figure 1: Satellite view of multi-rooftop
POI

Figure 2: Annotated satellite view of multi-


rooftop POI

EXAMPLE TYPE: BUSINESS WITH MULTIPLE ROOFTOPS AT SAME ADDRESS (FACTORY)

Fazerintie 2

01230 Vantaa Finland


Tu IP
ed r o m o
17 sis f
This a a large factory consisting of several buildings.
2.1 y, Ja 2 0 23 licarp
o
6.2 nu
54 ary y 10, cy P
r n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

144
Example IP Explanation
r o m
0 2 3 f carpo
li
1 0, 2 y Po Perfect (green areaT in Figure 2) -> If the
ues
ry c pin falls on any of the
n ua y Nan 17 buildings.

da
y
a
y, J 54.9
b Approximate (yellow area 2 . 16 , JinanFigure 2) ->
a .25 ua
es d .2 If the pin falls within the property
4.9 ry
Tu 72.16 boundaries.
by 10,
1 Na 202
ncy 3 f
P ro
This particular POI has no Next Door olica m IP
rpo
area.

Figure 1: Satellite view of multiple-rooftop


POI

Figure 2: Annotated satellite view of


multiple-rooftop POI

EXAMPLE TYPE: MULTIPLE BUILDINGS ON ONE PARCEL SHARING ONE ADDRESS


(APARTMENT COMPLEX)

Merkuriuksentie 13

00750 Helsinki

Finland

This query is for an address that is shared by several apartment buildings on the same
parcel.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

145
Example IP Explanation
r o m
0 2 3 f carpo There are five buildings with the same
li
1 0, 2 y Po address on the parcel.
Tu A pin on any of
ry c them is rated Perfect ed
n ua y Nan 17 swhile
ay, a pin on the
a b 2
parcel or any of the support
. 16 Jastructures is
a y, J 54.9 .25 nua
es d .2 rated Approximate. 4.9 ry
Tu 72.16 by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

EXAMPLE TYPE: BUSINESS WITH A SHED IN THE BACK

33 Mile Roadhouse

33 Mile Haines Hwy

Haines AK 99827

United States

This business is a restaurant with a support building — a storage shed — in the back.
This restaurant has a detached storage
shed on its property.

Perfect (green area in top image) -> If the


pin falls on the main restaurant building.

Approximate (yellow area in top image)


-> If the pin falls within the property
boundaries, including the small support
shed behind the restaurant.

Next Door (purple areas in top image) ->


If the pin drops on either of the immediate
properties next to the intended one.

Annotated satellite view shows restaurant


and shed (arrow points to street imagery
of shed). IP
Tu o m o
e f r
17 sday, 0 23 licarp
2.1 2
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

146
9.3.2. Campus Rating

IP
r o m
0 2 3 f carpo
Some POIs will encompass entire 0, 2 y Pbusiness
oli complexes, meaning that there are multiple buildings
1 Tu
associated with/owned aby y the
r an POI.
c These POIs include (but are not elimited to) institutional complexes
u yN 17 sday,
like universities, hospitals, n
Ja .9 b and airports. Other POI types that can be 2.1 rated as campuses include
y, malls 6.2 Janu
shopping and estrip
s d a
.2 5 4 with multiple rooftops, amusement parks, resorts,
54.9 and
ary zoos.

Tu 72.16 by 10,
1 N 20
In cases like this, the entire parcel or property inside the boundaries of the POI,anincluding cy 23 fr all rooftops,
will be rated Perfect. There will be no Approximate or Next Door ratings.
Po om
lica IP
rpo
The property of a campus complex includes the buildings themselves, any shared parking lots, and
half ’n half as described in the guidelines.

How to Identify Campus Results

Wondering if a multiple-rooftop result is a campus? Many, though not all, campuses can be
identified by the presence of POIs within the POI. That is, individual stores within multiple-rooftop
malls, departments within hospitals, libraries and colleges within universities, spas and
restaurants within multiple-rooftop resorts, terminals within airports, and so on.

Rating Explanation

Perfect Pin falls within the campus/complex boundaries, as determined by


research.
Approximate N/A - Campuses and business complexes do not have Approximate
ratings.
Next Door N/A - Campuses and business complexes do not have Next Door
ratings.
Wrong Pin falls outside of the campus/business complex boundaries.

Can't Verify See Can’t Verify

Note: The result may be for an address that should have the campus rule applied.

Some of these types of POIs may have polygons outlining the boundaries of the POI on the map.
These polygons may not always be present or perfect, so rate against the true boundaries of the IP
Tu
campus
esd or complex as determined by research. A few examples of campuses are below, including fro rone
m o
p
1
that a
72is missing 3
.16 , Jan its polygon.
ca
y 2 0 2 li
o
.25 ua y 10, cy P
4.9 ry r n
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

147
POI type IP Screenshot
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Hospital Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

Park

Airport

Outlet Mall

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

148
POI type IP Screenshot
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
Amusement Park
rpo
No Polygon available

9.3.2.1. Single-Complex Campus

Entities made up of a single cluster of buildings are the easiest to identify. On the map, these entities
can be represented by a single, continuous polygon. Remember, the polygons on the map may not
always be perfect or present, so rate against the true boundaries of the campus or complex as
determined through research.

The property of a complex includes the buildings themselves, any shared parking lot and half n half
as described in the guidelines.

Note: Parking facilities may be included in the polygon if they are owned by the POI
and contiguous to the campus (contiguous means that they are not separated from
the campus by a street).

Tip: Start by looking at the pin's location, then determine if the property surrounding
the pin belongs to the POI you are looking at.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

149
POI IP Screenshot Rating Explanations
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo
Perfect (green area in Fig. 2) ->
If pin falls within campus
boundaries.

Wrong (everything else outside


Fig. 1: Vector view of Stanford
of green area in Fig. 2)-> If pin
University campus

falls outside campus


Stanford University
boundaries.

Remember, there is no
Approximate or Next Door
rating for campus and business
complexes.

Fig. 2: Annotated vector view of


Stanford University campus

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

150
POI IP Screenshot Rating Explanations
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

Perfect (green area in Fig. 2) ->


If the pin falls within the hospital


Fig. 1: Vector view of El Camino
boundaries.

Hospital campus

Wrong (everything else outside


El Camino Hospital
of green area in Fig. 2)-> If the
pin falls outside of hospital
boundaries, as determined by
your research.

Fig. 2: Annotated vector view of


El Camino Hospital campus

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

151
POI IP Screenshot Rating Explanations
r o m
0 2 3 f carpo There is no polygon available for
li
1 0, 2 y Po Tu this POI, so an imaginary
ry c e
n ua y Nan 17 sdpolygon
ay, outline must be created
a 2.1 according
a y, J 54.9
b 6.2 anu to the actual
J
es d .2 boundaries
54 ary of the POI.

Tu 72.16 .9
by 10,
1 Na 202
To determine ncy where
3 the valid
Po from
pin area is, look at
licathe Ilocation
rpo P
of the attractions within the
amusement park and visualize
the boundary of the park to

determine the POI’s polygon.
Fig. 1: Vector view of The green area highlighted in a
Disneyland Park Disneyland Park
satellite view of the POI (Fig. 2)
represents the valid area for the
pin to land in. A pin landing
anywhere outside of this green
area would be a Wrong pin.

Note: Parking lots separated by


a road should not be included in
the polygon because they
outside the boundary. Utility
buildings located outside of the

public park premises are not
Fig. 2: Annotated satellite view included in the polygon.

9.3.2.2. Dispersed Campus

In some cases, a campus will not have a single, continuous location that a polygon can be drawn over,
but rather be spread out across a large area like a city. Sometimes, the pin will fall on this type of
campus and there may not be a polygon for the campus. If this occurs, research to determine where
the polygon should be. Pins that fall on campus-associated, non-parking facilities are valid pins.
Apply the single rooftop rules to any standalone, non-parking facility, campus building.
IP
Tu o m o
esd f r
If 1two
72 or ay, 23 licarp
.16 moreJa campus buildings are next to each other, apply the single complex campus logic.

2 0 o
.25 nua y 10, cy P
4.9 ry r n
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

152
IP
POI r o m
Screenshot Rating Explanation
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 Perfect
54 ->
.9 aryIf1the pin falls the
Tu 72.16 by
green polygon 0
1 Na ,minus
20 campus-
n
associated parkingcy 23facilities
f and
Po rom
non-campus-associated l ica IP
rpo
buildings.

Wrong -> If the pin falls on a


standalone, campus-associated
parking facility, or on a non-
campus-associated building.


In this example, Virginia
Fig. 1: Annotated vector view of Virginia Commonwealth University (VCU)
Commonwealth University
is a campus that is spread out
Virginia
around the city (campus
Commonwealth
properties are highlighted in
University Fig. 2: Zoomed-in view of pin location
green).

A pin falling on the rooftop of the


Virginia Commonwealth University
- School of Medicine building (in
VCU Medical Center complex)
would be considered a valid pin
for this POI, but a pin falling on a
VCU parking lot would not be a
valid pin for the same POI.

Zooming into the pin shows that


the result is Perfect in this
example.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

153
IP
POI r o m
Screenshot Rating Explanation
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
The Boston University rpcampus is
o
also spread out across the city, as
represented by the highlighted
green areas. In this case, the pin
happens to fall on the Boston
Boston University Center for
University Computational Neuroscience and
Neural Technologies building. The
building is a standalone, non-

parking facility building that is
Fig. 1: Annotated vector view of the Boston associated with the campus, so
University campus the pin is Perfect.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

154
9.4. Features Without a Rooftop

IP
o m
This chapter will describe how to fr rpin
3rate po accuracy for features that typically do not have a rooftop.

0 2 i c a
2 ol
10, cy P Tu
9.4.1. Natural Features
a y
r an
u yN
e
17 sday,
a n 2.1
Natural features include
a
b
y, J 54.9 but are not limited to:
6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
• Lakes (Lake Victoria)
ncy 3 f
• Oceans (Pacific Ocean)
Po rom
lica IP
• Creeks (Bear Creek in Colorado)
rpo
• Rivers (the Danube river)

• Ponds (Antonelli Pond in California)

• Wetlands (Laguna de Rocha)

• Seas (Black Sea)

• Forests (Black Forest)

• Mountains (Carpathian Mountains)

• Hills (Chocolate Hills of the Philippines)

• Plateaus (Colorado Plateau)

• Valleys (Death Valley)

• Plains (The North American Great Plains)

• Fjords (Geirangerfjord in Norway)

• Peninsulas (Indian Peninsula)

• Volcanoes (Etna)

• Deserts (Gobi Desert)

• Glaciers (Patna Glacier in Iceland)

• Waterfalls (Niagara Falls)

A natural feature may also have other natural features within or surrounding it. These could include,
but are not limited to, the shore of a lake, an island in a river, and a forest surrounding a mountain.

Similar natural features, even if not listed above, should be rated using these guidelines.

Rating Explanation
If the natural feature has a defining feature (water for a river/ocean, cliffs/peak of
a mountain, the sand for a beach), pin should fall on that feature or if the natural
Perfect
feature is defined by an arbitrary boundary (parks, national forests), pin should
fall in their polygon or where it would be if we had that information.
The pin falls outside of the defining features of a natural feature but still on it
(slope of a mountain rather than the peak, the shore of a river or lake). Consider
Approximate each situation individually. Not all natural features will have an Approximate. If
Tu the natural feature exists within an urban or suburban area, you may apply the IP
esd r o m o
17 ay, Half 'n' Half rules. f
23 licarp
2.1 J 2 0 o
.25 anua
Next6Door 10, cy P
4.9 ry N/A - Natural features do not have Next Door ratings. r y
ua y Na n
by 10, an bor
Na The20 pin falls in an area that does not meet the criteria for Perfect
, J .9
Wrong ncy 23 f
Approximate. s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1
Can't Verify See Can’t Verify

155
IP
Type of POI Screenshot r o m Explanation
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
d
es 16.2 54 ary
Tu 7Lake
. Merritt
.9
by 10,
1 2 Na 202
ncy 3 f
Po rom
lica IP
rpo

Perfect (green area in Fig. 2) -> Anywhere on


the defining feature of the lake. In this case, the

defining feature would be the water.

Fig. 1: Vector view of Lake Merritt

Body of
Approximate (yellow area in Fig. 2) -> The
water
shore of the lake.

Wrong (everything else in Fig. 2) -> Anywhere


past the shore of the lake.

Fig. 2: Annotated vector view of


Lake Merritt

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

156
Type of POI ScreenshotIP Explanation
f romrpo
Land feature Mount Rainier
02 ica 3 Land features, such as mountains, mountain
2 ol
y 10, cy P ranges, or volcanoes,
Tu
esd
should use the following
ar n guidelines.
17 ay
J a nu by Na 2.1 , Ja
d ay, 254.9 6.2 nu
54 green
es
Tu 72.16
. Perfect (area above .9 ary 1line in Fig. 4) ->
by 0,
1 Anywhere on the defining Nfeature
an 2023of the
mountain (peak or ridge, depending cy
Po froon the
mountain).
lica m IP
rpo
Approximate (area between green and yellow
lines in Fig. 4) -> Anywhere on the slope of the
mountain.

Fig. 1: Vector view of Mount Wrong (area below yellow line in Fig. 4) ->
Rainier
Valley of the mountain, anywhere farther out
than the obvious slope.

Tip: If available, try using a 3D view of the


mountain to determine where its peak or ridge is.
Check to see if there is a 3D view before using
other sources.

Use common sense to determine the pin rating


for these types of land features. For example, a

peak of a mountain can span a large area and
Fig. 2: Satellite view of Mount may have a more gradual slope area, so make
Rainier
sure you're not being too strict or too generous
when rating the pin.

Fig. 3: 3D view of Mount Rainier

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary
r y n
.9 10 ua a
by Fig.
Na , 4:
2 Annotated 3D view of , Jan by N
ncy 02Rainier
Mount 3 s day .254
.9
Po from e
Tu 72.1 6
lica IP
rpo 1

157
IP
r o m
9.4.2. Administrative Divisions

0 2 3 f carpo
li
1 0, 2 y Po Tu
Administrative divisionsacan
ry referc to, but are not limited to:
e
u y Nan 17 sday,
• Countries
, Ja n 2.1
9b 6.2 Janu
• States
esday .254. 54 ary
Tu 72
.16 .9
• Counties by 10,
1 Na 202
• Provinces
ncy 3 f
• Cities
Po rom
lica IP
• Neighborhoods
rpo

Rating Explanation
Perfect Pin should fall in within the boundaries/polygon of the administrative division.
Approximate N/A
Next Door N/A
Wrong Pin falls in an area that does not meet the criteria for Perfect.
Can’t Verify See Can’t Verify

Type Screenshot Explanation

Perfect – the pin can fall


anywhere within the
neighborhood boundaries

Approximate – not applicable

Neighborhood
Next Door – not applicable

Wrong – everything outside of


Perfect

Tenderloin in San Francisco

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

158
9.4.3. Streets

IP
o m
In this chapter, rating pins for streets 3 f cawill
r rpo be explained.

0 2 li
Rating 1 0, 2 y Po ExplanationTu
ry anc e
n
a
u yN 17 sday,
Ja .can 2.1
Perfect d a y, Pin 5 4 9 b fall anywhere on the street, including medians 6.2 Jaand
nu intersections the
5
es
Tu 72.16
street
. 2 passes through completely (but not on sidewalks).
4 .9 ary 1
by 0
1 Na , 202
Approximate N/A ncy 3 f
Po rom
Next Door N/A lica IP
rpo
Wrong Pin falls in an area that does not meet the criteria for Perfect.
Can’t Verify See Can’t Verify

Example Explanation
Perfect – The pin can fall anywhere on the street,
including medians and intersections the street
passes through completely, whether seen in
satellite view or on the vector map. If there is a
discrepancy between the satellite view and vector
map of the street boundaries, use the most
favorable layer. Note that sidewalks are not part of
the Perfect area.

Approximate – not applicable

Next Door – not applicable

Wrong – everything outside of Perfect, including


intersections the street does not pass through

Here, only the Jersey St. & Lafayette St.


intersection is a valid intersection for the pin to fall

on, since Jersey St. completely passes through
Jersey St. in New York City Lafayette St. The intersections where Jersey St.
meets Mulberry St. and Crosby St. are not included
because Jersey St. does not pass through these
streets.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

159
IP
Query: [highway 92]
r o m
0 2 3 f carpo
, 2 Poli
10San Tu
User and fresh viewportyin y Francisco, CA

ar Nanc Perfect – The 1pin


esd
u 72 canay fall anywhere on the street,
, Jan .9 by .16 , Jan
a y 4 including bridges that .25 areupart
ary of the street. Both
esd .25 4
result 1 and result 2 are Perfect
by 10,since the pin falls
Tu 72.16 . 9
1 on the San Mateo-HaywardNBridge, an 2023which is part of
cy
the highway.
Po from
lica IP
Approximate – not applicable
rpo
Next Door – not applicable

Wrong – everything outside of Perfect, including


intersections the street does not pass through

Rate pins falling on physical road dividers (the


middle of a road with lanes in both directions) as
Perfect, even if they fall into water, as in result 3.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

160
9.5. Parking Lots and Structures

IP
o m
r rpo
Shared parking lots are considered 3 f Approximate even though they do not belong entirely to the
feature. Assume that parking , 0
lots
2 2 lica to the feature and do not split them. When Sourdough & Co
belong
o
10 cy P Tu
(green building) is the result,
a ry athe
u yN n approximate area (yellow) extends
17 sup
e d to the public road to the north.

a
J a n b 2.1 y, Ja
ay , 4. 9 6.2 nu
u esd 16.25 54 ary
.9
T 72. by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

InTcases where the parking structure can be verified in satellite imagery (by either parked cars orm IP
ue froberpno
parking
17 sdaylot striping), consider the entire structure a parking lot. The assumption is that there 3will a
o
2 , 0 2 i c
businesses
.16 Janwithin the structure other than parking-related businesses.
2 ol
.25 ua y 10, cy P
4.9 ry r
by 10, n ua y Nan
Na 202 Ja b
ncy 3 f s d ay, 254.9
Po rom e .
lica IP Tu 72.16
rpo 1

161
IP
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po ro
m
lica noIneed
Always consider parking lots and parking structures as belonging to the feature. There’s rpo P
split them by applying the Half n' Half rule.

In the example below, the result is a shopping mall with both a parking lot and parking structures. Pins
that fall on the building (rooftop) of the mall are Perfect. Apply the Half 'n Half rule to the street and
internal access roads, if any, to determine the area for Approximate, as parking lots and parking
structures are also Approximate.

9.6. Transit POIs

Transit POIs include, but are not limited to, POIs that are transit stops, stations, toll booths, and
terminals.
Tu A transit stop is a small, transit location typically designated by a bench or covered bench IP
o m o
area,
17 sadaposted
e sign, or street markings. Transit stations, on the other hand, are typically larger fstops
r
y 0 23 licarp
that 2have
.16 , Jaamajor structure associated with them, which include, but are not limited to, platforms, 2 o
ticketing
nu
.25offices, 10, cy P the
4.9 ary enclosed waiting/seating areas, or terminal buildings/structures encompassing r y
ua y Na n
transit area. The 10
by term an larger
Na , 202“station” is primarily used to refer to transit locations that y, Jare
. 9b
and
typically a terminalcyhousing
n 3 multiple routes. All stations are stops, but not eall
sd stops
a
.25 are stations.

4
Po from Tu 72.16
lica IP
1
rpo the criteria to be rated under the Single Rooftop
If a transit POI does not meet or Campus/Complex
guidelines, please use the following criteria to rate.

162
Rating IP Explanation
m
The pin falls on23the fropolygon rpo for the transit POI or in the area where you
0 l i c a
2
would wait10for transit or within the entrance polygon
Perfect ,
cy
P o Tu for an
underground ry antransit station e
n
a
u yN 17 sday,
a 2.1 Ja
The .9 bfalls within 50 meters of where you would wait
y, J 5pin 6.2 for nu
4.9 transit
ary or
d a 4 5
es 16.2
u
Approximate
T 72within
. station parking lots and surrounding property up to bwhere y N 10,the
1 Half 'n' Half rule allows. an 2023
cy
Po from
Next Door Transit POIs do not have Next Door ratings. lica IP
rpo

The pin is wrong if it falls:

• Farther than 50 meters from the ideal location

Wrong • Within 50 meters on a non-associated rooftop

• Outside of the boundaries as allowed by the Half 'n' Half rule

• Beyond half a city block (applies to bus stops only)

Can't Verify See Can’t Verify

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

163
9.6.1. Bus, Tram, and Streetcar Stops

IP
o m
Bus, tram and streetcar stops are3 often, fr rpobut not always, on the side of the street and have one spot
where users can wait to board , 0 2 lica Perfect pins should be placed on the spot where a user would
2the obus.
0 P Tu
wait while Approximatearpins y 1 ncancy be placed within 50m of the waiting e spot and within the Half 'n' Half
u yN a 17 sday,
rule.
a n 2.1
a y, J 54.9
b 6.2 Janu
POI d
es Screenshot
.2 54 ary
Rating Explanation
Tu 72.16 .9
by 10,
1 Na 202
Perfect (green area in Fig. 2) -> Where nacyuser3 fwould wait for
r
the bus.
P oli om I
car P
po
Approximate (yellow area in Fig. 2) -> 50 m away from
where a user would wait for the bus but no farther out than
the Half 'n' Half rule allows and not on a building rooftop.

Wrong (everything else in Fig. 2) -> Farther than 50 meters,



or beyond half a city block from where user waits for the
Noriega Fig.1: Vector view of bus bus, or farther out than the Half’n’Half rule allows, or on a
St and stop
rooftop, or in an agricultural field where a person would not
46th wait for transit.

Ave bus
stop
Can’t Verify – See Can’t Verify

Special Note: A satellite view shows that this pin might


actually fall in the street for this bus stop. Remember, favor
the map view that gives a more generous rating for the pin
these cases. In this case, the vector map is used to rate the

pin.
Fig.2: Annotated satellite
view of bus stop

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

164
9.6.2. Transit POI with Multiple Rooftops/Platforms

IP
o m
If the POI has multiple rooftops/platforms, 3 f carpo apply similar ideas from the campus/complex pin
r
0 2
guidelines when determining 0, the
2 valid
Po
li area for the pin to land on.

1 y Tu
ry anc e
a
u yN 17 sday,
For campuses/complexes, a n a polygon was created using the boundaries 2.1 of the campus. Use the same
y, J POIs.9 b and create a polygon for the transit POI using 6.2 Janu
concept with transit
d a
es 16.2 5 4 5the
4.9 POI's
ary multiple rooftop/
u
platforms.
T
172
. b y N 10, 2
an 023
cy
Po from
POI Screenshot Explanation licar IP
po

Here is the San Jose Diridon train station, so


rate the pin according to the train station
platforms and rooftops.

Perfect -> Polygon of the station or rooftop/


platform of the station or area between

rooftops/platforms of the station (green area).

Fig. 1: Vector view of San Jose


Diridon Station
Approximate -> Within transit station parking
San Jose
lots and surrounding property up to where the
Diridon
Half 'n' Half rule allows (yellow area).

Station
Wrong -> Anywhere outside of transit station
boundaries.

Can’t Verify – See Can’t Verify

Fig. 2: Annotated satellite view of Remember, if there is a polygon available in


San Jose Diridon Station
vector view for the POI, rate against the
polygon.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

165
POI Screenshot IP Explanation
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
Some transit stops only havency a 3platform
fro where
P
a user can wait for the transit.
olic m
arp IP
o
Perfect (green area in Fig. 2) -> Where a user
would wait for transit or the area between
where a user would wait for transit.

Fig. 1: Vector view of Sunnyvale Approximate (yellow area in Fig. 2) -> Within
Station
50 meters of where you would wait for transit
Sunnyvale
or within transit stop parking lots and
Station
surrounding property up to where the Half 'n'
Half rule allows.

Wrong (everything else in Fig. 2) -> Farther


than 50 meters from where user waits for
transit or farther out than the Half 'n' Half rule
allows.

Can’t Verify – See Can’t Verify

Fig. 2: Annotated satellite view of


Sunnyvale Station

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

166
POI Screenshot IP Explanation
r o m
0 2 3 f carpo Some stations have both a building rooftop
li and an open
1 0, 2 y Po
c Tu platform waiting area. Both of
ry these areas 17 are
esd considered valid places for
ua y Nan a
a n b 2.1 y, Ja
pins to fall on.

d a y, J 54.9 6.2 nu
es .2 54 ary
Tu 72.16 .9 10 -> Pin falls on
Perfect (green area in by Fig.
1 Na 2),2
0
the platform(s) where the user ncy 2would
3 wait or
Po from
the area between the platformslior car IProoftop.

the

po
Solana
Fig. 1: Vector view of Solana Beach Approximate (yellow area in Fig. 2) -> Pin
Beach
station
falls within 50 meters of where you would wait
Amtrak for transit or within transit stop parking lots
Station and surrounding property up to where the Half
'n' Half rule allows.


Wrong (everything else in Fig. 2) -> Farther
Fig. 2: Annotated satellite view of than 50 meters from where user waits for
Solana Beach station transit or farther out than the Half 'n' Half rule
allows.

Can’t Verify – See Can’t Verify

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

167
9.6.3. Transit POIs with a Single Rooftop

IP
o m
If the POI has a single rooftop, apply 3 f cthe
r rposingle rooftop guidelines.

0 2 a
0 , 2
P oli Tu
ry 1 ncy e
POI n u y Screenshot
a N a 17 sday,Explanation
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

Perfect -> Rooftop of transit station or stop

Approximate -> Transit POI parking lots and



surrounding property up to where the Half 'n'
Grand Fig. 1: Vector view of Grand Central Half rule allows

Central Terminal station

Terminal Wrong -> Farther out than the Half 'n' Half
rule allows from POI property

Can’t Verify – See Can’t Verify

Fig. 2: Annotated satellite view of


Grand Central Terminal station

9.6.4. Underground Transit Stations

Some transit stations are underground. For stops that do not have polygons available on the tool map,
P
Tu similar rules to the satellite campus and use your imagination to draw a polygon using theom I
apply
esd r
entrances
17 ay, to the underground station as polygon coordinates. A pin dropped within 50 meters 2 rpo
3 f ofcathis
2.1 Ja 2 0 ol i
polygon 6.2 should
n be rated Approximate.
10, cy P
54 uary r y
.9
by 10, n ua y Nan
If a pin is placed Naon a20building a
within the polygon, the building must contain any,entrance
J b to the transit
ncy 23 f d a 254.9
stop for the pin to bePPerfect. r If the pin falls on any other building within uthe
e polygon,
s . rate it
oli om I T 72.16
Approximate.
car P 1
po

168
Some entrances can be seen via satellite view of the station, while other entrances can only be found
by doing more research, including using IPstreet imagery of the station area to find entrances or using a
o m
r rpo shows entrances to the station.

station map from the transit provider


0 2 3 f cathat
li
1 0, 2 y Po Tu
ry nc e
9.6.4.1. How to Establish an Entrance Polygon

n
a
u yN a 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
1. Find at least d
es three .2 entrances to the underground transit station, if possible.
54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
• Use street imagery or an official source to determine where the transit station Poentrances
ro are
located.
lica m IP
rpo
• Tip: A good place to start looking for transit entrances is near the pin's location. This will
make it easier to determine whether or not the pin falls within the polygon.

2. Connect the entrance points to create an enclosed polygon, where each entrance is a point of the
polygon.

3. Determine whether or not our pin falls within 50 meters of the polygon or within the property
covered by the Half 'n' Half rule.

If the underground transit station only has two entrances, use the following steps to create an
entrance polygon.

POI Steps Satellite Views

1. Imagine property boundaries around


the underground transit station
entrances using the Half ’n’ Half
Rule.

Note: Entrances are designated by stars


and property boundary polygons are
designated by the letters A and B.

2. Connect the closest points of the two


boundaries from step 1 to create an
entrance polygon.

Note: In this case, we have taken points


Tu IP
e 1 and 2 from polygon A and connected r o m o
16th
17 sdSt
ay& f
23 licarp
2.1 , Ja them with points 3 and 4 from polygon 2 0
Mission
6.2 nu 10, cy P
o
54 arB, y respectively. Exclude building r y n
BART .9
by 10, ua a
rooftops an by N
Station
N an 2023 that do not contain an entrance , J .9
cy underground
to the station from the s day .254
Po from e
Tu 72.1 6
lica IP
entrance polygon.
rpo 1

169
POI StepsIP Satellite Views
m
3 fro rpo
a
0 , 202 olic
1 cy P Tu
3. Determine
u ary Nawhether
n or not the pin falls
e
17 sday,
a n by 2.1
, J
aywithin 9
4. 50 meters of the polygon.
6.2 Janu
u esd 16.25 54 ary
.9
T 72. by 10,
1Note: For underground transit POIs that Na 202
ncy 3 f
Po rom
only have one entrance, create the same lica IP
rpo
polygon around the entrance as the
Perfect pin rating area, then measure
50 meters from that polygon for the
Approximate pin rating area.

9.6.4.2. Examples

POI Screenshot Explanation


If the underground POI already has a
polygon available, rate the pin against
the polygon.

In this case, there is a blue-colored


polygon on the map for the POI.

Perfect (green area in Fig. 2)



Polygon of transit station.

Fig. 1: Vector view of Jingu Marutamachi


Station
Approximate (yellow area in Fig. 2)
Jingu Pin lands within 50 meters from the
Marutamachi polygon or on transit station parking
Station lots and surrounding property up to
where the Half'n'Half rule allows. In this
case, the station does not have a
station parking lot, so only look at the
surrounding property within 50 meters
Tu
of the polygon.
IP
e r o m o
17 sday, Fig. 2: Annotated vector view of Jingu f
2.1 2 0 23 licarp
6.2 Janu Marutamachi Station Wrong (everything elsey in 10,Fig.
o
y P2)
54 ary r n c
.9
by 10, Farther out than thenuHalf'n'Half
a Na
y rule
Na 202 Ja b
allows from station, property.

.9
ncy 3 f s day .254
Po rom e
Tu 2.1 6
lica IP
rpo Can’t Verify17– See Can’t Verify

170
POI Screenshot IP Explanation
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

Fig. 1: Vector view of 16th St Mission BART


station
Perfect -> Pin falls within the entrance
polygon and not on a building rooftop
(unless there is an entrance to the
station within the building).

Approximate -> Pin falls within 50


meters of the entrance polygon or
within the property that Half 'n' Half
rule covers.

Wrong -> Pin falls more than 50


meters outside of the entrance polygon
16th St and or outside the Half 'n' Half rule area.

Mission St
BART Station
Can’t Verify – See Can’t Verify

Fig. 2: Satellite view of 16th St Mission


BART Station showing station entrances

In this case, there are only two


entrances to the transit station (Fig. 2).
We'll use the Half 'n' Half rule to
determine the points for our entrance
polygon (Fig. 3).

Our pin falls within the entrance IP


Tu mpin.o
e polygon created, so it is a Perfect f r o
17 sday, 0 23 licarp
2.1 2
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f
rom

e s day .254
P
Fig. 3: lAnnotated 6
o ica IP satellite view of 16th St Tu 72.1
1
Mission BART.
rpo Stars represent the
entrances.

171
POI Screenshot IP Explanation
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
Perfect
n ua y Nan 17 sday-> ,
Pin falls within the entrance
a b 2
polygon. 16 andannot on a building rooftop
J
a y, J 54.9 .25 ua
es d .2 (unless there 4.9 is ran
y 1 entrance within the
Tu 72.16 building).
b y 0
1 Na , 202
ncy 3 f
Po rom
Approximate -> Pin falls licawithin
I 50
rpo P
meters of the entrance polygon or

within the property that Half 'n' Half


Fig. 1: Vector view of Tuileries Station

rule covers.

Tuileries
Wrong -> Pin falls more than 50
Station
meters outside of the entrance
polygon or outside the Half 'n' Half rule
area.

Can’t Verify – See Can’t Verify

In this example, the pin falls within the


Half 'n' Half rule area for the entrance
polygon, so it is an Approximate pin.
Fig. 2: Annotated satellite view of Tuileries
Station. Stars represent the entrances.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

172
POI Screenshot IP Explanation
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
es d .2 54 ary
Tu 72.16 .9
by 10,
1 Na 202
Perfect -> Pin fallsncywithin
3 f entrance
r
P oli om Irooftop
polygon and not on a buildingcar P
(unless there is an entrancepowithin the
building)

Approximate -> Pin falls within 50


meters of the entrance polygon

Fig. 1: Vector view of Jay St-MetroTech


Wrong -> Pin falls more than 50
station

meters outside of the entrance


polygon

Can’t Verify – See Can’t Verify

With underground transit stations that


Jay

have multiple entrances, you'll need to


Street-
use street imagery or an online
MetroTech
resource to find the transit entrances
then draw a polygon using the
entrances as points of the polygon.
Here, we were able to find 5 entrances

represented by the yellow stars that


Fig. 2: Annotated vector view of Jay

were near our pin (Fig. 2). These


St-MetroTech station with entrance polygon

entrances were found via street


imagery, since satellite view does not
clearly show entrances to this transit
station (Fig. 3). There is also a transit
station map available from the official
transit website that shows the
entrances to this station.

In this example, our pin is placed within IP


Tu the entrance polygon for this station, o m o
e r
f rp
17 sday, so we rate it as Perfect. 2023 olica
2.1
6.2 Janu 10, cy P
54 ary r y
.9
by 10, n ua y Nan
Na 202 Ja b
ncy 3 f
s d ay, 254.9
Po rom e .
Fig. 3: Satellite
l i car IP view of Jay St-MetroTech Tu 72.16
po 1
station

173
10. How to Rate Results
IP
o m
fr rpo
This chapter shows how to rate02a3 variety ca of examples.

0 , 2
P oli Tu
1
ry antocyanswer questions about:
e
For each result, you will u aneedN 17 sday,
y , Jan .9 by 2.1
6.2 Janu
a 4
esd .25
• Relevance

54 ary
.9
Tu 72.16 by 10,
• Name accuracy

1 Na 202
ncy 3 f
• Address accuracy
Po rom
• Pin accuracy
lica IP
rpo

10.1. Specific Address

When the query is an address, and the user explicitly states their location intent by including the
name of a locality, this is an explicit location query and the user’s viewport and location are irrelevant.
The query refers to a unique location, so a result for this exact location should be rated Navigational.

Query Results Ratings and Explanation


Is there a Navigational Result for this Query? Yes

[12112 Relevance Navigational


sugarloaf key Name Accuracy n/a
st tampa fl
33626]
Address Accuracy Correct

Pin Accuracy Perfect

12112 Sugarloaf Key St

12112 Sugarloaf Key St

Tampa, FL 33626

Classification: n/a

This address belongs to an apartment complex,


where all buildings have the same address.

The pins falls on one of the rooftops of this


mutiple-rooftop result and is rated Perfect. IP
Tu m
e
17 sday, 3 fro rpo
2 a
2.1
6.2 Janu 0, 20 olic
1 y P
54 ary
.9 u ary Nanc
by 10,
Na 202 y, Jan .9 by
ncy 3 f a 4
Po rom u esd 16.25
lica IP T 72.
rpo 1

174
Query Results P Ratings and Explanation
I
f romrpo Relevance Navigational
[12112 Camden Westchase, 2 023 olica Park
sugarloaf key Apartments
10 P Tu
Name Accuracy Correct
ry ancy e
st tampa fl 12112
a
u yN 17 sday,
an Sugarloaf Key St
2.1
33626]
sda 54
y , J
Tampa, . 9 b
FL 33626
Address Accuracy 6.2 JanCorrect
54 uary
e 6.2
Tu 72.1Classification: Apartment
.9
by 10,
1 Pin Accuracy Wrong
Na 202
ncy 3 f
Po rom
lica IP
r o
The result includes the name of the pbusiness,
which is located at this address.

The pin falls outside the boundaries of the


apartment complex.

12112 Sugarloaf Key St


Relevance Navigational
12112 Sugarloaf Key St

Tampa, FL
Name Accuracy n/a
Classification: n/a
Address Accuracy Incorrect - Postal Code
Pin Accuracy Perfect

The result is missing a postal code so Address


Accuracy is Incorrect (with Postal Code
specified as the incorrect component). Postal
code is a mandatory component for a
residential address result. The pin falls on one
of the rooftops of this multiple-rooftop POI.

Sugarloaf Key St
Acceptable (User Intent
Relevance
Sugarloaf Key St, Tampa, FL
Issue)
33626

Classification: n/a
Name Accuracy n/a
Address Accuracy Correct
Pin Accuracy Perfect

The result is a whole street result instead of a


specific address. As the user query is for a IP
Tu specific, full address, the information provided m
e
17 sday, 3 fro rpo
2.1 by the result is incomplete. The user2would 0 olicabe
2
6.2 Janu able to find the street, but not the 0,
1exact yP
54 ary r
a Nay n c
.9 address s/he is looking for.aThe
by 10,
J nu bpin y is dropped
Na 202 , 9
ncy 3 f on the street mentioned a in the
y 4 result and is
.
Po rom Perfect. u esd 16.25
lica IP T 72.
rpo 1

175
Query Results P Ratings and Explanation
I
f romrpo Relevance Bad (User Intent Issue)
11244 Windsor 023 oPl

lica
, 2
11244 Windsor 1 cy Pl Cir

0 P Tu
Name Accuracy n/a
Tampa, u aryFLNa33626

n e
17 sday,
a n by 2.1
[12112
J
, 4.9
ayClassification: n/a
Address Accuracy 6.2 JanCorrect
es d . 25 54 uary
sugarloaf Tkey2.1
u 6 .9
by 10,
st tampa fl1
7 Pin Accuracy Perfect
Na 202
ncy 3 f
33626]
P rom
The result does not satisfy the oquery
lica and
I is not
rpo P
considered relevant. However, the address and
pin placement are Correct and Perfect.
Remember, the data and relevance of the result
are considered separately. The data can be
correct even when the result’s relevance is
Bad.
[220 yonge st Is there a Navigational Result for this Query? Yes
toronto]

Toronto Eaton Centre
Relevance Navigational
User in Toronto, 220 Yonge St

Toronto ON M5B 2H1


Name Accuracy Correct
Canada

Classification: Shopping Center


Address Accuracy Correct
Pin Accuracy Perfect

This query is the address of the best-known


mall in downtown Toronto. Even though many
businesses have this address as their official
address, the mall is rated Navigational due to
its prominence.

The result includes the correct address plus the


name of the mall, which is useful additional
information. The pin is dropped on the mall’s
rooftop.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

176
Query Results P Ratings and Explanation
I
r om po
Indigo
f r Relevance Good
2 023 olica
220 Yonge 10 St

, P Tu
Toronto, ry ON n cy 2H1

M5B Name Accuracye Correct


[220 yonge st a
nu y N a 17 sday,
2.1
, Ja 4.9 b
toronto]
 ayClassification: Book Shop
Address Accuracy6.2 JanCorrect
es d . 2 5 54 uary
Tu 72.16 .9
Pin Accuracy by 10,
Perfect
User in Toronto,
1 Na 202
Canada
ncy 3 f
Po rom
lica IP
rpo

This large, well-known bookstore is inside the


Eaton Centre and shares the 220 Yonge Street
address. It is demoted to Good because it is
less prominent than the Eaton Centre.

The name and address are Correct. Based on


the best available evidence (including interior
maps of the mall available online) the exact
position of the bookstore under the rooftop can
be found. A pin falling on the green area
(bookstore’s position) is Perfect. The rest of
the mall is Approximate.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

177
Query Results P Ratings and Explanation
I
r om po
Moneysworth & Best

f r Acceptable (Distance/
2 023 olica Relevance
220 Yonge 10 St

, P Tu Prominence)
Toronto, ry ON n cy
M5B 2H1
e
[220 yonge st a
nu by N a 17 sday, Correct
Name Accuracy
a 2.1
J
toronto]
 ayClassification:
, 4.9 Shoe Repair
6.2 Janu
d 5
es
Tu 72.16
. 2 Address Accuracy54.9Correct
ary
by 10,
User in Toronto,
1 Na 202
Canada
Pin Accuracy Perfect
ncy 3 f
Po rom
lica IP
rpo

Most people come to the mall to shop, so this


shoe repair service, also at 220 Yonge Street, is
much less prominent and a much less likely
intent than other stores in the mall. Its
relevance is demoted to Acceptable.

The store is very small and located


underground. When comparing the official map
provided by the mall with the satellite, the
store’s location can be established inside the
green area.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

178
Query Results P Ratings and Explanation
I
r om po
[220 yonge st Subway
Relevance Bad (User Intent)
f r
2 023 olica
toronto]
 260 Yonge 10 St

, P Tu
Toronto, ry ON n cy
M5B 2H1, CAN
Name Accuracye Correct
a
nu by N a 17 sday,
a 2.1
J
User in Toronto, ayClassification:
, 4.9 Fast Food
Address Accuracy6.2 JanCorrect
Canada
ue s d . 2 5 54 uary
T 72.16 .9
Pin Accuracy by 10,
Perfect
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

This fast-food restaurant is not located at 220


Yonge Street. The name and address in the
result are Correct and the pin placement is

Perfect.

The official venue map shows the precise


location of the restaurant, but finding the
perfect area is a little tricky. Given all evidence,
the Perfect location (green area) can be
estimated generously.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

179
Query Results P Ratings and Explanation
I
r om po
[1141 Swiss Chalet
23 f r Relevance Excellent
2 0 olica
Highbury 1141 Highbury 10 cy Ave

, P Tu
Ave, London, London, ry ON nN5Y 1A5 CAN
e
a
nu by N a Name Accuracy17 sday, Correct
Ontario]
 a 2.1
J
ay, 254.9 6.2 Janu
es d . 54 ary
Tu 72.16
User in London, Address Accuracy .9Correctby 10,
1 Na 202
Canada
ncy 3 f
Pin Accuracy Po rom
Approximate
lica IP
rpo
All four of these businesses:

1. Swiss Chalet

2. Wings Kitchen

3. Fast Photo

4. Globally Local

share the 1141 Highbury Ave address and are of


similar prominence. They are all equally likely to
be the intent of a user with this query. This
means that all results can be rated Excellent.

Compare this example to the Eaton Centre


example, above, where there is a single most
prominent POI at the address that is the
dominant user intent.

In the diagram at left, the pin is in the parking


lot and would be rated Approximate for any of
the results.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

180
Address queries can also be just the name of a street, neighborhood, intersection, or city. Results for
streets, neighborhoods, intersection, IP city queries are eligible for Navigational.

and
r o m
0 2 3 f carpo
The expectation is that we 1return 0, 2 y Ptheoli requested entity with the sameTu level of broadness that the user
requested, which may unot a nc all of the elements of a full address.

ary include 1
esd
a
a n y N 7 2.1 y, Ja
, J . 9 b 6.2 nu
y
esda 6.254 54 ary
QueryT 2.1
u Results Ratings.9&byExplanation
10
17 Na , 202
Is there a Navigational Result for this Query? Yes ncy P 3 fro
oli m I
c P
Relevance Navigationalarpo
Name Accuracy n/a
Address Correct
Accuracy
Pin Accuracy Perfect

Stevens Creek Blvd

Stevens Creek Blvd

Cupertino, CA

Classification: n/a

The query is for a street in Cupertino, CA. The


postal code is optional for such results, but if
the postal code is returned, any portion of the

street has to belong to that postal code area.
The pin appears to fall outside the street
[stevens boundaries in the vector view. However, in
creek blvd satellite it is still within the boundaries.
cupertino]
Whenever there is a discrepancy the most
favorable layer should be used to determine
pin accuracy.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

181
Query ResultsIP Ratings & Explanation
m
3 fro rpo Relevance Bad (User Intent)
a
0 , 202 olic
1 P Tu
ary Nanc
y Name Accuracye n/a
u 17 sday,
y , Jan .9 by Address
2.1
6.2 JaCorrect
n
a 4 54 uary
esd .25 Accuracy .9
Tu 72.16 Pin Accuracy by 10,
Perfect
1 Cupertino, CA
Na 202
ncy 3 f
Cupertino, CA
Po rom
lica IP
Classification: n/a
rpo

This result for an entire city does not satisfy


user intent when the query was for a street in
that city. Pin is dropped within the boundaries
of the city of Cupertino and is rated Perfect.

Relevance Bad (User Intent)


[stevens
Name Accuracy n/a
creek blvd
cupertino]
Address Correct
19062 Stevens Creek Blvd
Accuracy
Pin Accuracy Perfect
19062 Stevens Creek Blvd

Cupertino, CA, 95014

Classification: n/a

The result includes a street number when the


query is just for a street, making this result tooP
I
Tu
e specific for the requested query. The pin risom o
17 sday, f
2.1 dropped on the result address.
2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

182
Query ResultsIP Ratings & Explanation
m
3 fro rpo Relevance Bad (User Intent)
Happy Lamb 202Hot ca
0 , P oli Pot
Tu
y 1 ncy Creek Blvd

19062arStevens Name Accuracy e Correct


n by NaCA, 95014

u 17 sday,
Cupertino,
a 2.1
J
ay, 254.9 Address 6.2 JaCorrect
n
e Classification:
s d Chinese
54 uary
Tu 72.16
. Accuracy .9
by 10,
1 Pin Accuracy Perfect
Na 202
ncy 3 f
Po rom
lica IP
rpo
The result is for a business on the street. When
the query is for an entire street, returning a
business is too specific a result for the
requested query.

Stevens Creek and De Anza Relevance Bad (User Intent)


Blvd. Stop

Cupertino CA 95014

Name Accuracy Correct


Classification: Bus Stop

Address
Correct
Accuracy

[stevens Pin Accuracy Perfect


creek blvd
cupertino]

The result is for a bus stop on the street. This


random result does not satisfy the user's intent
and lacks prominence compared to the very
long street.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

183
Query ResultsIP Ratings & Explanation
m
[upper east Is there a Navigational3 fro rpo Result for this Query? Yes
2 0 olica
2
side] 10 , P
a ry ancy Relevance Tues Navigational
n u yN 17 day,
a 2.1
a y, J 54.9
b Name Accuracy 6.2 Jan/a
n
d
es 16.2 54 uary
u . 9
T 72. Address by 10,
Correct
1 Upper East Side
Na 202
Upper East Side
Accuracy nc 3
Pin Accuracy Perfect y Pol from
New York, NY 10021
ica IP
rpo
Classification: n/a

The result is the requested neighborhood and


therefore is rated n/a for Name Accuracy. The
postal code is correct and belongs to the
requested neighborhood. A Perfect pin can
drop anywhere within the boundaries of the
neighborhood.

Relevance Good (User Intent)


Name Accuracy Incorrect
Address Correct
Metropolitan Museum of Art

Accuracy
1000 5th Ave
Pin Accuracy Perfect
New York, NY 10028

Classification: Art Gallrey


Research shows the Metropolitan Museum,
one of the most famous museums in the world,
is located on the Upper East Side. Its
extremely high international prominence
qualifies it for a Good rating due to secondary
intent for this query.

The Name Accuracy rating for this result is


Incorrect due to the misspelling of the
classification.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

184
Query ResultsIP Ratings & Explanation
m
3 fro rpo Relevance Bad (User Intent)
a
0 , 202 olic
1 P Tu
ary Nanc
y Name Accuracye Correct
u 17 sday,
y , Jan .9 by Address
2.1
6.2 JaCorrect
n
a 4 54 uary
esd .25 Accuracy .9
Tu 72.16 Pin Accuracy by 10,
Perfect
1 Na 202
ncy 3 f
Boqueria Upper East Side
Po rom
lica IP
1460 2nd Ave
rpo
New York, NY 10075

Classification: Spanish

The result is for a business within the queried


neighborhood. Even though the business
name contains the query terms, this result
does not satisfy user Intent, and is not
internationally prominent enough to be
considered relevant for the query.

Relevance Bad (User Intent)


Name Accuracy n/a
Address Correct
Accuracy
1596 2nd Ave
Pin Accuracy Perfect
1596 2nd Ave

New York, NY 10028

Classification: n/a

The result is for a specific address within the


Tu neighborhood. This result is too specific for IP
m
e
17 sday, the broader query. The address is not 3 fro rpo
2.1 internationally prominent enough to 0 olicathe
2
2satisfy
6.2 Janu 0,
1 cy P
54 ary intent for the query. r y
.9
by 10, n ua y Nan
Na 202 Ja b
ncy 3 f s d ay, 254.9
Po rom e .
lica IP Tu 72.16
rpo 1

185
Query ResultsIP Ratings & Explanation
m
Is there a Navigational3 fro rpo Result for this Query? Yes
, 2 0 olica
2
10 P
Relevance Tues Navigational
a ry ancy
Cork
n u yN 17 day,
2.1
a , Ja 4.9Ireland

yCork,
b Name Accuracy 6.2 Jan/a
n
[Cork]
d
es 16.2 5 54 uary
u
T 72. Classification: n/a
. 9
Address by 10,
Correct
1 Na 202
Accuracy nc 3
Pin Accuracy Perfect y Pol from
ica IP
rpo
The result is for the city of Cork in Ireland. A
perfect pin can drop anywhere within the city
boundaries.

Relevance Good (User Intent)


Cork Airport

Kinsale Rd
Name Accuracy Correct
Cork, Ireland

Address Correct
Classification: Airport

Accuracy
Pin Accuracy Perfect

The result is for a transit POI, which satisfies a


secondary query intent. The address and pin
are correct.

Relevance Bad (User Intent)


Cork City Library
Name Accuracy Correct
57-61 Grand Parade

Cork, Ireland
Address Correct
Accuracy
Classification: Library
Pin Accuracy Perfect

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu The result is for a POI within the city.10, cThis
y P does
o
54 ary r y n
.9
by 10, not satisfy secondary intentnfor ua theNaquery as it
Na 202 , Ja .9 by nor a
is neither internationallyyprominent
ncy 3 f a 4
Po rom transit POI. u esd 16.25
lica IP T 72.
rpo 1

186
Query ResultsIP Ratings & Explanation
m
[Stevens Is there a Navigational
3 fro rpo Result for this Query? Yes
2 0 olica
2
Creek and ,
10 cy Pand De Anza
De Anza] Stevens a ry Creek
n Relevance Tues Navigational
Blvd
n u yN a 17 day,
2.1
, Ja 4.9 b
yStevens Name Accuracy 6.2 Jan/a
n
d a 5 Creek and De Anza Blvd
54 uary
u es 16.2 . 9
T 72. Cupertino CA 95014
Address by 10,
Correct
1 Na 202
Classification: n/a
Accuracy nc 3
Pin Accuracy Perfect y Pol from
ica IP
rpo

The query is for an intersection and the


specific intersection is returned.

Good/Acceptable (User
Relevance
Intent)
Stevens Creek and De Anza Name Accuracy Correct
Blvd. Stop

Cupertino CA 95014
Address Correct
Accuracy
Classification: Bus Stop
Pin Accuracy Perfect

The query is for an intersection and a bus stop


with the same name is returned. In some
countries, bus stops carry the same name as
the intersection where they are located and
can satisfy a secondary intent for the query.

The pin falls where a user would wait for the


bus.

Stevens Creek Blvd


Relevance Bad (User Intent)
Stevens Creek Blvd
Name Accuracy n/a
Cupertino CA 95014

Classification: n/a
Address Correct
Accuracy
Tu Pin Accuracy Perfect IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary The query is for an intersection r y
and we
n return
.9
by 10, ua y Na
Na 202 just one of the streets from , J anthe bquery. This
ncy 3 f does not satisfy user s ay 254.9
intent.
d
Po rom e .
lica IP Tu 72.16
rpo 1

187
Query ResultsIP Ratings & Explanation
m
[95051] 3 fro rpo
2
Is there a Navigational a Result for this Query? Yes
0 , 20 olic
1 y P T u
ry c e
n ua y Nan 17 sday,
, Ja 4.9 b Relevance 2.16 JaNavigational
d a y95051

5 .25 nua
es 1Santa
6 .2 Clara, CA, 95051
4.9 ry
u
T 72. Name Accuracy n/a
by 10,
1 Classification: n/a
Na 202
ncy 3 f
Address r
Correct Poli om I
Accuracy car P
po
Pin Accuracy Perfect
The expectation for this result is to include
locality, state and postal code. Other
components are optional, but if present they
need to be correct.

The pin must drop within the boundaries of the


locality presented in the result.

10.2. Non-Specific Address

For queries where the location intent is not explicitly stated in the query, you must infer the location
intent from the user’s viewport and the user’s location. One difficulty in evaluating address queries
has to do with partial addresses, which could refer to multiple locations.

Generally, for partial addresses, users are looking for the location closest to their position or within/
near the fresh viewport. Some general considerations:

• Exact location that exists returned very close to the user is eligible for Navigational, unless
other addresses that satisfy the user intent are also very close.

• Exact location returned within a fresh viewport is eligible for Navigational, unless other
addresses that satisfy the user intent are also very close.

• Results that are farther away from an ideal result but can potentially satisfy the user’s intent
can be rated as high as Good (Distance/Prominence)

• Results are demoted based on distance.

• Results are demoted based on the density of potential results in a given area

• Results that are too far away will be rated Bad (Distance/Prominence)

Consider the query [154 orchard st] in different scenarios:

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

188
Scenario 1: Fresh viewport over Midtown Manhattan in New York City.

IP
r o m
0 2 3 f carpo
li
Query 1 0, 2 y Po User
Tu and Viewport
ry anc e
n
a
u yN 17 sday,
a User and fresh viewport
2.1 over Midtown Manhattan in
[154 orchard st] a y, J 54.9
b 6.2 Janu
es d .2 New York City 54.9 ary
Tu 72.16 by 10,
User Intent: The
1 query does not specify in which locality the address is expected. Na 202Use the
ncy 3 f
location intent given by the user and viewport to rate the results. Po rom
lica IP
Is there a Navigational Result for this Query? Yes rpo

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

189
Results IP Ratings and Explanation
r o m
① 154 Orchard St 
0 2 3 f carpo Relevance Navigational
, 2 10002
li
154 Orchard St, New York, 1 0NY Po Tu n/a
ary anc
y Name Accuracy e
Classification: n/a
Janu by N 17 sday,
2.1 J
ay, 254.9 Address Accuracy 6Correct
.25 anua
es d . 4.9 ry
Tu 72.16 Pin Accuracy by 10,
Perfect
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

The result is in Lower Manhattan, very close to the user


location.

② 154 Orchard St 


Relevance Good (Distance/Prominence)
154 Orchard St, Newark, NJ 07102

Classification: n/a
Name Accuracy n/a
Address Accuracy Correct
Pin Accuracy Perfect

The result is farther away from the viewport, but still


matches the query.
Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

190
Results IP Ratings and Explanation
r o m
③ 154 Orchard St 
3 f carpo
2 0 2 li Relevance Good (Distance/Prominence)
154 Orchard St, Garfield,y NJ10, 07026

y Po Tu
ar anc esd
Classification: n/a
Janu by N Name Accuracy 172.1 n/a ay,
ay, 254.9 6.2 Janu
s d 54 ary
e
Tu 72.16
. Address Accuracy Correct
.9
by 10,
1 N 20
Pin Accuracy Perfect ancy 23 fr
Po om
lica IP
rpo

The result is farther away from the viewport, but still


matches the query.

④ 154 Orchard Dr
Relevance Bad (Distance/Prominence)
154 Orchard Dr, Levittown, Pennsylvania
19054
Name Accuracy n/a
Classification: n/a

Address Accuracy Correct

Pin Accuracy Wrong

The result is in a different state and very far away from


the user’s viewport. The street type does also not
match the query.

The pin lands on the house with the street number 114,
which can be verified via street imagery. Since this is
several houses down from the intended address, it is
incorrect.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

191
Scenario 2: Viewport/user’s location IPin Maine. There is no address in the vicinity that contains
is
o m
r rpo address are far from the location intent of the query.

[154 Orchard St]. All locations2with


0 3 f cathis
li
1 0, 2 y Po Tu
ry anc e
Query a 17 sdand
User2.1 y, JaViewport
n u yN a
, J a b
ay 254. 9 6.2 nu
[154 orchardu esdst]
6 . User and viewport in Maine 54 ary
.9
T 72.1 by 10,
1 Na 202
User Intent: Since there is no matching result close to the location intent given ncby
y Pthe
3 f user and
r
viewport, the closest address is rated without demotion for user intent or distance/prominence. oli om I
car P
po
Is there a Navigational Result for this Query? No

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

192
Results IP Ratings and Explanation
r o m
① 154 Orchard St
0 2 3 f carpo Relevance Excellent
, 2 10002
li
154 Orchard St, New York, 1 0NY Po Tu n/a
ary anc
y Name Accuracy e
Classification: n/a
Janu by N 17 sday,
2.1 J
ay, 254.9 Address Accuracy 6Correct
.25 anua
es d . 4.9 ry
Tu 72.16 Pin Accuracy by 10,
Perfect
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

This location is among the closest possible results to


the viewport/user’s location.

② 154 Orchard St 


Relevance Excellent
154 Orchard St, Newark, NJ 07102

Name Accuracy n/a


Classification: n/a

Address Accuracy Correct


Pin Accuracy Perfect

This location is among the closest possible results to


the viewport/user’s location.

③ 154 Orchard St 


Relevance Excellent
154 Orchard St, Garfield, NJ 07026

Name Accuracy n/a


Classification: n/a

Address Accuracy Correct


Pin Accuracy Perfect

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu This location is among the closest possible 10,results
o
y P to
54 ary r y n c
.9
by 10, the viewport/user’s location. ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

193
Results IP Ratings and Explanation
r o m
④ 154 Orchard Dr
0 2 3 f carpo Relevance Bad (User Intent)
154 Orchard Dr, Levittown, 1 , 2 Poli
0Pennsylvania Tu
y
19054
u ary Nanc Name Accuracy 1 esdn/a
72 ay, J
Jan .9 by .16
Classification:sn/a

a y , 4 Address Accuracy .25 anua


Correct
e d .25 4.9 ry
Tu 72.16 by 10
1 Pin Accuracy Wrong Nan , 202
cy 3 fr
Po om
This location is farther from the viewport/user
lica Ilocation
rpo P for
than the result in New York and therefore demoted
distance. The user is also looking for a Street, but has
been presented with a Drive.

The pin lands on the house with the street number 114
which can be verified via street imagery. Since this is
several houses down from the intended address, it is
Wrong.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

194
Here is another example of an address query with implicit location intent. Although this is a common
address in US cities, it overwhelmingly P
Irefers to the location of the White House and should be
o m
considered the primary intent of23the fr query
r p o unless an additional location modifier is provided (i.e.
ca
20different
state, city, or postal code) or 0 ,a P oli 1600 Pennsylvania Ave that’s
Tu not the White House is already
1 cy
in or very near the location ry intent.

n e
n
a
u yN a 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu
Scenario 1: Fresh d
es viewport
.2 on Los Angeles, CA (not near Richmond, CA):
54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Query Results Ratings and Explanation
Po rom
lica IP
rpo
Is there a Navigational Result for this Query? Yes
The White House 
Relevance Navigational
1600 Pennsylvania Ave,
Washington, DC, 20500 United Name Accuracy Correct
States
Address Accuracy Correct
Classification: Landmark

Pin Accuracy Perfect

The POI associated with this address is


[1600 overwhelmingly prominent and this is the
pennsylvania most likely intent.
ave]


Fresh viewport
on Los Angeles,
1600 Pennsylvania Ave
Acceptable/Bad
CA (not near Relevance
1600 Pennsylvania Ave, (Distance/Prominence)
Richmond, CA)
Richmond, CA 94801

Name Accuracy n/a


Classification: n/a

Address Accuracy Correct


Pin Accuracy Perfect

Technically a match, but considering the


user’s viewport it is less likely that the user is
looking for this location.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

195
Scenario 2: The fresh viewport is in San Francisco, CA (near Richmond, CA). The proximity of the
user viewport to the Richmond location IPmakes this location just as relevant as the prominent location
r o m
in Washington DC.

0 2 3 f carpo
li
Query 1 0, 2 yResults
Po TuRatings & Explanation
ry anc e
n
a
u yN 17 sday,
a 2
y,IsJ 5there
.9 b a Navigational Result for this Query?.16.2 anNo
J
d a 4 5 u
es 6.2 4.9 ary
Tu 72.1The White House
Relevance bExcellent
y N 10, 2
1 1600 Pennsylvania Ave, an 023
Name Accuracy cy
Correct
Washington, DC, 20500
Po from
lica IP
Classification: Landmark
Address Accuracy Correct rpo

Pin Accuracy Perfect

[1600 Both results are equally valid, so neither can


pennsylvania get Navigational and should instead be rated
ave]
 Excellent.

Fresh viewport
on San 1600 Pennsylvania Ave
Relevance Excellent
Francisco, CA
1600 Pennsylvania Ave,
(near Richmond, Name Accuracy n/a
CA)
Richmond, CA 94801

Classification: n/a
Address Accuracy Correct
Pin Accuracy Perfect

Both results are equally valid, so neither can


get Navigational and should instead be rated
Excellent.

10.3. Query Address Does Not Exist

To be useful to the user, address results need to point to either a building with that address or a plot
of land that has been officially assigned the address. Sometimes your research will show that a full
query address does not exist (or no major search engine will be able to determine its exact location).
In cases like this, you will see one of three types of results:

Tu• The closest verified address (on the same street and in the same city and state): oRate m o
IP
esdrelevance as Excellent.
r
f rp
17 ay,
•2.16The 23 aslica
Jasame address as the query address: Rate relevance as Excellent and address 0, 2 0
P o
.25 nua – Address does not exist. The pin will be rated Can’t Verify.
1
Incorrect
4.9 ry a ry ancy
by 10, street without a street number: Rate relevance as Acceptable.
u N
• The queriedNa 202 Jan .9 by
ncy 3 f a y, 4
Po rom u esd 16.25
When a queried address licadoesIPnot exist, the answer to the question “Is there
T 72.a navigational result for
1
this query” will always be rNo.

po

196
Query ResultsIP Ratings and Explanation
m
[2001 Duncan Is there a Navigational 3 fro rpo Result for this Query? No
2 0 olica
2
St, San 10 , P
Francisco]  1099 aDuncan
ry ancy St
Relevance Tues Excellent
u Duncan
N 1 da
1099n y St., San 7 2 y,
, Ja 4.9 b
yFrancisco, Name Accuracy.16.2 Jann/a
d a 5 94131, CA
5 u
4.9 ary
es 6.2
Tu 72.1Classification: n/a
Address Accuracy y N 10, 2
Correct
b
1 an 023
c
Pin Accuracy Perfecty Pol from
ica IP
rpo
If 2001 does not actually exist then selecting
1099, the closest address on the same street in
the same city and state that does exist, is
considered correct.

For a locale that uses the rule of even numbers


on one side of the street and the odd numbers
on the other, we need to return the closest
existing address on the same side of the street
as the query. If the rule of odds and evens does
not apply then the closest numeric number will
be considered correct.

The pin has to be correctly dropped on the


address presented in the result to be rated
Perfect.

2001 Duncan St
Relevance Excellent
2001 Duncan St., San Name Accuracy n/a
Francisco, 94131, CA

Classification: n/a
Incorrect – Address
Address Accuracy
does not exist
Pin Accuracy Can’t Verify
Duncan Street only goes up to number 1099,
but the query requests a non-existent number.
The result returned is the same as the queried
address and should be rated as Excellent.

The pin rating for addresses that do not exist is


Can’t Verify.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

197
Query ResultsIP Ratings and Explanation
om
Duncan St
23 fr arpo Relevance Acceptable (User Intent)
0 olic
Duncan St, 1 0, 2SanP Francisco, Tu
94131, ryCA
ancy Name Accuracy e n/a
u a 17 sday,
an by N 2.1
, J
Classification:
ay 254.9 n/a
Address Accuracy 6.2 JanCorrect
es d . 54 uary
Tu 72.16 .9
Pin Accuracy by 10,
Perfect
1 Na 202
ncy 3 f
ro
Po with
The result returns only the street lica maIPpin
dropped within the boundaries of the rpostreet.
This result technically satisfies the user intent,

but this intent is unlikely, so relevance should
be rated Acceptable.

10.4. Point of Interest

A correct location result should be rated Navigational for queries referring to a point of interest.
Consider the query [mount rushmore], the famous US monument. Although the query terms do not
contain an explicit location, the Mount Rushmore monument is so prominent and unambiguous that
its location should be considered the primary location intent. The user viewport and user location are
irrelevant for this query because the user is looking for the place of interest no matter where they
currently are.

Query Results Ratings and Explanation


Is there a Navigational Result for this Query? Yes
[mount
rushmore]
Relevance Navigational
Name Accuracy Correct
Address Accuracy Correct
Mount Rushmore National Pin Accuracy Perfect
Memorial

13000 S Dakota 244, Keystone,


SD, United States

Classification: Landmark

Tu The pin can drop anywhere within the IP


o m o
e
17 sday, boundaries of the park to be rated Perfect. f r
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

198
Query Results IP Ratings and Explanation
o m
r rpo at
Mount Rushmore
0 2 3 f caKOA Relevance Bad (User Intent)
li
Palmer Gulch
1 0, 2 y Po Tu
12620 ry anc 244
 e
n ua Highway
N 17 sday, Correct
Name Accuracy
, Ja City,
Hill . 9 by SD  57745
2.1
6.2 Janu
a y 4
esd 6.25 54 ary
Tu 72.1Classification: Campground
Address Accuracy .9 Correct
by 10,
1 Na 202
Pin Accuracy Perfect
ncy 3 f
Po rom
lica IP
rpo

This result is a campground within the park


and is not the park the user asked for.

Mount Rushmore Gift Shop

Relevance Bad (User Intent)


13000 SD-244, Keystone, SD
57751

Name Accuracy Correct


Classification: Gift Shop

Address Accuracy Correct


Pin Accuracy Perfect
This result is a gift shop inside Mount
Rushmore National Park and is not the park
the user asked for. Both the Name and
Address Accuracy are verified and rated
Correct. The pin falls on the shop and is
Perfect.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

199
Query Results IP Ratings and Explanation
m
Is there a Navigational
3 fro rpo Result for this Query? Yes
, 2 0 olica
2
Route 10 P
RelevanceTues Navigational
a ry66
ancy
u y N AZ  86337

Seligman,
n 17 day,
2.1
, Ja 4.9 b
yUnited Name Accuracy 6.2 Jann/a
d a 5 States
54 uary
es 6.2 .9
Tu 72.1Classification: n/a
Address Accuracy y N 10, 2
bCorrect
1 an 023
cy
Pin Accuracy Perfect Po from
lica IP
rpo
This result represents Route 66 and is rated
Navigational regardless of user location,
viewport, or the locality in the address. The

pin can be dropped anywhere along the route.

Route 66 Indian buffet all 7 Relevance Bad (User Intent)


[route 66]
days
Name Accuracy Partially Correct
Fresh viewport 397 Las Colinas Blvd,

on Amarillo, TX
Irving, TX  75039
Incorrect - Unit/Apt,
Address Accuracy
Classification: Indian
Street Name
Pin Accuracy Perfect
The result is a randomly chosen business far
from the user whose name includes the query
terms. The result name differs from the
official name variations used on the website:
“Route 66 Fine Indian and American
Cuisines” or “Route 66 Indian Cuisine”.
However, the name is still recognizable and is
rated Partially Correct. The address on the
official website is “397 East Las Colinas Blvd”
whereas the result address excludes “East”.
Also, the official site lists a unit number, 180,
which is missing from the address in the
result.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

200
Query Results IP Ratings and Explanation
m
Is there a Navigational3 fro rpo Result for this Query? Yes
, 2 0 olica
2
Machu 10 cy P RelevanceTues Navigational
a ry Picchu

a n da
Aguasn u Calientes,
N Peru
1 7 y
a by 2.1 , Ja
a y, J 54.9 Name Accuracy 6.2 nCorrect
d
es 16.2 54 uary
u .9
T 72.
1 Address Accuracy y N 10, 2
bCorrect
an 023
cy
Pin Accuracy Perfect Po from
lica IP
rpo

The result is an internationally known historical


site and the most relevant result, making it the
primary user intent.
[Machu
Picchu]

Fresh viewport
over Relevance Good (User Intent)
Massachusetts,
some distance Machu Picchu Restaurant
Name Accuracy Correct
away from 307 Somerville Ave, Somerville, MA
Somerville, MA
Address Accuracy Correct
02143

Pin Accuracy Perfect

Since the result is reasonably close to the


fresh user viewport, it will be considered
secondary intent for this query.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

201
10.5. Understanding Multiple Query Interpretations: Beyond Viewport and User Location

IP
r o m
Many address/POI queries have2multiple
0 3 f carpo interpretations. Understanding which interpretation is most
likely often requires extra research li
1 0, 2 y Poin addition to considering theTviewport
u
and user’s location. It is
critical to fully understand y c
ar thenquery through research rather than 17 guessing.

e sda
J a nu by Na 2.1 y, Ja
s d ay, 254.9 6.2 nu
54 ary
QueryTue .16. Results Ratings .9and Explanation
by 10,
1 7 2 Na 20
Is there a Navigational Result for this Query? Yes ncy 23 fr
Po om
lica IP
New York City
Relevance Navigational rpo
New York City, NY, US

Name Accuracy n/a


Classification: n/a

Address Accuracy Correct


Pin Accuracy Perfect

This is a very prominent result that satisfies


the user intent.

New York State


Relevance Good (User Intent)
New York, US

Name Accuracy n/a


Classification: n/a

[new york]
 Address Accuracy Correct


Pin Accuracy Perfect
User and
viewport
somewhere in This result refers to the state of New York and
France satisfies a secondary intent of the query.

Avenue de New York


Relevance Good (User Intent)
Avenue de New York, Paris,
France
Name Accuracy n/a
Classification: n/a
Address Accuracy Correct
Pin Accuracy Perfect

Tu IP
e The result is within the fresh viewport,3 fbut romis rpo
17 sday, 0 2 ca
2.1
6.2 Janu not a very prominent street. Although 0, 2 y Pthis
ol is
i
54 ary y 1
still a possible interpretation,arit is anot
c a perfect
.9
by 10, u yN n
Na 202 match to the query and, is aovershadowed
n
J .9 b by
the prominence of eNew y
ncy 3 f
Po rom sd York
a
.25 City.

4
lica IP Tu 72.16
rpo 1

202
Query Results IP Ratings and Explanation
m
Is there a Navigational 3 fro rpo Result for this Query? Yes
, 2 0 olica
2
Amsterdam 10 P T
a ry ancyCafe
Relevance uesd Navigational
410 n uSouth N Gay St
 17 a y
y 2.1 , Ja
, Ja 4.9 b
yAuburn, Name Accuracy 6.2 nCorrect
d a 5 AL 36830
54 uary
u es 16.2 .9
[amsterdam
T 72. Classification: American (New)

1 Address Accuracy y N 10, 2


bCorrect
an 023
cafe]
 cy
Pin Accuracy Perfect Po from
lica IP
rpo
User and fresh The user and fresh viewport are close to
viewport in Auburn, Alabama, this cafe is an exact match,
Auburn, AL and can therefore be considered the main
intent.

The pin lands on the edge of the building, so


by applying the tennis rule the pin will be
rated as Perfect.
Is there a Navigational Result for this Query? No
Café de Jaren
Relevance Excellent
Nieuwe Doelenstraat 20-22, 1012
CP Amsterdam, Netherlands
Name Accuracy Correct
[amsterdam
cafe]
 Classification: Café
Address Accuracy Correct

User and Pin Accuracy Perfect


viewport
somewhere in
Europe The user and viewport are in Europe, so cafes
in the city of Amsterdam are the expected
results.

Is there a Navigational Result for this Query? No


Relevance Excellent
Café de Jaren

Nieuwe Doelenstraat 20-22, 1012 Name Accuracy Correct


CP Amsterdam, Netherlands

Classification: Café
Address Accuracy Correct
[amsterdam Pin Accuracy Perfect
cafe]
 IP
Tu o m o
esd f r
72 aand
1User y fresh 0 23 licarp
.16 , Jan The user and viewport are in a rural 2 area
o and
viewport
.25 inua 10, cy P
Maine,4.US there is no relevant result in the r area, so the
y
9 b ry 1 0 n ua y Nan
yN ,2 strongest matches are cafes
, J 4.9 b the city of
a in
an 023 a y
cy Amsterdam. esd .25
Po from Tu 72.16
lica IP
rpo 1

203
Query Results IP Ratings and Explanation
m
Is there a Navigational
3 fro rpo Result for this Query? Yes
, 2 0 olica
2
10 P T
Relevance uesd Navigational
a ry ancy
n u yN 17 ay,
a 2.1
a y, J 54.9
b Name Accuracy 6.2 Jann/a
d
es 6.2 54 uary
Tu 72.1Europe
Address Accuracy
.9
y N 10, 2
bCorrect
1 Europe
an 023
[europe]
 cy
Classification: n/a
Pin Accuracy Perfect Po from
lica IP
User and rpo
The query is clearly for the European
viewport
somewhere in continent, so returning the continent should
US be rated Navigational. If the name of a local
business exactly matches the query with no
extra words then that business may be a
reasonable interpretation of the query and
should be rated based on distance from the
user or viewport. All other businesses are
Bad.
Is there a Navigational Result for this Query? Yes
Relevance Navigational
Name Accuracy n/a
Paris

Paris, France
Address Accuracy Correct
Classification: n/a
Pin Accuracy Perfect

The query [paris] can mean either the capital


of France or one of the more than 10 towns
across the USA with the same name. Because
[paris]
 of the small population and lack of tourism in
these small towns, the city in France should
User and fresh be rated Navigational unless the query’s
viewport location intent is within or very close to one of
somewhere in these small US cities.
San Francisco,
CA Paris
Acceptable/Bad (User
Relevance
Texas, USA
intent)
Classification: n/a
Name Accuracy n/a
IP
Tu
e Address Accuracy Correct r o m o
17 sday, f
2.1 0 23 licarp
6.2 Janu Pin Accuracy Perfect 2 o
54 ary y 10, cy P
r n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
This result is unlikely
Tu 72to .1 satisfy the user intent.
6
lica IP
rpo 1

204
Query Results IP Ratings and Explanation
m
Is there a Navigational
3 fro rpo Result for this Query? No
, 2 0 olica
2
10 P T
Relevance uesd Excellent
a ry ancy
n u yN 17 ay,
2.1
a , Ja 4.9 b Ho's Hunan Food

yBrandy Name Accuracy 6.2 JanCorrect


d
es 6.2 5 54 uary
Tu 72.1217 Columbus Ave, San .9
Address Accuracy y N 10, 2
bCorrect
[hunan]
 1 Francisco, CA 94133
an 023
cy
Classification: Hunan
Pin Accuracy Perfect Po from
User and fresh lica IP
rp
viewport The query [hunan] represents botho the
somewhere in seventh most populous province in China and
San Francisco, a popular type of cuisine. In this case, both
CA user location and viewport are in the San
Francisco Bay area. An online maps search
done by a user in this area shows that the
dominant intent of this query is for the
cuisine. The province is a less likely, but still
viable, intent that can be rated Acceptable.

10.6. Business Queries

Before you rate a business query, consider:

• Multiple interpretations: Are there ways to interpret the query terms other than as a
business name? French Laundry is both a famous restaurant in Napa and a type of
laundromat/cleaner.

• Number of locations: How many locations of this business exist? If there are many of them
(like Starbucks) then the user expects to find locations in or very close to the their location
intent.

• Population density: Is the area of the business results urban, suburban, or rural? City
dwellers are less willing to travel longer distances than suburban and rural users.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

205
10.6.1. Non-Chain Businesses

IP
o m
Some businesses have only one 3location, fr rpo so treat and rate them as navigational queries. The correct
location should be rated Navigational 0 2 ca
0 , 2
P oli and any other results should
Tu
receive Bad (User Intent).

y 1 cy e
ar n 17 sday,
a nu by Na 2.1
Query a
J
y, 54.9 Results 6.2 Janand
Ratings ua Explanation
s d 2 54
e
Tu 72.1Is 6 . .9 ry 1
there a Navigational Result for this Query? byYes0,
Na 202
1 ncy 3 f
Klein High School
Relevance Navigational
Po rom
lica IP
16715 Stuebner Airline Rd
rpo
Spring, TX 77379
Name Accuracy Correct
Classification: High School
Address Accuracy Correct
Pin Accuracy Perfect

This is a perfect result for the query. While


the city on the official website is ‘Klein’,
because USPS validates the full address, as
[klein high returned, in the city as ‘Spring’, we can rate
school]
 the address as correct.

User and Fresh


Viewport in Klein Independent School Relevance Bad (User Intent)
Spring TX District Central Office

7200 Spring Cypress Road


Name Accuracy Correct
Klein, TX 77379
Address Accuracy Correct
Classification: School District
Office
Pin Accuracy Perfect

The school district office is not relevant for


the query.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

206
Query Results IP Ratings and Explanation
m
Is there a Navigational
3 fro rpo Result for this Query? Yes
, 2 0 olica
2
Restaurant 10 y P Danko
T
a ry ancGary Relevanceuesd Navigational
800 n uNorth N Point St, San Francisco, 17 a y
y 2.1 , Ja
, Ja 4.9 b
yCalifornia Name Accuracy 6.2 nu Correct
d a 5 94109
54 ary
u es 16.2 .9 10
T 72. Classification: American (New)
Address Accuracy byCorrect
1 Na , 202
ncy 3 f
Pin Accuracy PerfectPo rom
lica IP
rpo

This is a nationally famous restaurant in San


Francisco with no other possible results.

800 North Point


Relevance Bad (User Intent)
800 North Point St, San Francisco,
California 94109
Name Accuracy n/a
[Gary Danko Address Accuracy Correct
800 North
Point St, San Pin Accuracy Perfect
Francisco,
When a user types in the name of a business
California
or a POI along with its address, they expect
94109]
to see the business mentioned in the query
as part of the result. If the result is the
address alone and does not mention the
business, the user cannot be certain that the
query and the result refer to the same thing.
This is why the result’s relevance is Bad.
Garry Lee, DDS
Relevance Bad (User Intent)
1259 Mason St, San Francisco,
California 94108
Name Accuracy Correct
Classification: Dentist
Address Accuracy Correct
Pin Accuracy Perfect

Result is unrelated to the queried restaurant.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

207
Sometimes there are multiple unrelated businesses with the same name in the same area. In this
case, rate each business independently IPconsidering its relevance and distance from the location
r o m
intent of the query.

0 2 3 f carpo
li
1 0, 2 y Po Tu
ry anc e
Query a 17 sdand
User
2.1 y, JaViewport
n u yN a
, J a b
ay 4. 9 6.2 nu
esd 16.25 User inside a fresh viewport 54 over
.9 aryin1 Dearborn, MI (a
[lighthouse] u
T 72. suburb of Detroit) by 0
Na , 202
1 ncy 3 f
User Intent: When there are multiple unrelated businesses with the same name inP thersame area,
oli om I
rate each business independently considering its relevance and distance from the location car Pintent of
po
the query.
Is there a Navigational Result for this Query? No

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

208
Results IP Ratings and Explanation
r o m
① The Lighthouse
0 2 3 f carpo Relevance Excellent
2 oli
4474 W Jefferson Ave
y 10, cy P Name Accuracy Tu Correct
e
r n
Ecorse, MI 48229
anua y Na 17 sday,
J b 2.1 J
ay, 254.9
Classification:sPub
Address Accuracy 6Correct
.25 anua
e d . 4.9 ry
Tu 72.16 Pin Accuracy by 10,
Perfect
1 Na 202
nc 3f
This is one of the closest results thatyfits
Po thero
lica muser’s
IP
query. This result should receive a relevancerprating
o of
Excellent.

Both the Name and Address Accuracy are verified and


rated Correct.

The Pin lands on the correct rooftop.

② Lighthouse Ministries of Free Relevance Good (User Intent)


Methodist Church

2069 Chandler Ave


Name Accuracy Correct
Lincoln Park, MI 48146

Classification: Church
Address Accuracy Correct
Pin Accuracy Perfect
This is one of the closest results and partially fits the
query intent. This result is about the same distance from
the user’s location as the result above (The Lighthouse),
but is less likely to be the user's intent based on the
query. Therefore, this result should be demoted based
on secondary intent to Good.

Both the Name and Address Accuracy are verified and


rated Correct.

The pin lands on the correct rooftop and is Perfect.

10.6.2. Chain Businesses

A query for a chain business is generally not considered an explicit query and is therefore not eligible
a for Navigational rating unless the query contains a location modifier that points to a single unique
location (see Chain Business with Location Modifier).
IP
Tu o m o
esd r
Chain a
17 businesses are businesses that have more than one location, and include everything 3 f carp
2from
2.1 y, Ja 2 0 li
6.2 chains
national nu like Starbucks, Target, Auchan, Albert Heijn, and Boots down to small local 1 y Po
0, chains.

54 ary
.9 a ry anc
by 10, u N
Na 20should Jan .9 by
Distance evaluations 2
ncy 3 f be based on chain business locations in the real world,
y,
da .254 not only the
r e s
returned results.
P o
oli m I Tu 72.1 6
car P 1
po

209
• The more locations the chain business has in the area, the closer the results should be in
order to be considered relevant. IP

o m
r rpo
• The fewer locations the chain 3 f cbusiness has in the area, the more you can widen the distance
2 0 2 l ia
for relevant results.
10 y P , o Tu
ry anc e
n
a
u yN 17 sday,
Note: Go to the chain a 2.1 of
d a y, J 54business’
.9 b official website and check the address 6.2 Janthe
ua
specific branch you’re
rating. For each s branch. 2 of a chain business, research to verify that it 5
actually
4 exists
r y 1 at the address
Tue .16 .9
b 0
listed in the result.

17 2 y Na , 202
ncy 3 f
Po rom
lica IP
rpo

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

210
IP
Query o m
fr rpo User and Viewport
2 3 a
0 lic
[whole foods] 1 0, 2 y Po User and fresh
Tu viewport in Irvine, California
ry anc e
a
u yN 17 sday,
User Intent: The,user Ja .9isb clearly looking for the grocery chain Whole
n 2.1 Foods close to their location
ythe 6.2 Janu
or at least within
es d a
.2 5viewport.
4 5 a
4.9 ry
Tu 72.16 by 10,
Is there a Navigational
1 Result for this Query? No Na 202
ncy 3 f
Po rom
lica IP
rpo

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

211
Results IP Ratings and Explanation
m
Is there a Navigational Result 3 fro this
for rpo Query? No
0 2 l i c a
, 2 o
10 P
Relevance
Tu
e Excellent
ry ancy
n
a
u yN 17 sday,
a b 2.1 J
d a y, J 54.9 Name Accuracy 6Correct
.25 anua
es .2 4.9 ry
Tu 72.16 Address Accuracy by 10,
Correct Na 202
① Whole Foods
1 ncy 3 f
The District, 2847 Park Ave, Tustin, CA Pin Accuracy Approximate Po rom
lica IP
92782
rpo
Classification: Grocery

This is a Whole Foods store within the user’s viewport


as well as the closest Whole Foods location to Irvine.

The pin is dropped within the shared parking lot of the


result, making it Approximate.

② Whole Foods
Relevance Good (Distance/Prominence)
Fashion Island, 415 Newport Center Dr,
Newport Beach, CA 92660
Name Accuracy Correct
Classification: Grocery
Address Accuracy Correct
Pin Accuracy Perfect

This is a Whole Foods store in the same metro area, but


is outside the user’s viewport.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

212
Results IP Ratings and Explanation
m
fro rpo Acceptable (Distance/
③ Whole Foods
2 2 3
0 olica Relevance
Aliso Village Shopping Center, ,
10 23932 P Tu Prominence)
a ry ancy esd
Aliso Creek Rd, Laguna a n u Niguel,
y N CA 92677
Name Accuracy 1 7 ay,
2.1 Correct
, J
Classification:sGrocery

ay 254. 9 b 6.2 Janu


d 54 ary
e
Tu 72.16
. Address Accuracy Correct
.9
by 10,
1 N 20
Pin Accuracy Perfect ancy 23 fr
Po om
lica IP
rpo
This is a Whole Foods store in a neighboring city,
outside of the viewport and a considerable distance
away. As such this result is less relevant to the user and
is rated Acceptable.

10.6.3. Chain Business with Location Modifier

If the query for a chain business includes a location modifier that points to a single unique branch of
that business, that specific branch can be eligible for a Navigational rating.

When there are multiple results available for the location modifier, the highest possible rating for all
results will be Excellent. Remember:

• User and viewport location should always be ignored when there is a location modifier

• Ratings must always be based on possible real-world results

There are two types of location modifiers:

• General location modifier (locality or postal code)

• Specific location modifier (street or full address)

10.6.3.1. General Location Modifier

Location modifiers in the form of localities or areas are considered to be general location modifiers.

Results inside the requested location

When the location modifier is general, results inside the specified location are not demoted for
distance.

Tu IP
esd r o m o
f
17 ay,
2.1 2 0 23 licarp
J o
6.2 anu
54 ary y 10, cy P
r n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

213
Quantity of results IP
Location of
inside the requested o m
fr rpo Rating and Explanation
results 3
location
0 2 lic a
1 0, 2 y Po Tu
ry anc If there is only one e
result
n
a
u yN 17 sdapresent
y, J
in the requested
J a b 2
location, it should receive. 16 a rating of Navigational.

ay, 254.9 .25 anua


es d .One 4 .9 r y
Tu 72.16 It is promoted because it is the byonly10result
, that satisfies
1 N an 2023
Inside the the user intent c y P ro f
oli m I
requested When there are multiple results for the chain
car P
pbusiness in
location o
the requested location, they should all receive a rating
of Excellent.

More than one


Ignore user and viewport location. The user has already
told you exactly where they are looking for results.

Results outside the requested location

When the location modifier is general, results outside the requested location are demoted based on
how many results there are inside it.

Location of Results inside the


Rating and Explanation
results requested location

If there are no results for the chain business inside the


requested location, results outside the area may be
Outside the demoted less severely depending on how close they are
requested to the named location and how many branches of the
location chain exist in the real world. Ratings may range from
Excellent to Bad.

None
This is because when there are no locations of a chain
business inside the requested area, results that are
outside it can still be relevant. However, it's also IP
Tu m o
e possible for results to be so far away from the location f r o
17 sday, 23 licarp
2.1 that they have no relevance at all. 2 0
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

214
Location of Results inside the IP Rating and Explanation
results requested location r o m
0 2 3 f carpo
li
1 0, 2 y Po If there are few results
Tu for the chain business inside the
ry c esd outside the area may be
requested location, 1results
n ua y Nan 72 ay, J
a demoted less severely.1depending
a y, J 54.9
b 6. anu on how close they are
es d .2 to the named location and25how 4.9 many
ary branches of the
Tu 72.16 b y N 10may
chain exist in the real world. Ratings , range from
1 an 2023
Good to Bad.
cy
Po from
Few lica IP
rpo
This is because when there are fewer locations of a
chain business inside the requested area, results that
are outside it can still be relevant. However, it’s also
possible for results to be so far away from the location
that they have no relevance at all.
When there are many results for the chain business
inside the requested location, results outside the area
Many are demoted to Bad. This is because there are multiple
results that would satisfy user intent inside the
requested area, so there’s no need to look outside it.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

215
IP
Query o m
fr rpo User and Viewport
2 3 a
0 lic
[Starbucks san francisco] 1 0, 2 y Po User and fresh viewport
Tu in San Francisco, CA
ry anc e
a
u yN 17 sday,
User Intent: The,user a isb seeking a Starbucks in a specific location.
n 2.1 TheJafresh viewport and user
location can be y J 54.9 since the user has an area in mind for results.
ignored
6.2 nu
d a
es 16.2 5Because
4.9 ary there are so many
Tu
Starbucks within . the named area, results outside it are rated Bad. by 10,
172 Na 202
ncy 3 f
Is there a Navigational Result for this Query? No Po rom
lica IP
rpo

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

216
Results IP Ratings and Explanation
m
fro rpo Relevance Excellent
① Starbucks
2
3
0 olica
2
,
10 cy P
2165 Polk St, San Francisco, ry anCA Name Accuracy Tu Correct
e
94102
n
a
u yN 17 sday,
Ja b 2.1 Ja
ay, 254.9
Classification:sCoffee
Address Accuracy 6.Correct
25 nua
e d . 4.9 ry
Tu 72.16 Pin Accuracy by 10,
Perfect
1 Na 202
ncy 3 f
Po rom
lica IP
This result is one of many Starbucks in the specified
rpo
location, San Francisco, and is rated Excellent. All results
within San Francisco are eligible for the highest possible
initial rating of Excellent.

All the data for the result is correct.

Relevance Excellent
② STARBUCKS

Name Accuracy Correct


1231 Market St, San Francisco, CA
94103
Address Accuracy Correct
Classification: Coffee

Pin Accuracy Perfect


This result is one of many Starbucks in the specified
location, San Francisco, and is rated Excellent. All results
within San Francisco are eligible for the highest possible
initial rating of Excellent.

The STARBUCKS name is written in capital letters. Because


this is how the business refers to itself on storefront signs,
it is Correct. The address is Correct and the Perfect pin
lands on the correct rooftop.

③ Starbucks
Relevance Bad (Distance/Prominence)
1555 40th St. Emeryville, CA 94608

Classification: Coffee
Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Approximate
This Starbucks is outside of the boundaries of the specified
Tu location and should be rated Bad since there are so many IP
m o
e Starbucks to choose from in San Francisco.
f r o
17 sday, 0 23 licarp
2.1 2
6.2 Janu 0, y Po
54 ary The name and address are Correct. Usingarthe y 1 best
c
.9
by 10, n u y Nan
Na 202 available evidence — in this case, street, Ja 4imagery
9b — the
ncy 3 f a y .
Po rom location of the Starbucks under the
esd 1rooftop
.25 can be found.
lica IP 2. 6
Tu 7rooftop,
Since the pin falls on the correct but not in the
rpo 1
correct location, it is rated Approximate.

217
Results IP Ratings and Explanation
m
fro rpo
④ Starbucks
2 3
20 olic
a Relevance Bad (Distance/Prominence)
601 Westlake Center, Daly 1 0 ,
City, CA
P T
ry c y u e
94015
ua y Nan Name Accuracy 17 sdaCorrect
n
Ja .9 b 2.1 y, Ja
a y ,
Classification:sCoffee
4 6.2 nu
u e d 16.25 Address Accuracy
54 ary
Correct
.9
T 72. by 10,
1 N 20
Pin Accuracy Perfect ancy 23 fr
Po om
lica IP
rpo
This Starbucks is outside of the boundaries of the specified
location and should be rated Bad since there are so many
Starbucks to choose from in San Francisco.

All the data for the result is correct.

⑤ Starbucks
Relevance Bad (Distance/Prominence)
12 Manor Plaza, Pacifica, CA 94044

Classification: Coffee
Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Approximate

This Starbucks is outside of the boundaries of the specified


location and should be rated Bad since there are so many
Starbucks to choose from in San Francisco.

The pin drops within the Half n' Half rule boundaries of the
shared parking lot.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

218
Query IP User and Viewport
m
[Aldi waco tx] 3 fro rpo User and fresh viewport in Houston, TX
, 2 0 olica
2
User Intent: The user aasked 10 cy Pa specific chain business in a specific
Tu
ry anfor e location. The fresh viewport
can be ignored since n u yuser
the N has a specific area in mind for 17 sdaBecause
results. y there are very few
Ja .9 b 2.1 , Ja
y , 6 n
stores within the
a specified
4 area, results outside it are gradually demoted. . 25 ua
esd .25 4.9 ry
Tu 72.16 b 10
Is there a Navigational
1 Result for this Query? Yes y Na , 202
ncy 3 f
Po rom
lica IP
rpo

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

219
Results IP Ratings and Explanation
m
3 fro rpo Relevance Navigational
, 2 0 olica
2
10 P
Name Accuracy Tu Correct
ry ancy e
n
a
u yN 17 sday,
a b 2.1 Ja
d a y, J 54.9 Address Accuracy 6.Correct
2 nu
s 6.2 54.9 ary
① ALDI
T 72.1
u e
Pin Accuracy by 10,
Approximate
1
1220 N Valley Mills Dr, Waco, TX Na 202
ncy 3 f
76710
Po rom
lica IP
Classification: Grocery
rpo

ALDI is a well-known chain business. Research confirms


that the location modifier in the query narrows possible
results to a single unique location. This is the only location
eligible for a Navigational rating.

The pin drops within the shared parking lot.

② ALDI
Relevance Good (Distance/Prominence)
3310 S 31st St, Temple, TX 76502

Classification: Grocery
Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Perfect
Although this result is not in Waco, research shows that,
unlike the many Starbucks in San Francisco, there are very
few Aldi stores in the Waco area. That is why this nearby
result should be demoted -2 for distance from the highest
possible initial rating of Navigational and rated Good.

The pin drops on the edge of the appropriate rooftop and


can be rated Perfect.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

220
Results IP Ratings and Explanation
m
3 fro rpo Acceptable (Distance/
2 0 olica Relevance
2
③ ALDI
10 , P Tu Prominence)
a ry ancy esd
3623 W State Highway u 31, N Corsicana, Name Accuracy 1 ay,
a n y 7 2.1 Correct
TX
a , J
y 54. 9 b 6.2 Janu
d
es 16.2 54 ary
u Address Accuracy Incorrect
.9
by 1–0,Postal Code
Classification:7Grocery

T 2 .
N 20
1
Pin Accuracy Perfect ancy 23 fr
Po om
lica IP
Although this result is not in Waco, research shows rpo that,
unlike the many Starbucks in the San Francisco example
above, there are very few Aldi stores in the Waco area. This
result has been demoted -3 from the highest possible
initial rating of Navigational to Acceptable because it is
significantly farther from the area of expected results.

The postal code, which is a mandatory address


component, is missing from the result address.

10.6.3.2. Specific Location Modifier

Location modifiers in the form of streets or full addresses are referred to as specific location
modifiers.

When the a query includes a specific location modifier, results that satisfy the location intent should
not be demoted for distance:

Number of results
Location of
inside the requested Rating and Explanation
results
location

Consider the location modifier a general one and


None demote results based on distance to the specified
location.

If there is a only a single result present in the specified


location it should receive a rating of Navigational.

One
Inside the It is promoted because it is the only result that satisfies
requested
Tu the user intent IP
o m o
location
e
17 sday, f r
2.1 2 0 23 licarp
6.2 Janu When there are multiple results in the location, Po
10, cythey
54 ary r y n
.9
by 10, should all receive a rating of Excellent.
ua a
Na More Jan by N
ncy 023 f than one
2 , 9
s
Ignore user and viewport location. 2 54. user has already
day .The
Po rom e
Tu 72.1 6
lica IP
rpo told you exactly where they are1 looking for results.

221
IP
r o m
0 2 3 f carpo
li
Query 1 0, 2 y Results
Po TRatings
ues and Explanation
a ry anc d
u N 172 y, Ja
JIsan there by a Navigational Result for this Query?
.25 anuYes
y , . 9 .16
d a 5 4
es . 2 4.9 ary
Tu 72.16 Kate Spade New York
Relevance bNavigational
y N 10, 2
1 an 023
[kate spade 789 Madison Ave, New York, NY Name Accuracy cy
Correct Po from
789 Madison 10065
lica IP
Ave, New York]
Classification: Accessories
rpo
Address Accuracy Correct

User and large, Pin Accuracy Perfect


fresh viewport in
This chain business query includes a specific
New York, NY

location modifier in the form of a full address.


Research confirms that this is the address of
queried business, so this result is eligible for
a Navigational rating.

All the data for the result is correct and the


pin is Perfect.

Kate Spade New York


Relevance Bad (User Intent)
205 Columbus Ave, New York, Name Accuracy Correct
NY 10023

Classification: Accessories
Address Accuracy Correct
Pin Accuracy Perfect

This is a very specific query and the result


does not satisfy the specific location
modifier and would not be useful to the user
searching only for the location at the
specified address. This result is rated Bad.

All the data for the result is correct.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

222
Query IP User and Viewport
m
[tacodeli burnet rd] 3 fro rpo User and fresh Viewport in Austin, TX
0 2 l i c a
2
10, two Po T
User Intent: Since there y are
r an c y Tacodelis located on the nameduestreet, both are primary intent.
a
u y NBad.
Any other location Jisanrated 17 sday,
2.1
a y, 54.9
b 6.2 Janu
es d .2 5 a
Is there a Navigational
Tu 72.16 Result for this Query? No4.9 b ry 10
1 yN ,2
an 023
cy
Po from
lica IP
rpo

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

223
Results IP Ratings and Explanation
r o m
3 f carpo Relevance Excellent
① Tacodeli
0 2
0, 2 y Po
li
1 Name Accuracy Tu Correct
12001 Burnet Rd, Austin, ryTX 78757

c e
n ua y Nan 17 sday,
Classification: Mexican
a
y, J 54.9
b Address Accuracy
2.1 J
6Correct
d a .25 anua
es .2 4.9 ry
Tu 72.16 Pin Accuracy by 10,
Approximate
1 Na 202
ncy 3 f
At first glance, this chain business query ro
Po with
lica maIPspecific
location modifier may suggest the user is looking
rpo for a
unique location. However, research indicates that there
are two branches of this restaurant on the same road.
Both are therefore eligible for a rating of Excellent.

The pin drops off the edge of the appropriate rooftop


and should be rated Approximate.
Relevance Excellent
② Tacodeli

7301 Burnet Rd, Austin, TX 78758


Name Accuracy Correct
Classification: Mexican

Address Accuracy Correct


Pin Accuracy Perfect
At first glance, this chain business query with a specific
location modifier may suggest the user is looking for a
unique location. However, research indicates that there
are two branches of this restaurant on the same road.
Both are eligible for a rating of Excellent.

All the data for the result is correct.


Relevance Bad (User Intent Issue)
③ Tacodeli
Name Accuracy Correct
4200 N. Lamar Blvd, Austin, TX 78756

Address Accuracy Correct


Classification: Mexican

Pin Accuracy Perfect


This result does not satisfy the specific location
modifier and would not be useful to the user searching
only for locations along Burnet Road and is therefore
rated Bad.
IP
Tu o m o
e r
17 sday, However, if there are no results present on this 0 3 f carp
2road,
2.1 2 li
6.2 Janu consider the location modifier as a general 1 ,
0one y Po
and
54 ary ry anc
.9
by 10, demote results based on distance toanthe ua yroad

N
Na 202 y, J .9 b
ncy 3 f da 54
Po rom
lica IP ues .16.2
All the data for the result isTcorrect.
rpo 172

224
IP
r o m
0 2 3 f carpo
When a query is for a POI on li street, results for this POI that are on the named street but
1 0, 2a ynamed
Po Tu
have an official address ron n c
y another street can also be rated Excellent.
e
n
a
u yN a 17 sday,
a 2.1
a y, J 54.9
b 6.2 Janu

es d . 2 54 a r y
Tu 72.16 .9
by 10,
1 N an 2023
10.6.4. Back Offices and Businesses with no Physical Location
cy
Po from
lic IP
These type of results are most often rated Bad because they are either not useful to thearuser po or have
no maps intent at all.

Business Type Example Rating and Explanation


Businesses with no physical location, like mobile
Mobile
No Physical location locksmiths or mobile dog groomers, have no relevance for
locksmith
maps and are rated Bad.
Back offices are usually not open to the public. Rate them
Administrative
with a lower prominence. In most cases the relevance
Back Office offices of a
rating will be Bad unless these offices match the specific
company
user intent. 
Unless your Country Specific guidelines state otherwise,
give businesses running out of a home very low
prominence.

These businesses see customers by appointment only


and have no regular opening hours or brick and mortar
Home based
Home Business businesses (like a store with regular hours where
calligrapher
customers can drop by and choose from a large selection
of merchandise).

The most likely relevance rating is Bad, unless there is a


likely user intent or the suggestion is similar to a bed and
breakfast or other business that a user may want to visit.

For these types of results, rate the address accuracy according to the official website or consensus
of three sources, otherwise rate Can’t Verify. If the entire address is missing, rate Can’t Verify. If an
address
Tu is present, rate the pin according to the address in the result. If no address is present, rate IP
e r o m o
the
17 pin
sdaCan’t Verify.
f
23 licarp
2.1 y, Ja 2 0 o
6.2 nu
54 ary y 10, cy P
r n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

225
Query Results IP Ratings and Explanation
m
Is there a Navigational3 fro rpo Result for this Query? No
, 2 0 olica
2
10 P
RelevanceTues Bad (User Intent)
a ry ancy
n u yN 17 day,
a 2.1
a y, J 54.9
b Name Accuracy 6.2 JanCorrect
es Wendy's
d .2 Flower Affair
54 uary
Tu 72.161175 E 930 N, Provo, UT 84604
.9
1 Address Accuracy y N 10, 2
bCorrect
an 023
Classification: Wedding Planning
Pin Accuracy cy
Perfect Po from
[flower shop]
 lica IP
rpo
Research shows that this is a business run
User and fresh out of a residential home, not a showroom full
viewport in of flowers. The relevance rating for this
Provo, UT location is Bad. We have been able to confirm
the address and pin for this business and they
will be rated Correct.

This business will not be rated Business/POI


is closed/does not exist because we want
to reserve that option for businesses and
POIs that truly do not exist.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

226
10.6.5. Business/POI does not Exist

IP
o m
There are situations where a result 3 f returned
r rpo is for a business that does not exist. You must still rate
0 2 c a
relevance as if the business0were 2 open.

ol i
y 1 , cy P Tu
e
r an
n
a
u yN 17 sday,
a 2.1
Query a y, J 54.9
b Results 6.2 Jaand
Ratings nu Explanation
d 5
e s . 2
Tu 72.16Is there a Navigational Result for this Query?
4 .9 ary 1
bNo
y N 0, 2
1 an 023
cy
Ocean Blue Sushi Club
Business/POI is closed/does Po from
1010 E El Camino Real,
not exist

lica IP
rpo
Sunnyvale, CA 94087

Relevance Excellent
Classification: Sushi

[sushi]

Research shows that this business is closed.
User and fresh
The checkbox for Business/POI is closed/
viewport in
Sunnyvale, CA
does not exist should be selected. Name,
address and pin accuracy questions will not
appear. The relevance rating for this location
is Excellent because if this business were
open, it would be a very good result for the
query.

Is there a Navigational Result for this Query? No


North Shore Hotel
Business/POI is closed/does
99300 Sea View Drive, Hwy 11
not exist

North Shore, CA

Relevance Excellent
[hotel]
Classification: Hotel

Fresh viewport
over North
Shore, CA
The North Shore hotel no longer exists at this
address, but its relevance is judged as if it
were still in business.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

227
10.7. Category Queries

IP
o m
r rpo type because they can return the greatest variety of results.
Category queries are the broadest 3 f query
0 2 ca
2thanolidistance
Give prominence more weight 0 , P when rating them.
T
y 1 cy ues
u ar Nan d
The highest relevance a n rating
y most category query results will receive 1 72 aisy, Excellent.

J
y, 54.9
b . 16 Jan
d a .25 ua
es 6.2 4.9 ry
Tu 72.1with
Category queries a location modifier are the only category queries by 1for
eligible
Na , 2a02Navigational
0
1
rating (see Navigational Results for Category Queries).
ncy 3 fr
Po om
lica IP
You’ll need to determine the user’s intent based on the query:
rpo

• Primary Intent refers to the businesses or POI the user is expecting to see for the given
category.

• Secondary Intent refers to businesses that fit the category intent but would not be the
user's first choice. Secondary intent results will receive a demotion of -1 or an initial rating of
Good.

• Unlikely Intent refers to results that technically match the query terms or category intent,
but do so poorly. They receive a demotion of -2 or an initial rating of Acceptable.

Significant Increase in Distance

Given how many results usually are within close proximity to the location intent, results for category
queries are not demoted for distance simply because there is something closer (in the result set or in
real life). Instead, use significant increases in distance to group possible results for the appropriate
demotions.

It is important to understand the real-world distribution of all


possible results when assessing a significant increase in
distance.

The image on the left shows possible results around the user
as purple dots. In this example, demotion for distance starts
approximately 500m away from the user (around 3 to 6 blocks
away) due to the high number of possible results. This distance
will vary depending on how many or few results are available in
a given area.

Please note that no results inside the fresh Viewport should be IP


Tu demoted to Bad for distance alone. o m o
e f r
17 sday, 0 23 licarp
2.1 2
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

228
10.7.1.Demotion for Distance with IP Inside Viewport

User
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry nc e
Query a
u yN a 17 sdand
User a Viewport
J a n b 2.1 y, Ja
ay , 4. 9 6.2 nu
[pizza]esd 16.25 User and fresh viewport in 5Campbell,
4.9 ary CA
u
T 72. by 10,
User Intent: The
1 user is looking for a pizza place. Na 202
ncy 3 f
Po rom
Is there a Navigational Result for this Query? No lica IP
rpo

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

229
Results IP Ratings and Explanation
r o m
0 2 3 f carpo Relevance Excellent
2 li
① Domino’s Pizza
ry 10, ncy Po Tu
The pizza place is among esd the closest results to the user,
930 W Hamilton Ave ua y Na CA

nCampbell, who is in an area with a


17 many
J a b 2.1 y, Jpizza
an
options, and is about
ay, 254.9 6
1km away. Other results in25this
Classification:sdPizza 4.9 general range would also
. ua
e . ry
Tu 72.16 receive this rating. by 10,
1 Na 202
n y 3f
Relevance Good (SignificantcDistance)
Po rom
② Luigi's Pizza and Pasta
lica IP
rpo
2495 S Winchester Blvd, Campbell
Luigi’s is significantly further away from the user is and
is demoted for distance, as are all other results in this
Classification: Pizza
general range.

Relevance Acceptable (Significant Distance)


③ Pizza My Dear

2590 S Bascom Ave, San Jose, CA


Pizza My Dear is over 4km away from the user, which is
significantly further than many other results. It is
Classification: Pizza
demoted -2 for distance.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

230
10.7.2. Demotion for Distance with IP
User Outside Viewport

o m
3 fr rpo
a
0 , 202 olic
P Tu
ry 1 ncy e
Query a
u yN a 17 sdand
User a Viewport
J a n b 2.1 y, Ja
ay , 4. 9 6.2 nu
esd 16.25 Fresh viewport in New Braunfels,
54 aryTX, with user north of
[guns]
u .9
by 10,
T 72. San Antonio Na 202
1 ncy 3 f
User Intent: The user is looking for guns. Po rom
lica IP
rpo
Is there a Navigational Result for this Query? No

Results Ratings and Explanation


Relevance Excellent
① EDC TX

964
Tu N Walnut Ave, New Braunfels, Tx
IP
e This result is inside the very specific viewport andfrom o
17 sday,
Classification: Gun Store carries weapons and other accessories. 0 23 licarp
2.1 2
6.2 Janu 10, cy P
o
54 ary Relevance Excellent ua Na r y n
.9
by 10,
Jan .9 by
② Freddy’s Pawn Na 2&
ncy 02Jewelry

3 a y, 4
671 S Seguin Ave, New Po fBraunfels,
ro TX
u esd 16.25
lica m IP The pawn shop is very close T to72the
. fresh Viewport and
Classification: Pawn Storepor sells guns and related items. 1

231
Results IP Ratings and Explanation
r o m
2 3 f carpo Relevance Good (Significant Distance)
③ Guntrap
1
0
0, 2 y Po
li
Tu
850 Schneider, Cibolo, ry anc This weapons store satisfies the user intent but is
uaTX

esd
N 72 ayfrom
significantly further1away
Classification: Guny , a n
JStore
. 9 by .16 , Jan the fresh viewport in a
a 4 more rural area, with fewer .25such
4.9 arstores
u close by.
esd .25 y
Tu 72.16 by 10,
1 Relevance Good (Significant
Na 202 Distance)
④ River City Pawn & Jewelry
ncy 3 f
Po rom
417 Main St, Scherz, TX
The pawn shop sells guns and other related lica equipment
IP
but is also significantly further away from the rpofresh
Classification: Pawn Store
viewport.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

232
10.7.3. Demotion for Distance with Fewer Possible Results

IP
r o m
0 2 3 f carpo
2 li
Query 10, y Po User
Tu and Viewport
ry anc e
n
a
u yN 17 sday,
[bicycle path] a User and fresh viewport
2.1 in Kennesaw, GA
a y, J 54.9
b 6.2 Janu
es d .2 5 a
4.9 ry
User Intent: The
Tu 72.16user is looking for places to ride a bike. These could byinclude
10 trails, parks,
and other paths
1 that are frequented by bicyclists. Na , 202
ncy 3 f
Po rom
Is there a Navigational Result for this Query? No lica IP
rpo

Results Ratings and Explanation


Relevance Excellent
① Deerfield Park
Deerfield Park is among the closest results to the user.
2401 Deerfield Dr, Kennesaw, GA
There are other results that are within an acceptable
Classification:
Tu Park range given the number of other possible results that IP
esd r o m o
are within 13km. f
17 ay,
2.1 2 0 23 licarp
6.2 Janu , o
10Distance)
yP
54 ary Relevance Good (Significant r y n c
.9
by 10, ua a
② Allatoona Creek
Jan by N
N an 2023 These mountain bike trails are about , 25km
.9 away from
cy
Pitner Rd NW, Acworth, day .254
Po frGA
o 30101
the user and significantly moree s
Tu 72.1 distant
6 than the closest
lica m IP
Classification: MTB Trailsrp group of results. The result, and
1 others in the same
o
general range, is demoted by -1 for distance.

233
Results IP Ratings and Explanation
r o m
3 f carpo Acceptable (Significant
0 2 li Relevance
1 0, 2 y Po Tu Distance)
③ Iron Hill Trail Head
ry
ua y Nan
c esd
a
Cartersville, GA 30121
a n b Iron Hill Trail Head is17about
2.1 y, 30km
Ja away. It is still within
y, J 54.9 the Good group in terms of 6 n
25 distance
4.9 ary to the location
d a . u
Classification:
esHiking .2 Area
Tu 72.16 intent given the smaller number by of 1possible
0 results in
1 Na , 202
the area, and gets a demotion of -2nfor cy distance.
3
Po from
lica IP
rpo

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

234
10.7.4. Category Queries and User Intent

IP
r o m
0 2 3 f carpo
li
Query 1 0, 2 y Po Suggestion Tu Ratings & Explanation
ry anc e
a 17 sday,
, J
y 54.9
u
an by N ① The Art Institute Relevance
2.1
6.2 Janu
Excellent
[art]

es d a
.2 of Chicago
 54 ary
Tu 72.16 111 S Michigan Ave, This result is.9anbyinternationally
10
,2 famous
N
User in1 Chicago, IL
Chicago
art museum in Chicago a ncy very
0 23 close to the
(Viewport is stale)
Classification: Museum user's location. Po from
lica IP
rp
Good
o
(User Intent &
② Arts & Artisans
 Relevance
Distance/
321 N Michigan Ave Prominence)
#1, Chicago

Classification: Art This art gallery should be demoted due


Gallery to distance to user as there are many
other possible art-related matches in
the user’s area.
③ The Art of Pizza
Relevance Bad (User Intent)
727 S State St,
Chicago

Classification: Pizza

Even though it has the word “art” in its


name, this pizzeria does not meet the
user’s intent and should be rated Bad.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

235
10.7.5. Category Queries and Prominence
IP
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
Query a Suggestion 2.1 Ratings
a y, J 54.9
b 6.2 Janu & Explanation
es d . 2 54 ary
.9
Tu 72.16
1
① Solomon R. Relevance by 10,Excellent
Na 202
[museum]
Guggenheim nc 3
Museum
Po from
This result is a highly yprominent
l a IP
No user location (viewport is fresh)
1071 5th Ave
museum likely to fulfill theicuser’s
rpo primary
New York
intent.
Classification: Museum

Relevance Excellent
② 9/11 Memorial &
Museum
This is another highly prominent result
180 Greenwich St
likely to meet the user’s the primary
New York
intent.
Classification: Museum

③ Houdini Museum
Good/Acceptable
421 7th Ave
Relevance (Distance/
New York
Prominence)
Classification: Museum
This result is a small museum that’s
much less prominent than other
museums in this location, like the
Guggenheim.
④ Museum of the Bad (Distance/
Moving Image
Relevance
Prominence)
36-1 35th Ave

Astoria

This result is also much less prominent


Type: BUSINESS
than other possible results in the area. It
Classification: Museum is located outside of the viewport while
there are multiple other options available
inside of the viewport.

10.7.6. Category Query with Location Modifier

If the query contains a location modifier, all results within the specified location should receive the P
Tu I
highest
esd possible initial rating of Excellent. Results outside the expected location should be demoted r o m o
f
based
17 on
2.1 y, Jtheir
a distance from the location modifier and the number of possible real-world 2results 0 23 licarp
o
within6it. an and viewport location should be disregarded.

.25Useru y 10, cy P
4.9 ary ua
r an
by 10, an by N
Further demotions N 2
an can J
0 be applied based on how well the result fits the intentayof the
, .9category.

cy 23 fr e s d .254
Po om Tu 72.1 6
lica IP
rpo 1

236
IP
r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry c e
n ua y Nan 17 sday,
Ja .9 b 2.
a y,Query
4 6.2 JaViewport
User1and n
es d .25 54 uary
Tu 72.16 .9
[Food montgomery tx] by 10,
User and viewport outside Montgomery,
1 Na 202 TX
ncy 3 f
ro
Po primary
User Intent: Any food provider or restaurant within the named locality is considered lica m IP
intent. Given the large number of possible results within the explicit area, results outsiderpit
o are
rated Bad.
Is there a Navigational Result for this Query? No

Results Ratings and Explanation


Relevance Excellent
① Pizza Shack

20821 Eva St, Montgomery, TX


Name Accuracy Correct
Classification: Pizza

Address Accuracy Incorrect – Postal Code


Pin Accuracy Approximate IP
Tu o m o
e r
17 sday, All results that satisfy the ‘Food’ intent located2in
0 3 f carp
2.1 2 li
6.2 Janu Montgomery are eligible for an initial rating 10of
,
y Po
54 ary Excellent.
ry c
.9
by 10, n ua y Nan
Na 202
ncy 3 f a y, Ja 4.9 b
Po rom esd 16.25 address
The postal code, which is a umandatory
lica IP component, is missing from theT .
rpo 172 result address.

The pin drops into the shared parking lot.

237
Results IP Ratings and Explanation
r o m
② Taco Bell
0 2 3 f carpo Relevance Bad (Distance/Prominence)
li
3207 W Davis St, Conroe, 1 0, 2 77304

TX Po Tu Correct
ry c y Name Accuracy e
Classification: FastJFood
n ua y Nan 17 sday,
a b 2.1 J
a y, 54.9 Address Accuracy 6Correct
.25 anua
es d .2 4.9 ry
Tu 72.16 Pin Accuracy by 10,
Perfect
1 Na 202
ncy 3 f
Po rom
lica IP
Given the large number of places to get food rpoin
Montgomery, results outside of it are rated Bad.

All the data for the result is correct.

10.7.7. Navigational Results for Category Queries

Sometimes it’s not clear whether a query is for a category or a specific business/POI. What first
appears to be a category query with a location modifier may lead to a single prominent result which
can be rated Navigational.

Due to the ambiguity of these queries, even if there is a Navigational result, the query should still be
treated as a potential category query and other results considered relevant.

When deciding if a category query could have a Navigational result, consider:

• The actual wording of the query

• Possible results in the real world

• Local knowledge

• Prominence

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

238
Query Results IP Ratings and Explanation
m
Is there a Navigational
3 fro rpo Result for this Query? Yes
, 2 0 olica
2
10 P T
Relevance uesd Navigational
a ry ancy
n u yN 17 ay,
Ja .9 bKilkenny
2.1
a y,Hotel 4 Name Accuracy 6.2 JanuCorrect
es d 5 54 ary
Tu 72.16College Road, Kilkenny R95
.2 .9
1 KP08
Address Accuracy y N 10, 2
bCorrect
an 023
Ireland
cy
Pin Accuracy Perfect Po from
lica IP
Classification: Hotel
rpo

This result is an exact match to the query. The


wording of the query leads to a single result,
so it’s likely the user intent is this specific
hotel.

The address is correct without a street


number because it matches what's found on
the official website. The pin landing in the
hotel's roof is Perfect.
[hotel
kilkenny]
Relevance Excellent
Name Accuracy Correct
Newpark Hotel

Castlecomer Road, Kilkenny R95 Address Accuracy Correct


KP63, Ireland
Pin Accuracy Perfect
Classification: Hotel

Although the wording of the query suggests a


single result, there is still a possibility that the
intent is for any hotel in Kilkenny. Since this
could be a category query with a location
modifier, all hotels in this locality should be
rated as Excellent.

The address is correct without a street


number because it matches the address
shown on the official website. The pin is
Perfect because it lands on the hotel’s
rooftop.
Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

239
Query Results IP Ratings and Explanation
m
Is there a Navigational
3 fro rpo Result for this Query? No
, 2 0 olica
2
10 P T
Relevance uesd Excellent
a ry ancy
n u yN 17 ay,
Ja .9 b 2.1
a y,Hotel 4 Kilkenny
Name Accuracy 6.2 JanuCorrect
es d .2 5 54 ary
Tu 72.16College Road, Kilkenny R95 Address Accuracy
.9
y N 10, 2
bCorrect
1 KP08
an 023
cy
Ireland
Pin Accuracy Perfect Po from
lica IP
Classification: Hotel
rpo
There is no result that matches the exact
wording of the query, so this is more likely to
be a category query with a location modifier.
Any hotel result returned in the locality of
Kilkenny would be rated Excellent.

The address is correct without a street


number because it matches what appears on
the official website. The pin landing the hotel's
roof is Perfect.

Relevance Excellent
Name Accuracy Correct
[Kilkenny
hotel] Address Accuracy Correct
Pin Accuracy Perfect

Newpark Hotel

Castlecomer Road, Kilkenny R95


KP63, Ireland

Classification: Hotel

Any hotel result returned in the locality of


Kilkenny would be rated Excellent,
completely satisfying the ‘Category with
Location Modifier’ query

The address is correct without a street


number because it matches the address
P
Tu
e shown on the official website. The pin is om I
r
17 sday, Perfect because it lands on the hotel’s 0 2 3 f carpo
2.1 li
6.2 Janu rooftop. 10, 2 y Po
54 ary ry c
.9
by 10, n ua y Nan
Na 202
ncy 3 f a y, Ja 4.9 b
Po rom esd .25
lica IP Tu 72.16
rpo 1

240
Query Results IP Ratings and Explanation
m
Is there a Navigational
3 fro rpo Result for this Query? No
, 2 0 olica
2
10 P T
Relevance uesd Excellent
a ry ancy
n u yN 17 ay,
a 2.1
a y, J 54.9
b Name Accuracy 6.2 JanuCorrect
es d .2 54 ary
Tu 72.16 .9
1 Address Accuracy y N 10, 2
bCorrect
an 023
Berlin Tegel Airport
cy
Po from
Pin Accuracy Perfect
13405 Berlin, Germany
lica IP
rpo
Classification: Airport

There are two equally prominent airports in


Berlin. Since there is more than one possible
result for this query in the real world, it is likely
to be a category query with a location
modifier. All airports within the queried locality
should be rated as Excellent.

The address is correct without a street


number and street name because this is a POI
without an expected address so a locality and
postal code are appropriate. The pin is
Perfect because it lands on the airport’s
rooftop.

[airport
berlin] Relevance Excellent
Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Perfect
Berlin Schönefeld Airport

12521 Berlin, Germany

Classification: Airport

There are two equally prominent airports in


Berlin. Since there is more than one possible
result for this query in the real world, it is likely
to be a category query with a location
modifier. All airports within the queried locality
should be rated as Excellent.

IP
Tu
e The address is correct without a street rom o
17 sday, f rp
2.1 number and street name because this 2 0 23isliacaPOI
6.2 Janu without an expected address so 1a0, locality
o
y P and
54 ary r y n c
postal code are appropriate. ua y Npin
an The
.9
by 10, a is
Na 202 Perfect because it lands , J b
on.9the airport’s
ncy 3 f s day .254
Po rom rooftop. e
Tu 72.1 6
lica IP
rpo 1

241
10.7.8. Clear Categories

IP
o m
When a query is clearly for a straightforward r
3 f carpo category, results must also belong to that category

0 2 i
2 ol
y 10, cy P Tu
e
r n
Query n u y N Results
a a 17 sday, and Explanation
Ratings
a 2.1
y, J 54.9
b 6.2 Janu
d aIs there a Navigational Result for this Query? 54 No
es
Tu 72.16
.2 .9 ary 1
by 0,
Relevance Bad 2
Na (User
1 ncy 023 Intent)
Po from
Name Accuracy Correct lica IP
rpo
Sephora

2855 Stevens Creek Blvd,


Address Accuracy Correct
Santa Clara, CA 95050
Pin Accuracy Approximate
Classification: Beauty Supplies

[mall]
The query intent is for a mall. The result is a
store inside Westfield Valley Fair mall and is
User and fresh within the viewport. Since the query is a
viewport in category and the result is a specific store,
Santa Clara, CA which the user did not ask for, rate Bad due to
user intent. If the result had been the entire
mall, the result would be rated Excellent.

The name and address can be confirmed on


the official website. The pin is Approximate
because it does not land on Sephora's location
(shown in green) according to the mall’s official
map.
Is there a Navigational Result for this Query? No
Relevance Bad (User Intent)
Name Accuracy Correct
Terminal 8
Address Accuracy Correct
JFK International Airport

Queens, NY 11430
Pin Accuracy Perfect
Classification: Airport

[airports]

The result is a terminal that's part of JFK


User and fresh
International Airport. Since the query is a
viewport in
category and the result is a specific terminal
New York, NY
and not the airport itself, rate Bad due to userIP
Tu m
e intent. 
fro rpo
17 sday, 2 3 a
2.1
6.2 Janu 0, 20 olic
The name and address can be confirmed 1 P
y on
54 ary
.9 u ary Nanc
by 10, the official website. The pin Janis.9Perfect
by because
Na 202 ,
ncy 3 f it lands on one of the srooftops
a 254 of Terminal 8
y
Po rom e d 1airport
according to the official
.
map.
lica IP T 72. 6
u
rpo 1

242
10.7.9. Soft Categories

IP
o m
Some category queries are straightforward 3 f carpo and may have results that satisfy an intent exactly, like
r
0 2
[italian restaurant]. However, 0, 2 ysometimes
Po
li categories are very small or have multiple interpretations,
1 T
so several different types yof
r an results
c could satisfy the user’s intent.uThese
e are called “soft categories.”

n
a
u yN 17 sday,
a 2.1
b
y, J 54.9will produce a variety of results, each of which 6.2 Janu
These category dqueries
a
es 16.2 5could
4.9 arsatisfy the query intent
u y1
to a greater or lesser
T . degree. How well a result satisfies a category query willy N b vary0, depending on the
172 an the20
services typically offered by the result entities in that market and the customs of cy 2specific
3 market.

Po from
lica IP
It’s often difficult to define which businesses or chains belong in any one soft category, so rpoyou’ll have
to research the individual results provided to make your rating decisions. For instance, the query [ski
shop] is very specific and is associated with the more general Sporting Goods category.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

243
Query IP User and Viewport
r o m
[ski shop]
0 2 3 f carpo User and fresh viewport in Denver, Co
, 2 o li
10 cy Pfor places that sell ski clothingTand
User Intent: The user aisrylooking ues equipment. Any store that
u a n d
y N primary intent.
carries such items Jisanconsider
b
172 ay, J
. 16
d ay, 254.9 .25 anua
e s
Is there a Navigational
. Result for this Query? No4.9 b ry 10
Tu 72.16 yN ,2
1 an 023
cy
Po from
lica IP
rpo

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

244
Results IP Ratings and Explanation
r o m
3 f carpo Relevance Excellent
① Meier Skis
0 2
0, 2 y Po
li
Tu Correct
970 Yuma St, Suite 190
1 c Name Accuracy
ry e
n ua y Nan 17 sday,
Denver, CO 80204
a b 2.1 Ja
a y, J 54.9 Address Accuracy 6.Correct
25 nua
Classification:
esSki Equipment

d .2 4.9 ry
Tu 72.16 Pin Accuracy by 10,
Perfect
1 Na 202
ncy 3 f
Po rom
lica IP
rpo

Business is a shop dedicated to skiing, which would


satisfy the primary intent of this category.

Relevance Good (User Intent)


② Patagonia

1431 15th St
Name Accuracy Correct
Denver, CO 80202

Address Accuracy Correct


Classification: Sports Wear

Pin Accuracy Perfect

Stores that sell ski clothing would be considered


secondary intent for the category query [ski shop].

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

245
Query ResultsIP Ratings and Explanation
m
Is there a Navigational3 fro rpo Result for this Query? No
, 2 0 olica
2
10 P T
Relevance uesd Excellent
a ry ancy
n u yN 17 ay,
a 2.1
a y, J 54.9
b Name Accuracy 6.2 JanuCorrect
d
es 6.2 54 ary
Tu 72.1Riva's Italian Restaurant
.9
by 10,
1 1117 Missouri St
Address Accuracy Correct Na 202
ncy 3 f
Houston, TX 77006
Po rom
li I
Classification: Italian
Pin Accuracy Perfect carpo P

The most likely user intent for this query is


Italian restaurants. This result satisfies the
user’s intent.

Cafe Dolce Gelato


Relevance Good (User Intent)
5135 W Alabama St, Ste 7315

Houston, Texas 77056


Correct

Classification: Ice Cream


Name Accuracy

Address Accuracy Correct

[italian]
Pin Accuracy Approximate

User and fresh


viewport in
Houston, TX
An Italian ice cream café is mostly likely a
secondary intent for this query.

Tu IP
o m o
e The official mall map shows the exact location r
3 f carp
17 sday, 2part
2.1 of the cafe. The pin lands on another 2 0 li of
6.2 Janu 10, y Po
54 ary the mall and is rated Approximate. ry c
.9
by 10, n ua y Nan
Na 202
ncy 3 f a y, Ja 4.9 b
Po rom esd .25
lica IP Tu 72.16
rpo 1

246
Query ResultsIP Ratings and Explanation
om po
frGalleria

Prada Houston 3 r
2 02 olica Relevance Bad (User Intent)
5015 Westheimer,
10 cy P Ste 2285A

, Tu
Houston, ry Texas
n 77057
e
a
nu by Na 17 sday,
Name Accuracy Correct
a 2.1
J
ayClassification:
, 4.9 Accessories
6.2 Janu
es d . 2 5 54 ary
Tu 72.16 .9
1 y N 10, 2 – Postal Code
Address Accuracy bIncorrect
an 023
cy
P fro
Pin Accuracy Perfect olica m IP
rpo

An Italian clothing store is an unlikely intent for


this query.

The name is Correct, but the postal code


should be 77056.

The official mall map shows the exact location


of the store. The pin lands on this location and
is rated Perfect.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

247
10.7.10. Category Query: Parking

IP
o m
"Parking" generally refers to:
3 fr rpo
a
0 , 202 olic
1 y P Tu
• Parking lots
ary Nanc e
u 17 sday,
• Parking garages
Jan .9 by 2.1
y , 6.2 Janu
• Parkingesdecks

da .254 54 ary
Tu 72.16 .9
by 10,
1 Na 202
ncy 3 f
Po rom
Example lica IP
Query Results Ratings and Explanation
rpo
Type
Is there a Navigational Result for this Query? No

Parking
Relevance Excellent
123 O’Farrell St, San Francisco, CA Name Accuracy Partially Correct
94102

[parking]
 Classification: Parking


Address Accuracy Correct
Pin Accuracy Perfect
Specific User and
Parking viewport in
San Research reveals that the official name
Francisco, for this parking location is Ellis-
CA O'Farrell Garage. Since an official
name exists, the generic name
“Parking” is demoted to Partially
Correct.

Is there a Navigational Result for this Query? No


Parking
Relevance Excellent
121 Spear St, San Francisco, CA
Name Accuracy Correct
[parking]
 94105

Classification: Parking
Address Accuracy Correct
User and
Generic fresh Pin Accuracy Perfect
Parking viewport in
San
Francisco, This result is the parking garage for
CA the Rincon Center, which does not
have a specific name according to
official resources. Accept the generic IP
Tu name “Parking” as Correct. from po
e
17 sday, 3 ar
2.1
6.2 Janu 0, 202 olic
1 y P
54 ary
.9 u ary Nanc
by 10,
Na 202 y, Jan .9 by
ncy 3 f a 4
Po rom u esd 16.25
lica IP T 72.
rpo 1

248
Example P
Query IResults Ratings and Explanation
Type f o m
r rpo
2 023 olica
Is1there
0 , Pa Navigational Result for this
TuQuery? No
a ry ancy esd
u 17 ay,
Relevance Excellent
, J an by N 2.1 Ja
a y 4 . 9 6 . 25 uan
esd .25 Rincon Center Garage
Name Accuracy by 10, Correct
4.9 ry
Tu 72.16 121 Spear St, San Francisco, CA
1 Na 202
94105
Address Accuracy ncyCorrect
3
Po from
[parking]
 Classification: Parking
lica IP
Pin Accuracy Perfect
rpo
User and
Paid vs. fresh
free viewport in This result is the parking garage for
San the Rincon Center. It’s a parking
Francisco, garage accessible to the public for a
CA fee. Free and paid parking are equally
relevant. There should be no relevance
demotion if the parking lot/garage
requires payment and the query does
not specifically ask for free parking.

Is there a Navigational Result for this Query? No


Relevance Excellent
Name Accuracy Correct
Parking

3705 El Camino Real, Santa Clara, Address Accuracy Correct


[parking CA 95051
Pin Accuracy Perfect
free]
 Classification: Parking

User and
The query specifically requests free
Paid vs. fresh
parking, so the results should reflect
free viewport in
Santa the user’s request. This parking lot is
Clara, CA free and should be rated as Excellent.

If the result were a parking lot that


requires payment, then the correct
relevance rating would be Bad, as it
does not satisfy the user’s intent.
Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

249
Example P
Query IResults Ratings and Explanation
Type f o m
r rpo
2 023 olica
Is1there
0 , Pa Navigational Result for this
TuQuery? No
a ry ancy esd
u 17 ay,
Relevance Excellent
, J an by N 2.1 Ja
a y 4 . 9 6 . 25 uan
esd .25 Stevens Creek Parking
Name Accuracy by 10, Correct
4.9 ry
Tu 72.16 2899 Stevens Creek Blvd, San
1 Na 202
Jose, CA 95050
Address Accuracy ncyCorrect
3f
r
Affiliate [parking]
 Classification: Parking

P oli om I
Pin Accuracy c
Perfectarp P
parking o
that does User and
Fresh
not have a
Viewport
specific
in San
name Jose, CA This parking lot has no specific name,
but it is associated with a nearby
business, therefore the name is
Correct.

Is there a Navigational Result for this Query? No


Relevance Excellent
Parking
Name Accuracy Correct
552 Waverley St, Palo Alto, CA
94301
Address Accuracy Correct
[parking]
 Classification: Parking

Pin Accuracy Perfect


Generic User and
fresh
Parking
viewport in
Palo Alto,
CA
This result is a generic parking lot and
there is no need for a specific name.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

250
Example P
Query IResults Ratings and Explanation
Type f o m
r rpo
2 023 olica
Is1there
0 , Pa Navigational Result for this
TuQuery? No
a ry ancy esd
u yN 17 ay,
, J an bParking
Relevance
2.1 Ja Excellent
a y . 9
4 San Francisco, CA United States
6 . 25 uan
esd .25 Name Accuracy by 10, Correct
4.9 ry
Tu 72.16 Classification: Parking

1 Na 202
Address Accuracy ncyCorrect
3
Po from
[parking]
 Pin Accuracy
lica IP
Perfect
rpo
User and
fresh
Airport This result refers to the parking lot of
viewport in
Parking San Francisco International Airport.
San
Francisco, The generic name “Parking” is
CA considered Correct. Pin must be
dropped on the SFO parking lot. This is
a POI without an expected address so
just a locality is appropriate and rated
Correct without a street number and
street name.

Is there a Navigational Result for this Query? No


Parking
Relevance Bad (User Intent)
3600 Flora Vista Ave, Santa Clara,
CA 95051
Name Accuracy Correct
[parking]
Classification: Parking
Address Accuracy Correct
Private vs. Pin Accuracy Perfect
User and
public
viewport in
parking
Santa
Clara, CA The result in this example is a
residents-only parking lot. This should
be rated Bad because the lot is not
useful for the general public.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

251
IP
r o m
10.8. Rating Results with PERMANENT_CLOSURE
0 2 3 f carpo Status

, 2 o li
When rating results whose 10 cy Pis PERMANENT_CLOSURE, beTsure ues to understand whether the
a ry status
a n da
u yN 1
results are expected J aor
n unexpected.
b For more information on the 2.1 y, Ja between expected and
7differences
unexpected results,d ay, 2see
5 4.9 section 5.19. Rating Relevance When Result6Status .25 nuis
u s
e 16 . 4.9 ary
PERMANENT_CLOSURE.

T . by 10,
172 Na 202
ncy 3 f
10.8.1. Expected PERMANENT_CLOSURE Status
Po rom
lica IP
rpo
When a result with PERMANENT_CLOSURE status is expected, choose the Business/POI is closed
or does not exist checkbox and rate as if the location were open.

Query Results Ratings and Explanation


Is there a Navigational Result for this Query? Yes
Relevance Navigational
Business Closed/does not
Yes
Gaslight Grill
exist
PERMANENT_CLOSURE
Name Accuracy no ratings needed
[gaslight
5020 W 137th St, Overland
grill]

Park, KS 66224
Address Accuracy no ratings needed
Fresh Pin Accuracy no ratings needed
viewport in
Kansas City, Research shows that the result for this navigational
KS
query is permanently closed, and it displays the
status PERMANENT_CLOSURE. Showing this closed
result is expected since no other result can be
returned in the area of location intent.

Select Business is closed or does not exist and


rate the business as if it did exist. No further POI
data rating will be needed.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1
10.8.2. Unexpected PERMANENT_CLOSURE Status

IP
o m
When many branches of a chain 3are fr available
rpo in the area of intent, we would not expect to see any
0 2 c a
locations with a status of PERMANENT_CLOSURE,
2 ol i whether that status is correct or not.

y 10, cy P Tu
e
r an
n
a
u yN 17 sday,
a 2.1 Ja Viewport
a 4 .9 b
y, J 5Query User 6.2 and nu
d
es 16.2 5 4.9 ary
u
T 72. b 10
1 [mcdonalds] User and fresh viewport yinNaSunnyvale,
,2 CA
ncy 023 f
Po rom
lica IP
rpo

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

253

Suggestion Rating and Explanation


IP
m
3 fro rpo
Relevance Acceptable
, 2 0 olica
2
10 P Tu
ry ancy Business/POI closed/ Yes e
① McDonald's
Janu by N
a
does not exist 17 sday,
2.1
y, 54.9
6.2 Janu
PERMANENT_CLOSURE
d a 54 ary by research) has
u es 16.2 This permanently closed restaurant (confirmed
.9
615 N Mathilda72Ave,

T . by 10,
1 its status set to PERMANENT_CLOSURE. It is
Naconsidered
2
Sunnyvale, CA 94085 ncy 023 f
unexpected because there are many other locations Po rofomthis chain
in the area. This means the highest rating it can getliiscar IP
p
Acceptable. Name, address, and pin will not be rated. o
Relevance Excellent
Business/POI closed/
No
does not exist
② McDonald's
Name Accuracy Correct
550 Lawrence Expy,

Sunnyvale, CA 94086 Address Accuracy Correct


Pin Accuracy Perfect
This open chain location is among the closest to the user and
rated Excellent.
Relevance Acceptable
Business/POI closed/
No
does not exist
Name Accuracy Correct
Address Accuracy Correct
Pin Accuracy Perfect

⓷ McDonald's

PERMANENT_CLOSURE

556 E El Camino Real, This chain location is showing a status of


Sunnyvale, CA 94086 PERMANENT_CLOSURE. Research shows that it is, in fact, open.
Its relevance is rated independent of whether it is really open or
closed in the real world. The result is considered unexpected and
rated Acceptable.

Tu IP
e o m o
17 sday, Do not mark this result as Business/POI closed/does not3 exist, r
f rp
a
2.1
6.2 Janu 202 olic
and continue rating the result for relevance plus name,0,address,
1 y P
54 ary
.9 and pin details. ary Nanc
by 10, u
Na 202 y, Jan .9 by
ncy 3 f a 4
Po rom u esd 16.25
lica IP T 72.
rpo 1

254
Suggestion Rating and Explanation
IP
m
3 fro rpo
Relevance Good (Distance)
, 2 0 olica
2
10 P Tu
ry ancy Business/POI closed/ Yes e
n
a
u yN does not exist 17 sday,
④ McDonald's
y, Ja .9 b 2.1
a 4 6.2 Janu
d
es Real,
1082 E El Camino
5
.2
54 arto
The chain location does not exist according y official resources
Tu 72.16 .9
by 10,
Sunnyvale, CA1 94087 and should be rated as Business is closed Nor
andoes
20 not exist.
2
c y P 3 fro
The result does not show the status as PERMANENT_CLOSURE,
oli m I
so it should be rated as if it were open, which is Good cagiven
rpo P the
distance.

10.9.Other Query Types

Queries can sometimes be less obvious or even ambiguous.

10.9.1. Routing Queries

When a query mentions two distinct locations that are not near each other, the user was likely looking
for driving directions, so returning either of the two distinct locations used for the route is the best
experience Search can offer. Each location should be rated Excellent for Relevance.

Query Results Ratings and Explanation


Is there a Navigational Result for this Query? No
Relevance Excellent
Name Accuracy n/a
Oxford
Address
Oxford, United Kingdom
Correct
Accuracy
Classification: n/a

Pin Accuracy Perfect

The query includes two separate locations,


which are very far away from each other, so
the user was likely looking for routing IP
Tu directions. Returning either of the individual o m o
e r
f rp
17 sday, locations is expected and should be 0 23ratedca
2.1
6.2 Janu 0, 2
Poli
Excellent.
1 y
54 ary
[66 Chandos.9 u ary Nanc
by 10,
Jan .9 by
Pl, LondonNanc 2023 The pin should be dropped ,
da .254 within the
y
y P fro e s
WC2N 4HG oli m I boundaries of the
Tu result
.16 locality.
car P 7 2
Oxford] po 1

255

Query Results IP Ratings and Explanation


r o m
0 2 3 f carpo Relevance Excellent
66 Chandos li
1 0, 2 y Pl

Po Tu
66 Chandos Name Accuracy n/a
ua y Nan Pl

ry c e
n 17 sday,
London
a b WC2N 4HG
2
Address .16.2 Janu
y, J 54.9
d a 54 Correct
es Classification:
Tu 72.16
.2 n/a
Accuracy .9 ary 1
by 0
1 Na , 202
Pin Accuracy Perfectcy 3 fr
n
Po om
lica IP
The query includes two separate rplocations,
o
so the user was likely looking for routing
directions. Returning either of the individual
locations is expected and should be rated
Excellent.

The pin should be dropped on the address


provided in the result.

Is there a Navigational Result for this Query? Yes

Oxford
Relevance Navigational
Oxford, United Kingdom

Name Accuracy n/a


Classification: n/a

Address
Correct
Accuracy
[route to
Oxford] Pin Accuracy Perfect

This routing query contains only one


location.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

256
10.9.2.Coordinate and “My Location” IP Queries

r o m
0 2 3 f carpo
li
1 0, 2 y Po Tu
ry nc esd
Note: Results for coordinate u y N and ‘’my location” queries (or any 1variation
a a a of these, like “current
J a n b 7 2.1 y, Ja
location,” “where ,I am,”
ay 254. 9 and so on) are rated differently from the other
6.2 results
nu described in these
d 5
s
guidelines.TPlease
ue .16 read this section carefully.
. 4 .9 ary 1
by 0

172 Na , 202
ncy 3 f
Po rom
Pin and Relevance are rated separately using a 50m radius around the queried coordinates lica Ior the
rpo P
user location (for “my location” queries):

• Relevance:

• A result that exists and is within the 50m radius is rated Excellent.

• A result that does not exist or is outside of the 50m radius is rated Bad.

• There will be no Navigational results.

• Pin Accuracy:

• A pin that falls within 50m radius is rated Perfect.

• A pin that falls outside the 50m radius is rated Wrong.

• Name and Address Accuracy:

• Rate the name and address accuracy according the regular guidelines.

The graphic below gives an overview. These concepts are explained further on the following pages.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

257

IP
o m
r rpo
If no result can be found within 0 2 3 f c50m,
a then the closest address or street up to 100m away
0 , 2
P oli Tu
will be accepted. Ifryno 1 address
n c y or street can be found within
esd 100m, depending on the
a a
amarket,
n by N a locality or sub-locality will also72be
u 1 aaccepted.
y, J
, J 9 . 1 6 a

s d y
a 254 . . 25 nua
e . 4 .9 ry 1
Tu 72.16 by 0
1 Na , 202
ncy 3 f
Query Pin Rating and Explanation Po rom
lica IP
rpo

Draw an imaginary circle with a 50m radius around the


user’s location. Rate any pin inside the circle Perfect and
any pin outside the circle Wrong.

Draw an imaginary circle with a 50m radius around the


queried coordinates. Rate any pin inside the circle Perfect
and any pin outside the circle Wrong.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

258
Results IP Relevance Rating and Explanation
m
3 fro rpo
2 a
0 , 20 olic
1 P Tu
ry ancy e
n
a
u yN 17 sday,
a b Use an imaginary circle with2.a1650m Ja radius around the queried
a y, J 54.9 . 2 nu
d
es 16.2 location to rate relevance. A result4.that
5 arhas
y 1 any part of its
u
T 72. 9
1 Perfect area within the circle is rated bExcellent.
y Na , 202 If a result
0
does not have any Perfect area inside the circle, ncy 3 frate Bad.

Po rom
lica IP
The Perfect area usually refers to the rooftop or section rpo of the
rooftop, but can include the parcel for parks and other
features rated perfect for the parcel.

Result Relevance Rating and Explanation

1: 3495 El Camino Real


Part of the POI is inside the
Excellent
Santa Clara, CA  95051 50m radius

2: 3530 El Camino Real

Part of the POI is inside the


Santa Clara, CA 95051
Excellent
50m radius

The street is inside the 50m


3: El Camino Real (street name) Excellent
radius
4: United Furniture Club

No part of the POI is within


3503 El Camino Real
Bad
the 50m radius
Santa Clara, CA 95051
5: 3482 El Camino Real Unit B
Research shows this address
Bad
Santa Clara, CA 95051 does not exist

Note that the pin and result title do not need to match. For example, if a result for United Furniture
Club is returned, but the pin is placed at the queried coordinates or user location, the Relevance
Rating will still be Bad, but the pin rating will be Perfect even though it is far from United Furniture’s
location.

10.10. Unclear Results

Tu may be times when it is difficult to determine exactly what the result is because the business IP
Thereesd f r o m o
name
17 can’t
2.1 y, Ja be identified with certainty or the business does not correspond with the given
a
2 0 23 licarp
location
, o
and it 6cannot
.25 nube confirmed as closed. When this happens, use all provided information y 10(including
c yP
4.9 ary ua
r a n
information that
by is10not rated, such as URL and phone number – never call a business)
,2 an bytoNreach a
conclusion.
N an 023 , J .9
cy s day .254
Po from e
Tu 72.1 6
lica IP
rpo 1

259

If there is a tie in the evidence or you are rating Search Relevance only, rate Business/POI is closed/
does not exist, then rate relevanceoas IP
if the entity did exist.

m
3 fr rpo
a
0 , 202 olic
1 P Tu
ry ancy e
n
a
u yN 17 sday,
a 2.1
Query y, J 54.9
b
Results 6.2 Jaand
Ratings 54 uaryExplanation
a n
d
es 16.2
u . 9
T 72. by 10,
1 Is there a Navigational Result for this Query? NoNa 20
ncy 23 f
dressbarn
Relevance Po rom
Excellentlica IP
5762 Hollister St
rpo
Houston, TX 77040
Name Accuracy Correct
Classification: Women’s Clothing
Incorrect – Street
Address Accuracy Number and Street
Additional info:
Name
URL: https://www.dressbarn.com/

Phone: 1-713-331-0007
Pin Accuracy Approximate
[dressbarn]
The result name and URL are pointing to a
dressbarn location. The address listed is
User and fresh associated with a business called Dots,
viewport in located in the same shopping center, that has
Houston, TX now closed. After researching the nearby
area, a dressbarn with the same phone
number as our result is found located within
the same shopping center as our result
address at 13256 Northwest Freeway,
Houston, TX 77040. The pin is located
within the shared parking lot of the shopping
mall. Because a business with the same name
and phone number is found in the immediate
surrounding area, we will consider the
address incorrect for this result.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

260
Query Results IP Ratings and Explanation
r o m
0 2 3 f carpo Result for this Query?
Is there a Navigational No
, 2 o li
10 P
RelevanceTues Excellent
a ry ancy
n u yN 17 day,
2.1
, Ja 4.9 b
yPottery Name Accuracy 6.2 JanCorrect
d a
es 6.2 5 Barn
54 uary
Tu 72.11350 .9
Fashion Valley Rd, San y N 10, 2 – Street
bIncorrect
1 an 02and
Diego, CA 92108
Address Accuracy Number cy 3 fr Street
Classification: Furniture Store
 P o
Name olica m IP
rpo
[furniture Additional info:
Pin Accuracy Approximate
store]
 URL: www.potterybarn.com
The result name and URL point to a Pottery

 Phone: 1-619-296-8014

User and Fresh


Barn location. The address listed is
San Diego, CA associated with a nearby business, Wells
Fargo Bank. After researching the nearby
area, a Pottery Barn with the same phone
number as our result is found at 7007 Friars
Road, San Diego, CA 92108, within the
Fashion Valley Mall. The pin lands on the
Fashion Valley Mall. Because a business with
the same name and phone number is found in
the immediate surrounding area, consider the
address incorrect for this result.
Is there a Navigational Result for this Query? No
The Lot Bar
Relevance Excellent
2333 S St

Sacramento, CA 95816
 Name Accuracy Incorrect


Classification: Dive Bar
 Address Accuracy Correct

[bar]
 Additional info:


Pin Accuracy Perfect
Phone: 1-916-451-4682

User and Fresh Research on the result information shows that


Viewport in the address belongs to Round Corner Tavern.
Sacramento, CA The result phone number also belongs to the
Round Corner Tavern and the pin is located at
the result address. Finally, there is no ‘Lot Bar’
located in the immediate area. Because all
result information except for the name listed
points to the Round Corner Tavern, we will
Tu consider the name incorrect for this result. IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

261

Query Results IP Ratings and Explanation


r o m
Is there a Navigational
0 2 3 f carpo Result for this Query? No
, 2 o li
Holiday 10 cy P Tu is closed/does not
a ry Inn

a n Business/POI esd ☑
300 uN Harbor
N Drive
exist 1 a
J a n b y 7 2.1 y, Ja
, 4.9
ayRedondo 6.2 nu
Beach, CA 90277

u e 16.25
s d
Relevance
54 ary
.9 Excellent
T 72. Classification: Hotels and Events
by 10,
1 Na 202
Use all the information provided
ncy 3 f, even
Additional Info:
Po rom
information that's not rated, like licaURLIPand
URL: http://www.ihg.com/ phone number, to research the result.
rpo
holidayinn

Phone: 1-310-750-1149
In this case, research shows that the address
belongs to a Crowne Plaza Hotel, not a
Holiday Inn. Street imagery also shows that
[holiday inn]
 this building is a Crowne Plaza.

User and fresh The result phone number does not belong to
viewport in Santa any business and the given URL does not
Ana, CA point to any particular Holiday Inn.

Investigation of the surrounding area shows


that there is no Holiday Inn in Redondo Beach,
so this is not a case where the business has
been misplaced and the result contains an
incorrect street name or number.

Because the result information does not


overwhelmingly point to a Holiday Inn at this
location, rate the result Closed/Does not
exist.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

262
Query Results IP Ratings and Explanation
r o m
2 3 f carpo
Is there a ,Navigational
0 li Result for this Query? No
1 0 2 y Po T u
ry c esd
ua y Nan 1 a
Santa’s
J a n b Professional Dog 7 2.1 y, Ja
, 4.
ayGrooming
9 Relevance 6.2 nExcellent
es d . 2 5 54 uary
6
Tu 72.1603 .9
Manley St, North Pole
by 10,
1 Na 202
AK, 99705
 Name Accuracy Incorrect
ncy 3 f
Classification: Pet Services
 Po rom
lica IP
rpo
Additional info:
Address Accuracy Correct
Phone: (907) 480-9701

URL: http:// Pin Accuracy Perfect


www.paulasprofessionaldoggroo
ming.com/

Use all the information provided , even


information that's not rated, like URL and
phone number, to research the result.

[santa's dog
Here, research shows that the address, url,
grooming]

and phone number belong to Paula’s
Professional Dog Grooming. Since the
User and fresh
viewport in North evidence points to Paula’s business actually
Pole, AK existing at this location, the name Santa’s
Professional Dog Grooming is considered
Incorrect.

When rating relevance, ignore all data issues


and rate the result as if the name and
classification were correct. Because of the
match between the query and the incorrect
name, and how near the user is to the result in
the fresh viewport, this result is rated
Excellent.

When rating other results, treat this one as


closed/does not exist and don’t demote the
relevance of other, more distant, results. This
is so that a valid result that’s farther away
won’t be demoted solely due to this naming
error.
Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

263

Query Results IP Ratings and Explanation


r o m
Is there a Navigational
0 2 3 f carpo Result for this Query? No
, 2 o li
10 P Tu is closed/does not
Business/POI
ry ancy e
n
a
u yN exist 17 sday, ☑
J a b 2.1 J
ay, 254.9 6.2 anu
s d 54 ary
.
Tu 72.1Shell

e 6 Relevance .9 Excellent
by 10,
1 1221 S Main St, Wildwood, FL Na 202
ncy 3 f
34785
 Po rom
lica IP
Classification: Gas Station
 rpo

Additional info:

URL: www.shell.com

Phone: 1-352-748-6199
There are two gas stations in the immediate
area:

Mobil (purple pin)

1221 S Main St

Wildwood, FL 34785

Phone: 1-352-748-6199

Shell (red pin)

1001 S Main St

[gas station]
Wildwood, FL 34785

User and fresh Phone: 1-352-748-8903

viewport in
Wildwood, FL
The result contains conflicting information
from two nearby businesses. The result name
and URL point to a Shell gas station a little
north of the result address listed, while the
result address and phone number point to a
Mobil gas station. If, after researching all of
the given information for a result no clear
consensus of what the result is pointing to
can be made, the result should be rated as
Closed/Does not exist.

You will still need to rate relevance as if the


business were open. The result matches the
query intent and is within the fresh viewport.
The result should receive a rating of
Tu Excellent. IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

264
Query Results IP Ratings and Explanation
r o m
Is there a Navigational
0 2 3 f carpo Result for this Query? No
, 2 o li
Dinosaur 10 cy P Tu is closed/does not
a ry Inc

a n Business/POI esd ☑
8655 u JonesN Rd
exist 1 a
J a n b y 7 2.1 y, Ja
, 4.9
ayHouston,TX77065
6.2 nu
u e 16.25
s d
Relevance
54 ary
.9 Excellent
T 72. by 10,
1 Additional info:
Na 202
Research on the result information
ncy 3 f shows
Phone: 1-281-531-6500
Po rom
that the address belongs to Trails
lica atIP
Classification: n/a
Corinthian Creek Apartments. The rporesult
[dinosaur]

phone number belongs to a different


User and large apartment complex, Domain West
fresh viewport in Apartments. Finally, there is no evidence that
Texas the business Dinosaur Inc exists. Based on
the information listed, rate the result as
Closed/Does not exist.

You will still need to rate relevance as if the


business did exist. The result matches the
query intent and is within the large, fresh
viewport. The result should receive a rating
of Excellent.
Is there a Navigational Result for this Query? No
Business/POI is closed/does not
Lowongan Guru Kimia SMA SMU ☑
exist
Di Jakarta

[Salon di jalan Jalan Danau Sunter Utara No. 1


Relevance Bad (User Intent)
tebet timur Tanjung Priok

dalam raya DKI Jakarta 14350


The query is for a category with a specific
jakarta Indonesia
location modifier. The result is for a job
selatan]
Classification: Education
opening which does not satisfy the intent and
is not indicative of a POI. There is a
Translation: Result Title Translation:
possibility the result is for a particular high
[Salons in [Job Opening for High School school, however, the result address is not
Jalan Tebet Chemistry Teacher in Jakarta]
tied to any high school and no specific
Timur Dalam Additional info:
school is named in the result title. Since the
Raya, Jakarta Lat/long: -6.13799,106.86598
result data is ambiguous and does not
Selatan] or represent a single POI this entity should be
[Category, rated Closed/Does not exist.

Street Name,
TCity You will still need to rate relevance as if the IP
ues Name] r o m o
f rp a
17 day, business were open. The user's intent 23 islicfor
a
2.1 2 0
6.2 Janu Salon on a specific street. The 1result
0, y P does
o
54 ary not match this intent and should ry nc rated as
.9
by 10, n ua y Nabe
Na 202
ncy 3 f
Bad.
a y, Ja 4.9 b
Po rom esd .25
lica IP Tu 72.16
rpo 1

265

11. Top Rating Tips


IP
o m
r rpo
Solutions to the most common0rating 2 3 f cadilemmas.

li
1 0, 2 y Po Tu
a ry anc esd
11.1. What’s the relevance u y N when query is business/POI name 17 and a
J a n b 2.1 y,address
Ja and the result is
y , . 9 6 n
only the address?

a 4 . 25 ua
esd .25 4.9 ry
Tu 72.16 by 10,
When a user types in the name of a business or a POI along with its address, they 2
Na expect
1 ncy 023 f to see the
business mentioned in the query as part of the result. If the result is the address alone Po and
lica m does
ro not
mention the business, the user cannot be certain that the query and the result refer to the IP thing.
rposame
This is why the result’s relevance is Bad.

Address and pin accuracy can be rated as usual.

Query Results Ratings and Explanation


800 North Point
Relevance Bad (User Intent)
800 North Point St, San Francisco,
California 94109
Name Accuracy n/a
[Gary Danko Classification: American (New)
Address Accuracy Correct
800 North
Point St, San Pin Accuracy Perfect
Francisco, Result is for the address and not the
California business stated in the query, so the user
94109] cannot know whether or not the query and
result refer to the same thing. This is why the
result’s relevance is Bad.

11.2. What’s the relevance when the query is a street name and the result is a single
business on that street?

A query for an entire street is very broad. When the result is just one business or one address on that
street, it is too specific to satisfy the broad intent of the query.

Name, address, and pin accuracy can be rated as usual.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

266
Query Results IP Ratings and Explanation
o m
r rpo
Happy Lamb2Hot
0 3 f cPot

a Relevance Bad (User Intent)


19062 Stevens0 , P oli
2 Creek Blvd
Tu
1 cy Name Accuracy Correct
Cupertino,ry aCA,n 95014
e
u a 17 sday,
an by N 2.1
, J
Classification:
ay 254.9 Chinese
6.2 Janu Correct
Address Accuracy
es d . 54 ary
Tu 72.16 .9 10
Pin Accuracy byPerfect
Na , 202
[Stevens 1 ncy 3 f
Creek Blvd] Po rom
l ca IP
The result is for a business onithe rpostreet.
When the query is for a street, returning a
single business is too specific a result for the
broad query.

11.3. How do I know what the location intent is when user is outside/inside a fresh viewport?

When a viewport is fresh, the location intent for results depends on whether the user is inside or
outside the viewport:

• When a user is inside the viewport, that user’s location is the location intent

• When a user is outside the viewport, results are expected in or near the viewport, no matter
how near or far the user is from that viewport.

Viewport User Location Intent


When the user is within a fresh viewport, take the user
location as location intent. Results are generally expected in
Inside Viewport
or near the viewport, and results inside the area cannot be
rated Bad because of distance alone.

Fresh Results are expected in or near the viewport area. If no results


Outside
can be found in or near the viewport, use the user location as
Viewport
a secondary location intent.

When the user is missing, the viewport remains the location


Missing
Tu intent. IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

267

11.4. How do I know what the location intent is when user is outside/inside a stale viewport?

IP
r o m
0 2 3 f carpo
When a viewport is stale, the li
1 0, 2user’s
y Po location is considered the location
Tu intent for the results whether
the user is inside or outside y
ar the c
n viewport
e
nu by Na 17 sday,
a 2.1
a
J
y, 54.9 6.2 Janu
es d .2 54 ary
Viewport Tu 72.16 User Location Intent
.9
by 10,
1 Na 202
Inside Viewport ncy 3 f
ro
When the viewport is stale, consider only thePouser
lica mlocation
I as
Outside location intent. rpo P
Stale Viewport
Use the stale viewport as location intent when the user
Missing
location is missing.

11.5. This full address result does not exist. How do I rate it?

An address type result needs to be associated with a building or officially assigned to a plot of land in
order to be useful to a user. Sometimes your research will show that a queried address simply does
not exist. In cases like, this you’ll see one of three types of results:

• The closest verified address (on the same street, in the same city and state): Rate
relevance as Excellent.

• The same address as the query address: Rate relevance as Excellent and address as
Incorrect – Address does not exist. The pin will be rated Can’t Verify.

• The queried street without a street number: Rate relevance as Acceptable.

When a queried address does not exist, the answer to the question “Is there a navigational result for
this query” will always be No.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

268
Query ResultsIP Ratings and Explanation
m
Is there a Navigational3 fro rpo Result for this Query? No
, 2 0 olica
2
10 P
Relevance Tues Excellent
[2001 Duncan 1099 aDuncan
ry ancy St

u Duncan
N 1 da
1099n y St., San 7 2 y,
St, San , Ja 4.9 b
yFrancisco, Name Accuracy.16.2 Jann/a
Francisco]  d a 5 94131, CA
5 u
4.9 ary
es 6.2
Tu 72.1Classification: n/a
Address Accuracy y N 10, 2
Correct
b
1 an 023
c
Pin Accuracy Perfecty Pol from
ica IP
rpo
If 2001 does not actually exist then selecting
1099, the closest number that does exist, is
considered correct. For a locale that uses the
rule of even numbers on one side of the street
and the odd numbers on the other, we need to
return the closest existing address on the same
side of the street as the query. If the rule of
odds and evens does not apply then the
closest numeric number will be considered
correct.

The pin has to be correctly dropped on the


address presented in the result.

2001 Duncan St
Relevance Excellent
2001 Duncan St., San Name Accuracy n/a
Francisco, 94131, CA

Classification: n/a
Incorrect – Address
Address Accuracy
does not exist
Pin Accuracy Can’t Verify
Duncan Street only goes up to number 1099,
but the query requests a non-existent number.
The result returned is the same as the queried
address and should be rated as Excellent.

The pin rating for addresses that do not exist is


Can’t Verify.

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

269

Query ResultsIP Ratings and Explanation


m
3 fro rpo
a
0 , 202 olic
Duncan 1St
y P Relevance Tues Acceptable (User Intent)
ary Nanc 17 day,
Duncanu St, San Francisco,
, Jan .9 by 2
Name Accuracy.16.2 Jann/a
a y94131,
4 CA
54 uary
esd 6.25 .9
Tu 72.1Classification: n/a
Address Accuracy by 10,
Correct
1 Na 202
nc 3
Pin Accuracy Perfecty Po from
lica IP
rp
The result returns only the street withoa pin
dropped within the boundaries of the street.
This result technically satisfies the user intent,

but this intent is unlikely, so relevance should
be rated Acceptable.

Appendix: Release Survey

You may occasionally be unable to rate a survey. To skip it, click Release Survey at the top right of
the tool.

A pop-up window with a list of reasons for release will appear. You must choose one before you can
release the survey.

Note: If you change your mind and decide to rate the survey, click Cancel at the bottom left of the
pop-up window.

Reasons to Release

1. Adult Content

You are not comfortable rating queries and/or results that include businesses offering adult services
or entertainment, like strip clubs.

2. Technical Issue

Technical issues that prevent rating include:

• Map or map features not loading.

• Query field is empty.


IP
Tu• Tool is not interactive. You cannot zoom in and out or move the map at all.
o m o
esd f r
17• aCannot
2.1 y, Ja submit ratings.
2 0 23 licarp
o
• 6More
.25 nthan 10, cy P
4.9 ary 5 pins in a row are missing or pins do not stay in place.

u r y n
ua y Naare not the
• Receivingby 150,consecutive surveys with all results in China, if China, or Hong anKong,
b
Na 202 , J
markets youncyare3rating.

f s d ay 254.9
Po rom e .
lica IP Tu 72.16
If you choose this option, rleave
po a comment describing the issue before releasing
1 the survey.

270
IP
r o m
3. Not Enough Time Allocated

0 2 3 f carpo
li
1 0, 2 y Po T
ry anc Rating Time is not sufficient to ucomplete
Select this option if theuaEstimated esd the task. Remember, the
n y N 17 ay,
Estimated Rating yTime J a is the average time over multiple tasks.

b 2 . 16 J
d a , 254.9 .25 anua
s
ue .16 . 4.9 ry
4. Other
T 2 by 10,
17 Na 202
ncy 3 f
Po rom
Issues not mentioned above that prevent you from rating.
lica IP
rpo
If you choose this option, you must leave a comment before you can release the
survey.

Do Not Release

These issues will not prevent rating and are not reasons to release surveys:

• Poor satellite image, including clouds over target area or lack of image detail

• You can zoom in and out on map, but not as much as you'd prefer

• Rating is too difficult

• Query does not appear to be related to maps

• Query or results are from outside your market

• A query has no results

• If you see a query with no results, answer the query-level “Navigational Result”
Question and submit.

• Query or results in unexpected languages and scripts:

• If you see a query in an unexpected language or script, research it or use an online


translation tool to find out what it means, then rate it as usual.

• For results in an unexpected language or script see Result Name/Title in Unexpected


Language or Script and Language/Script Issues in Address

Tu IP
e r o m o
17 sday, f
2.1 2 0 23 licarp
6.2 Janu 10, cy P
o
54 ary r y n
.9
by 10, ua a
Na 202 , Jan by N
.9
ncy 3 f s day .254
Po rom e
Tu 72.1 6
lica IP
rpo 1

271

You might also like