ADS QUALITY RATER LEARNING PROGRAM

Query & What is this task about?

Determining how well the

What is the ultimate goal?

Training the algorithm to detect

OK, how do I perform it well?

Familiarize yourself with the

Mobile App
mobile app fulfills what the the suitability of the mobile app rating options based on how
user is looking for on YouTube. in relation to the query. well they satisfy the user
intent.Use this infographic as a
mental model while
Match Evaluation Hmm, but why?
determining how well the
To be able to improve the mobile app fulfills what the
relevancy of displayed mobile user is looking for on YouTube.
app ads and satisfy user intent.
Reminder
In the entrance exam, you will
NEW TASK
be asked to solve example
tasks of this type!
Review and understand the query

Terms
Click on While researching the user intent,
keep in mind that the query was
Query
Query entered on YouTube.
A word or set of words that a user to open the YouTube search results
enters into a search engine.
You may perform additional
Mobile device Research to understand the user intent research outside of YouTube as
A small, handheld computing device, well.
such as a smartphone or tablet.

User Intent The query is:

What the user hopes to accomplish by
in a foreign language
using a search engine.
incomprehensible
Mobile app otherwise can't be rated
A smartphone or tablet application.

Tick checkbox:
Is the query rateable? No
Unrateable query

Yes

Familiarize yourself with the mobile app

Click the button labeled Ignore other mobile apps listed

as similar mobile apps.
RESEARCH MOBILE APP
to open the app’s Google Play page
You may perform additional
research outside of the Play Store
as well.
Check if any of the below applies:
The mobile app is NOT rateable if any of the below
applies. The Play Store page or the app it describes is:
Do not download the mobile app!
in a foreign language
incomprehensible
otherwise can't be rated

Is the mobile Tick checkmark:

app rateable?
No
Unrateable app

Yes

Would installing and

using the app satisfy
the user intent?

The app is
unrelated to the user intent
and/or the app is of obviously bad
quality.
The user intent will definitely not be
satisfied by installing and using
the app.
The app provides
features that are related
to what the user is looking for, but
they’re unlikely to be satisfied by
installing and using it because it’s not
a very good match and/or because
the app appears to be of low quality.
The app provides
similar functionality
to what the user is looking for.
The user intent could be satisfied by
installing and using the app because
it is of generally good quality, even
though some of its features don’t
match what they are looking for.
The app provides
exactly the functionality
that the user is looking for, even if the
app is a competitor app.
The app is of good quality, and the
user intent would be satisfied by
installing and using it.

Dissatisfaction Likely Dissatisfaction Possible Satisfaction Possible Satisfaction Likely

SUBMIT TASK

Send feedback about this decision map

talentrequests@welocalize.com

Confidentiality Notice: 2021 C

This file is intended solely for the individual to whom they are delivered within Ads Quality Rater Training Program and contains confidential or legally
privileged information. If you are not the intended recipient, or an employee or agent responsible for delivering the file to the intended recipient, you are Version 3.0
hereby notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. 2021-09-28