Professional Documents
Culture Documents
Image Guidelines
Image Guidelines
u=jqmklkol
1. Understand the query and the user task or journey. This will inform all of your subsequent ratings.
2. For each image search result, assign up to four types of ratings:
○ Image Satisfaction: How satisfying is the image for the query?
○ Image Prominence: How prominent is the image on the landing page?
○ Landing Page Helpfulness: How helpful is the landing page for the underlying user task or journey,
assuming that the user is interested in the image?
○ Landing Page E-A-T
3. Assign image and landing page flags.
4. Assign an overall Side-by-Side Preference rating if requested.
5. In some tasks, you will also be asked to assign Added Value ratings, Freshness ratings, and/or a Diversity
Assessment rating. See guidance inside the rating task for these steps.
Important: Image Satisfaction ratings should be based only on the image you see in the rating task, not its
landing page or any text you see below the image. Occasionally you may need to research the object(s) in an
image to understand what they are, but you should not consider the content, quality, page type, or website domain
of its landing page when assigning an Image Satisfaction rating.
Image Satisfaction Rating Description
Fully Satisfying (FullyS) A special rating category that only applies to queries that are looking for one
very specific image.
Highly Satisfying (HS) A very satisfying image and a good fit for the user task or journey.
Highly Satisfying images must have one or more of the following
characteristics: extremely helpful, beautiful, inspirational, or visually appealing.
Highly Satisfying images may address any reasonable interpretation or intent
of a query, including reasonable minor interpretations.
Moderately Satisfying (MS) A satisfying image and a reasonable fit for the user task or journey.
Moderately Satisfying images are generally average to good. There is nothing
"wrong" with a Moderately Satisfying image.
Moderately Satisfying images may address any reasonable interpretation or
intent of a query, including reasonable minor interpretations.
Slightly Satisfying (SS) A less satisfying image and/or a less reasonable fit for the user task or journey.
Slightly Satisfying images may be less helpful for a reasonable interpretation
of the query, lower in quality, less visually appealing, etc.
Fails to Satisfy (FailsS) A satisfying image for very few to no image search users who issue the query.
Fails to Satisfy images may be unrelated to the query, have extremely low
image quality, or may contain unsolicited unpleasant or upsetting content.
Important: Any unpleasant images, uncomfortable images, upsetting or
offensive images, or porn images should be rated Fails to Satisfy unless the
query clearly indicates the user is seeking that type of content.
Please have high standards and reserve Highly Satisfying for truly outstanding images. Use in-between ratings
if you think the rating of an image search result falls between two labels. You can either drag the slider or click on
the point that you want the slider to land on.
Highly Satisfying
(HS)
This is a visually appealing image of
blueberries. The green background, the open
hands, and the large, deeply colored berries
are a beautiful visual presentation.
Satisfaction Rating Images Explanation
Highly Satisfying
(HS)
(CONTINUED)
Highly Satisfying
(HS)
(CONTINUED)
Slightly Satisfying
(SS)
This is an image of a school notebook with a
blueberry-themed cover. While it is
connected to the query, blueberry-themed
school supplies are a less reasonable user
intent.
Fails to Satisfy
(FailsS)
Fully Satisfying N/A Because the query [chickenpox rash] does not
(FullyS) seek one very specific image, no image can
be rated Fully Satisfying.
Highly Satisfying
(HS)
This is a very helpful image for chickenpox
rash identification because it shows both the
general appearance of a child with chickenpox
as well as specifically what the rash looks like.
The photo is high quality, and the magnified
portion gives details of the chickenpox rash.
Satisfaction Rating Images Explanation
Slightly Satisfying
This is a low quality photo with limited visual
(SS)
information. The very high contrast bleaches
the image towards the middle and fades to
black on the edges, making it difficult to see
the rash on the skin. The black border above
and below the photo also looks out of place
and adds nothing to the informational value.
The low quality and low level of visual
information make this image helpful for few
users.
Fails to Satisfy
(FailsS)
Fully Satisfying N/A Because the query [black and white nike
(FullyS) shoes] does not seek one very specific
image, no image can be rated Fully
Satisfying.
Highly Satisfying
(HS)
Highly Satisfying
(HS)
This is a photo of black and white Nike shoes,
(CONTINUED) showing the front, sole, and sides. An effort
was made in this product photo to show users
the features of the shoes.
Moderately
Satisfying (MS)
This is a typical product photo of a black and
white Nike shoe. The image is average to
good, but not outstanding in any dimension.
This image would be satisfying for many
image search users.
Slightly Satisfying
(SS)
Fails to Satisfy
(FailsS)
Fully Satisfying
(FullyS)
Highly Satisfying
(HS)
Slightly Satisfying
(SS)
This is a business logo for a company with
"Mona Lisa" in its name. While it is connected
to the query, it is a less reasonable user intent.
Fails to Satisfy
(FailsS)
This is a painting by a different artist
(Picasso). It is too unrelated to the query to
be satisfying.
Fully Satisfying N/A Because the query [piglet] does not seek one
(FullyS) very specific image, no image can be rated
Fully Satisfying.
Highly Satisfying
(HS)
Highly Satisfying
(HS)
Moderately
Satisfying (MS)
This photo of a piglet is average to good and
would be satisfying for many image search
users. There is nothing wrong with it, but it is
not particularly adorable or inspiring.
Slightly Satisfying
(SS) This image is lower quality: the image is a bit
grainy or pixelated; the steps are somewhat
confusingly arranged and difficult to follow;
there is both a pink decorative font as well as
handwritten annotations. The lower quality of
this how-to image and the slightly more niche
intent of balloon animal crafting combine to
make this image Slightly Satisfying.
Fails to Satisfy
(FailsS)
An image of a kitten, even an extremely cute
one, is too unrelated to the query [piglet] to
be satisfying for users.
IMPORTANT: The next page of this guideline includes examples of images that may be slightly unpleasant to
view. If you do not feel comfortable viewing these images at this time, please skip to Section 3.0.
Fails to Satisfy
(FailsS)
This image prominently features piglet
genitalia in the center of the image. Nothing
(CONTINUED)
in the query suggests users are interested in
this type of content.
1. Image Prominence: How easily can the image be found on the landing page?
2. Landing Page Helpfulness: How helpful is the landing page for the underlying user task or journey,
assuming that the user is interested in the image?
3. Landing Page E-A-T: Evaluate the E-A-T of the landing page as described in the General Guidelines.
Important: In an image search rating task, you may see multiple results showing the exact same image, but with
different landing pages. In this case, your image satisfaction ratings should be the same for each image, while
your landing page ratings should vary according to the content and quality of each landing page.
Important: Image Prominence ratings should be based only on the image and the landing page, not the query.
You do not need to think about the query when assigning Image Prominence ratings to results.
Prominence Rating Description
Main Feature The image is the main feature of the landing page. All users would easily find the
image.
Easy to Find The image is easy to find on the landing page, but it is not the main feature of the
page. Most users would find the image.
Hard to Find The image can be found on the landing page, but it requires effort. Many to some
users would find the image.
Missing The image cannot be found anywhere on the landing page, even with effort.
This rating should also be used if the image is so difficult to find that few or no
users would find it, even though it is present somewhere on the landing page.
For example, if the image is not in the first few scrolls of a very long page with
many images, you may consider it Missing without investigating further.
Landing Page
Easy to Find This is an informational page about the painting in the image.
The image is under the first paragraph, and it is easy to find on
a long page that mostly contains text.
Landing Page
Hard to Find This page has so many images related to the Mona Lisa that
it's hard to find this particular image.
Landing Page
Landing Page
Image and LP Prominence Rating Explanation
N/A Main Feature Example could not be found for this image at this time
Easy to Find This is a recipe page that shows step-by-step instructions on
how to make the recipe. This image is one of several on the
landing page, but it is easy to find.
Landing Page
Hard to Find This is a search results page full of images. This image is
towards the top, but it is still hard to find since it is one of many
similar images on the page.
Landing Page
Landing Page
Important: The helpfulness of the landing page only matters when the corresponding image would satisfy at least
some users and can be found somewhere on the page. As a result, when an image is Fails to Satisfy (FailsS)
or Missing, its landing page should automatically receive an Unhelpful (UH) rating without further
consideration. For LP Helpfulness ratings, you only need to consider the content of the landing page when the
corresponding image is at least Slightly Satisfying (SS) and can be found somewhere on the page.
The remainder of this section only applies to landing pages that correspond to images that are at least Slightly
Satisfying (SS) and can be found somewhere on the page.
When rating the helpfulness of the landing page, please start by considering the possible user task(s) or
journey(s) behind the query. Image search users may be trying to accomplish a specific task, such as buying a
product, or they may be on a longer-term journey, such as completing a project. As image search users look
through the results, users click on images to learn more. Helpful landing pages allow users to learn more about
the image or object(s) in the image and make progress on their task or journey.
Then, please assume that the user is interested in the image, and ask yourself whether the landing page
would help them complete their task or make progress on their journey. Helpful landing pages don't just provide
the image. Helpful landing pages have in-depth content about the image or object(s) in the image.
Putting it all together, helpful landing pages must be helpful both for the user task or journey AND for users
interested in the image. If a landing page is not helpful for the user task or journey, or if it is not helpful for users
interested in the image, then the LP Helpfulness rating should be Unhelpful (UH).
Here are some examples of potentially helpful landing pages (depending on the user task or journey) for different
types of images:
● For an image of a product, helpful landing pages should be about the product in the image and may
include information such as specs, reviews, etc. Helpful landing pages may offer the product for
purchase directly, give information about how or where to purchase it, provide reviews about it, etc.
● For an image of a recipe or dish, helpful landing pages may be about the specific recipe in the image.
Helpful landing pages may include step-by-step instructions on how to prepare the dish, reviews of the
recipe, tips on presentation, alternate ingredients, nutritional information, etc.
● For an image depicting a medical condition, helpful landing pages should give authoritative health
information about the condition in the image. This may include symptoms, diagnosis criteria, when to
seek formal medical attention, etc.
● For an image of a celebrity or musical group, helpful landing pages may explain when the photo was
taken or where the image came from, mention who is included, and give biographical information or
recent news about the people pictured. Helpful landing pages may also provide a relevant video featuring
the person, such as a music video from a musical group.
● For an image of a DIY, craft, or other project, helpful landing pages may offer detailed how-to
information, such as materials and resources, so that a user could complete a similar project of their own.
This may include step-by-step instructions, video tutorials, blueprints or technical drawings, etc.
There are a few types of landing pages that are Unhelpful (UH) for users interested in the image:
● Any landing page that does not help users along their task or journey. Helpful landing pages must be
helpful both for the user task or journey AND for users who are interested in the image.
● Any landing page that consists only of the image itself. Users have already seen the image on the image
search results page. Helpful landing pages must offer much more than just the image.
● Any landing page that has little information specific to the image or the object(s) in the image. Helpful
landing pages must be about the image or the object(s) in the image.
● Any landing page filled with many similar images. Remember that image search users have just browsed
through image search results and have chosen an image of interest. A landing page that requires
users to search again by visually scanning a large number of similar images is unhelpful.
● Any landing page on which the image cannot be found at all. A landing page that does not allow users
to find the corresponding image is unhelpful.
Very Helpful (VH) Landing Page The landing page is very helpful both for the user task or journey and for
users interested in the image. Most users would be helped along their
task or journey, and the landing page has a substantial amount of very
helpful content or information about the image (or the object(s) in the
image).
Note: A landing page is only eligible for this rating if the image is at least
Slightly Satisfying (SS) and can be found somewhere on the page.
Moderately Helpful (MH) Landing The landing page is helpful both for the user task or journey and for users
Page interested in the image. Many users would be helped along their task or
journey, and the landing page has helpful content or information about
the image (or the object(s) in the image).
Note: A landing page is only eligible for this rating if the image is at least
Slightly Satisfying (SS) and can be found somewhere on the page.
Slightly Helpful (SH) Landing Page The landing page is slightly helpful for the user task or journey and for
users interested in the image. Some users would be helped along their
task or journey, and the landing page has some content or information
about the image (or the object(s) in the image).
Note: A landing page is only eligible for this rating if the image is at least
Slightly Satisfying (SS) and can be found somewhere on the page.
Unhelpful (UH) Landing Page For any image that is Fails to Satisfy (FailsS) or Missing, its landing
page should automatically receive a rating of Unhelpful (UH).
For images that are at least Slightly Satisfying (SS) and can be found
somewhere on the page, the landing page should be rated as Unhelpful
(UH) when either of the following are true:
● The landing page is not helpful for the user task or journey. Few
or no users would be helped along their task or journey.
● The landing page is not helpful for users interested in the image.
The landing has little or no content or information about the
image (or the object(s) in the image).
Very Helpful (VH) Users who are interested in this image may want to make
the ice cream pictured in the image. This is a detailed
recipe page that would be very helpful for anyone wanting
to make this ice cream.
Landing Page
Slightly Helpful (SH) This landing page is a list of blueberry recipes, each with a
link to other websites for the recipe. The list is short, and
this image corresponds to the first recipe shown. There is
some content on the page specific to this image and
recipe.
However, the landing page itself isn't that helpful for users
interested in making this ice cream.
Landing Page
Unhelpful (UH) This is a search results page with many images and very
little information about each. A user who is interested in
this particular image would have to visually scan the
landing page to locate the image, then click on it to find
more information or content about the actual recipe.
Landing Page
Unhelpful (UH) This landing page is the image itself, with very little
additional information or content about this image. Even
though the image is extremely prominent, the page is
unhelpful for users trying to accomplish their task.
Landing Page
Very Helpful (VH) This is the product information and purchase page for the
shoe in the image on the official Nike website. This page
has product information, reviews, and offers users a way
to purchase these shoes. This page would be very helpful
for users looking for information/reviews or for those who
want to purchase this product.
Landing Page
Moderately Helpful (MH) This page has styling advice on sneakers and specifically
describes the type of black and white Nike sneakers
pictured. This page would be helpful for users interested
in styling or fashion.
Landing Page
Slightly Helpful (SH) This is an article about the shoes and clothes worn by
tennis superstar Serena Williams. It does mention that
Serena Williams wears Nike shoes, but the landing page
does not describe which Nike shoes are shown in this
image. This landing page is Slightly Helpful to users who
are interested in the shoes shown in this image.
Landing Page
Unhelpful (UH) This is a page full of shoe options from a popular shoe
retailer. To get information about the specific shoe in the
image, users would have to scan the listing page to find
this particular shoe and then click into the page specific to
this shoe.
Landing Page This landing page is Unhelpful for this image because the
landing page has very little content specific to this shoe.
Landing Page
Important: Landing Page E-A-T ratings should be based only on the landing page, not the query or the image.
You do not need to think about the query or the image when assigning Landing Page E-A-T ratings to results.
IMPORTANT: The next page of this guideline include examples of images that are Upsetting-Offensive
(U-O). If you do not feel comfortable viewing these images at this time, please skip to Section 4.3.
Image Flag Explanation
● Racy or sex-related images including images that show human or animal genitalia, even if the image is
blurred, slightly obscured, clearly photoshopped or "faked", illustrated, shown for the purposes of
education, etc.
● Images of medical procedures, bodily fluids, medical conditions, or abnormalities, even if illustrated for
educational purposes, clearly photoshopped, created with special effects, etc.
● Mild depictions of harm including self-harm, animal or human suffering, animal or human injuries, etc.,
even if clearly photoshopped, illustrated, created with special effects, etc.
● Images that negatively or unflatteringly portray groups of people, including memes, infographics, or
photoshopped images.
● Images that promote conspiracy theories or other factually unsupported or misleading information,
including memes, infographics, or photoshopped images.
● Mild profanity or mildly rude gestures.
● Any image that would not be appropriate in a public space, a work environment, a library, a school, etc.
● Any other image that would make sensitive users in your locale uncomfortable.
Important: Please note that the Porn and U-O flags are considered stronger than the N-E flag.
● If you flag an image as Porn or U-O, the N-E flag for that image will be automatically disabled in the rating
task.
● If you flag an image as N-E, you should also consider whether the Porn and/or U-O flags are appropriate
for that image as well. Please represent the sensitivities of users in your rating locale.
IMPORTANT: The next two pages of this guideline include examples of images that are Not-for-Everyone
(N-E). If you do not feel comfortable viewing these images at this time, please skip to Section 4.4.
Note: All of the images below should receive the Not-for-Everyone (N-E) flag. Depending on the sensitivities of
your rating locale, the Porn or U-O flags may be appropriate as well. Please use your judgment.
Image Flag Explanation
N-E This sex position chart may be inappropriate for children or
users in a professional workplace.
N-E This photo of animal sex may be inappropriate for children or
in a professional workplace.
Image Flag Explanation
N-E This image shows methods of suicide. This image may be
inappropriate for children and other sensitive users.
N-E This sign has mild profanity and expresses sentiments that
may be inappropriate for young children and other sensitive
users.
N-E This is a Nazi propaganda poster. While the image may have
historical importance, the ideology of racial supremacy
depicted may not be appropriate for all audiences.
5.0 Image Satisfaction Rating for Porn / U-O / N-E Tolerant Queries
Some queries may indicate that the user is explicitly seeking Porn, U-O, or N-E images. For these explicit
queries, Porn, U-O, or N-E images may be the most helpful results, and thus may receive high Image Satisfaction
ratings. For example, the most helpful results for the query [photos of dead bodies] are likely to be U-O or N-E.
Please select the Porn, U-O, and/or N-E flags for all such images, even if the query explicitly seeks Porn, U-O, or
N-E images.
Have high standards and think about the user intent and overall user experience. Assume that users have a
genuine educational or informational intent whenever possible. As always, image search results (including Porn,
U-O, and N-E results) must be helpful and satisfying for the query to receive high Image Satisfaction ratings.
Do not assume that Porn / U-O / N-E tolerant queries "deserve" the most graphic, offensive, or shocking images.
Do not assume that Porn / U-O / N-E tolerant queries are issued by people who hold upsetting or offensive views.
Do not assume that users are merely seeking to validate an offensive or upsetting perspective.
A very offensive Porn / U-O / N-E image should only be given a high satisfaction rating if it is very clear that the
user is seeking offensive images and such images are necessary to satisfy the user intent. Image search results
should be no more shocking, disturbing, or upsetting than necessary in order to satisfy the user intent and
underlying user task or journey.
IMPORTANT: The next page of this guideline include examples of images that are Upsetting-Offensive
(U-O) and/or Not-for-Everyone (N-E). If you do not feel comfortable viewing these images at this time,
please skip to Section 6.0.
Highly Satisfying U-O This image is very helpful for the query, so
(HS) Highly Satisfying is appropriate.
However, this image is a graphical
depiction of severe and potentially
disturbing harm, so it should be flagged
as U-O.
Please apply the following guidance to your ratings for still frame images from videos:
● Image Satisfaction should be rated as usual. For example, if a still frame image is blurry, contains
distracting/unhelpful backgrounds or borders, or has other qualities that make it less visually appealing,
then these attributes should contribute to a lower Image Satisfaction rating, just as they would for any
other image result.
● Image Prominence should capture how easily the image can be found on the landing page. This will
require you to consider both of the following: (1) How prominent is the video on the landing page? and (2)
How easily can you find the image within the video?
○ If the image can be easily found within the video—or corresponds to the video's thumbnail
image—then your Image Prominence rating should just correspond to how prominent the video is
within the landing page, and may be as high as Main Feature.
○ The harder it is to find the image within the video, the lower your Image Prominence rating should
be, even if the video itself is highly prominent on the landing page. For example, if the image is
very difficult to find in the video even after skipping around a bit, you may consider it Missing
without investigating further.
● Landing Page Helpfulness should be rated as usual. For still frame images that are at least Slightly
Satisfying (SS) and can be found somewhere within the video, your LP Helpfulness rating should
consider the helpfulness of the landing page as a whole, including the video content.
○ Examples of helpful video content include:
■ a helpful video review of a product featured in the image.
■ a relevant music video from a musician depicted in the image.
■ a helpful tutorial video on how to create a home garden design portrayed in the image.
○ Examples of unhelpful video content include:
■ a video that has nothing to do with a celebrity featured in the image.
■ a low-resolution, blurry video that is too low quality to be helpful.
View animated GIF
View animated GIF
View animated GIF
View animated GIF
View animated GIF
View animated GIF
View animated GIF
View animated GIF
View animated GIF
View animated GIF
View animated GIF
View animated GIF
Highly Satisfying This is another animated GIF that is clearly aimed at
(HS) making people laugh. Although the humor in this
result may be considered more nuanced than the
example above, many users would likely find it funny.
Notably, this result also has a clever concept, an
impressive attention to detail, and good execution, all
of which contribute to a rating of Highly Satisfying.
View animated GIF
View animated GIF
View animated GIF
Fails to Satisfy This animated GIF is not really funny, but rather
(FailsS) depicts someone who seems bored and unimpressed.
View animated GIF
Fails to Satisfy Many users would likely find this result funny.
(FailsS) However, it's not animated, so it would not satisfy the
user's clear intent to see animated GIF results.
Remember: For GIF-seeking queries like this one,
non-GIF results should automatically receive a rating
of Fails to Satisfy, since the animation aspect of the
user intent is not met.
This result is NOT animated
Helpfulness of results Images and landing pages must be helpful for the query and user intent. Please
think about what users are trying to accomplish. The query may be part of a
quick task or longer-term journey.
Order of the results The most likely interpretations or intents should be addressed by results that
appear in the top positions of the image search result set.
Diversity of results Diversity in the result set is one of the most important aspects of image SxS
rating. A satisfying result set addresses all reasonable user intents.
Beauty, inspiration, and Beauty, inspiration, and visual appeal are very important for topics such as
visual appeal of the images home and garden, crafting, styling, design, products, travel, recipes, food, etc.
A satisfying set of images for these types of topics should be beautiful,
inspirational, and visually appealing.
Helpfulness and E-A-T of Landing pages must be helpful for the underlying user task or journey and for
the landing pages users interested in the images. Landing pages with high E-A-T enable users to
have more trust in the content of those pages, which contributes to a higher
quality result set.
Porn, U-O, and N-E images Image search results should never unpleasantly surprise users with upsetting,
offensive, or disturbing content. Think carefully about user intent and consider
whether Porn, U-O, and/or N-E content is appropriate. When in doubt, assume
it is not appropriate.
User task or journey: Users may be seeking visually appealing images of blueberries, blueberry recipes, or
uses for blueberries.
Note for this example: Please assume all images are prominent on helpful and high E-A-T landing pages.
Overall SxS Preference: Please indicate which side you think most users issuing this query would prefer
overall. Make sure to consider the images, the landing pages, and the diversity of the result set on each side.
Much Better Better Slightly Better About the Same Slightly Better Better Much Better
⬤ ◯ ◯ ◯ ◯ ◯
◯
Discussion: The images on the left are Moderately to Highly Satisfying. The images on the right are Highly
Satisfying. However, the left side is Much Better because it has both blueberry images as well as blueberry
recipes. The right side is missing a very likely user intent: images of blueberries. Please pay close attention to
reasonable user intents and the diversity of images.