Instructions:

In this task, the goal is to determine which set of titles for the given photo album is better quality.
Instead of the images of the album, each image is represented by a caption of the image, the date and
time taken, and possibly the location taken along with names of people in the image.
You will assess whether the titles in each response exhibit any significant issues then give a general
rating for which set of titles you would prefer.
It’s okay to prefer a set of titles that exhibit some issues especially if the issues are not severe or
offensive. It’s also okay to rate the titles as “About the Same” if both sets have titles of reasonable quality
or if both sets exhibit about the same severity of issues.

Assessing Substantial Inaccuracy

A title is substantially inaccurate when it contains a large detail not present in the context.

● inaccurate time frame

○ “A Year in Paris” but the dates in the context only spans a few days
● inaccurate location
○ “Paris 2016” but the location cannot be inferred from the context
 ● inaccurate ordinal
○ “My First Paris Trip” but it cannot be inferred from the context that this is the user’s first
time in Paris.
● inaccurate activities
○ “Swimming and Sandcastles” but there are no sandcastles mentioned in the context.

Sometimes it’s okay for the title to infer small details not stated in the context:

● attribution
○ “Sally’s Birthday” is fine even if the context does not state the birthday is for Sally as long
as the context is about a birthday.
● relationships
○ “Paris with My Sister” is fine even if the context does not indicate that relationship
between the user and the person.
● holidays
○ “Christmas 2021” is a reasonable title and not an inaccuracy if the dates of the images
are all around Dec 25, 2021.

However if these small errors appear in every title, then it becomes a substantial inaccuracy.

Assessing Not Detailed Enough

A title is not detailed enough when it doesn’t contain the most relevant or useful details from the
context. If it could be used as a title to many different albums, then it doesn’t have enough details.Titles
should use specific times/names when appropriate and avoid generic platitudes.

A set of titles is not detailed enough when two or more titles are not detailed enough.

Not detailed enough Detailed

👫
2019 Trip 2019 Trip to Hamburg

📸 ⚓
A Trip with Friends A Trip with Hannah and Jackie
A Photogenic Trip A Sailing Trip

☀️
☀️
Fun with Friends Holden Beach 2021

🌴 🌊
Summer Stroll At Holden Beach
Out and about A day at Holden Beach

Assessing Unnatural Language

Titles should not refer to the user by their name, but use 1st person instead.

● “My Paris Trip” (good) vs “Sally’s Paris Trip” (bad, if the user is Sally)

Titles should not use last names unnecessarily.

● bad: “Hiking with Sally Lee and Molly Lee”

 ● good: “Hiking with the Lees” or “Hiking with Sally and Molly”

Titles should be concise and not a long description of the album

● “Robert, John, and Amy Enjoy Thanksgiving Dinner in Chicago” (bad)

Assessing Emoji Use

Emojis used in titles should relevant and appropriate. Emojis shouldn’t be interruptive (in the middle of
the title).

Examples:

● “Vegas with the Fam 🎰🎳🎫 ”: the bowling emoji is irrelevant if there’s no mention of bowling in
the context
● “A Grand Tour of London with James Brown 🎭🕍🎡 ”: A synagogue emoji is inappropriate when
there’s nothing related to Judaism in the context
🧒🏻
“A Trip to Texas with My Little Girl ”: The emoji used is inappropriate because it has a specific
👧
●
skin tone which cannot be inferred from the context. would be better

Inappropriate emoji use can also be potentially harmful content if the usage is severe.

Assessing Harmful

● Uses the wrong gender

○ “Out with my girl” when the context only mentions a boy.
Human-animal confusion
🐒
●
○ “My little monkey is growing up so fast ” is harmful because it labels a human child as
a monkey.
● Stereotype reinforcement
○ Titles shouldn’t make stereotyped assumptions based on gender, race, ethnicity, or age
○ “Adorable Babysitting Photos” reinforces a negative gender-caregiver stereotype where
dads caring for their own kids is called babysitting, and moms caring for their own kids is
called “parenting”.
● Sexually explicit
○ Titles should not be sexually explicit or suggestive especially when referring to minors.
● Culturally inappropriate or appropriative
○ Titles should not use culturally appropriative slang or refer to non-Western locations or
people as “exotic” or “out of this world”
Rating Examples