Professional Documents
Culture Documents
⚠️ Raters & Vender Manager SRT Bug Report Process: If you are facing a SRT issue,
please visit the Bug Report Playbook to learn how to report it
0 l
81 tia
JSTM GUIDELINES
44 n
of the relevant subtopics. There are multiple sub-topic queues for each high-level topic
from R1.
e
78 id
1. Key Rating Concepts
should first consider the following questions. The answers to these questions should
guide you in applying topic(s) to the post. Captions, hashtags and the media
(images/video) can provide clues to the answer.
● What is the content about?
Co
The short sentence should then provide you with a potential list of topics that could be
applied to the content. However, not all of those topics are ultimately relevant as we have
to consider the context of the content. Therefore, we also need to answer this next
important question:
● Does the content make sense showing up in a search/feed about that
topic/subtopic?
0 l
✅ ✅ Ex. A: This IG Reel is about a bathroom makeover and
81 tia
can be labeled: ‘Home Renovation & Construction’ +
‘Interior Design’
44 ne
✅ ❌
Do not apply irrelevant subtopic label(s)
● Ex. A: This IG Reel is about a group of sisters reenacting a makeover scene from
0 l
the movie The Princess Diaries during a wedding. These subtopics can be applied:
✅ ‘Siblings’
81 tia
✅ ‘Beauty & Fashion Makeovers’
✅ ‘The Princess Diaries (2001 film)’
✅ ‘Engagements & Weddings’
● Ex. B: This IG Reel is about a travel vlogger enjoying street food in Senegal. These
The post is not about the individual flavors of pie but just baking sweet pies in
general so only the broader subtopic should be applied:
✅ Apply ‘Sweet Pies’
❌ Do not apply pie flavors (ex. ‘Apple Pie’, ‘Pecan Pie’ etc)
Co
● Ex. B: This FB post is about baking the best sweet pies for Thanksgiving in three
specific flavors so the more granular subtopics need to be applied:
✅ Apply ‘Sweet Pies’
✅ Apply ‘Apple Pie’
✅ Apply ‘Pecan Pie’
✅ Apply ‘Pumpkin Pie’
If a post links to an article, video, slideshow or other content that is long (Ex. video over
30 seconds long) and contains a wide range of subtopics, consider what is specifically
mentioned or shown in the post itself and add all relevant subtopics that apply using the
matrix in 1.1.
● Ex. A: This is a 3.5-minute FB video tutorial about styling hair. Click at 5 places
throughout the video and if:
○ All 5 instances refer to styling a bob
✅ Apply ‘Bob (hair style)’
0 l
○
81 tia
The 5 instances refer to styling different kinds of hairstyles BUT
■ Do not specifically focus on any particular hairstyle in the post or
captions and
■ The sharecard image shows a compilation of different hairstyles
✅ Apply ‘Hairstyles & Trends’
❌ Do not apply each individual hair style
For content involving multiple known and easily identifiable individuals, apply labels for
all of them if they are relevant AND are the focus. [See also Section 1.6 on selfies and
nf
wefies]
● Ex. A: This IG post is a group photo of famous basketball/NBA players: LeBron
James, Carmelo Anthony, Chris Paul and Dwyane Wade. These subtopics can be
applied:
✅ Apply ‘Basketball’
✅ Apply ‘National Basketball Association (NBA)’
Co
0 l
✅ Apply ‘Boston Celtics’
81 tia
✅ Apply ‘Detroit Pistons’
✅ Apply ‘Jaylen Brown’
❌ Do not apply names of other players in the match as they are not the
focus even if they are known or easily identifiable
44 n
●
e Ex. C: This FB video is mainly about Golden State Warriors player Ryan Rollins
making his first career bucket during a match against the New Orleans Pelicans.
However, Rollins does not currently exist in the Taxonomy (as of Nov 2022). Take
the following actions:
✅ Apply ‘Basketball’
✅ Apply ‘National Basketball Association (NBA)’
78 id
✅ Apply ‘Golden State Warriors’
✅ Apply ‘New Orleans Pelicans’
✅ Suggest ‘Ryan Rollins’ as a potential subtopic in the free-form textbox
✅ Apply higher level labels such as ‘Popular Basketball Players’ or
nf
If the content is about an entity (i.e. unique people/groups, places or things) AND that
entity is strongly related to a topic and subtopic, you should assign them to the content.
● Ex. A: This IG post/video is about movie star Zendaya gracing the cover of Vogue
Italia.
✅ Apply ‘TV & Movies’
✅ Apply ‘TV & Movies Celebrities’
✅ Apply ‘Zendaya (US actor, music artist)’
✅ Apply ‘Books & Literature’
✅ Apply ‘Magazines’
✅ Apply ‘Vogue’
● Ex. B: This IG Reel is about a food hack involving fast food chain Chipotle’s
0 l
ingredients
✅ Apply ‘Food & Drink’
81 tia
✅ Apply ‘Fast Food’
✅ Apply ‘Chipotle (Restaurant)’
● Ex. C: This FB post is about the K-pop group BTS meeting with President Joe
Biden at the White House
✅ Apply ‘Music & Audio’
44 ne ✅ Apply ‘K-pop Music Artists’
✅ Apply ‘BTS (KR music group)’
✅ Apply ‘Politics’
✅ Apply ‘Joe Biden (US president)’
✅ Apply ‘The White House’
78 id
However, not every piece of content that mentions an entity is about that entity. Refer
to the matrix in 1.1 for relevancy when selecting topics and subtopics.
0 l
81 tia
1.4. Author(s) of the content
When labeling content, we must not automatically apply labels based solely on the
author. The following conditions must be met in order for us to apply topics associated
with the author:
● The content must be about the author; OR
44 n
●
● A post by Adele expressing her thoughts about her Las Vegas tour being
delayed relates to her:
✅ Apply ‘Music & Audio’
✅ Apply ‘Western Pop Music’
✅ Apply ‘Adele (GB music artist)’
Co
If an image has no accompanying captions to provide additional context, the main subject
matter is determined by the ‘focus’ of the image. There are two types of focus:
0 l
81 tia
44 ne
78 id
Central focus: The subject(s)* that is at the Primary focus: The subject(s)* that is dominant
nf
center of the image is the focus. The person and (or covers at least two-thirds of the image) is
the dog are the central focus or main subject the focus. The landscape is the primary focus or
matters in the image above. main subject matter in the image above.
⚠️ NOTE: If the image itself does not contain sufficient additional context for any
relevant subtopic(s) to be selected, apply the ‘No Topic’ label. [See also Section 1.6 on
selfies, wefies]
Apply relevant subtopic(s) for selfie or wefie (group portrait) content if one or more of the
following conditions are met:
● It has accompanying captions that provide sufficient additional context for a
relevant subtopic label to be applied
○ Ex. A: This selfie Reel of a person trying on wedding gowns
✅ Apply ‘Bridal Fashion’
0 l
✅ Apply ‘Wedding Dresses’
81 tia
● The subject(s) of the selfie or wefie are easily recognizable public figures whom
we can associate a relevant subtopic with
○ Ex. A: This wefie by actor Bradley Cooper during the Academy Awards
✅ Apply ‘Academy Awards (Oscars)’
✅ Apply ‘TV & Movies Celebrities’
44 ne ✅ Apply ‘Bradley Cooper’
✅ Apply ‘Ellen DeGeneres (US actor, TV host)’
✅ Apply other celebrities who are present
⚠️ NOTE: If you not know the names of the celebrities, apply a higher level
78 id
subtopic such as ‘TV & Movies Celebrities’. If you know the name of the celebrity
but the individual does not currently exist in the Taxonomy, suggest the celebrity’s
name as a potential subtopic in the free-form textbox
If none of the above conditions are met and there is no discernable additional context or
intent:
✅ Apply ‘No Topic’
1.7. Memes
Memes are photos, screenshots, videos, GIFs or other types of digital imagery that
usually contain a text overlay or other digital edit that can pertain to a timely cultural
moment and are intended for humor and/or relatability. Memes are highly contextual and
a reaction to a community/shared experience.
In most cases, a creator’s original contribution to most memes is the text, not the image.
For template memes (see Meme A), the image remains the same while the text (and
context/meaning) changes with each new version. This can take on a couple of different
forms:
● The text may be related to the image directly, particularly in early iterations of a
meme, but this is not always the case and becomes less so as the meme evolves;
0 l
● The text deliberately subverts the original context of the image or uses it as a
juxtaposition for the purpose of humor, to highlight absurdity, etc;
81 tia
● The text is completely divorced from its original context and leans in on being
relatable
When applying subtopic(s) to memes, base your selection on the content and context of
the post. A meme is highly likely to be relevant on a subtopic based on its text and less
likely based on its image but in some cases, selecting subtopic labels for both the image
and text may be relevant.
⚠️ NOTE: ‘Internet Memes’ falls under the ‘Books & Literature’ topic. Therefore, apply
44 n
‘Internet memes’ or ‘Memes (idea, fad)’ for all memes AND the subtopic that the meme
is about. See below examples for guidance.
0 l
a potential subtopic
81 tia
‘Internet Memes’
✅ Apply ‘McDonald's’
An iteration with some minor
changes to the text. This is ❌
about going to the fast food
restaurant McDonald’s.
❌ Do not apply ‘The Lord of the
Rings: The Fellowship of the Ring
(2001 film)’
Some memes may be purely comedic in nature with no additional relevant subtopics that
can be applied other than ‘Memes (idea, fads)’ or ‘Internet Memes’. (See Meme B).
Co
Are the topic(s) associated with
the original meme image
Meme B What is the meme about Action
relevant to what the meme is
about
0 l
presentation meme, this version
involves a pun/joke that is not
❌ ✅ Apply ‘Memes (idea, fads)’ or
81 tia
conceptually connected to the
‘Internet Memes’
original content
Sometimes, memes may not include text and the original imagery is digitally altered for
44 n
the purpose of humor (i.e. comedic comparisons), to highlight absurdity or add
relatability (See Meme C). In such instances, the topic(s) associated with the original
meme image is often still highly relevant to the content and context of the meme so
those topics should be applied.
Meme C
e What is the meme about
Are the topic(s) associated with
the original meme image
relevant to what the meme is
about
Action
78 id
An iteration of singer Rihanna’s ✅ Apply ‘Memes (idea, fads)’ or
yellow Met Gala dress meme ‘Internet Memes’
where a pizza is overlaid on top
of the train of her couture gown
✅ Apply ‘Rihanna (BB actor, music
✅
artist)’
✅ Apply ‘Evening Dresses (product)’
✅ Apply ‘Gowns (product)’
Original image subtopic(s):
nf
0 l
the haute couture gown and the
movie’s yellow brick road
✅ Apply ‘The Wizard of Oz (1939
81 tia
film)’
Audio effects such as music may be present as a part of a video or Reel. Apply relevant
subtopic labels related to the audio if it is central and relevant to the content.
✅ ✅
nf
0 l
81 tia
Ex. A: This IG Reel is a meme centering around Mariah
✅ ❌ Carey’s iconic Christmas song All I Want For Christmas
Is You and the singer’s tradition announcing the arrival
of the holiday season. Apply ‘All I Want for Christmas Is
You (1994 song)’ and ‘Mariah Carey (US music artist,
producer)’
❌
44 ne ✅
Ex. A: This IG Reel shows sweeping landscape views of
a Swiss river and the music by British electronic duo
Disclosure is roughly timed to the twists and turns of
the drone camera movements. However, another piece
of music could potentially be used here too. Do NOT
apply ‘Disclosure (GB music group)’
78 id
Do not apply subtopic label(s)
❌ ❌
Ex. A: This IG Reel highlights climate activist Xiye
Bastida’s work while featuring Mexican singer Sofia
Reyes’ popular song Mujer in the background. In this
nf
There might be instances where a piece of content is appearing in the correct R2 queue
but it has no relevant subtopics that can be applied:
● Ex. This IG post about color palettes would fall under ‘Visual Arts, Architecture &
Crafts’ but it has no relevant subtopics
0 l
81 tia
[See Section XX in Labeling Instructions]
❌ Do not apply ‘No Topic’
2. Rejection Protocol
44 n
If you encounter an issue that prevents you from evaluating the content, use the
appropriate ‘Reject’ button, according to the conditions below.
●
e
2.1. Foreign language content
✅
from the translation
Action: Apply labels as per normal
○ If the translation is poor OR you are unable to confidently determine topic
✅
labels from the translation
Action: Reject: Incorrect Language
Co
0 l
81 tia
2.2. Content fails to load
44 n
2.3. Sensitive content
●
e Violates or potentially violates Facebook's Community Standards or Instagram's
Community Guidelines; and/or
Contains or potentially contains any of the following harmful categories:
78 id
○ Acts of Terrorism
○ Adult Sexual Content and/or Nudity
■ Sexual intercourse, genitals, close-ups of fully nude buttocks, female
nipples (except in the context of breastfeeding, giving birth, acts of
nf
0 l
○ Sex Offender
81 tia
○ Sextortion
‼️ If the content contains or potentially contains any of the harmful categories above,
alert your manager immediately. [See Escalation Protocol section]
44 n
2.4. Content in wrong R2 queue
In the event that a piece of content you are reviewing appears to be in the wrong R2
queue:
●
e For example, if this IG Reel about how to make an egg and cheese bagel sandwich
is incorrectly placed in a ‘Crime & Tragedy’ R2 queue:
✅ Select all the correct and relevant ‘Food & Drink’ subtopics that apply to
78 id
the content (i.e. ‘Bagels’, ‘Egg Sandwiches’ etc) despite it being in the
‘Crime & Tragedy’ queue [See Section 4 in Labeling Instructions]
❌ Do not apply ‘Reject: Incorrect queue’
nf
● You should ONLY apply ‘Reject: Incorrect queue’ if you are absolutely confident
no relevant subtopics can be applied
Co
3. Escalation Protocol
0 l
child. This includes but is not limited to:
81 tia
● Taking a screenshot of a bug or widget in an internal tool displaying CEI
● Saving CEI to your laptop or mobile device to attach to a task or email
● Forwarding an email with an attachment of CEI
● Forwarding or sharing CEI content on Workchat, Messenger, Instagram, or WhatsApp
44 n
Appendix
e
Labeling Instructions
78 id
Definitions
nf
Co