Suisun

Project
Language Neutral Video PDO Labeling 
 Borderline
Label
• Videos which aren’t clearly language neutral or focused are defined as
“borderline”. Significant % of users can still enjoy borderline videos even if they
don’t understand the speech/caption language of the video, however, some users
don’t enjoy them because they don’t understand the language. 
Examples: 

•Song videos (users don’t necessarily need to understand the lyrics of the song in order to
enjoy it, however, it still affects how much users can enjoy it).

•Sports commentary videos (the main focus of these videos is to watch sports, but listening
to the commentary is an important aspect too).

•Prank videos with small amounts of speech/captions (these videos are oftentimes easy to
follow the plot without understanding the speech/captions and can still be pretty funny) .
 
 Borderline
Label
Rating Instructions: 
You should follow the watch instructions in order to judge whether users need to
understand a certain language in order to enjoy the video. 

C. When to Select Borderline?

•There are speech/captions in the video; but understanding them isn’t a hard
requirement in order to enjoy the video.

•There would be a significant % of users who don’t understand the language of the
speech/captions in both cases; those who still enjoy the video and those who don’t

- Language Neutral for some users

- Language Focused for others

•Choose Borderline whenever the video isn’t clearly Language Neutral nor
Language Focused.
 Examples:

Song Videos 

https://www.facebook.com/watch/?v=291761149179183

https://www.facebook.com/watch/?v=336858173403795
Examples:

Commentary Sports Videos

https://www.facebook.com/watch/?v=793233368130291

https://www.facebook.com/watch/?v=420276943201719
Examples:

Prank videos with small

amounts of speech/captions.

https://www.facebook.com/watch/?v=783103012419792

https://www.facebook.com/watch/?v=406269757131269
 Suisun Project
Language Neutral Video PDO Labeling 

 Appen Connect: Visit the Suisun project page to keep up-to-date on all things
Suisun. This is where we will post clarifications, feedback, announcements,
etc. 

 Suisun Chat and Social Feed: Come talk with us. The auditing team monitors
these tools regularly. It is a great place to ask rating related questions and
get feedback from your auditing team. Come say hello and introduce yourself!
(Be sure to select Suisun from the drop-down menu).