NOTE: All information provided in this document is confidential.

Any publication, provision, or

dissemination of this content is strictly prohibited. Do not share or post the contents on the
internet.

Kankakee Guidelines: Two Speaker Audios

In this project, you’ll be listening to short audio clips containing two active
speakers. You must use headphones for this project.

Before you start work on the project, you will work on an initial quiz to familiarize
yourself with the rating task and specific audio samples.

You will be listening to the conversation between Speaker 1 and Speaker 2 as a

third party and assessing the quality of the speech of both speakers.

The two people will be speaking in parallel. You will hear one voice from one side of
the headset and the other voice from the other side, with Person 1's voice coming
from the left side and Person 2's voice from the right side. In some cases, you
may hear an echo of Person 1's voice alongside Person 2's voice, in other cases you
may hear Person 2's voice degraded or missing altogether.

You are listening from the perspective of a third person. See image below:
NOTE: All information provided in this document is confidential. Any publication, provision, or
dissemination of this content is strictly prohibited. Do not share or post the contents on the
internet.

In the event you find an explicit file or content which is potentially violating:

Please select the ‘This file is explicit’ checkbox.

Please also report the Display ID to your project support team.

Then click here for next steps. You will be required to confirm the reason you
labelled the file as explicit. Please be reminded that explicit files are uncommon and
should only be applied to extreme cases. It is not considered explicit if the audio
only contains bad language (i.e without violence/harassment/hate speech).

If the file is not explicit, you can answer questions about the speech.

When working on the task, you’ll be required to listen to the audio at least once
before answering each question.

1. Listen to the echo of the Speaker 1’s voice and rate how noticeable
or annoying it was.

Rating Description

5. Echo is inaudible.

4. Echo is audible but not annoying.

3. Echo is slightly annoying.

2. Echo is annoying.
NOTE: All information provided in this document is confidential. Any publication, provision, or
dissemination of this content is strictly prohibited. Do not share or post the contents on the
internet.

1. Echo is very annoying.

2. How would you judge degradations of Speaker 2’s voice? This

includes missing audio, distortions, cut-outs.

Rating Description

5. Degradation is inaudible.

4. Degradation is audible but not annoying.

3. Degradation is slightly annoying.

2. Degradation is annoying.

1. Degradation is very annoying.

3. Take note of any feedback or background noise. Rate how noticeable

or annoying any background noises were in the audio.

Rating Description

5. Noise, feedback and other interference is inaudible.

4. Noise, feedback and other interference is audible but not

annoying.
NOTE: All information provided in this document is confidential. Any publication, provision, or
dissemination of this content is strictly prohibited. Do not share or post the contents on the
internet.

3. Noise, feedback and other interference is slightly

annoying.

2. Noise, feedback and other interference is annoying.

1. Noise, feedback and other interference is very annoying.

Explicit files

If the file is explicit (e.g. contains pornography, violent content, hate speech),
please select “This audio is explicit”. Please remember to notify the project
support team with any explicit files with the Display ID.

Then, you will be required to pick a dropdown reason the file was deemed
inappropriate.

If none of the reasons are applicable, pick ‘other’ and you can provide further
information.
NOTE: All information provided in this document is confidential. Any publication, provision, or
dissemination of this content is strictly prohibited. Do not share or post the contents on the
internet.

Reasons include:

1. sexually explicit
2. violence
3. harassment/threats
4. suicide or self-injury
5. hate speech
6. terrorism
7. blasphemy
8. other

Extra notes:

● Sexually explicit files are files that contain pornography or very crude
description or discussion of the sexual act. Sexual innuendo or discussion of
sexuality is not considered explicit.
● Hate speech refers to public speech that expresses hate or encourages
violence towards an individual or a group based on race, religion, gender, or
sexual orientation.
● Blasphemy may not be considered explicit/offensive in some cultures, so
make your best judgment taking into account the context you are in.