HOW TO:

Copy paste the data received from the reviewer in the "Results" tab as values.
Copy paste the weekly data from CrowdCompute into the "Weekly snapshot" tab as values.

Under the "Analysis" tab you will find the automated generated analysis of the reviewers data.
To receive this open the Analysis tab and select Data from the Excel header and press Refresh All.
Please do this every time you add new data in the "Results" tab.
Select the underperforming worker from the dropdown next to worker's email. The error types and the occurance of these err
specific feedback in regard to the error type will be shown.
This Analysis and feedback should be provide to the underperforming worker.
The accuracy and amount of transcribed items will be automatically generated (from the weekly snapshot tab) for the selected
Under the "Settings" tab you will find the feedback linked to the specific error.
e occurance of these errors will be produced, also

shot tab) for the selected worker.

worker´s email Error type
lambda-7c570ae3-f880-4081-8d62-74a35afebc9c@sdoperapera.com
content

lambda-75f08e79-a60d-4d6d-9e42-e2e4ff961b05@sdoperapera.com
Formatting
Error pattern
Missing words

comma use
 Question Type Worker # Submitted QS
he_il_train_colossus_lion lambda-03f22d50-c0bd-42eb-8153-afe 312 n/a
he_il_train_colossus_lion lambda-1198005c-6a00-4ff2-99e0-831 898 n/a
he_il_train_colossus_lion lambda-1de84d1f-3ab9-441f-a7ce-fc6 136 n/a
he_il_train_colossus_lion lambda-1e1a3234-a3f4-416e-8627-553 584 n/a
he_il_train_colossus_lion lambda-2cc10d55-4168-412d-92fc-89e 295 n/a
he_il_train_colossus_lion lambda-30a48356-4c38-4e99-badf-a0 369 n/a
he_il_train_colossus_lion lambda-366865dc-1f3d-42d1-85dd-a7f 1271 n/a
he_il_train_colossus_lion lambda-4388465e-213a-4b8e-a4f4-51d 3296 n/a
he_il_train_colossus_lion lambda-518bfe49-e805-491c-b50a-7fe 922 n/a
he_il_train_colossus_lion lambda-57e205ad-6c8a-4fb9-a5ab-f53 908 n/a
he_il_train_colossus_lion lambda-5823f96d-7dcb-41de-934e-51a 602 n/a
he_il_train_colossus_lion lambda-637f5d4d-77cd-459a-8335-655 436 n/a
he_il_train_colossus_lion lambda-9717d5b4-7402-4b10-bc3f-f39 144 n/a
he_il_train_colossus_lion lambda-b10f1412-2bd6-4ee5-82e5-ebc 722 n/a
he_il_train_colossus_lion lambda-b298fc96-de8f-4838-8a0f-5f9 1170 n/a
he_il_train_colossus_lion lambda-b3a53811-b515-47be-b336-9d 379 n/a
he_il_train_colossus_lion lambda-d7a20f36-1cb0-4eb9-bee6-34 1484 n/a
he_il_train_colossus_lion lambda-dbfc2511-b740-4c0f-b954-9ab 107 n/a
he_il_train_colossus_lion lambda-de28e0a8-ed96-4610-bfc5-f81 23 n/a
he_il_train_colossus_lion lambda-fc3e974a-8c41-46c1-a068-5d9 153 n/a
Reviews Approved% Touched% Validated% Last modified
72% 54% 95% 4/15/2018 10:08
94% 56% 97% 4/15/2018 16:14
88% 52% 95% 4/15/2018 13:26
84% 50% 94% 4/15/2018 13:52
81% 61% 96% 4/15/2018 15:56
87% 51% 97% 4/15/2018 15:33
95% 62% 98% 4/15/2018 7:31
97% 51% 95% 4/15/2018 15:39
64% 57% 96% 4/15/2018 10:14
91% 62% 97% 4/15/2018 13:35
91% 58% 98% 4/15/2018 11:52
78% 65% 95% 4/15/2018 23:01
81% 59% 97% 4/13/2018 3:15
77% 52% 95% 4/15/2018 8:00
96% 53% 97% 4/15/2018 15:00
81% 46% 96% 4/15/2018 11:46
82% 53% 97% 4/15/2018 22:32
90% 56% 97% 4/15/2018 11:48
100% 52% 91% 4/14/2018 6:35
85% 47% 95% 4/15/2018 9:10
worker´s email - multiple -

Error pattern Count - Error type

comma use 1
Missing words 1
Total Result 2
Transcribed 144 Accuracy 81%

Recommendation

Check WDC rules Commas. Check if there should be a comma with

discourse words, yes/no answers etc.
#N/A
#N/A
#N/A
#N/A
#N/A
#N/A
#N/A
#N/A
#N/A
#N/A
#N/A
#N/A
Pivot - error type

Sentence punctuation

Sentence fragment format

Voice action format

Web search format

Number format
Date and time format
Math expressions format
Proper noun format
Comma use
Entity location rule
Colon use
Quotation mark use
Other symbols missing
Other symbols extra
Hyphen use
Spoken out punctuation
Currency format
Unit of measure format
Address format
URL format

Abbreviations/Acronyms
Spelling out word/s

Interjections

Media title format

Slang use
Hesitation treatment

Truncation treatment
Brands and products format
Accent treatment
Extra words
Missing words
Spelling error
Proper noun wrongly spelled
Missing word/s-repetition not written
Incorrect transcription/misheard
Do not translate what the speaker says
Do not change what the speaker says
Ignoring of red notes (unauthorized symbols)
Context error
Should have been transcribed

Shouldn't have been transcribed- Speech was not intended fo

Shouldn't have been transcribed- Unclear speech
Shouldn't have been transcribed- Speech was repeated more
Shouldn't have been transcribed- Singing

Shouldn't have been transcribed- Foreign language

Wrong category- Offensiveness

Wrong category- Pitch

Text was in preamble when shouldn´t have been
Text wasn't in preamble when should have been

Capitalization/Punctuation error in preamble

Pivot - additional feedback

Check WDC rules for punctuation. Full sentences should be punctuated. Do not capitalize or punctuate web searches that are
Check WDC rules Fragments versus sentences. Add end punctuation to sentence fragments that sound like the end of a sente
sound like the beginning or end of a sentence, leave out capitalization and punctuation.
Check WDC rules Fragments versus sentences. A voice action is an action that can be completed by the device. If it sounds com
capitalization.
Check WDC rules Fragments versus sentences. A web search not structurally built as a full sentence should not be capitalized o

Check WDC rules Number. Check the rules in regard to writing numbers in full or as digits. Double check digits in combination
Check WDC rules Date and time. Use the suggested time format and the natural form for transcribing dates.
Check WDC rules Number. Check the rules in regard to spaces between numbers and symbols.
Check WDC rules Proper nouns. Double check if the proper nouns need capitalization and their official spelling online.
Check WDC rules Commas. Check if there should be a comma with discourse words, yes/no answers etc.
Check WDC rules Address. There should be a comma between entity and location.
Check WDC rules Colon and quotation. Check the use of the colon in quotative voice actions.
Check WDC rules Colon and quotation. Check the use of the quotation marks in quotative voice actions.
Check WDC rules Other symbols. Check if there might be a symbol missing, this can be any of the allowed symbols.
Check WDC rules Other symbols. Check if an unnecessary symbol was added.
Check WDC rules Other symbols. Check the Other symbols sections in WDC or follow the correct hyphen usage in your langua
Check WDC rules Spoken punctuation. Write spoken punctuation in full between {}, except if it refers to an email address, UR
Check WDC rules Currency and unit. Double check if the currency should be written out in full or as a symbol.
Check WDC rules Currency and unit. Abbreviate all units that follow numeric values. Numbers preceding units should be writt
Check WDC rules Address. Write what is said and double check the spelling for street names, cities and countries on the inter
Check WDC rules Web. Write URLs, email addresses, and Twitter hashtags as they are spoken and don't capitalize them.

Check WDC rules Abbreviations. Check if the abbreviation should only be written when explicitly said. Do not use periods betw
Check WDC rules Spelling out. Use lowercase letters when a word is spelled out and check the spacing needed between letters

Check WDC rules Interjections. Transcribe words representing laughter or other non-speech vocalizations up to 3 syllables, do

Check WDC rules Media title. Double check the capitalization and way of writing of a media title on the internet. Do not use qu
Check WDC rules Multiple spellings. Double check the way slang is written in WDC. Do not alter non-standard speech that the
corrected.
Check WDC rules Hesitations and truncations. Do not transcribe false starts unless they are complete words.

Check WDC rules Hesitations and truncations. Only complete truncated words if a very small portion of the word is missing an
Check WDC rules Brand and product. Format brand and product names as written on the entity's website.
Check WDC rules Accents. Correct non-standard pronunciations to the standard ones.
Do not transcribe words that are not spoken.
Do not leave out words.
Pay attention to spelling. Use a spell checker in your browser.
Check how proper nouns are spelled and how they should be formatted, search this on internet.
Check WDC rules Hesitations and truncations. Write out all the words that are said even if they would be repetitions.
Use headphones and be careful when submitting data.
Do not translate what the speaker says, stick to the intended language. (unless there are other instructed rules in regard to tra
If the speaker makes a grammar mistake do not correct this but write what the speaker says.
Check WDC rules other symbols, for the list of authorized symbols. Check if there would be an unnecessary space in front of th
Check WDC rules Context error. A context error occurs when a real word is used incorrectly or when the incorrect form of a w
If the speech is clear, it should be transcribed.
If the speaker doesn't have the intention to be recorded or to have the phone take action (search, dictation, open applications
the device. Clear example of not intended for the device: would be two people talking to each other in the background.
If one word isn't clear, it is better to select Cannot transcribe than to mistranscribe.
If speech is repeated more than 5 times select cannot transcribe.
If the audio contains singing either synthesized or by the speaker: select Cannot transcribe.
If the audio contains foreign language that isn't an easily identifiable media title or a foreign phrase that is commonly understo
locale.
Select the most appropriate category in regard to offensiveness
Select the most appropriate category in regard to pitch: High: child speaker, Mid: female speaker, Low: adult male speaker, M
pitch. When unsure Low or Mid: choose Low. When unsure High or Mid: choose Mid pitch
Speech that is not in the green section should not be transcribed within the preamble field.
Speech that is in the green section should be transcribed within the preamble field.
When there is a green preamble section and normal transcription (not in the green section). The two structures should be han
be treated as such.