Guideline for the Annotation Platform-V20.2.

25

Catalogue
Guideline for the Annotation Platform-V20.2.25.............................................................................1

1. Platform Login............................................................................................................................ 2

2. Role and Corresponding Operations......................................................................................... 5

2.1 Vendor PM............................................................................................................................5

2.1.1 PO confirmation........................................................................................................ 5

2.1.2 PO submission........................................................................................................... 5

2.2 Transcriber............................................................................................................................6

2.2.1 Claim Task................................................................................................................. 6

2.2.2 Transcription............................................................................................................. 6

2.2.3 Submission................................................................................................................ 8

2.3 QA......................................................................................................................................... 8

2.3.1 Claim task.................................................................................................................. 8

2.3.2 Data quality inspection.............................................................................................8

2.3.3 Quality inspection data submission.........................................................................9

3. Client QA Feedback..................................................................................................................10
1. Platform Login
a) Connect to Intranet via Alilang PC app using the token from your Alilang mobile app.
b) Access the platform with link below:
Domestic: http://nls-df-inner.aliyun-inc.com
and then log in with your account and password:

c) If you see screenshot below it means that you have no access, follow the steps
below to apply permission: Click Request Access or Application button and it will
lead you to the page where you need to type the info below before submission:
 03/31/2021

Term of validity: 03/31/2021

Reason:
Vendor: Appen
Project Name: Aragorn English transcription
Name: your own name
MAKE SURE TO REMOVE THE VPN PERMISSION.

You can check whether you got approval on this page. https://acl.alibaba-inc.com/
d) After you got above approval, go to http://nls-df-inner.aliyun-inc.com

CONTACT YOUR PROJECT SUPERVISOR (Janice Claire: janiceclaire072990@gmail.com

dingtalk ID: jcaire072990 ) for the FINAL STEP.
 PLATFORM GUIDELINES
2. Role and Corresponding Operations
2.1 Vendor PM

2.1.1 PO confirmation
a) All unconfirmed orders are listed under tab “order management” “unconfirmed”.

b) Click “确定生产订单” under “action” to check the specification of order

c) set “task package size” to 20  set “抽检比例” to 1 or 20% after checking with PM

(“抽检比例” means how many audios will be review in one task)  click “确定” at the

right corner to confirm the order.

2.1.2 PO submission
Once the order is completed, you can see it under “unsubmitted” tab.
2.2 Transcriber

2.2.1 Claim Task

Click “claim annotation task” button under “to be annotated” menu to take new task.

2.2.2 Transcription
a) Click “start annotation” to under “annotating” menu to start working. The status for
rejected task will be “rework”.

b) You can check the tasks you completed under “annotation completed” menu:

c) User interface for transcriber

  Time stamping: you can drag the time bar to select the starting and ending point on
the spectrum.
1. Shortcut of playing button is “Space” key
2. After loading, audio will automatically be played, click “loop play” to change it.
3. Auto play is default. Click button to change to single play.
4. The starting and ending point for valid part will be automatically shown in the box
above the spectrum.
 validation
1. if valid, then select the time stamping, labels and enter the corresponding text;
2. if invalid, then select the reason as “Others”.
 Label
1. gender: Male/Female
2. accent: yes/no
3. children Sound: yes/no

4. Background noise：yes/no

 Message board: both transcriber and QA can leave message for doubt or
communication.
 Shortcuts
1. play/pause: space
2. last audio: Q
3. next audio: E
4. tag (sil): alt + 1
5. tag (~): alt + 2
6. tag (noise): alt + 3
Notes: to avoid enter extra letter in text box, better to click “Enter” before using shortcut.
2.2.3 Submission

Once complete the task, you can click button “提交” at the right corner and button “OK”

in the pop up window to submit the it. If you can see the error message shown as in
screenshot below, it means that you haven’t complete all audios in the task.

2.3 QA
2.3.1 Claim task
The QA role has the authority of transcription and quality inspection, the User interface to
claim task is the same as the transcriber. But as the QA role, you need to take the task under
tab “to be checked” first, if there is no task under it you can claim transcription task.

2.3.2 Data quality inspection

The quality inspection interface is basically same as the transcriber’s.
The difference is as below:
1) can see the transcribed results from transcriber;
2) The number of audio that QA can see depends on the sampling ratio set by PM. (Once
the sampling ratio is set, this order will be affected globally and cannot be modified
anymore.)
3) QA can modify the result directly and add the comment in “message board” to let the
transcriber know what the mistake it is, and then click button “correct, next” to pass it; or
click "wrong, next” to reject the incorrect ones to transcribers.

2.3.3 QA Submission
You can click button “pass, submit” and then button “OK” in the pop-up window to submit
the task. Or you can click button “failed, rework” and then button “OK” in the pop-up
window to reject the task to transcriber.
3. Client QA Feedback
If the order pass client’s QA, then it will be listed under tab “acceptance passed”.

If the order was failed on client’s QA, it will be rejected by client directly and listed under tab

“producing”, and the status for it will be changed to “返工中” (means “Rework” in English).

You can check the specific QA result by following steps: