Guidelines

Dominant Label
The objective of the task is to judge if the given short text, called Dominant Label, describes the entity represented by
the Reference page correctly.

Dominant Label consists of a combination of a few words. It is not a full grammatical sentence. Dominant Label goes one
level deeper than just the Entity Type. Good Dominant Labels are Entity specific, informative, accurate, brief, fresh,
grammatically/syntactically correct and without any spelling errors.

Please review the reference page and the short label in "Sample to Judge" Box for the entity. Judge the correctness of
dominant label based on the descriptions of the reference page.

 Select Short label identifies the entity correctly If the given dominant label (short label) correctly
represents the entity in the reference page.
 Select Short label is same as the entity name if the given label is same as entity name. For example, if
the given Entity is “Walmart”, and the given sample is also “Walmart”, choose this category.
 Select Short label is incorrect for the entity If the given label is not correct for the entity, then mark as
“Incorrect”. For example, a label of “American Actor” for an American Politician is incorrect.
 Select Short label is too generic and can be better If the given label is too generic with very broad
meaning such as "Company", "Mountain", “Lake” and there can be a more specific label for the entity based on
the descriptions in the reference page. For example, Label of “Company” for Walmart can be in this category
because “Company” is a very broad categorization. A label of “Retail Company” or “American Company” is
correct.
o Note that “Short label is too generic and can be better ” should only be used if the label is too
broad.
o If the label provides any information specific to the entity, it should be judged as correct by selecting
“Short label identifies the entity correctly”
 Select Short label is not in the judgement language If the given label is not in the judgement language.
 Select Other If the given label is not subject to the above categories. Please choose this option when reference
page is not in judgement language and write a comment to comment section.