Professional Documents
Culture Documents
Multi-Dimension Guideline-En 03.11
Multi-Dimension Guideline-En 03.11
Multi-Dimension Guideline-En 03.11
Brief Introduction
In this task, you are first given an entity, together with some information (its category,
image, description, wiki link). This information (ENTITY block area) is to provide you the
context so that you are able to judge some FACT underneath.
You are required to judge the quality of the fact with respect to the
Entity, using the following quality labels:
Quality
Label Criteria
Label
Very The FACT can’t deliver valuable information due to serious
Bad quality issues
Irrelevant The fact delivers obviously NON-
RELATED information regarding the Entity.
Related information is provided but it is not
clear that the fact is related to entity, without
background knowledge. If you can’t understand,
how they are related from the paragraph, even if
you can understand it from the Paragraph link,
suck entity-fact relations should be marked as
Very bad.
(E.g.
Irrelevant: Not
everyone knows that
LeBron James is the
LeBron James got player of Lakers
56 pts and 10 reb Team. The fact talks
Very
Lakers vs Golden State about LeBron while
bad
Warriors on sticking close to
2022.03.06. Lakers but it does not
specifiy the
relationship between
them