Multi-Dimension Guideline-En 03.11

You might also like

You are on page 1of 4

 

Brief Introduction
In this task, you are first given an entity, together with some information (its category,
image, description, wiki link). This information (ENTITY block area) is to provide you the
context so that you are able to judge some FACT underneath.

The FACT block area, is found below.


It is strongly advised you click “paragraph link” to go to the full article where this
paragraph comes from to understand the paragraph background better.

Fact is the information collected from the internet which is a provable


statement and non-subjective opinion from publishers or users. It can be used
as solid, indisputable description, evidence, measurement, or observation of
an Entity.

You are required to judge the quality of the fact with respect to the
Entity, using the following quality labels:
Quality
Label Criteria
Label
Very The FACT can’t deliver valuable information due to serious
Bad quality issues
Irrelevant  The fact delivers obviously NON-
RELATED information regarding the Entity.
 Related information is provided but it is not
clear that the fact is related to entity, without
background knowledge. If you can’t understand,
how they are related from the paragraph, even if
you can understand it from the Paragraph link,
suck entity-fact relations should be marked as
Very bad.
(E.g.
Irrelevant: Not
everyone knows that
LeBron James is the
LeBron James got player of Lakers
56 pts and 10 reb Team. The fact talks
Very
Lakers vs Golden State about LeBron while
bad
Warriors on sticking close to
2022.03.06. Lakers but it does not
specifiy the
relationship between
them

 When the fact block is about a similarly named


entity, but it is actually a different thing (e.g.
University of London v.s. University College
London).
The paragraph includes offensive content, like
Offensive/biased adult, racist, and etc., or the comment is strongly
subjective, and most people will think it is biased.
The passage is telling something not true by
Wrong
common knowledge; OR
 The language is totally different from the
Description Language
Serious format
 format is heavily messed up
issues 
 significantly incomplete sentences and the
core meaning is missed
Bad The FACT delivers readable information but with tolerable
quality issues which are:
 Fact already out of date, e.g. stale news
 Talking about the past event or activities with
present or future tense, even if the date is exactly
given (e.g. ‘The competition will take place on
13 August 2021’ – since the date has already
passed, we can’t speak of it as of the future
Out-of-date
event.
 Date without specifying Year (e.g. Oct, 1st,
November, etc) ,
 Usage of relative dates such as ‘last year’ ,
‘this summer’ when describing the time when the
event described in the fact happened.
Duplicate The content is duplicated or gives same facts as
the entity description.
Strange or abnormal punctuation, incomplete
Some format
sentences (but core meaning still conveyed),
issues
etc.
The FACT delivers valuable information without any issues. It
enriches your understanding or expands your interest around
the Entity.
The information is not very interesting to you, and
Not
Neutral you Do NOT want to further explore and learn
bad
more.
You think the information is very interesting,
Interesting/helpful either be delighted to read it, or you feel like
clicking the Paragraph Link to learn more.

Entity Fact Label Reason


Tom Hanks’s accolades Irrelevant: the passage is
include two Academy Very talking about Tom Hanks, not
Tom Cruise
Awards out of six bad the given entity Tom Cruise
nominations. which is totally irrelevant.
The University of
Irrelevant: The highlighted
University London is a federal public
Very entity similar pattern of words
College research university located in
bad but actually are two different
London London, England, United
concepts
Kingdom.
Irrelevant: Not everyone
knows that LeBron James is
LeBron James got 56 pts the player of Lakers Team.
Very
Lakers and 10 reb vs Golden State The fact talks about LeBron
bad
Warriors on 2022.03.06. while sticking close to Lakers
but it does not specifiy the
relationship between them
Twenty percentage equals Very Wrong: 20% definitely
Percentage
zero. bad doesn’t equal zero.
Offensive/bias: putting the
Richa moorjani is not a big entity in an embarrassing
Very
Richa moorjani star and not earning too spot. The sentiment of this
bad
much. text passage is also in bad
taste.
He was announced as Kaiser
Serious format
Wilhelm II and in the end he
issues: “Alright, let’s move to
was the last emperor in
Kaiser Wilhelm Very the other 10 interesting facts
Germany. Alright, let’s move
II bad about Kaiser Wilhelm II!” -
to the other 10 interesting
incomplete sentence and the
facts about Kaiser Wilhelm
core concept is missed.
II!
Adobe(attached Adobe 公司,是美国一家跨 Serious format issues:
Very
description is in 国电脑软体公司,总部位 Totally two different
bad
English) 于加州的圣荷西 languages.

You might also like