Judgement Guideline for Info Card on

Edge Discover Pane

When a user is browsing web pages in Edge browser, sometimes he/she may need
some additional information to complete the current browsing experience. For example, if
Alice is booking a flight to San Diego in www.expedia.com, she may be interested in
knowing the trend of the flight price, the best time to visit San Diego, the top-rated hotels,
things to do in San Diego, weather, etc. We want to recommend that information to her
like the Discover pane in below picture. Your task is to determine whether the
recommended information cards are good/useful or not. There may be multiple
information cards listed. The task only focuses on the very first one at the top.
Task Process

The task page looks like the below.

Below are the steps to finish one task:

1. Look the left displaying website or open the first web page link, you need to check the
page content and imagine you’re browsing the page.
2. Look the right displaying website or open the second web page link, which is the
Edge Discover link, you will see a few information cards. You just need to focus on
the first card, and judge if that card is not bad recommendation when you’re
browsing the first page opened in step 1.
3. Choose the best option based on your judgement. You can use the mouse to click the
radio button or use the hotkey number 1, 2, 3, or 4 in the keyboard.
[1] The card including the content is relevant to the first page.
[2] The type of the card is relevant; however, the content is not.
[3] The type of the card is not relevant to the left page.
[4] The left page is a login page or error message page.
4. Submit the result. And then it’ll load a new task for you. It may not be obvious
because all tasks look the same, but the links in steps 1 and 2 are different. Please
open both links before making the judge for every task.
5. If you can’t make an accurate judgment, you can choose to click this button to

skip this judgment task.

There are some examples at the end of this document to explain each option.
Important Notes

The duration of each judgment task is 5 minutes, and the task will be marked with
timeout status after timeout.

Tip In Work

If the page on the left can’t be displayed normally or you suspect that the displayed
content has page Jump, you'd better click the "open first page in new tab" link to open
the corresponding website to view the content.
Examples

Example 1:

In this example, the left side is the first web page, and the right side is the second web
page containing some information cards. The left side is about booking a place to stay in
Folly Beach. The top info card on the right side has a short introduction to Folly Beach.
The card can be helpful to the people browsing the left page, and the content of the card
is also relevant. So the expected judge is [1] in this example.
[1] The card including the content is relevant to the first page.
[2] The type of the card is relevant; however, the content is not.
[3] The type of the card is not relevant to the left page.
[4] The left page is a login page or error message page.
In this example, the left side is Nasdaq new, and the right side should display Nasdaq
stock price, that is because the left Nasdaq new try to recommend readers to buy some
stocks, Nasdaq stock gain information that for news readers, this will be the news of
potential concern. and the content of the card is also relevant. So the expected judge is
[1] in this example. The article is not necessary to be finance articles. For example, if it is
wiki of company, we can also show stock price about the company. Some news would
impact the stock price of the company. Company homepage can show the stock. But for
shopping/product page, the stock of the company is useless for users.
[1] The card including the content is relevant to the first page.
[2] The type of the card is relevant; however, the content is not.
[3] The type of the card is not relevant to the left page.
[4] The left page is a login page or error message page.

In this example, the left side is sports new which is about “signing guard Malik Monk”,
and the right side should recommend about the player who called “Malik Monk” and his
performance in the game. The left side is about Malik Monk’s performance in NBA
games. The card can be helpful to the people browsing the left page, and the content of
the card is also relevant. So the expected judge is [1] in this example.
[1] The card including the content is relevant to the first page.
[2] The type of the card is relevant; however, the content is not.
[3] The type of the card is not relevant to the left page.
 [4] The left page is a login page or error message page.

Example 2:
In this example (screenshot in the next page), the left side is about job search in Stanly
County, NC. The right side has an info card at the top also about the jobs, but all the jobs
listed are in WA. So the expected judge to this example is [2].
[1] The card including the content is relevant to the first page.
[2] The type of the card is relevant; however, the content is not.
[3] The type of the card is not relevant to the left page.
[4] The left page is a login page or error message page.

Example 3:
In this example, the left side is partially blocked by the log in box. From the rest of the
page and the address bar URL, we can tell this is a page about some recipe. The right
side has an info card about a wine tasting room in TX. The card has nothing to do with
the recipe. So the expected judge to this example is [3].
[1] The card including the content is relevant to the first page.
[2] The type of the card is relevant; however, the content is not.
[3] The type of the card is not relevant to the left page.
[4] The left page is a login page or error message page.
Example 4:

In this example, the left side shows an error message, which means you don’t have
permission to read the page. So you can simply judge it as [4].
[1] The card including the content is relevant to the first page.
[2] The type of the card is relevant; however, the content is not.
[3] The type of the card is not relevant to the left page.
[4] The left page is a login page or error message page.