Catalog Quality Content Recording

Ingalls
Category Inference

Week 9/17/2021
Topics

Rater Reminders

Rating Tips & Recommendations

Label Error Feedback & Examples

Category Path & Most Granular Label Level

Clarification Documents

Ingalls Ongoing Clarifications

2
Rater Reminders

• Content Recordings Slides: The slides contain links – you are encouraged to follow along and research alongside the presenter.

• Guidelines: Always rate with your guidelines open and follow the guidelines for every result.

• Appen Connect & Quizzes: Content Recordings, Project Guidelines, and other supplemental documents are all available on Appen
connect. Quizzes will be sent out to help you practice and improve your rating.

• Quality Feedback: Weekly emails are sent out with your stats and job examples.

• Productivity & Invoicing: Production hours should be completed in full every week. If you need to take time off, you can report
unavailability in Appen Connect by navigating to the “Help” icon at the top of the page and submitting a ticket. Reminder to review your
hours and submit your invoice on the 1st business day of every month by navigating to the My Invoices tab in Appen Connect.

• MyAccuracy: All errors should be reviewed and acknowledged in My Accuracy daily.

• Spam Folders: Be sure to check your spam folders if you are not receiving emails from us. Sometimes they do get filtered into the spam
folders.

3
Rating Tips & Recommendations

Always keep Review all clarification and

guidelines Review the guidelines supplemental guidance
open as you’re associated with each documents.
rating label

Rater Tips & Recommendations

for Quality Improvement Taking weekly
Review disagreements and
auditor comments in My Quizzes is helpful
Utilize the project chat
feature in Appen Accuracy daily. Utilize the practice to improve
Connect to ask comment feature in My quality
Accuracy to ask
clarification questions clarification questions

4
Label Errors – Category Path & Most Granular Label Level

5
Label Errors – Category Path & Most Granular Label Level

6
Example – Category Path & Most Granular Label Level

The product is an Engagement

Ring. Our goal is to determine
which category is the most related
and most relevant granular
category label level for the
product shown.

7 Job Link https://review.intern.facebook.com/intern/review/queue/view/?ids=385882283176663

Example – Category Path & Most Granular Label Level

Because we can determine the product, we can

use the category typeahead box to quickly find
and select the correct category path.

Typing just “rings” into the typeahead box renders

several category paths. We want to make sure
we can get to the most granular label level
possible. Therefore, we should always try
searching for the exact product that is
listed/shown.

• Note: We can see in the category description

under the Jewelry & Watches//Fine & Fashion
jewelry//Rings category that it “does NOT
include engagement rings”. Therefore, we
would not select this category path for an
engagement ring.

8 Job Link https://review.intern.facebook.com/intern/review/queue/view/?ids=385882283176663

Example – Category Path & Most Granular Label Level

Using the typeahead box and typing in the exact product

displayed (Engagement Ring) renders a couple of
different category paths to choose from. However, they
also include descriptions for each path to better
determine which path to choose.

❖ The first path states it is for Engagement Rings of all

styles as well as promise rings.

❖ The second path states it is for Engagement &

Wedding Ring sets.

9 Job Link https://review.intern.facebook.com/intern/review/queue/view/?ids=385882283176663

 Example – Category Path & Most Granular Label Level

Since the product displayed is not an

engagement & wedding ring set, we can
determine by the category descriptions that
the first category path in the list best fits the
product.

This will be our most relevant and granular

category label level.

Most Granular
Category Label Level Engagement Rings

Correct Category Path Jewelry &Watches//Engagement Jewelry//Engagement Rings

10 Job Link https://review.intern.facebook.com/intern/review/queue/view/?ids=385882283176663

Example – Category Path & Most Granular Label Level

The product is for running shorts. We can determine

by the product photos that these are women’s
running shorts. Our goal is to determine which
category is the most related and most relevant
granular category label level for the product shown.

11 Job Link https://review.intern.facebook.com/intern/review/queue/view/?ids=593459248504539

Example – Category Path & Most Granular Label Level

For this example, typing “running

shorts” into the typeahead box does not
render a category path. Therefore, we
can search by typing “shorts” which
renders several category paths, or by
searching through the category tree.

12 Job Link https://review.intern.facebook.com/intern/review/queue/view/?ids=593459248504539

 Example – Category Path & Most Granular Label Level

We will work our way through the Clothing &

Accessories category tree.

The Clothing & Accessories parent category

contains "Activewear" categories for both
men and women. Note that Activewear
includes items that are specifically worn for
athletic purposes. The shorts in this example
are designed for running, so they fall under
the Activewear category with Shorts being
the most relevant granular label level.

Most Granular
Category Label Level Shorts

Correct Category Path Clothing & Accessories//Women//Women's Clothing//Activewear//Shorts

13 Job Link https://review.intern.facebook.com/intern/review/queue/view/?ids=593459248504539

Example – Category Path & Most Granular Label Level

The product is a women’s tank top. There is

confusion when labeling women's tops & t-
shirts under the Women's Clothing category
vs. camisoles, bras or shapewear in the
Lingerie & Sleepwear category.

14 Job Link https://review.intern.facebook.com/intern/review/queue/view/?ids=3077931295808068

 Example – Category Path & Most Granular Label Level

Note: Lingerie tops such as camisoles,

bras and shapewear are meant to be worn
under clothing for layering. This item is not
for layering, but rather to be worn regularly.

The Tops & T-Shirts label level includes

blouses, tank tops, polos, etc. Therefore,
the correct granular label level for the
example is Tops & T-Shirts.

Most Granular
Category Label Level Tops & T-Shirts

Correct Category Path Clothing & Accessories//Women//Women's Clothing//Tops & T-Shirts

15 Job Link https://review.intern.facebook.com/intern/review/queue/view/?ids=3077931295808068

Example – Category Path & Most Granular Label Level

The product is a robot

vacuum cleaner. However,
there were several incorrectly
selected categories such as
"Vacuums & Floor Sweepers"
and "Vacuum Sealers".

16 Job Link https://review.intern.facebook.com/intern/review/queue/view/?ids=349408903517795

 Example – Category Path & Most Granular Label Level

It is very important that we pay close attention to the

details of the product image, title, and description.

It is also very important that we pay close attention to

the category definitions and descriptions to select the
correct, most granular category label level.

We should always try searching for the exact product

first in the typehead box. Using the typeahead box
and typing “vacuum” renders several category paths.
However, typing in “robotic vacuum” renders the
correct category path.

Most Granular
Category Label Level Robotic Vacuum Cleaners

Correct Category Path Home//Household Supplies & Cleaning//Vacuum Cleaners//Robotic Vacuum Cleaners

17 Job Link https://review.intern.facebook.com/intern/review/queue/view/?ids=349408903517795

Example – Category Path & Most Granular Label Level

The product is paper plates. This example was

commonly incorrectly categorized with category
paths such as "Baby &
Kids//Feeding//Utensils//Bowls & Plates" and
"Home//Kitchen &
Dining//Tableware//Dinnerware & Serving
Dishes//Plates". The details in the description
were not carefully read to determine that these
are disposable plates.

18 Job Link https://review.intern.facebook.com/intern/review/queue/view/?ids=325085909395831

 Example – Category Path & Most Granular Label Level

The details of the product description and category

descriptions were missed. Because these are paper
plates and disposable, we can look at the category
descriptions to narrow down the correct most
granular category label level. The correct most
relevant and granular category label level is
Disposable Plates.

Most Granular
Category Label Level Disposable Plates

Correct Category Path Home//Household Supplies & Cleaning//Household Disposables//Disposable Tableware//Disposable Plates

19 Job Link https://review.intern.facebook.com/intern/review/queue/view/?ids=325085909395831

 Thank You!
Admin & Support Questions:
Contact Support

Guideline Related Questions:

Appen Connect Chat

20