Defect Types

# Facet/Defect Type Judgment Rationale/Details Example

1 No Defect Exact When the Search
Query (SQ) and
Offered Product (OP)
are an exact match.
2 Accessory or Related Complement When the OP is an 1. SQ: air purifier
accessory of the OP: air purifier filter
product or a related 2. SQ: phone
product. OP: phone case

3 Product Type Wrong Irrelevant/ When the product falls 1. SQ: Phone
Substitute in a completely OP: Notebook
different product (Irrelevant)
category/type. 2. SQ: Dehumidifier
OP: Carbon bags for
moisture control
(Substitute)

4 Brand Wrong Substitute When the brand of the SQ: Nike shoes
result is different but OP: Adidas shoes
the product type is the
same.
5 Model/Sub-Brand Wrong (1) Substitute When the sub brand or SQ: Samsung S7
model is wrong for the OP: Samsung S10
lead product, and it is
functionally
equivalent.
6 Model/Sub-Brand Wrong (2) Irrelevant When the model/ sub SQ: Type C cable
brand is wrong and it OP: HDMI cable
cannot be used for the
same purpose.
7 Gender/Age Wrong Irrelevant When the product’s SQ: Women’s pants
gender/age is different OP: Kids/men’s pants
than specified in the
query.
8 Color Wrong Substitute When the color of the SQ: Red Nike shoes
result is different than OP: White Nike shoes
specified in the query.
Unless the requested
color can be selected
on the detail page.
9 Size Wrong Substitute/ When the size differs 1. SQ: Pants size S
Irrelevant from that mentioned OP: Pants of size M
in the query. Only the or XS (Substitute)
+1 and -1 size are 2. SQ: Boots size 6
considered. Else, OP: Boots size 7
marked as irrelevant. (Substitute)
3. SQ: Belt 32cm
OP: Belt 28cm or
38cm (Irrelevant)

10 Style Feature Theme Material Substitute When the product 1. SQ: striped shirt/long
style, feature, theme, sleeve
 or material is different OP: polka dot
that specified in the shirt/short sleeve
query. Non theme (Substitute)
products are Irrelevant 2. SQ: Cotton blouse
because of genre OP: Polyester blouse
difference. (Substitute)

11 Non Existing Product Unjudgeable When the product 1. SQ: IPhone 17

mentioned in the 2. SQ: Harry potter 10
query does not exist.
12 Secondary Product Substitute When the ASIN/OP is a SQ: Pearl
product made from OP: Pearl earrings
the primary product
being asked in the
query
13 Bundled (1) Exact When the query is the SQ: Electric Guitar
lead product and the OP: Electric Guitar,
offered product is the amplifier, stand, cover
lead product with its
direct accessories.
14 Bundled (2) Substitute When the query is the 1. SQ: Shampoo
lead product and the OP: Shampoo +
offered product is lead Conditioner
product with 2. SQ: Keyboard
another OP: Keyboard +
complementary lead mouse
product.
15 Genre Wrong Irrelevant When the OP is a SQ: The notebook
movie/anime/drama/b (romantic)
ook/manga of different OP: Die Hard 4.0 (Action)
genres from that of the
SQ.
16 Region Wrong Substitute/ When the region 1. SQ: table cloth made
Irrelevant differs from that in India
mentioned in the OP: table cloth made
query. in US (substitute)
2. SQ: Japanese
learning book
OP: German learning
book (irrelevant)

17 Category Mismatch To be judged When the selected 1. SQ: Juice

according to category (in search Alias: electronics
SQ string) completely 2. SQ: Movie Name
differs from the actual Alias: food and
category of product beverages
type of SQ involved.
18 Thematic Connect Complement When the theme of SQ 1. SQ: Frozen pen
/ Irrelevant and OP are same even OP: Frozen themed
though their product notebook
type is different. This is (Complement)
to be considered when 2. SQ: Frozen Pen
products can be used OP: Frozen themed
together/ are closely
pajama (Irrelevant)
related.
19 Irrelevant Theme Irrelevant When the theme of SQ: Spiderman
the product totally OP: Kung-fu panda water
differs from the search bottle
query.
When the query is an SQ: Iphone 6 case
accessory to the lead OP: Iphone Charger
20 Accessory to Accessory Irrelevant product and the
offered product is
another accessory.
When the product 1. SQ: John wick movie
title, person, or group OP: Harry Potter
is different to the movie (Irrelevant)
specified query. Non 2. SQ: John wick
theme products will be OP: Hitman
irrelevant. (Substitute)
Other Title/Person/Group is Irrelevant/
21
Wrong Substitute
When product
title/book (media) has
a specific genre and
offered product is of
same genre with
different title.
When the query is a SQ: Orange essential oil
product in itself but is OP: Soap with orange
Irrelevant also used as an essential oil
(Depends on ingredient. Could be
22 Misc. purpose of Substitute if product
the can be used for the
product.) same purpose, such as
essential oils in a
carrier oil.
23 Other Unjudgeable When the query/ASIN 1. SQ: Amazon prime
is marked Unjudgeable 2. SQ: 1
3. SQ: R