Professional Documents
Culture Documents
and Practice
20DSP832
F020162
1. INTRODUCTION 1. INTRODUCTION
Supreme
Supreme has created a considerable sense has that
of urgency created Participantssense
has a considerable had toofperform
urgencythe
thatfollowing
has Participants
tasks had tothe
while testing perform the following tasks while testing the
made
made every Thursday a “drop day” on which every
they Thursday
release new a “dropwebsite. These
day” on tasks
which theywere
release new basedwebsite.
curated These
on keeping top tasks
tasks were curated based onthe
Fig 1 showing keeping
brand top
logotasks Fig 1 showing the brand logo
garments
garments which has become a major event. in mind.
which has become a major event. (Noah johnson,
(Noah johnson, in mind.
2019) 2019)
Task1LVWRVHDUFKIRUDMDFNHW¿OWHUWKHUHVXOWVVHOHFWDQDS-
Task1LVWRVHDUFKIRUDMDFNHW¿OWHUWKHUHVXOWVVHOHFWDQDS-
propriate garment, and enter the garment’s propriate
productgarment,
page. and enter the garment’s product page.
Task
Task 2 is to inspect the images to see if the 2 is toisinspect
garment the images to see if the garment is a good,
a good,
Fig 1 showing the Google analytics of supreme read
website the Google
Fig 1 showing some user
analytics reviews,website
of supreme read some
and read the garment’s user reviews, and read the garment’s description.
description.
Task 3LVWR¿QGWKHVL]HDQG¿WLQIRUPDWLRQDQGFKHFNZKLFK
Task 3LVWR¿QGWKHVL]HDQG¿WLQIRUPDWLRQDQGFKHFNZKLFK
VL]H\RXVKRXOGEX\¿QGRXWDERXWWKHGHOLYHU\LQIRUPDWLRQDQG
VL]H\RXVKRXOGEX\¿QGRXWDERXWWKHGHOLYHU\LQIRUPDWLRQDQG
returns information. returns information.
7KLV¿JXUHLVVKRZLQJWKHWRWDOYLVLWVIRUVXSUHPHZHEVLWHLQODVW
7KLV¿JXUHLVVKRZLQJWKHWRWDOYLVLWVIRUVXSUHPHZHEVLWHLQODVW
PRQWKV7KH%RXQFHUDWHIRUWKHZHEVLWHLV7UDI¿F
PRQWKV7KH%RXQFHUDWHIRUWKHZHEVLWHLV7UDI¿F
overview of supremenewyork website, 2020) overview of supremenewyork website, 2020)
2 2
Home page Shop page Shop page VIEW ALL page VIEW ALL page
PRoduct page Sizing page Sizing page Shipping page Shipping page
3 3
2.1 ANALYSIS:
2.1 ANALYSIS: HEURISTICHEURISTIC
4 4
The “new” label The
has “new” label has No search bar and No search bar and
very low contrastvery low contrast filter features availa-
filter features availa-
ble ble
User
User can only get can only
to know thatget No visual
thisto know that this No visual
cues when user cues when user
garment
garment is sold out hovers
is soldtoout after
after going going to the hovers
over productover the product
the next page the next page
Delivery
Delivery information is oninformation is on auser
a different page, different
has topage, user has to
remember them remember
as it is not them as itwhile
showing is notchecking
showingout.while checking out.
Table 2 shows the ranking of threethe
Table 2 shows ranking problems
important of three important problems
No clear measurement
No clearmetrics are followed
measurement andare
metrics sizing
followed and sizing
information is oninformation
a different page.
is on a different page.
5 5
2.2 ANALYSIS: BIOMETRICS
2.2 ANALYSIS: BIOMETRICS
1. Introduction 1. Introduction 3. Conclusion
WZR¿[DWLRQLQWKHDUHDRILQWHUHVWVKRSRSWLRQZKLFKLVYHU\
WZR¿[DWLRQLQWKHDUHDRILQWHUHVWVKRSRSWLRQZKLFKLVYHU\ 3. Conclusion
OHVVHUFRPSDUHGWRWRWDOQXPEHURI¿[DWLRQVWKURXJKRXWWKH
OHVVHUFRPSDUHGWRWRWDOQXPEHURI¿[DWLRQVWKURXJKRXWWKH Following the analysis of the participant’s Following scanthepath analysis
it canofbethe participant’s s
Biometrics are the measurements Biometrics
that are used aretothe measurements that
understand page which
are usedisto15. This is indicatingpage
understand which is 15.
participant not This
focused is indicating
or participant that
concluded is not thefocused
presentorversionconcluded that theofpresent
of the UI design supreme version of the U
user’s emotions, thoughts and theiruser’s emotions,
intensities doing theand theirattracted
whilethoughts intensities to while
shop doing
option.the attracted to shop option. ZHEVLWHODFNVHI¿FLHQWYLVXDOVHDUFKEHKDY
ZHEVLWHODFNVHI¿FLHQWYLVXDOVHDUFKEHKDYLRXUZKLFKLVPDGH
usabilitydata
usability test. It can provide very accurate test.as It can provide very accurate data as it is sensitive
it is sensitive the participant to abort the task at hand. the participant to abort the task at hand.
in showing obscure things even to in theshowing
user or obscure
researcher. things Foruser
Eyeeven to the shop orpage
researcher. Eye For shop page The display design elements and their The organisation
display design canelements
be and their orga
tracking is the most commonly used tracking
by the is UXthe most commonly
designers to usedScanpath
by the UX spatial lengthto- The scanScanpath
designers path spatial spatial
length length
is very- The scan improved
path spatial by length is very psychology
implementing improved
and UI byprinciples.
implementing psychology and
track the users eye movements and track the userswhich
understand eye movements
parts andlonger than the
understand which parts longer than the
of the user
of the user interface is receiving attention andinterface
which parts is receiving
are expected
attention andorwhich
optimalparts are length.expected or optimal spatial length.
spatial
demanding
demanding more cognitive efforts.(Schiessl et more cognitive efforts.(Schiessl
al., 2003) et al., 2003) 4.Redesign recommendations
7KHVFDQSDWKLVORQJHUDVLWKDVPRUHQXPEHURI¿[DWLRQVDQG
7KHVFDQSDWKLVORQJHUDVLWKDVPRUHQXPEHURI¿[DWLRQVDQG 4.Redesign recommendations
regressive saccades. regressive saccades.
1.1.1 Heading 3 1.1.1 Heading 3 Home page Home page
Scan path direction – The optimal direction Scan pathisdirection
going to – the The optimal direction
•As per the is going to themost of the users
top tasks •As percare theabout
top tasks
shopping,most of the users car
For Homepage For Homepage area of interest “carousel” or to thearea “viewofall”
interest
option. “carousel”
But the or to the delivery
“view all”information
option. Butorthe delivery they
about the products information
want to or about the products
buy,
Scan path spatial length – The scan Scanpathpath spatial
spatial lengthlength – The scanparticipant
is longer path spatial had goneistolonger
length participant
different directions likehad gone
to the date to different
and directions
but on the likehome
to thepagedate there
and are unpopular
but on the sethome page there
of options whichare unpopular
than the than the ¿QDOO\WRWKHEURZVHU¶VEDFNRSWLRQLQGLFDWLQJWKHSHUVRQZDV
¿QDOO\WRWKHEURZVHU¶VEDFNRSWLRQLQGLFDWLQJWKHSHUVRQZDV are not related to the top tasks likeare not related
“random”, “news”,to the top tasks like “random
”mailing
expected or optimal spatial length.expected or optimal spatial length. lost and was unable to locate the area lost and was unable to locate the area
of interest. list” of
andinterest.
“fall/winter preview” are groupedlist” andtogether
“fall/winter andpreview”
placed are grouped t
7KHVFDQSDWKLVORQJHUDVLWKDVPRUHQXPEHURI¿[DWLRQV
7KHVFDQSDWKLVORQJHUDVLWKDVPRUHQXPEHURI¿[DWLRQV in proximity with the important “shop” in proximity with theprinciple
option(Gestalt’s important “shop” optio
Regressive saccades- There are atleast Regressive saccades-
5 regressive There are atleast
saccades 5 regressive
of proximity). This saccades
makes the user of feelproximity).
those options This makes
belongsthe user feel thos
Scan pathisdirection
Scan path direction – The optimal direction going to – theThe back andisforth
optimal direction
area going going
to the from
area back to
the carousel and forth going
different from the carousel
directions to the to same
different directions
category, which is the to the same
cause for more category,
number which
of is the cause fo
of interest(shop) from the supremeoflogo.interest(shop) from the had
But the participant supreme in the But
logo. scan thepath indicating
participant had in the scan
the organisation and path indicating the organisation
information and information
¿[DWLRQVDQGKHQFHWKHFRQIXVLRQ ¿[DWLRQVDQGKHQFHWKHFRQIXVLRQ
gone
gone to different directions indicating thetoperson
differentwas directions
lost and indicating architecture
the personiswas verylost
unsatisfactory.
and architecture is very unsatisfactory. •The font size and weight can also•The font size and
be enhanced weight
to bigger can also be enha
ones
was unable
was unable to locate the shop option(area to locate the shop option(area of interest).
of interest). WRPDNHWKHPYLVXDOO\HI¿FLHQW WRPDNHWKHPYLVXDOO\HI¿FLHQW
7RWDOQXPEHURI¿[DWLRQV7KHWRWDOQXPEHURI¿[DWLRQVLQ
7RWDOQXPEHURI¿[DWLRQV7KHWRWDOQXPEHURI¿[DWLRQVLQ •All the options in the primary navigation •All themenu
options caninbe the primary navigation m
Regressive saccades – There are Regressive saccades – There are atleast
atleast 3 regressive the scan path on the shop page are
3 regressive the scan
22, whichpathis on the shop
a very large page areassociated
22, which is witha very
iconslarge
by following associated
the dual coding with icons
theory.by following the dual
saccades
saccades back from mailing list option back from
to lookbook and mailing
to shop list option to lookbook and to shop QXPEHULQGLFDWLQJOHVVHI¿FLHQWYLVXDOVHDUFKEHFDXVHWKH
QXPEHULQGLFDWLQJOHVVHI¿FLHQWYLVXDOVHDUFKEHFDXVHWKH
option
option in the scan path indicating the in the scan
organisation of path
theseindicating the participant
organisation is unable
of these participant
to select any jacket from is theunable
carousel to select
and any jacket
Shop frompagethe carousel and Shop page
options to
options is unsatisfactory, which is leading is the
unsatisfactory,
lack of clarity which insteadtohe/she
to is leading the lack went back to
of clarity instead
to the home page.he/she went back to the home •Thepage.
carousel in the center of the page •The needs
carousel to inbethegivencenter of the page nee
the participant. the participant. names along with the images of the names along withcoding
garments(Dual the images of the garme
)L[DWLRQGXUDWLRQ7KHUHDUHORQJHU¿[DWLRQGXUDWLRQVRXW
)L[DWLRQGXUDWLRQ7KHUHDUHORQJHU¿[DWLRQGXUDWLRQVRXW theory). theory).
of which 3 are in the area of interest
7RWDOQXPEHURI¿[DWLRQV7KHWRWDOQXPEHURI¿[DWLRQVLQ
7RWDOQXPEHURI¿[DWLRQV7KHWRWDOQXPEHURI¿[DWLRQVLQ of and
which 3 are
1 is in the
outside it. area
Evenof interest•Theand images
1 is outside in theit.carousel
Even are placed •The images
very close in the carousel are placed ve
to each
the scan path on the homepage are the15,scan
whichpath is on
largetheand 15, which is large and WKRXJKWKHUHDUH¿[DWLRQVLQWKHDUHDRILQWHUHVWFDXJKWWKH
homepage areWKRXJKWKHUHDUH¿[DWLRQVLQWKHDUHDRILQWHUHVWFDXJKWWKH other without providing any white space other without
betweenprovidingthem, making any white space be
participant’s attention, still he/she got
LQGLFDWLQJOHVVHI¿FLHQWYLVXDOVHDUFKEHFDXVHWKHSDUWLFLSDQWLV
LQGLFDWLQJOHVVHI¿FLHQWYLVXDOVHDUFKEHFDXVHWKHSDUWLFLSDQWLV participant’s
confused attention,
and clicked stillon
he/she got confused
it look and clicked
like cluttered on
and demanding it look
morelike clutteredload
congnitive andon demanding more c
unable
unable to focus on the area of interest for to focustask.
his/her on the area of interest the for
back button
his/her leaving the task which
task. the back button
indicates theleaving the task which
participant indicates the
users(Gestalt participant
principle users(Gestalt
of proximity).It can reduceprinciple of proximity).It can
the regressive
couldn’t process the information. couldn’t process the information. VDFFDGHVDQGORQJHU¿[DWLRQGXUDWLRQV VDFFDGHVDQGORQJHU¿[DWLRQGXUDWLRQV
)L[DWLRQGXUDWLRQ7KHUHDUHORQJHU¿[DWLRQGXUDWLRQVRXWVLGH
)L[DWLRQGXUDWLRQ7KHUHDUHORQJHU¿[DWLRQGXUDWLRQVRXWVLGH •Search option can also be implemented •Search option
which can also
makes be implemented w
the users
the participant
the area of interest indicating that the area of interest indicating
is feeling hard that the participant is feeling hard 7RWDOQXPEHURI¿[DWLRQLQWKHDUHDRILQWHUHVW7KHUHDUH
7RWDOQXPEHURI¿[DWLRQLQWKHDUHDRILQWHUHVW7KHUHDUH VHDUFKWDVNDQGGLVFRYHUDELOLW\RISURGXFWV
VHDUFKWDVNDQGGLVFRYHUDELOLW\RISURGXFWVPXFKHI¿FLHQWWK
in performing the task(in this case in performing
selecting the task(in
the right option this case selecting the right option ¿[DWLRQVLQWKHDUHDRILQWHUHVWZKLFKLVOHVVFRPSDUHGWRWRWDO
¿[DWLRQVLQWKHDUHDRILQWHUHVWZKLFKLVOHVVFRPSDUHGWRWRWDO +HXULVWLFÀH[LELOLW\DQGHI¿FLHQF\RIXVH7
+HXULVWLFÀH[LELOLW\DQGHI¿FLHQF\RIXVH7KHUHQRRWKHU
“shop”). “shop”). QXPEHURI¿[DWLRQVWKURXJKRXWWKHSDJHZKLFKLV7KLVLV
QXPEHURI¿[DWLRQVWKURXJKRXWWKHSDJHZKLFKLV7KLVLV secondary navigation also on the website. secondary navigation also on the website.
indicating participant couldn’t able indicatingto comprehend participant
the showncouldn’t able to comprehend the shown
information.
7RWDOQXPEHURI¿[DWLRQLQWKHDUHDRILQWHUHVW7KHUHDUHRQO\
7RWDOQXPEHURI¿[DWLRQLQWKHDUHDRILQWHUHVW7KHUHDUHRQO\ information.
6 6
ptimal scanpath The optimal scanpath is longer and This scanpath is 7KHQXPEHURI¿[DWLRQVDUHPRUHRXWVLGHWKHDUHDRI
This scanpath longer and 7KHQXPEHURI¿[DWLRQVDUHPRUHRXWVLGHWKHDUHDRI
LQWHUHVWLQGLFDWLQJWKHODFNRIHI¿FLHQF\RIYLVXDOVHDUFK
LQWHUHVWLQGLFDWLQJWKHODFNRIHI¿FLHQF\RIYLVXDOVHDUFK
on should be from directionhas manybedirections
should from which is has many directions which is
because the user was not because
able to focusthe
onuser was at
the task not able to focus on the task at
me logo to the shop supremenotlogotowards
to the the area of inter- not towards the area of inter-
shop
hand. hand.
in the list. option inest.
the list. est.
7KHODUJH¿[DWLRQRQWKHEURZVHUEDFNEXWWRQDQG
7KHODUJH¿[DWLRQRQWKHEURZVHUEDFNEXWWRQDQG
PRUHQXPEHURI¿[DWLRQVRXWLVLGHWKH$2/LQGLFDWLQJ
PRUHQXPEHURI¿[DWLRQVRXWLVLGHWKH$2/LQGLFDWLQJ
thegiven.
the user could’nt follow the task user could’nt follow
Therefore he/ the task given. Therefore he/
shethe
she aborted the task by clicking aborted the task
back button andby clicking the back button and
returned
returned to the homepage. It shows to website
that the homepage.
has It shows that website has
to be improved a lot by givingto be improved
importance a lot by giving importance to users
to users
top tasks. top tasks.
7 7
2.3 ANALYSIS: SATISFACTION 2.3 ANALYSIS: SATISFACTION
1. Introduction 1. Introduction
The Kolmogorov- Smirnov test was conducted to know the The full transcripts
The Kolmogorov- Smirnov were
testanalysed which were
was conducted recorded
to know the while The full tran
Satisfaction of the user was found to be important in whether
Satisfaction of the data
user is
wasnormal
foundortonon-normal.
be important in whetherparticipants
the data iswere performing
normal think aloud on (Supremenewyork participants
or non-normal.
Result-whether
determining whether a website is good in terms of usability. Thedetermining The achieved
a websitep-value in the
is good KS test
in terms of was .085 The
usability. which Result-website, 2020). Thematic
The achieved p-value inanalysis
the KS test waswasconducted to gain
.085 which website, 20
greater usability provides good impact on satisfaction therefore greaterLQGLFDWHVWKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\6RWKHQH[W
usability provides good impact on satisfaction therefore insights into the preferences/desires of users while performing insights into
LQGLFDWHVWKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\6RWKHQH[W
conducted
increasing the trust and loyalty of the user towards a website. increasing was
the trust “t independent
and loyalty of thetest”.
user towards a website. RQOLQHVKRSSLQJDQGWR¿QGRXWWKHFKDOOHQJHVWKH\DUHIDFLQJ
conducted was “t independent test”. RQOLQHVKRS
An independent
So, it was found that user trust was partially dependent on the So, it was found that usermeanstrustt-test
was was conducted
partially dependentto compare
on the the while usingmeans
An independent the website.
t-test was conducted to compare the while using
degree of consumer website satisfaction.(Flavián, Guinalíu degreeSUS scores onwebsite
of consumer two online fashion retail websites
satisfaction.(Flavián, (Website
Guinalíu SUS scores on two online fashion retail websites (Website
and Gurrea, 2006). Satisfaction can be measured by both 1 = www.supremenewyork.com;
and Gurrea, 2006). Satisfaction can beWebsite measured 2 =byhttps://www.
both 3.2 Report
1 = www.supremenewyork.com; Website 2 = https://www. 3.2 Repor
Quantitative rating scales and Qualitative methods. pullandbear.com/).
Quantitative rating scales and Qualitative methods. pullandbear.com/).
The test revealed there wasVWDWLVWLFDOO\VLJQL¿FDQWGLIIHUHQFH Doing
The test revealed there wasVWDWLVWLFDOO\VLJQL¿FDQWGLIIHUHQFH Doing
2. Quantitative methods-SUS scale 2. Quantitative
in SUS scores methods-SUS
between Supreme scale
(M= 37.1,SD= 22.54) and in SUSThe mostbetween
scores frequentSupreme
activity undertaken
(M= 37.1,SD= throughout the think
22.54) and The most fr
SUS rating scale (Brooke, 1996) was chosen to measure the SUS rating Pull &scale
Bear (Brooke,
(M= 69.9,1996)
SD= was 22.54); t(74) to
chosen = -11.94,
measure p=the
0.00001, Pull &aloud
Bear (M= exercise
69.9,was
SD=clicking
22.54);on the =links
t(74) or buttons(30
-11.94, p= 0.00001, aloud exerc
satisfaction in quantitaive method. two tailed.
satisfaction The magnitude
in quantitaive method. of difference in the means (Mean instances).
two tailed. The next of
The magnitude frequent
differenceactivity
in theusers
meansdid was
(Mean to search instances).
difference =32.8) was large (eta squared 0.49). for a =32.8)
difference jacket(15 wasinstances).
large (eta For
squaredexample,
0.49).one participant stated for a jacket(
2.1 Data collection 2.1 Data collection ³,¶GOLNHWRFOLFNDQGVHH,ILW¶VDMDFNHW´ ³,¶GOLNHWRF
We collected the data of SUS scores with 78 students of our The results
We collected revealed
the data of SUSaverage
scoresSUS
withscore of supreme
78 students of ouris 37.1 The results revealed average SUS score of supreme is 37.1
class by using a Google forms survey which has 10 questions (<50
class by score
using is unacceptable)
a Google which
forms survey is very
which hasmuch lower than
10 questions Thinking
(<50 score is unacceptable) which is very much lower than Thinking
regarding the usability of websites. All the students had average
regarding SUS score
the usability of Pull & All
of websites. Bearthewhich is 70had
students indicating the averageTheSUS most common
score thought
of Pull & Bearthewhichparticipants had during
is 70 indicating the the task The most co
completed set of tasks like selecting a garment, checking the usersset
completed hadofatasks
bad experience while
like selecting using supreme
a garment, checking website.
the users was
had being
a bad unsure
experienceabout the content(17
while using supreme instances).
website.The other was being u
VL]H¿WHWFRQJLYHQZHEVLWHVEHIRUHWDNLQJWKLVVXUYH\ VL]H¿WHWFRQJLYHQZHEVLWHVEHIRUHWDNLQJWKLVVXUYH\ thoughts participants mentioned were feeling the content is not thoughts pa
Investigating Individual scale scores appropriate
Investigating for whatscale
Individual they are looking(10 instances),confused appropriate
scores
2.2 Data analysis 2.2 Data analysis
Comparing Supreme to Pull & Bear (See Bar chart 2) about Supreme
Comparing sizing information(9
to Pull & Bearinstances),
(See Barunable
chart 2)to differentiate about sizing
The SUS scores for each website were calculated by using Supreme
The SUS scoreswas foundwebsite
for each to be lacking in followingbycharacteristics
were calculated using Supremesoldwasout products(8
found to beinstances), Hard to read
lacking in following text due to small sold out pro
characteristics
a SUS calculator I ran some statistics on the SUS scores to a SUSresulting in Ilower
calculator SUS statistics
ran some score. on the SUS scores to IRQWVL]HLQVWDQFHV/HVVIUHTXHQWWKRXJKWVZHUHZDQWLQJ
resulting in lower SUS score. IRQWVL]HL
• /RZHUIUHTXHQWXVH
understand how Supreme is performing when compared to Pull understand how Supreme is performing when compared to Pull WR¿OWHUWKHFRQWHQWLQVWDQFHV:DQWLQJIRUDVHDUFKEDU
• /RZHUIUHTXHQWXVH WR¿OWHUWKHF
& Bear. • More complex to use
& Bear. • More instances).
complexFor example, one participant stated “,I,FOLFNRQWKLVinstances).
to use
• Harder to use LWPLJKWEULQJPHEDFN$KK,DPQRWVXUHZKHUH,DPQRZ´.
• Harder to use LWPLJKWEULQ
2.3 Report • Requiring more technical support
2.3 Report • Requiring more technical support
• Functions need better integration with site Feelingneed better integration with site
• Functions Feeling
Bar chart 1 comparing SUS scores between Supreme and Pull &Bar chart
• Harder to learn
1 comparing SUS scores between Supreme and Pull & No positive
• Harder to learnfeelings were detected throughout the website. No positive
Bear Bear • 8VHUV¿QGLWDZNZDUGWRXVH 2QO\QHJDWLYHIHHOLQJVZHUHGHWHFWHGVSHFL¿FDOO\DQQR\DQFH 2QO\QHJDWL
• 8VHUV¿QGLWDZNZDUGWRXVH
• 8VHUVKDYHOHVVFRQ¿GHQFHXVLQJWKHV\VWHP (9 instances) and bored(2 instances). For example, participant (9 instances
• 8VHUVKDYHOHVVFRQ¿GHQFHXVLQJWKHV\VWHP
• Greater learning curve with Supreme once said
• Greater ³,DPTXLWHDQQR\HGZK\ZRXOGLWEHKHUHLIZDVVROG
learning curve with Supreme once said ³,
RXWFRPSOHWHO\´ RXWFRPSOHW
3. Qualitative methods-Think Aloud 3. Qualitative methods-Think Aloud
4. Conclusion 4. Conclu
Think Aloud during the (Jaspers, M.W.M., Steen, T., van den Think Aloud during the (Jaspers, M.W.M., Steen, T., van den
Bos, C. and Geenen, 2004) was chosen to measure the Bos, C.Asand
shown in the2004)
Geenen, Pie chart
was1,chosen
In 25%toofmeasure
all the instances
the As shown in
satisfaction in qualitative method. participants
satisfaction were not
in qualitative sure about the content present on the
method. participants
website. For example ³,I,FOLFNRQWKLVLWPLJKWEULQJPHEDFN website. Fo
3.1 Data collection and analysis 3.1 Data collection and analysis This clearly shows it is an
$KK,DPQRWVXUHZKHUH,DPQRZ´. $KK,DPQ
8 8
KH XVDELOLW\ÀDZDQGQHHGVWREHFRUUHFWHGDVLWZDVWKH
Bar chart 2 comparing individual SUS scale scores between supreme and2 comparing
Bar chart individualthe
Table 1 showing SUS scale scores
recurrence between
of themes supreme
in the and
Think Aloud Table 1 showing the recurrence of themes in the Think Aloud
most recurred pattern.
Pull & Bear Pull & Bear protocol protocol
In 14% of all the instances, participants felt that
the content/information shown on the website was
not appropriate to what they are looking for. For
RI example one participant said ³7KHUH¶VDZKROHORDGRI
H XQQHFHVVDU\LQIRUPDWLRQKHUHEXW,ZDQWWRMXVWVHH
KRZPDQ\GD\VLWZLOOWDNHWRGHOLYHU´
WKH $JDLQLQLQVWDQFHVSDUWLFLSDQWVFRXOGQRW¿QGWKH
n proper size of the garment and felt sizing information
was not helpful. For example
7KHVL]LQJLVRGGWKHUHLVQRRWKHUPHWULFVOLNH
DWLRQ FHQWLPHWUHV«,FDQ¶WVHHPWR¿QGDQ\PRUHLQIRUPDWLRQ
e RQLW It caused participants to feel annoyed in some
cases.
9 9
2.4 ANALYSIS: PERFORMANCE2.4 ANALYSIS:
2.4PERFORMANCE
ANALYSIS: PERFORMANCE
10 10 10
e in the means (Mean difference 7KLVLQGLFDWHVWKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\1RQ
0.188, two tailed. The difference
0.188, twointailed.the means
The difference
(Mean difference
in the means (Mean7KLVLQGLFDWHVWKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\1RQ
difference 7KLVLQGLFDWHVWKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\1RQ
t revealed the p-value = 1.3) VLJQL¿FDQWIURPWKDWZKLFKLVQRUPDOO\GLVWULEXWHG6RWKHQH[W
= 1.3) VLJQL¿FDQWIURPWKDWZKLFKLVQRUPDOO\GLVWULEXWHG6RWKHQH[W
VLJQL¿FDQWIURPWKDWZKLFKLVQRUPDOO\GLVWULEXWHG6RWKHQH[W
k
oth2 the groups are Errors madetest is “t independent
analysis Errors
for Task made2 test” in Parametric
analysis for Task statistics.
2 test is “t independent test”
test in
is “t
Parametric
independentstatistics.
test” in Parametric statistics.
A “t independent
064 which is greater thanThe result achieved p-value
The result test”
of .064 (two tailed)
achieved
which is
p-value toof
greater investigate
than
.064 which if Supreme
A “t independent
is greater than test”A (two
“t independent test” (twoif tailed)
tailed) to investigate Supreme to investigate if Supreme
sHVQ¶WGLIIHUVLJQL¿FDQWO\1RQ
no statistically has lower7KLVLQGLFDWHVWKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\1RQ
lostness than Pull & Bear (Website 1 =supreme;
7KLVLQGLFDWHVWKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\1RQ has lower lostness than has
Pull
lower
& Bear
lostness
(Website
than1Pull
=supreme;
& Bear (Website 1 =supreme;
RUPDOO\GLVWULEXWHG
ss Website 2VLJQL¿FDQWIURPWKDWZKLFKLVQRUPDOO\GLVWULEXWHG
=Pull & Bear.
s for checking products VLJQL¿FDQWIURPWKDWZKLFKLVQRUPDOO\GLVWULEXWHG Website 2 =Pull & Bear. Website 2 =Pull & Bear.
ed QRVWDWLVWLFDOO\VLJQL¿FDQW
nd
eme (Md= 66, n=12) and The t independent Result-test The
The test revealed
t independent
revealed VWDWLVWLFDOO\VLJQL¿FDQWGLIIHUHQFH in
Result-
test revealed QRVWDWLVWLFDOO\VLJQL¿FDQW
QRVWDWLVWLFDOO\VLJQL¿FDQW Result-
The test revealed VWDWLVWLFDOO\VLJQL¿FDQWGLIIHUHQFH
The test revealed VWDWLVWLFDOO\VLJQL¿FDQWGLIIHUHQFH
in in
en Supreme
= -0.86 and p=(M= difference in lostness
0.38, SD=
0.38 errors made between
difference
between Supremeerrors(M=
in Supreme made0.51,
(M= SD=SD=
between
0.38, 0.28) and Pull
Supreme (M= &0.38, SD=
lostness between Supremelostness
(M=between
0.51, SD=Supreme
0.28) and(M=Pull
0.51,
& SD= 0.28) and Pull &
SD= 0.75); t(7) = 2.11 p= 2.57) Bear
0.06,and Pull (M= (M=
& Bear 0.27,1.57,
2.57) SD=SD=
and 0.26);
Pull t(11)t(7)
&0.75);
Bear = 2.21
(M= p= p=
=1.57,
2.11 0.01,
SD= one tailed.
0.06,
0.75); = The
t(7)Bear (M=p=0.27,
2.11 0.06,SD= 0.26);
Beart(11)
(M= = 0.27,
2.21SD=
p= 0.01,
0.26);one
t(11)
tailed.
= 2.21Thep= 0.01, one tailed. The
means (Mean differencetwo = 1.19) magnitude
tailed. The difference of in
two the difference
tailed.
the means in the difference
The difference
(Mean means
in the (Mean
means difference
= 1.19) =
(Mean magnitude
difference =of1.19)
the difference
magnitude
in theofmeans
the difference
(Mean difference
in the means= (Mean difference =
0.25) was large (eta squared = 0.18) 0.25) was large (eta squared
0.25) was= 0.18)
large (eta squared = 0.18)
k 3 no statistically
was Errors made analysisErrors for Task
made3 analysis for Task 3
nov test revealed the p-value
VVIRUFKHFNLQJVL]H ¿W
¿W The result of Kolmogorov-The Smirnov
result of test
Kolmogorov-
revealed Smirnov
the p-valuetest revealed the p-value
,of Supreme
en both the groups are was .020 which showswas
(Md= 100, the data
.020 of
which
bothshows
the groups
the data
are of both the groups are
2),
p= U=62, z= 0.54 and p= VLJQL¿FDQWO\GLIIHUHQW VLJQL¿FDQWO\GLIIHUHQW
there was no statisticallyMann-Whitney 3. Conclusion
U testMann-Whitney
revealed there wasU test no revealed
statistically 3. Conclusion
there was no statistically 3. Conclusion
rs made between Supreme VLJQL¿FDQWGLIIHUHQFH inVLJQL¿FDQWGLIIHUHQFH
the errors
After conducting made between
the performance in the Supreme
errorsbetween
analysis made between
SupremeSupreme
After conducting the performance
After conducting
analysis
the between
performance
Supreme
analysis between Supreme
Md= 0, n= 9), U=27, z= 0.05 and
(Md= 0, n=9)and
andPull
Pull&&(Md=
Bear0,the
Bear, (Md=
n=9) 0,
and
n=Pull
results 9), U=27,
infer &that
Bearz= (Md=
0.050,and
n= 9), U=27, z= 0.05
and Pull andthe results
& Bear, and Pull
infer& that
Bear, the results infer that
p= 0.92. p= 0.92.
Supreme and Pull & Bear have equal performance as there Supreme
is and Pull & Bear
Supreme
have equal
and Pull
performance
& Bear haveas equal
there is
performance as there is
QRVLJQ¿FDQWGLIIHUHQFHEHWZHHQWKHPLQPHWULFVRI QRVLJQ¿FDQWGLIIHUHQFHEHWZHHQWKHPLQPHWULFVRI
QRVLJQ¿FDQWGLIIHUHQFHEHWZHHQWKHPLQPHWULFVRI
• Task time • Task time • Task time
• Task completion • Task completion • Task completion
• Errors made • Errors made • Errors made
ich is greater than
IIHUVLJQL¿FDQWO\1RQ Supreme’s navigation is bad when compared to Pull & Bear’s Supreme’s navigation is Supreme’s
bad whennavigation
comparedistobadPullwhen
& Bear’s
compared to Pull & Bear’s
GLVWULEXWHG6RWKHQH[W
W DVLWKDVPRUHORVWQHVV7KHUHZDVDODUJHVLJQL¿FDQWGLIIHUHQFH DVLWKDVPRUHORVWQHVV7KHUHZDVDODUJHVLJQL¿FDQWGLIIHUHQFH
DVLWKDVPRUHORVWQHVV7KHUHZDVDODUJHVLJQL¿FDQWGLIIHUHQFH
c statistics. in lostness between Supreme (M=0.51) and Pull & Bear in lostness between Supreme in lostness
(M=0.51)
betweenandSupreme
Pull & Bear
(M=0.51) and Pull & Bear
DWLVWLFDOO\VLJQL¿FDQW (M=0.27) (M=0.27) (M=0.27)
8,
ween Supreme (M= 1.8, 4. Lostness analysis 4. Lostness analysis
541
D= which
= 0.75); is =
t(9) greater
-1.37, than
p= The result achieved p-value
The result
of .541
achieved
which is p-value
greaterofthan
.541 which is greater than
11
2.5 ANALYSIS: ACCESSABILITY
2.5 ANALYSIS: ACCESSABILITY
1.Introduction 1.Introduction
• 5 alerts on the shipping page indicating the text is •too 5small 5. shipping
alerts on the Redesignpagerecommendations
indicating the text is too small 5. Redesign recom
to read. to read.
To determine the accessibility issues of supremenewyorkTo determine the• accessibility
2QSURGXFWSDJHWKHUHDUHWZRLQVWDQFHVZKHUHWKH
issues of supremenewyork • 2QSURGXFWSDJHWKHUHDUHWZRLQVWDQFHVZKHUHWKH
After the evaluation, we noticed that supremenewyorkAfter needs
the evaluation, w
website, we need to run an expert evaluation. Providingwebsite, we need tobuttons
run an has lowevaluation.
expert contrast ratio failing AA and AAA design
Providing buttons has low
few contrast
elementsratio failing
to be AA and in
redesigned AAA design
order to achieve accessibility.
few elements to be re
accessibility means removing barriers that prevent people
accessibility
with meansrequirements.
removing barriers that prevent people with requirements.The designer should consider making these changes:The designer should c
disabilities from making use of services and products.(What is from •making
disabilities The navigation menuand
use of services is not consistently placed
products.(What is in one
• The navigation • menu is notnavigation
Re-group consistently placed
menu in one
options logically on the•home
Re-group navigatio
accessibility, 2014).location
accessibility, 2014). So, failing to make a website accessible through
So, failing out aallwebsite
to make the pages.
accessible location throughpage
out alland
themakepages.it consistent on all the pages in termspage
of and make it c
means that designer is negligent about 37.5% of total means that designer is negligent about 37.5% of total location. location.
population(‘Disabled People in the World in 2019: Facts /HYHO$$$$FFHVVLELOLW\LVVXHV$GYDQFHG
population(‘Disabled
and People in the World in 2019: Facts and /HYHO$$$$FFHVVLELOLW\LVVXHV$GYDQFHG
• Impart titles and clear structure to all the pages. • Impart titles and cl
)LJXUHV¶ZKRQRZ¿QGVLWGLI¿FXOWWRXVHWKHZHEVLWH:HDUH Following are some of the accessibility issues from WCAG
)LJXUHV¶ZKRQRZ¿QGVLWGLI¿FXOWWRXVHWKHZHEVLWH:HDUH Following
2.1 are some of the accessibility issues from WCAG 2.1
• /DEHODOOWKHOLQNV • /DEHODOOWKHOLQNV
comparing the website’s features against WCAG 2.1’scomparing
(W3C, AAA.
the website’s features against WCAG 2.1’s (W3C, AAA. • Improve contrast between the background and fore • ground
Improve contrast b
2018) requirements. • Many links are meaning less without proper labels.• Many links are meaning
2018) requirements. for all callless withoutbuttons.
to action proper labels. for all call to action
• When zoomed to 200% on browser, user needs to•scroll When zoomed • toInclude
200% captions
on browser, uservideo
for the needs
onto“random
scroll page”. • Include captions fo
2. Methods 2. Methods KRUL]RQWDOO\WRUHDGWKHWH[WDQGWKHUHDUHQRÀH[LEOH KRUL]RQWDOO\WRUHDGWKHWH[WDQGWKHUHDUHQRÀH[LEOH
presentation options like letting user to change background presentation options like letting user to change background
2.1 Setting and Sample 2.1 Setting and Sampleor foreground colors. or foreground colors.
We evaluated www.supremenewyork.com using the Firefox We evaluated
web • There are no detailed help
www.supremenewyork.com and
using theinstructions
Firefox webgiven. • There are no detailed help and instructions given.
browser. browser.
4. Conclusion 4. Conclusion
2.2 Data Collection 2.2 Data Collection
We evaluated the homepage, shop page, product page Weandevaluated the homepage, shop page, product page and
2XUHYDOXDWLRQIRUDFFHVVLELOLW\LVVXHVRQVXSUHPHQHZ\RUN 2XUHYDOXDWLRQIRUDFFHVVLELOLW\LVVXHVRQVXSUHPHQHZ\RUN
checkout page. All the problems were compared against checkout
WCAGpage. All the problems
website were
infers that it iscompared
failing basicagainst WCAG
guidelines of WCAG website
2.1. infers that it is failing basic guidelines of WCAG 2.1.
2.1’s (W3C, 2018) for attaining level A. 2.1’s (W3C, 2018) for attaining level A.
/HYHO$$DQG$$$ZDVWHVWHGE\DQDO\VLQJWKURXJKWKH:DYH
/HYHO$$DQG$$$ZDVWHVWHGE\DQDO\VLQJWKURXJKWKH:DYH
The key perceivable design issues are the lack of structure The key in perceivable design issues are the lack of structure in
website (Web accessibility tool, 2020) website (Web accessibility
home pagetool,with2020)
an illogical grouping of options in navigationhome page with an illogical grouping of options in navigation
menu, which might make user to get lost. There is no menu,
Errors showing meaning less empty links
text which might make user to get lost. There is no text
Errors sho
2.3 Data Analysis 2.3 Data Analysis alternative for the products in the carousel of the “shop page” for the productswithout
alternative any titles.
in the carousel of the “shop page” without an
I have categorized the test result into must address, should
I have categorized the creates
which test result
an into must address,
ambiguity for users.should
There are no captions
which creates
or an ambiguity for users. There are no captions or
address, Could address. This way it is easier to understand
address,andCould address. This wayfor
audio alternative it is
theeasier
videotoonunderstand
the “randomand
page”. There’s
audio alternative
no for the video on the “random page”. There’s no
implement these issues while the designer is redesigning
implement
the theseaudio
issues while the for
alternative designer
any of istheredesigning
pages. the audio alternative for any of the pages.
website. website. The critical operational design issues are inconsistentThe critical operational design issues are inconsistent
functioning of tab navigation in the “shop page” and lack functioning
of of tab navigation in the “shop page” and lack of
3. Results 3. Results visual clue when the user is switching between colorsvisual in product
clue when the user is switching between colors in product
/HYHO$$FFHVVLELOLW\LVVXHV%HJLQQHU page. Illogical grouping of navigation menu. Most of the
/HYHO$$FFHVVLELOLW\LVVXHV%HJLQQHU page.
pages
Illogical grouping of navigation menu. Most of the pages
See Table 1 See Table 1don’t have titles which makes hard for the user to be aware don’t have titles which makes hard for the user to be aware
where he/she is. Some links don’t have labels and some whereof he/she is. Some links don’t have labels and some of
/HYHO$$$FFHVVLELOLW\LVVXHV,QWHUPHGLDWH them have unclear labels.
/HYHO$$$FFHVVLELOLW\LVVXHV,QWHUPHGLDWH them have unclear labels.
I have listed the major accessibility issues from WCAG I have listed the The
2.1 AA majorkey understandable
accessibility issuesdesign issue is2.1
from WCAG lack
AAof clear labels
The key or understandable design issue is lack of clear labels or
and according to Wave. and according toinstructions
Wave. given making their purpose uncertain. instructions given making their purpose uncertain.
• There are 32 errors of empty links on shop page with • There
no are 32 errors of empty links on shop page with no
text. text.
12 12
13 13
2.6 ANALYSIS:
2.6 ANALYSIS: PSYCHOLOGY
PSYCHOLOGY
1. Introduction
1. Introduction The logo is red The logo
over theisblack
red over the blackwith
background background with a faded image-
a faded image- the primary
the primary navigation navigation
would would
be on the top be on the
of the page.top of the page.
Foreground toForeground
backgroundtocontrast.
background contrast. (negative) (negative)
It is importantItfor
is websites
importantorforapps
websites or apps
to follow to follow
the basic the
rules ofbasic rules All the list •of options
• of All the list
on of
theoptions
homepage on the
is homepage
placed close is to
placed close• toThe images • inThe
theimages
carouselin are
the not
carousel are not
associated associated
with text/ with text/
humaninpsychology
human psychology designing as in the
designing as thethe
experience experience
user each other,
the user each other, following following
Gestalt’s law Gestalt’s
of proximitylawmaking
of proximity
usersmaking users labels
labels violating violating
the Dual codingthetheory.
Dual coding theory. (negative)
(negative)
getswebsites
gets using these using these websites
will go through will go through
three differentthree different levels
levels believe they are believe they are
connected to connected to the same
the same category. But category.
the But• theThe usage• of The usage
colours of colours isand
is harmonious harmonious
highlightingandthehighlighting the
of informationofprocessing
information processing
levels in human levels in like
brain human visceral, main option
brain like visceral,main option “shop” “shop”for
is important is both
important for both
customers customers
and the and the centre part ofcentre partwhich
the page of theispage which (positive)
important. is important. (positive)
EHKDYLRUDODQGUHÀHFWLYH9LVFHUDOEHLQJWKHEDVLFVXEFRQVFLRXV
EHKDYLRUDODQGUHÀHFWLYH9LVFHUDOEHLQJWKHEDVLFVXEFRQVFLRXV company in order company
to buyinmore
orderproducts.
to buy more products.
levelcan
level where user where user the
process caninformation
process theoninformation
colors usageon colors usage
• Information • scent-
Information scent-
The option The option
random, news, random,
mailingnews, list all page-View all page-
list mailing View
in websites andin websites and basic of
basic organization organization
it (Gestalt principle). are not comprehensible
of it (Gestalt principle). are not comprehensible and vague. It’s and vague.
hard It’s hard to understand
to understand
6LPLODUO\WKHKLJKHVWRQHLVWKHUHÀHFWLYHOHYHOLQZKLFKXVHUFDQ
6LPLODUO\WKHKLJKHVWRQHLVWKHUHÀHFWLYHOHYHOLQZKLFKXVHUFDQ where the user where
goesthe user
after goes those
clicking after clicking
options.those options. • No grouping • ofNocontent
grouping of content
is seen on thisis page
seen as on athis page
result it isas a result it is
consciously
consciously think think about
about his/her his/herinexperience
experience using the website. • The color •used
in using the website. Theoncolor used on the
the homepage is homepage
red. A single is color
red. Aissingle color islooking clutteredlooking
and cluttered
making lessandsense
making to less sense brain.
the user’s to the user’s brain
used inwith
used in association association
black andwith black
white whichandiswhite
called which is called They could use They could
more usespace
white moreand
white space
clear and cleartoboundaries to
boundaries
2. Methods2. Methods DVPRQRFKURPDWLFFRORUWKHPH,WLVUHÀHFWLQJWKHEUDQG¶V
DVPRQRFKURPDWLFFRORUWKHPH,WLVUHÀHFWLQJWKHEUDQG¶V separate the
separate the garments garments
following following
Gestalt’s Gestalt’s principles.
principles.
image as boldimage and yetas minimalistic.
bold and yet minimalistic. • The images • are
Thenotimages are not
associated associated
with texts not with
following not following Dua
texts Dual
2.1 Setting2.1 andSetting
sampleand sample coding theory. coding theory.
I evaluated https://www.supremenewyork.com
I evaluated https://www.supremenewyork.com using a Firefox Product page-Product page-
using a Firefox
web browser.web browser.
4.recommendations
4. Redesign Redesign recommendations
2.2 Data collection
2.2 Data collection
I mainly
I mainly focused focusedon
the analysis thethe
analysis on thecategories
Homepage, Homepage, categories • The primary • navigation
The primary navigation
throughout throughout
the the website
website should be should be
page, productpage,
page product page and
and checkout checkout
as they as they
are often are often connected
connected changed
changed following following principles
the Gestalt’s the Gestalt’s likeprinciples
putting the like putting the
to the
to the top tasks top tasks
carried by thecarried by theshopping
users while users while
in shopping in items which areitems which
related are related
together together in proximity.
in proximity.
e-commerce
e-commerce websites websites 2018).
(McGovern, (McGovern, 2018). • Include
• Include suitable iconssuitable
with theicons
texts with
using the texts
Dual using Dual coding
coding
• The “add to • basket”
The “add andto“keep
basket” and “keep
shopping” shopping”
buttons buttons are justtheory.
are just theory.
2.3 Data Analysis
2.3 Data Analysis texts
texts without the without
aid theThis
of icons. aid of
is icons. This
violating Dual coding Dual coding
is violating • Improve font • size
Improveand font sizefor
weights andtheweights for the
text blocks text
and blocks and desig
design
The
The analysis is analysis by
conducted is conducted
checking forby any
checking for issues
usability any usability issues theory.
theory. Recalling Recallingwould
information information
be much would beifmuch
faster wordsfaster if words it inway
it in a hierarchal a hierarchal
followingway following
UI design UI design principles.
principles.
based on most based on most
commonly commonly
used usedprinciples
psychology psychology likeprinciples like are associated are associated
with imagery. with imagery. • Follow
• Follow consistent consistent
layout layout
for all the pages for all the website.
in the pages in the website.
colour theory,colour theory,
Gestalt’s Gestalt’s
laws, laws,scent,
Information Information scent, Dual coding
Dual coding • The free
• The free shipping shipping
message message
is red is redgives
color, which color,users
whichagives users a
theorymodels.
theory and Mental and Mental models. falseofassumption
false assumption some system of some
warning system warning
or error or error message.
message.
The usage of Thecolorusage
is notof color is notfor
appropriate appropriate
the situation for here.
the situation here.
3. Report 3. Report • Theadd
• The size button, sizetobutton,
basket,addkeepto basket,
shopping keep shopping buttons
buttons
Home page- Home page- are grouped
are grouped together with together with in the
in the proximity proximity
of next buttonof next button
giving sense ofgiving
theysense of a
all have they all have
similar a similar
function, function, indicating
indicating
law of
law of proximity. proximity.
There should There
be more should
whitebespace
moretowhite space to
differentiate them.
differentiate them.
• • The
The navigation navigation
menu is in themenu
bottomis in thenot
and bottom and not consistent
consistent
in its structureinon
itsall
structure
the pageson all
on the
the pages
websiteonwhich
the website
is which is
contradicting contradicting
to the mental to the mental
models of themodels of the users. Usually
users. Usually
14 14
Table
Table 1 showing 1 showing
website User website
interfaceUser interface
elements elements review
review
No spacing No spacing
between thebetween
prodcutsthe prodcuts making
making
it look
it look cluttered andcluttered and it is cogni-
it is increasing increasing cogni-
tive load ontive
usersload on users
while while
scanning scanning
them for them for
¿QGLQJDSURGXFW
¿QGLQJDSURGXFW
No proper
No proper grouping of grouping of the
the products in products
the in the
carousel
carousel which feels which
like thefeels likecarou-
entire the entire carou-
sel belongssel belongs
to one singleto group.
one single group.
15 15
3. SUMMARY OF USABILITY ISSUES3. SUMMARY OF USABILITY ISSUES
1. Introduction 1. Introduction
/DFNRI¿OWHU /DFNRI¿OWHU
After conducting several usability tests on the existing supreme newyork
After conducting • $VWKHUHZDVQR¿OWHUXVHUKDGWRVHDUFKDQGVNLPWKURXJKPDQ\SURGXFWVRQWKH
website several usability tests on the existing supreme newyork website • $VWKHUHZDVQR¿OWHUXVHUKDGWRVHDUFKDQGVNLPWKUR
such as heuristics, accessability analysis, performance, satisfaction
suchmetrics
as heuristics,
and accessabilityZHEVLWHUHQGHULQJWKHXVHU¶VWDVNDWKDQGOHVVHI¿FLHQW
analysis, performance, satisfaction metrics and ZHEVLWHUHQGHULQJWKHXVHU¶VWDVNDWKDQGOHVVHI¿FLHQW
biometrics, some key usability issues were discovered. biometrics, some key usability issues were discovered.
Unreadable text Unreadable text
• Smaller text size and lighter font size made the text not readable • Smaller
especially text size and lighter font size made the text no
2. Analysis 2. Analysis in the instances where large volumes of text was peresent. Not only in the
it caused
instances where large volumes of text was peres
annoyance in the normal users but also it makes low sighted people’s annoyance
life veryin the normal users but also it makes low s
Home page Home page hard. (W3C, 2018) hard. (W3C, 2018)
• Home page structure is very ambiguous without any clear navigation,
• Homeheaderpage structure
and • Sans
is very serif font
ambiguous has been
without any proved to have more
clear navigation, legibility
header and when •compared
Sans serif to serif
font has been proved to have more legibility
footer. footer. VPDOOHUIRQWV0LFKDHO%HUQDUG&KLD+XL/LDR VPDOOHUIRQWV0LFKDHO%HUQDUG&KLD+XL/LDR
• Navigation menu is inconsistent and most of the options in it are
• Navigation
not relatingmenu
to theis inconsistent and most of the options in it are not relating to the
top tasks. top tasks. Mention of sold out products Mention of sold out products
The text is not readable •beacause
• The text is not readable beacause of it’s smaller font size and• weight. User could’nt able to font
of it’s smaller viewsize
thatand
the weight.
product was sold out on the• shop
Userpage
could’nt
itself.
able to view that the product was sold ou
• There is lot of negative space with very less content on the homepage
• There making
is lot of it’s
negative space 2QO\DIWHUFOLFNLQJRQWKHSURGXFWDQGLQWRDGLIIHUHQWSDJHWKHQXVHUZRXOGEH
with very less content on the homepage making it’s 2QO\DIWHUFOLFNLQJRQWKHSURGXFWDQGLQWRDGLIIHUHQWSD
purpose questionable. purpose questionable. able to know if the product has been sold out. This is leading to frustration
able to know as the
if the product has been sold out. This is le
user had to go back to the main page every time.(More regressive user
saccades)
had to go back to the main page every time.(More
Shop page Shop page
• The carousel in the center of the page with products is very confusing.
• The carousel
It doesn’tin the center of the page with products is very confusing. It doesn’t
show the product’s name and there is change of state when usershow hovered
the product’s
on it. name3.and Conclusion
there is change of state when user hovered on it. 3. Conclusion
• The navigation bar is in the bottom of the page and the font size
• The
is small
navigation
makingbar it is in the bottom of the page and the font size is small making it
YHU\KDUGIRUWKHXVHUWR¿QGLW YHU\KDUGIRUWKHXVHUWR¿QGLW
Existence of all these usability issues on supreme website was the Existence
reason for of all these usability issues on supreme website
bad experience for the user. This made supreme score the lowest bad
in SUS
experience
surveyfor the user. This made supreme score the
View all page View all page in satisfaction metrics. In performance analysis, all the metrics like in satisfaction
time taken for metrics. In performance analysis, all the me
• All the products are placed very close to each other without boundaries
• All the products
or usageare placed thevery
task,close to each other
task success, without
errors madeboundaries
and lostnessor could
usagebe improved
the task,
a lot task
if these
success, errors made and lostness could be
of white space making it look cluttered. There are no product namesof white
available
space making it usability
look cluttered.
issuesThere are no product names available
were solved. usability issues were solved.
under the products. under the products.
• The navigation menu is again inconsistent in it’s location which• isThe
on the
navigation
left sidemenu is again inconsistent in it’s location which is on the left side
of the page. of the page.
16 16
Product page of supremene original website Product page of supremene original website
nal Home page of supremene original
View all page of supreme original website View all page of supreme original website
17 17
4.1 REDESIGN: WEB DESIGN
4.1 REDESIGN: WEB DESIGN
1. Iteration 1. Iteration
7KHPDLQIRFXVRIWKH¿UVWLWHUDWLRQZDVWRJLYHDJRRGVWUXFWXUHWRWKHKRPHSDJHDQGZLWKJRRGRUJDQLVDWLRQRIQDYLJDWLRQPHQXRQLWVRWKDWWKHXVHUVFDQUHDFKWKHLUGHVWLQDWLRQTXLFNO\7KH
7KHPDLQIRFXVRIWKH¿UVWLWHUDWLRQZDVWRJLYHDJRRGVWUXFWXUHWRWKHKRPHSDJHDQGZLWKJRRGRUJDQLVDWLRQRIQDYLJDWLRQPHQXRQLWVRWKDWWKHXVHUVFDQUHDFKWKHLUGHV
navigation bar was kept at the top of the page
navigation
below the
barheader.
was kept
Byatclicking
the topon
of the
the section
page below
on the
thetop
header.
menu,By
a more
clicking
detailed
on thedrop
section
downonmenu
the top
with
menu,
categories
a moreofdetailed
optionsdrop
would
down
come
menu
up so
with
that
categories
users of options wo
FRXOGFKRRVHVRPHWKLQJVSHFL¿FIURPWKHP FRXOGFKRRVHVRPHWKLQJVSHFL¿FIURPWKHP
Impart search bar and wishlist features on to
Impart
the home
search
page
bar which
and wishlist
will accelerate
features the
on to
users
the home
tasks. page which will accelerate the users tasks.
,QLWLDOO\WKHVNHWFKHVZHUHPDGHZLWKSHQDQGSDSHUJLYLQJLPSRUWDQFHWRWKHQDYLJDWLRQÀRZDQGWKHWRSWDVNV+HUH,KDYHGUDZQKRPHSDJHVHDUFKUHVXOWV¿OWHUDQGSURGXFWSDJHV,VWDUWHGIRUPLQJ
,QLWLDOO\WKHVNHWFKHVZHUHPDGHZLWKSHQDQGSDSHUJLYLQJLPSRUWDQFHWRWKHQDYLJDWLRQÀRZDQGWKHWRSWDVNV+HUH,KDYHGUDZQKRPHSDJHVHDUFKUHVXOWV¿OWHUDQGSURG
the structure of the website after making the
the
basic
structure
information
of the website
architecture.
after making the basic information architecture.
/DWHUSDSHUVNHWFKHVZHUHWDNHQWRWKH¿JPDIRUGHVLJQLQJRISURWRW\SH
/DWHUSDSHUVNHWFKHVZHUHWDNHQWRWKH¿JPDIRUGHVLJQLQJRISURWRW\SH
Home page Home page Product page Product page Search and filter Search and
18 18
Home page of supremenewyork redesign Home page of supremenewyork redesign Product page of supremenewyork redesign Product page of supremenewyork redesign
Product names and prices were Product names and prices were
given along with images given along with images
19 19
4.2 REDESIGN: TOP TASKS
4.2 REDESIGN: TOP TASKS
Pie
Pie chart 1 showing the percentages of tasks chart 1 showing
considered the percentages
important by users of tasks considered important by users
20 20
Product page
,QWKHRULJLQDOVXSUHPHSURGXFWSDJHPDQ\IHDWXUHVVKRXOGEHLPSDUWHGUHODWHGWRWKHWRSWDVNVZKLFKZRXOGPDNHXVHUVWDVNRIFKHFNLQJWKHSURGXFWVL]LQJDQGGHOLYHU\LQIRUPDWLRQHI¿FLHQWO\
XFWSDJHPDQ\IHDWXUHVVKRXOGEHLPSDUWHGUHODWHGWRWKHWRSWDVNVZKLFKZRXOGPDNHXVHUVWDVNRIFKHFNLQJWKHSURGXFWVL]LQJDQGGHOLYHU\LQIRUPDWLRQHI¿FLHQWO\
21 21
4.3 REDESIGN:
4.3 REDESIGN:
ACCESSABILITY
ACCESSABILITY
Fig 1 showing carousel
Fig 1 showing
on original
carousel
website
on original website
In¿JKRPHSDJHWKHFDURXVHOKDVEHHQPRGL¿HGFRPSOHWHO\ZLWKFOHDUSURGXFWLPDJHV7KH
In¿JKRPHSDJHWKHFDURXVHOKDVEHHQPRGL¿HGFRPSOHWHO\ZLWKFOHDUSURGXFWLPDJHV7KH
red border aroundredtheborder
imagearound
is showing the center
the image focus of
is showing thethe carousel.
center focusThe product
of the labels
carousel. The product labels
Shipping page has
Shipping
so manypage
accessibility
has so many
issues
accessibility issues
and the pricing were
andalso provided
the pricing under
were alsothe focusedunder
provided image.
theThe carousel
focused hasThe
image. clearcarousel
title has clear title
and those were eliminated
and thoseinwere
the redesign.
eliminated in the redesign.
called “Fall new releases 2020”.
called “Fall newAll the accessibility
releases 2020”. Allissues related to carousel
the accessibility are solved.
issues related to carousel are solved.
22 22
Fig 3 showing highlighted top navigation
Fig 3 showing bartop
highlighted and header bar and header
navigation
Navigation bar was made consist-
Navigation bar was made consist-
ent and the con tents are the
ent and logically
con tents are logically
grouped. grouped.
23 23
4. REDESIGN: NAVIGATION 4. REDESIGN: NAVIGATION
Flow chart 1 showing Navigation structure of redesigned supremeFlow chart 1 showing Navigation structure
website
2YHUDOOQDYLJDWLRQVWUXFWXUHKDVEHHQPRGL¿HGIRUEHWWHU 2YHUDOOQDYLJDWLRQVWUXFWXUHKDVEHHQPRGL¿HGIRUEHWWHU
HI¿FLHQF\LQWKHUHGHVLJQHGYHUVLRQRIVXSUHPHZHEVLWH HI¿FLHQF\LQWKHUHGHVLJQHGYHUVLRQRIVXSUHPHZHEVLWH
The newly added features are: The newly
Thereadded features
are almost are:
four There are almost four
• Imparted search bar on the home page along with the • Imparted
modessearch bar on the
of navigation pos-home page along with the modes of navigation pos-
primary navigation menu. primary
siblenavigation
for the usermenu.
to reach sible for the user to reach
• Divided the shop option into sub-categories into clothing, • Divided the shop
product page option into sub-categories into clothing,
from the product page from the
accessories, shoes and skate. home page.
accessories, Theand
shoes primary
skate. home page. The primary
• Made the primary navigation consistent throughout the • Made navigation includes
the primary the top
navigation consistent throughout the navigation includes the top
website at the top. levelat
website navigation
the top. bar and level navigation bar and
search bar which is con- search bar which is con-
• Added breadcrumbs on different pages so that they could • Added breadcrumbs on different pages so that they could
stant through out the web- stant through out the web-
aid in getting back to previous pages and also they provide aid in getting back to previous pages and also they provide
site. site.
information for the user where they are curretly located. information for the user where they are curretly located.
• Filter feature has been added for both search results page • Filter feature has been added for both search results page
and browsing through product categories page, which can and browsing through product categories page, which can
reduce the users efforts of scrolling through many products. reduce the users efforts of scrolling through many products.
• Clicking on logo on every page was linked backed to • Clicking on logo on every page was linked backed to
homepage. homepage.
24 24
of home page Fighome
Fig 1 showing Navigation structure of 3 showing
page Navigation of product page Fig 3 showing Navigation of product page
25 25
4.5 REDESIGN: PSYCHOLOGY
4.5 REDESIGN: PSYCHOLOGY
Homepage Homepage
Following below is the comparison betweenFollowing
the homebelow
pagesisof
the comparison
original between the
and redesigned home in
versions pages of original and redesigne
1. Implementation of psychology principles
1. Implementation of psychology principles terms of usage of psychology and UI principles.
terms of usage of psychology and UI principles.
26 26
designed homepage- Top sellers Fig 4 redesigned homepage- Top sellers
Fig 5 Image gallery Fig 5 Image gallery
Fig 6 content on product page Fig 6 content on product page
All the sizing options hav- All the sizing options hav-
ing rectangular shaped ing rectangular shaped
boundary making them boundary making them
look similar to eachother look similar to eachother
and hence giving sense of and hence giving sense of
related to eachother. This related to eachother. This
is following “Gestalt’s law is following “Gestalt’s law
os similarity.” os similarity.”
27 27
4.6 REDESIGN: HEURISTICS
4.6 REDESIGN: HEURISTICS
28 28
Fig 2 Redesigned filter page Fig 2 Redesigned filter page product page
Fig 3 Redesigned Fig 3 Redesigned product page
Selection of filter
options with the Shipping info was given on the same page Shipping info was given on the same page
change of stateSold out Sold out
and user didn’t have to go through the all and user didn’t have to go through the all
into red. countries delivery information. User can countries delivery information. User can
search for their country and view shipping search for their country and view shipping
details like price and time for their country details like price and time for their country
Sold out products were clearly Sold out products were clearly
shown on the top of product and it shown on the top of product and it
the opacity was reduced. the opacity was reduced.
e product page. User can Sizing pop up on the product page. User can Sub categories were well grouped Sub categories were well grouped
quickly check from this popup.
his popup. It also has clear Shipping It also has clearis clearly categorisedShipping
information according information
to their is clearly categorised according
meaningfully to their
with clear selection of meaningfully with clear selection of
metrics. time and price. User can view this direclt on time
theand price.page
product User can view this hover
direclt state
on the
onproduct page
the option. hover state on the option.
itself, so it
itself, so it saves the time and reduces the cognitive saves
load on the time and reduces the cognitive load on the
user. user.
29 29
5. PROTOTYPE 5. PROTOTYPE
KWWSVZZZ¿JPDFRPSURWR75WS1*G9%G-G.TL\NLY$)LQDO6XSUHPH5H-
KWWSVZZZ¿JPDFRPSURWR75WS1*G9%G-G.TL\NLY$)LQDO6XSUHPH5H-
design?node-id=1%3A7830&viewport=1809%2C593%2C0.08114264905452728&scaling=min-zoom
design?node-id=1%3A7830&viewport=1809%2C593%2C0.08114264905452728&scaling=min-zoom
7KHFRPSOHWHSURWRW\SHZDVGHVLJQHGXVLQJ¿JPDE\EDVHGRQWKHIRXQGDWLRQODLGIURPWKHEDVLFQDYLJDWLRQVWUXFWXUH7KHPDLQIRFXVLQWKLVUHGHVLJQZDVWRFKDQJHWKHH[LVWLQJKRPHSDJH
7KHFRPSOHWHSURWRW\SHZDVGHVLJQHGXVLQJ¿JPDE\EDVHGRQWKHIRXQGDWLRQODLGIURPWKHEDVLFQDYLJDWLRQVWUXFWXUH7KHPDLQIRFXVLQWKLVUHGHVLJQZD
into a more meaningful and purposeful. To conserve the
intooriginal
a moresupreme’s
meaningfulpositive things, theTobasic
and purposeful. elements
conserve like carousel
the original was still
supreme’s preserved
positive things,onthe
thebasic
home page butlike
elements it waa redesigned
carousel inpreserved
was still a on the hom
more usable way. more usable way.
All the pages were kept minimal as the supreme website haspages
All the very limited products.
were kept minimal as the supreme website has very limited products.
The Shipping page has been redesigned in a much better way by reducing
The Shipping page haslarger
beenvolumes of text
redesigned in asections. The sizing
much better way byinformation and shipping
reducing larger volumeswere displayed
of text sections.onThe
thesizing
product page itself.
information and shipping were disp
30 30
Figon4 home
Fig 7 Carousel Drop down
page menu Fig 7 Carousel on home page Fig 12 Shipping information popup Fig 12 Shipping information popup
Fig 9 Footer with secondrary navigation Fig 9 Footer with secondrary navigation
31 31
5.1 A/B TESTING: PERFORMANCE 5.1 A/B TESTING:
5.1 A/B
PERFORMANCE
TESTING: PERFORMANCE
1. Introduction 1. Introduction
Task time analysis for Task1. Introduction
2 Task
Tasksuccess analysis
time analysis for
forTask
Task Task 2 2 analysis for Task 2
time Task
The KS test achieved p-value .62 which means the groups are The
Theresult of Kolmogorov-
KS test achieved p-valueThe Smirnov
KS.62 test
testwhich revealed
achievedmeans p-value p-value
the groups .62 which are meansThe the
A/B testing for analysing was done comparing the original QRWVLJQL¿FDQWO\GLIIHUHQW
A/B testing for analysing A/Bwas testing
done for comparing
analysingthe was done comparingwas
original the.00003
originalwhich showsQRWVLJQL¿FDQWO\GLIIHUHQW
QRWVLJQL¿FDQWO\GLIIHUHQW the data of both the groups are was
website to the redesigned version to know if the redesigned An independent
website meanswebsite
to the redesigned t-test
versionrevealed
to the
to know there
redesigned was
if the statistically
redesigned
version to know if theVLJQL¿FDQWO\GLIIHUHQW
Anredesigned
independent means Ant-testindependent
revealed means there was t-test revealed there VLJQ
statistically was
version has better performance metrics than the original VLJQL¿FDQW
version hasdifferrencein task
better performance
version times hasEHWZHHQ2ULJLQDOVXSUHPH
metrics
better than
performance
the originalmetrics than the Mann Whitney
VLJQL¿FDQW
original test revealed
differrencein VLJQL¿FDQW
task times there differrencein
was no statistically
EHWZHHQ2ULJLQDOVXSUHPH
task times EHWZHHQ2ULJLQD Man
website. (M= 82, SD= 200.5) and website.
website. Redesigned supreme (M= 30, VLJQL¿FDQWGLIIHUHQFHLQWKHWDVNVXFFHVVEHWZHHQ2ULJLQDO
(M= 82, SD= 200.5) and(M= Redesigned
82, SD= 200.5) supreme and(M=Redesigned
30, supremeVLJQ(M=
SD= 90); t(8) = 1.8, p= 0.002, two tailed. The magnitude of Supreme
SD= 90);(Md= t(8) =82, n=12)
1.8, and90);
p= 0.002,
SD= Redesigned
twot(8) tailed.
= 1.8, version
The (Md=
p=magnitude
0.002, two100, Supr
oftailed. The magn
2. Data collection and analysis 2. Data in
difference collection
the means and 2. Data
(Mean analysis collection
difference = 52) andwas largeanalysis(eta n= 4), U=58,inz=
difference the-0.8 anddifference
means p=
(Mean 0.58difference
in the means = 52) (Mean
was large (eta = 52)n=
difference wa4
I have collected the data required for performance analysis with squared = 0.17) the data
I have collected I have
required collected
for performance
the data required analysis forwith
performancesquared = 0.17)
analysis squared = 0.17)
with
4 people after explaining them the tasks they had to perform. 4 people after explaining 4 people
them the after
tasksexplaining
they hadthem to perform.
the tasks they had to perform.
Metrics used for comparing the redesign vs original Metrics used for comparing
Metrics the used
redesign for comparing
vs originalthe redesign vs original
1.Task Time 1.Task Time 1.Task Time
2.Task completion 2.Task completion 2.Task completion
difference in the means (Mean difference = 40.21) was large difference in the meansdifference
(Mean difference in the means = 40.21) (Mean wasdifference
large = 40.21) was large
(eta squared = 0.12) 2.Task success
(eta squared analysis
= 0.12) (etaforsquared
Task 1 = 0.12) 2.Task success analysis 2.Task for Tasksuccess 1 analysis for Task 1
The result of Kolmogorov- Smirnov test revealed the p-value 3.Errors
The result made analysisThe
of Kolmogorov- forSmirnov
Task
result1oftest Kolmogorov-
revealed the Smirnov
p-value test revealed3.Erth
was .0002 which shows
the data of both the groups are
The
wasresult
.0002achieved
which shows p-value
wastheof.0002 .06 of
data which
bothisshows
which thegreaterthethan
groups data
are of both the group The
VLJQL¿FDQWO\GLIIHUHQW
7KLVLQGLFDWHVWKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\1RQ
VLJQL¿FDQWO\GLIIHUHQW VLJQL¿FDQWO\GLIIHUHQW
Mann Whitney test revealed there wasno statistically
VLJQL¿FDQWIURPWKDWZKLFKLVQRUPDOO\GLVWULEXWHG
Mann Whitney test revealed Mann Whitney there wastest no statistically
revealed there was no statistic VLJQ
VLJQL¿FDQWGLIIHUHQFHLQWKHWDVNVXFFHVVEHWZHHQ2ULJLQDO The t independent test VLJQL¿FDQWGLIIHUHQFHLQWKHWDVNVXFFHVVEHWZHHQ2
revealed ZDVVWDWLVWLFDOO\VLJQL¿FDQW
VLJQL¿FDQWGLIIHUHQFHLQWKHWDVNVXFFHVVEHWZHHQ2ULJLQDO The
Supreme (Md= 100, n=12) and Redesigned version (Md= 100, GLIIHUUHQFHLQHUURUVPDGHEHWZHHQ2ULJLQDOVXSUHPH0
Supreme (Md= 100, n=12) Supreme and Redesigned
(Md= 100, n=12) version and(Md=
Redesigned
100, GLIIH
versio
n= 4), U=23, z= -1.002
and p= 0.25.
SD=
n= 4),19.54)
U=23, andz=Redesigned
-1.002 n= and 4), supreme
p=U=23,
0.25.z= (M= 0.11, and
-1.002 SD=p= 23); t(9)
0.25. SD=
= 2.4, p= 0.02, two tailed. The magnitude of difference in the = 2.4
32 32 32
05) 4.means
Lostness(Meananalysis
differencemeans
= 1.8)(Mean
was small (eta squared
difference = 1.8) was small (eta 4.
= 0.05) Lostness
squared analysis 4. Lostness analysis
= 0.05)
e p-value The result achieved p-value of .731 which is greater than The result achieved p-value of .731
The result which isp-value
achieved greaterofthan
.731 which is greater than
ps are 7KLVLQGLFDWHVWKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\1RQ 7KLVLQGLFDWHVWKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\1RQ
7KLVLQGLFDWHVWKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\1RQ
VLJQL¿FDQWIURPWKDWZKLFKLVQRUPDOO\GLVWULEXWHG6RWKHQH[W
VLJQL¿FDQWIURPWKDWZKLFKLVQRUPDOO\GLVWULEXWHG6RWKHQH[W
VLJQL¿FDQWIURPWKDWZKLFKLVQRUPDOO\GLVWULEXWHG6RWKHQH[W
ally test is “t independent test” in Parametric statistics. test is “t independent test”
testinisParametric
“t independentstatistics.
test” in Parametric statistics.
2ULJLQDO A “t independent test” (two tailed) to investigate if Redesigned A “t independent test”A(two tailed) to investigate
“t independent test” (two if Redesigned
tailed) to investigate if Redesigned
(Md= 100,6XSUHPHKDVORZHUORVWQHVVWKDQ2ULJLQVOYHUVLRQ 6XSUHPHKDVORZHUORVWQHVVWKDQ2ULJLQVOYHUVLRQ
6XSUHPHKDVORZHUORVWQHVVWKDQ2ULJLQVOYHUVLRQ
Result- The test revealed
VWDWLVWLFDOO\VLJQL¿FDQWGLIIHUHQFH
Result- The test revealed VWDWLVWLFDOO\VLJQL¿FDQWGLIIHUHQFH
Result- The test revealed VWDWLVWLFDOO\VLJQL¿FDQWGLIIHUHQFH
LQORVWQHVVEHWZHHQ2ULJLQDO6XSUHPH0
6'
LQORVWQHVVEHWZHHQ2ULJLQDO6XSUHPH0 6'
LQORVWQHVVEHWZHHQ2ULJLQDO6XSUHPH0 6'
and Redesigned supreme (M= 0.12, SD= 19); t(8) = 1.01 and Redesigned supreme and (M= 0.12, SD=
Redesigned 19); t(8)(M=
supreme = 1.01
0.12, SD= 19); t(8) = 1.01
p= 0.0002, one tailed. The magnitude of the difference in the p= 0.0002, one tailed. The magnitude
p= 0.0002, oneoftailed.
the difference in the of the difference in the
The magnitude
means
Errors(Mean
madedifference = 0.39)
analysis Errors
for Task was
2 large
made analysis(eta squared
for Task=20.26) means (Mean differencemeans = 0.39) was large
(Mean (eta squared
difference = 0.39) was= 0.26)
large (eta squared = 0.26)
The result achieved p-value of .054
The result which isp-value
achieved greaterofthan .054 which is greater than
7KLVLQGLFDWHVWKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\1RQ
7KLVLQGLFDWHVWKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\1RQ
H[W VLJQL¿FDQWIURPWKDWZKLFKLVQRUPDOO\GLVWULEXWHG6RWKHQH[W
VLJQL¿FDQWIURPWKDWZKLFKLVQRUPDOO\GLVWULEXWHG6RWKHQH[W
test is “t independent test”
testinisParametric
“t independent statistics.
test” in Parametric statistics.
e p-value The t independent testThe revealed QRVWDWLVWLFDOO\VLJQL¿FDQW
t independent test revealed QRVWDWLVWLFDOO\VLJQL¿FDQW
PH
are differenceLQHUURUVPDGHIRUWDVNEHWZHHQ2ULJLQDO6XSUHPH
differenceLQHUURUVPDGHIRUWDVNEHWZHHQ2ULJLQDO6XSUHPH
= (M= 1.94, SD= 22.3) and (M= Redesigned
1.94, SD= supreme
22.3) and(M= 0.5, SD= supreme (M= 0.5, SD=
Redesigned
eally 0.93); t(8) = -1.37, p= 0.238,
0.93);two t(8)tailed.
= -1.37, Thep=difference
0.238, twointailed.
the The difference in the
ng size & means (Mean differencemeans = 0.44) (Mean difference = 0.44)
DO6XSUHPH
, n= 4),
3. Conclusion
3. Conclusion 3. Conclusion
$IWHUFRQGXFWLQJWKHSHUIRUPDQFHDQDO\VLVEHWZHHQ2ULJLQDO $IWHUFRQGXFWLQJWKHSHUIRUPDQFHDQDO\VLVEHWZHHQ2ULJLQDO
$IWHUFRQGXFWLQJWKHSHUIRUPDQFHDQDO\VLVEHWZHHQ2ULJLQDO
and redesigned version the results infer that and redesigned versionand the redesigned
results inferversion
that the results infer that
Errors made analysis Errors for Task 3 analysis for Task 3
made
The result achieved
Redesigned supreme p-value
hasThe
betterof .78
result which is greater
achieved
performance in taskthan
p-value of .78and
time which is greater than supreme has
Redesigned Redesigned
better performance
supreme has in task
better
time
performance
and in task time and
7KLVLQGLFDWHVWKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\1RQ
7KLVLQGLFDWHVWKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\1RQ
LQRQHWDVNRIHUURUVPDGH,WKDVVKRZHGVLJQL¿FDQWGLIIHUHQFH LQRQHWDVNRIHUURUVPDGH,WKDVVKRZHGVLJQL¿FDQWGLIIHUHQFH
LQRQHWDVNRIHUURUVPDGH,WKDVVKRZHGVLJQL¿FDQWGLIIHUHQFH
H[W VLJQL¿FDQWIURPWKDWZKLFKLVQRUPDOO\GLVWULEXWHG6RWKHQH[W
when compared to original VLJQL¿FDQWIURPWKDWZKLFKLVQRUPDOO\GLVWULEXWHG6RWKHQH[W
website. However, it has not when compared to originalwhen website.
comparedHowever,
to original
it haswebsite.
not However, it has not
than test is “tin
changed independent
Task success test”
test
andinisother
Parametric
2 tasksstatistics.
“t independent of test”
errorsinmade.
Parametric statistics.
changed in Task success changed
and other
in Task
2 tasks
success
of errors
andmade.
other 2 tasks of errors made.
QWO\1RQ The t independent testThe revealed QRVWDWLVWLFDOO\VLJQL¿FDQW
t independent test revealed QRVWDWLVWLFDOO\VLJQL¿FDQW
PH differenceLQHUURUVPDGHIRUWDVNEHWZHHQ2ULJLQDO6XSUHPH
Redesigned supreme has differenceLQHUURUVPDGHIRUWDVNEHWZHHQ2ULJLQDO6XSUHPH
got better navigation compared the Redesigned supreme has Redesigned
got bettersupreme
navigationhascompared
got betterthe
navigation compared the
D= (M= 0.64,
LJQL¿FDQW original oneSD=as it 25.3) and
has very (M=Redesigned
low 0.64, supreme
25.3) and(M=
SD=score.
lostness 0.52, SD=supremeoriginal
Redesigned (M= 0.52,
oneSD=
as it has very
original
low lostness
one as itscore.
has very low lostness score.
e
PH0 0.33); t(8) = -0.32, p= 0.528,
0.33);two t(8)tailed. The
= -0.32, p=difference
0.528, twointailed.
the The difference in the
D= 23); t(9) means (Mean differencemeans = 0.12) (Mean difference = 0.12)
nce in the
33 33
5.2 A/B TESTING: SATISFACTION 5.2 A/B TESTING: SATISFACTION
5.2 A/B TESTING: SATISFACTION
1. Introduction 1. Introduction
The achieved p-value in the KS test was .078 which1.indicates Introduction 5.The Report
achieved p-value in the KS test was .078 which Theindicates
achieved p-value 5. inR
WKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\6RWKHQH[WFRQGXFWHGZDV WKHGDWDGRHVQ¶WGLIIHUVLJQL¿FDQWO\6RWKHQH[WFRQGXFWHGZDV WKHGDWDGRHVQ¶WGLIIHUVL
A/B testing was done comparing the original website to the “tA/B
independent
testing was test”.
done comparing the original website A/Btotesting
the was done Doing
“t comparing
independent thetest”.
original website to the “t independent test”.Doin
redesigned version to know if the redesigned version is has An independent
redesigned means
version t-test
to know wasredesigned
if the conducted version
to compare
redesigned
is hasthe versionThe independent
Anknow
to most iffrequent means
the redesigned t-test was
activity undertaken
version conducted
is hasthroughouttothe
An independent
compare
think the means
The
more satisfaction metrics than the old one. SUS
more scores of original
satisfaction and than
metrics redesigned
the old versions.
one. SUS exercise
more satisfaction metrics
aloud scores
than the ofwasoriginal
old one. andon
clicking redesigned
the links or versions. SUS scores of original
buttons(10 alou a
The test revealed there wasVWDWLVWLFDOO\VLJQL¿FDQWGLIIHUHQFHLQ The test revealed
instances). The nextthere wasVWDWLVWLFDOO\VLJQL¿FDQWGLIIHUHQFHLQ
frequent activity users did wasThe test revealed there
to search instaw
2. Methods 2. Methods
SUS scoresEHWZHHQ2ULJLQDOVXSUHPH0 6' 2.
Methods SUS
for scoresEHWZHHQ2ULJLQDOVXSUHPH0
a jacket(6 instances). For example, one participant 6'
SUSstated
scoresEHWZHHQ2U
³, for a
SUS rating scale (Brooke, 1996) was chosen to measure the and
SUS Redesigned
rating scalesupreme
(Brooke,(M= 72.6,
1996) SD=
was 360.54);
chosen t(13)
SUS =
to measure -7.05,
rating and Redesigned
the scale (Brooke, 1996) wassupreme chosen to(M= 72.6, SD=
measure
ZRXOGOLNHWRVHHWKLVPLGGOHMDFNHWZKLFKLVIRFXVHG´ the 360.54);andt(13)
Redesigned
= -7.05, suprem ZRX
satisfaction in quantitaive method. p= 0.00001, two
satisfaction tailed. Themethod.
in quantitaive magnitude of differencesatisfaction
in the p= 0.00001,
in quantitaive method. two tailed. The magnitude of difference p=in 0.00001,
the two tailed. T
Number of people participated - 13 means
Number (Mean difference
of people =35.6) was
participated - 13 large (eta squared
Number0.52).of people Thinking
means (Mean
participated - 13difference =35.6) was large (eta squared means0.52).(Mean differenceThin
Method - Quantitative SUS scale rating Method - Quantitative SUS scale rating Method - Quantitative TheSUS mostscale
common ratingthought the participants had during the task The
The results revealed average SUS score of Redesigned Thearesults
was good thing revealedwhileaverage
they were SUS scoreabout
talking of Redesigned
wellThe results revealedwas
structured ave
2.1 Data collection 2.1 Data collection
VXSUHPHLV!VDWLV¿HGZKLFKLVIDUEHWWHUWKDQWKH 2.1 Data collection VXSUHPHLV!VDWLV¿HGZKLFKLVIDUEHWWHUWKDQWKH
menu with simple navigation(5 instances). The other VXSUHPHLV!VD
thoughts men
I have collected the data of SUS scores with 13 students of our original
I have supreme
collected is the37.1 (<50
data scorescores
of SUS is unacceptable) clearly
with 13 students
I have collected original
of our theparticipants supreme
data of SUS mentioned
scoresis 37.1
with (<50
were scorethe
13 feeling
students isofunacceptable)
number
our original
clearly
of products supreme is 37.1parti
class by using a Google forms survey which has 10 questions showing
class bythe improvement.
using a Google forms survey which has 10 class
questions showing
were
by using a Google less
forms thesurvey
for improvement.
selecting (4 instances).This
which has 10 questions showing
was probably due the
to improvemen were
regarding the usability of websites. regarding the usability of websites. the limitations
regarding the usability of websites. of products shown in the prototype. Products the l
Investigating Individual scale scores Investigating
being highlighted Individual
in the centerscale scores
of the homepage (3 Investigating
instances) Individua
bein
2.2 Data analysis 2.2 Data Redesigned
Comparing analysis version (See Bar chart 2) 2.2 Data analysis For example,Redesigned
Comparing one participant stated
version (See Bar chart 2)Comparing Redesigned
“,W¶VJUHDWWKDW,FDQVHOHFW For e
The SUS scores for each website were calculated by using Redesigned
The SUS scores version forwas
eachfound to behaving
website good characteristics
were calculated The
by using
SUS scores for Redesigned
each websiteversion was foundby
were calculated
PDQ\SURGXFWVIURPWKHWRSFDWHJRULHV´. to using
behaving good characteristics
Redesigned versionPDQ was
a SUS calculator and later I ran some statistics on the SUS inaindividual SUS scores.
SUS calculator and later I ran some statistics ona the
SUSSUScalculator and in individual
later I ran SUS somescores.
statistics on the SUS in individual SUS scores
scores to understand how my redesigned version is performing • scores
Higherto frequent
understand usehow my redesigned version scores is performing
to understand • howHigher frequent use
1HJDWLYH,QRQHLQVWDQFHSDUWLFLSDQWIHOWWKH¿OWHUZDVQRW
my redesigned version is performing • Higher frequent use 1HJ
when compared to original website. • when
/HVVFRPSOH[WRXVH
compared to original website. when compared toshown • /HVVFRPSOH[WRXVH
original until the bottom of the page. This is showing• there
website. /HVVFRPSOH[WRXVH
is still show
• Easy to use • Easy
room to use
for improvement. • Easy to use room
3. Report • 3.Not
Report
Requiring technical support 3. Report • Not Requiring technical support • Not Requiring technic
• Functions integrated well Feeling
• Functions integrated well • Functions integrated Feel
Bar chart 1 SUS scores of orignal vs redesigned • Easier to learn
Bar chart 1 SUS scores of orignal vs redesigned Bar chart 1 SUS •scores
Easier to learnvs redesigned
2QO\SRVLWLYHIHHOLQJVZHUHGHWHFWHGWKURXJKRXWWKHZHEVLWHQR
of orignal • Easier to learn 2QO\
• 8VHUVGRQ¶W¿QGLWDZNZDUGWRXVH • 8VHUVGRQ¶W¿QGLWDZNZDUGWRXVH
negative feelings were detected. They felt happy(6 •instances). 8VHUVGRQ¶W¿QGLWDZ nega
• 8VHUVKDYHPRUHFRQ¿GHQFHXVLQJWKHV\VWHP • example,
For 8VHUVKDYHPRUHFRQ¿GHQFHXVLQJWKHV\VWHP
participant once said ³,DPKDSS\WKDW,VHHP\ • 8VHUVKDYHPRUHFRQ For e
• /HVVHUOHDUQLQJFXUYH
• /HVVHUOHDUQLQJFXUYH
GHOLYHU\FRVWVKHUHLWVHOI´ • /HVVHUOHDUQLQJFXUYH GHOLY
34 34 34
Table 1 showing coding of thematic analysis Table 1 showing coding of thematic analysis
HSDUWLFLSDQWIHOWWKH¿OWHUZDVQRW
the page. This is showing there is still
UHGHWHFWHGWKURXJKRXWWKHZHEVLWHQR
etected. They felt happy(6 instances).
once said ³,DPKDSS\WKDW,VHHP\
metrics showed an overall
ility of the website for the chosen tasks
ements has brought a positive impact
HVDWLV¿HGZLWKWKH5HGHVLJQHG
35 35
6. CONCLUSION 6. CONCLUSION
What was the biggest improvement? What was the biggest improvement?
• I would say the biggest improvement in the redesigned
• I wouldversion
say thewas
biggest
to make
improvement
the navigation
in thesimple
redesigned version was to make the navigation simple
DQGPXFKHI¿FLHQW DQGPXFKHI¿FLHQW
• Imparting search bar and Top level navigation•menu Imparting
has mad search
ethe bar
navigation
and Topquicker
level navigation
and it wasmenu has mad ethe navigation quicker and it was
the reason to reduce the task time effectively. the reason to reduce the task time effectively.
• Next important thing made was including the top • Next
tasksimportant
like sizingthing
information
made wasandincluding
shipping the top tasks like sizing information and shipping
LQIRUPDWLRQRQWKHGHOLYHUXSDJHLWVHOI2QWKHRULJLQDOYHUVLRQWKRVHLQIRUPDWLRQZHUHRQGLIIHUHQW
LQIRUPDWLRQRQWKHGHOLYHUXSDJHLWVHOI2QWKHRULJLQDOYHUVLRQWKRVHLQIRUPDWLRQZHUHRQGLIIHUHQW
pages and they were so cluttered. pages and they were so cluttered.
36 36