Dr. Wickliff,
To the best of my knowledge, my final edit of the document provided for this project
‘meets the goals and expectations of the primary audience. | believe that the authors will
benefit from my work and the quality of their document will be improved, In the process of
proofreading the document, I was able to find and correct a good deal of typos. There were also ~~
some significant formatting issues that lower the quality of the document.
I didn’t encounter any real technological problems while editing the document. Overall,
Iiked the Adobe software and thought it worked nicely for supplying the authors with
suggestions. The only thing that | feel limits the software is the fact that there is no way to mo
actually make the edits themselves. This may simply be due to the fact that the document is in
POF format, but actually making the changes would make things just a bit easier.
Most of the changes | will implement for the final portfolio will address the significant
formatting issues present in the document. These issues drastically affect the readability of the
report and changing them will be my main concern. | may need to reach out to the authors and
clarify what the intended format is in order to effectively fix these issues. Other than that, | will
simply go through and make the changes that | marked in this assignment.
Thank you,
- Cody DennardRachael Winterling
‘J. Murrey Atkins Library
University of North Carolina at Charlotte 9201 University City Blvd
Charlotte, NC 28223-0001
Saad
‘We would like to thank Rachael Winterling for visiting our class. She supplied us. 4s yd
with useful background information and helped us to do appropriate user tests.
task was assigned to us by Associate English Professor Dr. Gregory Wickliff as part of
our class ENGL 4181, Writing User Documents. Our goal was to analyze the usability of
the Atkins/ WorldCat Local interface by observing the successes and difficulties of ah.
UNCC students searching the system for texts. ae at Chordata
The findings presented in our report reveal that UNGG-students did have success
in using the interface, but there are many areas that caused frustration
fon. We suggestyith certain modifications Jape Gat can |
interface easier to maneuver iq (pr new and non-frequent users. The following are the
issues that most users came-upeR hile using the interface.
Sol
Filter function in navigation bar is cumbersome
‘Icon choice for source citation iq fnbiguous
Text overloading made finding information difficult
‘We feel that finding @ galution for these obstacles will make a more simplistic, Re a
‘experience for users. 7
Sincerely,
Michael Berthold & Chris Huff }
Authors gt
ee > vt 3
ff al
oc | to
pp #Summary of Comments on Report v2
Page: 4
[ema Ae oma
Lo
‘git: dena
‘Suse ead Tear 9, 02 PH OST
‘Sibjgc Sky Noi Ont 026, 08:2. 2500
yet sues sn
Qherahescesa_npcinmna ros ta nuh
fits suas ening om vagimo
setae) Sat votttat om sonzsesn ae
Ie
[jour 7A word
parce grater
aoe
Sioa Coes Ou oma 32/6, 7.1856 FAL 0500
Spook meted tox ate 22/6, 434 FM 500)REVO ALO ela
WorldCat Local Discovery: The User Experience
Eventing Books | Arttes | patabases| Journals | ovidoo
Search for books, atcles, journals, media, and more |
fe BETA Search ‘Advanced Search
Understanding the User Experience Through Interface Testing
By:
Michael Berthold
&
Chris Huff
ENGL 4181
February 29, 2016
Submitted to:
Gregory Wickliff, Assoc. Professor of EnglishExecutive Summary
Our lass thie semesteg Bpatsh 410 wring Userocuments gpformed a series of weetesh
on the functionality of the WorldCat Discovery beta site.
ris EREWVESIBSHOHRERENNB J. Murrey Atkins
Library [cated at the University of North
Carolina at Charlotte!
The issues that we
have cumulated [ap silts of a series of
usability tee Parformed by UNCG idents.
1. Filtering search results.
Upon using the interface, many
testers brought-up [ifficulty in filtering
individual subject matter types. These
include e-book, paperback, [ard copy.
Most testers also vocalized their frustration
a=. interface, bareference to ij paloading
after unselecting a subject jnatter in the
filter. This issue led to a wastéflime for the
user because of the load time it took to
refresh the results, ">
{
Heras! a
2. More distinction between the
different categories after results
have been found.
‘A problem arose while trying to
find the physical location of a book.
‘The testers complained that there was
Glen an abundance information on
the screenshatitawae,[ijrd to navigate
through all the text.
3. Citation feature is difficult for new
users to locate.
euserwas-attompting faite the
source Eipy offen had difficulty rere
the particular feature was located on
the interface. The icon used to cite is
not intuitive for new users to locate.Page: 3
[Norber tauher ndsonerd Sues Comment Tox! Dale W276, 7504 P0500
‘Capital "Documors als.
[T)Nerber 2Auner wésenaid _Subjeet rsorod Tex Dale 9018, 74409 PM 0800.
(ber Aur wdsrnard Subject ori Txt Date 90/16, 745.12 PM.0800.
[x]Sunber ¢Aunor wdeonaed Subject nsones Tox ooo 32/6, 7:45:51 PM-0500"
sabi tis
(gMunber sAuthor wdonnard Subject. Commer onText__Outo 82/6, 7:48.22 PM.O500"
This eos Thea cif on Siero re est The paragyagh. Als, t should be These Wess" Youpoviaod Up a
[]Munber GAuther: wdemnand Subject Inserted Tet Date 326, 74894 PM-500,
(g]Menber 7Autorwdermand Subject. Cross Out_Oata- 22/16, 74850 Pid-0500
(giNurtar 6Autor demand Subject Commenton Text Dal: $0/16,7 50:0 FM 0500)
‘Tis seranca’s sil urceetToeiove el you ray have mea fo pul Uso" Vislead dt usabi7_BT ca bow
Number Ghuthor wera _ Subject nseed Tet Date 3216, 7:40:55 P- 0500
[g]Munbo: 10 ___Auor-wdemars Subject: sored Toot Dato. 2/6, 7:51:10 P0900
‘Obsoved
[p)Munboc 11 Autor womans Subject. Ineoriod To_Date 2/6, 75228 P.0900
[]Munber 12 Author wsennaes Subject: Cross Ot _Date 3276, 6.0025 PuL-O500"
[gMumbe:13___ Author wéemant_ Subject nserid Tox Date: 20/18, 789.04PV.0500
‘os,
[lMontec 4 Author nennand Subject nsotes Tet ___Dale 36, 80082 P¥-0500
eran
WMumber 15 _Auhor wend Subject sated Text ___ ate: 2/18, 80010 FM Os
‘UNG Chara
(Number 16 Author wenrard Subject: Insed Toxt__Daly- 226,801.23 PM. 050.
“Tris med T
[xjNumbec 17_futhorwéenrard_ Subject: Incr Text____Date- wan 6, 75428 PM 0800
"mpentoneg@f encoun” meh be AT Tae eandeeEUEENT
(Number 8 Author wdonrard Subd: Cross Out_Dato: 12/6, 75448 P0500
[plunder 19 Auer wéenrard Subject: ingertod Text __Dats 3276, 55:05 PM 0500
‘at
INumter:20_Auhor:ndennard Subject Insred Text ___Oato: 16, 80224 PMO 00"
"on usar aopied
Nunter:21 Au ndonnard Subj nsrod Text _ ato: 9/6, 6.0269 PM0500"
{uJMunber22 Author donned _ Subject seted Text ote 36, 6025 Pe as
‘ning
(glNumvor:23 ura mdonnard_ subj: narod Text Date: 9216, 7:85:28 PM 2500
‘nth
(qdunber:2¢ Aur ndonnand Subj: ised Text Date: 926, 75:54 PM2500
(GiNerbwe 25___ Auer donno _Subject: seed eat ote 526, 75:26 Paso
‘arty
(pheno: 25 une mdonnars_ subject Cross Out Dao: 2116, 75807 P0800
Comments from page 3 continued on next page
eeExecutive Summary
Our class this semestey English 4181 Writing User(@ocuments performed a series of weortoch
‘on the functionality of the WorldCat Discovery beta sit,
(TRisRestWas|PerorMeMANIN® J. Murrey Atkins 2. More distinction between the
Library located at the University of North different categories after results
Carolina at Charlotte campus. have been found.
A problem arose while trying to
The issues that we find the physical location of a book
have cumulated are sesults of a series of —_—_The testers complained that there was
usability 4ee4 performed by UNGG, students. such an abundaneg of information on
the screen-thatitwag hard to navigate
1. Filtering search results. through all the text.
Upon using the interface, many
testers broughtua difficulty in filtering 3. Citation feature is difficult for new
individual subject matter types. These users to locate.
‘would include e-book, paperback, hard copy. iFuserwas-attempting to cite the
Most testers also vocalized their frustration _sourcg they often had difficulty, where
‘e{the interface.in reference to {reloading __the particular feature was located on
itself after unselecting a subject matter in the the interface. The icon used to cite is
filter. This issue led to a wasta fie for the not intuitive for new users to locate.
user because of the load time it took to
refresh the results.[H]Munbe: 27 uh tormard Subj med Ten ute 32716, 757 08 Pw-C500
otHB,
Table of Contents. 5477 vf
ce?
Executive Summary |, | ae . i
Introduction and Methodology 1
Key findings 2
1. Filter function in navigation bar is cumbersome, a
2. Icon choice for source citation ambiguous, @
3. Text overloading made finding information difficult.
Conclusions and Recommendations 5
AppendicesPage: 4
[RINztBar Avon wom — Supe Hosted Tox Date 9216, 60938 PH 500,
(q]Nenber2Auhor ndoonard Subj: sete Text Date a0'6, 80337 PM-0sc0.
w)Munber SAuthordennard _SubjcCommartenText__ Date: 32/16, 8:06:50 PM.0s00
ight bo AdKbo Fedor, bu tol lam Pre bos Raa ore olor an holes 2 Ago, rao sare at ha words Usor w oagh tana VOT
‘lanes wihona anther Fay, ro make sure he urdenes dent run over, ihe the fst em (User Test Observe)Introduction
For OO cs now, the J.
Murrey Atkins Library has been using a
search feature for finding scholastic
material called WorldCat Beta local. This
search engine is designed to allow students
and faculty to look up reference material,
much like g fJoogle search engine interface,
but without erroneous information being
inoluded. The library's focus was to allow for
uick retrieval of information without the
‘cumbersome Google search query.
After the third party search feature
‘was introduced, a number of users, including
faculty and students, were conducting
usability tests to report ane groblems with
the interface. These problems included
anything from trying to find major bugs
logical format errors introduced by the
system. According to Bur English 4181
professor, Dr. Gregory Wickiff, previous
usability test results were submitted to the
WorldCat Discovery creators, only to-ting
interface, f]
This semester's 4181 English class
provides a continuation of the usability tests
tolBither reaffirm previous findings, o-even,
find new problems
reveal with additional testing. A total of
five student:
graduate-student participated in our usability
study and provided beneficial feedback of
their experience.
Once the tests were completed, each
taster, fips asked what they would do to
improve the navigation of the site,
Methodology
The users were recruited mainly
through word of mouth communication or
through email contact. The usability test
was conducted by two students: Chris
Huff and Michael Berthold, Since our
group was small, we had to take on dual
roles when performing the tests, usually
by being a reader and note taker at the
same time, as an example.
The test duration was designed to
last anywhere from five to seven minutes,
We concluded that our testing questions
should take anywhere from a minute or
less, with room forgiven extra time in
case the user was still deciding how to
‘complete the instructions. The testing
was performed on our own laptops that
used a webcam to record user facial
expressions and also to provide screen
capture for recording their interface
navigation. We also expressed, as a final
disclaimer, to each tester that we would
not provide any help for showing them
how to complete a task, Instead, we
provided clarity to the question or would
ask them their thought process along the
way if we discovered they looked
stumped.
for example. We asked the users to cite
a particular source and every tester
experienced a great deal of frustration
trying to complete that particular task
1Page: 5
[Hjiunbax tAchor wasoned Subject Commertan Tot Date 82/6, 65605 PM O50,
‘Dont ow where this west blangsin be decir.
[Number 2Author wdernand Subject: cossOut_Dale-2/6, 6:07 28 PH 0500
(tue: nnet ins a a |
is
fei inaiceard “adieu Wier em teaae |
ir
(gRMacshunec nerd unserer Td oa: 92, 00821 PH-0s07 i
ntti wd cs oa songs ie |
(Peer nemesis oes sn uc |
THD a ee Taso ei COMES RT RST YW aa NA DETTE
(MMe enor ura unc Ones OF Oana, 669 PH-0500
GeectAteceirn)_ peti Geto te ae |
ina
[piManbo: 10__Auhor dena Suject Crose-Out_Oats: 216, 1745 PM 05007 if
Aino wiowert Speco OM Ot 926, 21750 FH A550 |
(_Mmect2 Aborted Sie Cose.ou at 9268 19S8PU.A5C0 |
(atin: o_tnarworrrd_scConmanen et _on976 22004PH.0s07 |
ans a
(GMminc 1 Adbacadornd_stc xt 8 03 P0500
pate
(gNiminc 15 Adbocndsrand_ sac Coms.Ou Oat 200419 F. 0500
(gNmecie __puecndonnd set eos Ton ow 26, 5900 P 00
ar Wy
Nunta? Arden Sic ty et O96, 65704-2500
‘These two pages a very faa ftom Ths our break ake i oo el whore one selon end ad anne bagi The SRC ey Tad,
andmethoglogy should each bape ona new pape‘enhancement fy make searching references
easier. They were also given the opportunity
provide general feedback about their own
Higeiond experience and what they liked
or didattika Ghout the interface. Once the
data was collected, we reviewed the
recordings and evaluated each user to
compare how the testers performed f
on our questions. The data was tabulated
based on key factors we bit deemed
important to the functionality of the site.
Key Findings
) Problematic Interface Issues: Filter
function in navigation bar is
cumbersome, i
One particular user was frustrated with the
filter option in the left hand navigation bar.
is video recording did show some
and lip tightening as he was
trying to filter out the option to find an e book, [
we requested. He noted several times how
the feature is “slow to load the page” and, [7]
“wy Thave to uncheck each filter option
singly?” He was upset that the filter option
keeps reloading the page after every un-
check is performed. This was a very
remarkable finding from our user and, ff it
was an important flaw in the interface.
Based on our own experience using the filter
feature, we felt the searching was
cumbersome because all selected materials
are set to default.
2. Problematic Interface Issues: Icon
choice for source citation @abiguous,
All of our users experienced difficulty
One user even asked after a good
amount of time passed,
“dll Gpu mean you wanted me to cite it
outloud?”
Obviously, this part of the interface was
difficult to pale) ce the user
discovered the rig Fae get to the
citation feature, they were able to finally
complete the task.
3. Problematic Interface Issues: Text
‘overloading made finding information
difficult,
Several users noted specifically thal Gace
the referenced source was located, they
had difficulty finding an author or
publisher because the text seemed to
“blend together’, {qj reported by one user.
He noted it was hard to find the publisher
because there was too much information
read in the results section once the ttle
fas found. We found this to be an
interasting complaint about the feature
and ile found givjer users exper
same problem. Perhaps adding a filfer
reset option for the searches could be
implemented to make searching faster for
the user.
locating the option to cite sources using APA, Ea}Page: 6
[Nunber Auhor naomnard
‘andor ay suggestions
(x]Nunber Autor: ndernand
be
[x]Munber Aur: wdennard
(Mumer- «Aur wdonmard
‘asked
[g]Munber sAutnor:wdernant
"aso" or avigai” might bo Gai
prt mun ras
at
(pea 2A wr
(gMinte thir woman
(inj unborn dormers
Sobek eoiod Teak
‘Subj! sorted Text
Subj: nsred ext
‘Subject: Insane ext
Subj: nsred Text
Subj: nnd Toxt
Subject Gross ou
Subic: Commarton Text
arrows idoion fo cars sloney wih tho ofertas.
Subjgensered Tost
Date 92716 82010 P2500,
Date 9216, 0:24 PM.2800
Subjso Cross Out_Date: 92/16, 890'83 F-08500.
aw 372/16, 83051 P0500)
ate 326, 9:00:90 P0500)
Date 22/6, 904.05 P0500"
Date 32/6, 8:53.09 P0500"
Date 906, 028129 PY cs.
Date 32/6, 8:35:58 P0500
aw 97276, 00536 PM 0st
Subject nsored Tost
ave 92/6, 5401 PM 0500
‘chor wonard__Subjoet Sticky Note Dato 32/6, 8 4849 PM 00
Subject inserted Tox
ate: 22/6, 0055 Pe. asto
Subjoct Comment en Text
Date 32/6, 6 50:23 PM-Ost0
‘Subjoet nerd Tet
ate 9216, 51:29PM. ost0
(gMumier 10 Au: wonnard
[xjtumber tt Aor: enna
Numer: 12
“Tyo rarain Gombe wihindoion ab0ss sectors
(jMumbec 13 Aur: wena
Number: 14 __ ror: wdonnars
Does need quaaTans
(gMumer 15 Aur wdomard
‘sbock
ust for canistncy trughout he document
Subject Cross Out_Date: 32/16, 9.0825 P0800.
(Mumee 16
puntos
oes
ahoe winoars
ues wnoars
Date: 926, 85207 PM.05t0
[g)Mumber 18 ___Auordennars _Subjoct sored Toot __Date 3216, 905338 Pn-0500
‘hat
[Numer 19___uorwsenars _ Sutoe!nserad Tox Date 3276, 90835 Posto
‘xporenced
fgMunbo: 20 Autor: womans _ Subjoet. tgs Tex Date 9216, 0529 P.ost0
‘Wy
g)Numier21___ Auer wdennars Subject Insred Text ___Date-2/6, 85:13 FM. O50.
ye" oF hey
(qiaume:22 Avtar demand Subj: Isr Text Date 326, 853.48 P0500
(qiNumoer25 Autor wdonnard_ Subj: nore Tox Date 326, 85410 P0500
(p)Munbe:2¢ Avo wdemmard Subject IneiodTet__Dale: 91216, 88840 PM. OSTO
of” AConclusions and Recommendations
cm
ox sno tt fiter option Gong
with the citation felture, ghould be a focal point for
improvement for the Workicat local beta site
Break up the information on the page into
categories
Research shows that eftendime formation
(on a page that is all the same format can be
overlooked. We recommend when the
search results are populated that the
information is divided up gping a quadrant
stylafhith separating the Information with
whitespace. This val own benef the
user in scanning the page and being able to
locate the information iqg faster pace
Create a way to unselect all categories
‘We would recommend te-creata fajink button
that would deselect all categories in the book
filter. Ofter-timegfizour test users would
become frustrated because they would have
to deselect every single filter fanen it would
just be faster to deselect everything
select the filter they desir i
Create a link for citation on main page
(QABRURRES users who are using the
foridcat site will be-requiring-come-acpectof
recommend te-have, fp link
more visible on the interfacg, Ech as by the
search bar, That way users will easily find it
and not become frustrated i fring to find the
button that might eppeas palden to them pyPage: 7
[Meter ation wnnard— Sujeot heared Tox ‘Dae aFG6, 70547 Pu
[Number 2autnor donned _ Subjoet sorted Tox Date ar6r6, 7.0552 Pk
[xjStunbor sAuthor wdoonaed — Subjoet sod Tox Date aet6, 70843 PAL
olntees,
(]dunber ¢Author wdennand _Subjoct rsnriod Text ___ Dat 66,7003 PE
(Munters Shor wdornand Subject CoseOut_Date: 316/16, 70042 PM
(qunber 6Author demand Subject: InsoriodToxt___ Oat: /6/16, 700557 PL
(FMurbor:Zautor wdommard Subj Cross Ou_Dal: 316/18, 70088 PM
(R)Nunber Bute udornard Subject: Inserted Tet Date: a6/6, 7:90:14 PM
e
[A)MunbeEOAU wdornard Subj: sored Tent Date 366, 7:1020 Pm
Numba 10x nad Subject nsared Tet Date: 6/1, 71038 04
reaing
(jiunbor tt Auer-wdemnard Subject Cross-Out_Oate- S161, 71130 PM
[x]Munbor 12 Aur: womans Subj: ented Text ae sr66, 71:17
‘Otentmes,
(Mumbo: 13 Autror demand _Subjoet Cross Out_Date st66, 7:12:00 PM
(gMumer furor wens subjee! nsred Tat Date a6t6, 7:11:55 PM
(q]Munbox 15 Author wseonand_Subjoet neoriod To_Date: 1616, 71226 PM
(q]Number 16 ___fuhorwdorraré Subject Insta Text ____ate-16116, 71232 PM
(Noms 17_Auther-wtonraré _ subject Conmont on Toxt_Oatu- 9/6/16. 7:1831 PM
"Ye igh SVT Sedat a rer Tae, ett eouc8 TNC.
Number 18 _Auhor wena) Subject nseredText alo: 1616, 7-15-15 PM
qe ciation,
fxNemec 19 Author woerrard subject nseed Tost __ate-a6/16, 71528 PM
rave
[Mumbo 20____puor wena Subject: teered Test__alo- 4616. 7.1804 PML
[xgNunter21 Author weennard_ Subject Insered TestDate 2/6/16, 71608 PM
‘wen
fgNumeer 22 Auber wena Subj: heotes Tost___ Oo. a616, 7.16.17 PA
be
[piNunber 28 ___Auhorwennard Subject: sera Texk__Dats 0816, 7:18.21 PMTo Biver ie bseratins ==
ete
inane book oma,
et |uere ee fs oes
Taaion [samsie[owmane iiss amie ase
anit 7 7 3 7 7
eine
ese
featneest
Rema [aan pmcoome sate Yates ingen tene
Pecaeteet [man [sooo sean se as
font [eae ace merseee_[toroewsonme | Bay
Topewias [aro __[tisuaetet nndesaning [emtert eg rand apensne [emotes
eevee
Tate 5 7 5 7 7
tee
etn
Soa
ees _ Some ce
Decivia [cate tounieaene [Hownivemou |aatiewa nanennuaensatona
cihtyerontcocine, | sacpacs ear
teen
Wet [tie minotmesnatennig sre | ts ong ol tan ind wa ig Tome
cat vivetnsbynn[ottenocten teria mgeontebaencasn enone
cae [tersoany ssi scone
sceorerte
etedioons
eee
Vier? |e milvgionste pint |e teuns avar | vet amino cn bot voi epi ve
Beversischeren rs |veresceteaes | Ramen ace ay cece ieioamasan tote
lectus cnc [cc moaatoeet | ne fic ciate
eectaa urisoaec 9 |iomnmeaicae
fies mote bt
sas | urtodntiostncmcng | srhodoi rar oe compa Sa joerg Cain
Shea ton teaser Caconion|petomagt abst fine oO
atte wemadseer ct” [adconpantate
ncincchanicecion”[iedomctmsete
me wa nae
fiat |omrotromasmempcne |vartadvaaie [Ua indotalyntearstow oa tetod. Wiese wero
hetektocte he tated te batan wes itiers [userhasnousesincomplcing —[Userhadinesim User fovn the ctoaba sated ta the proces wast tive
ie tsttask bt eampanes ofa | ingen to
the word vont onthescreen” | categorie it atoan e-
Back states ns ne
proces ot very
‘Appendix C: User Time Completion
®
| i
5 il
2
Wi Usor 1 — Usor2 User ml User Users
sounuyy ul oun,References:
Usability Test Participants:
* English Graduate Student, UNC Charlotte, 2/7/2016
* Computer Science Undergraduate, 2/10/2016
* Computer Science Undergraduate, 2/10/2016
* Computer Science Undergraduate, 2/10/2016
* Biology Undergraduate, UNC Charlotte, 2/12/2016