Grayson Collins
English 4183
March 23, 2016
Assessment
State how well the edited version meets the goals of your audience, your instructor, and
yourself. Note the major informational, rhetorical, and technological problems you
encountered and how you attempted to overcome each. Look ahead to changes you might
want to make for the portfolio version of this work to be submitted at the end of the term.
Project two was to edit the Usability Report that students in Professor Wickliff’s class wrote.
The Usability report was testing the WorldCat Discovery Interface that is used in the Atkins
Library, The edited version of the Usability Report meets many of the goals directed to the
audience, Professor Wickliff, and myself. Throughout the editing process, we came across many
challenges. Although the content of the Usability was well written as directed to the faculty at
the library, the creators of the interface, Professor Wickliff, and myself, there were a few
problems with repetitive statements and formatting errors. We noted where information was
repeated and deleted some wordy sentences. We also looked at formatting and noted that the
formatting of the figures could not be viewed. Overall, it was an exactly report and conveys the
message needed.Usability Analysis of the Atkins Library
WorldCat Discovery Interface
By: Brooke Johnson, Joseph Samson & Sabrina Terry
February 23, 2016
‘Submitted to:
«Rachael Winterling, Usability Coordinator
‘* Gregory Wickliff, Assoc. Professor of EnglishSummary of Comments on Microsoft Word - Formal Report -
Final Edit-2.docx
Page: 1
[EOL IAutor orpeonconns Supa Gone Ten Dale. wee, SABE PE
‘A number is not needed on the tile pageExecutive Summary
Qurctass ENGE4H8+ Writing ser Documenta Phalyzed the beta version of the
WorldCat Discovery interface used by UNC Charlotte's J. M, Atkins Library. To examine
Ghertd cat Discovery interface, our group recruited a total of five undergraduate students from
UNEG,Fheh of whom were from various majors on eampus, By reruiting individuals from
different majorg freempus we lessened our chances of having skewed or biased results. We
used the software Morae on a laptop to record each participant's experience. Morae tracked each
person's mouse movements, verbaly/EM nonverbal communication through the provided! webeam
and audio recordings, Throughout each participant's usability test, we selected two people to act
as the observers and one person to facilitate the testing.
There very Cfow ponsstent problems that each participant encountered when navigating
the WorldCat Discovery Interface. All five of our participants didnot successfully complete task
QURRBER wo or six of our task-based questions. Task two involved locating the Sage Premiere
2016 Resource (Get it! function), and task six involved determining how many languages a
particular book is CARMI Aer examining our resus with More, we discovered that certain
AN
fonts, images, and icons throughout the interface seemed too small. The small size caused.
participants to be unsuccessful in their completion of certain tasks. Second, the HAASSBEIIINB o
‘words in the search field caused the results to drasticallEHAREOUENED leaving out just one letter
‘caused problems amongst our usability tests.
Based on our usabi
ly tests, our group recommends enlarging certain text and images on
the Library’s site or writing a short reference guide instructing users how to find resources that
Be-commonly cause problems,‘Sapa rose Oo ale 2/6, 60ST PM OSOO,
iti pein siti eased sor
iin chirps "enero eee
SE a wang Beer Osearone,
sda teatra 1 adel ech a ene
rr
Biljana 1 fours
‘University of North Carolina at Charlotte (UNCOL. gyal 7
Ghee sicncounidin tes Oasis bic asain,
(inet ssnss! ii i. "wi ara toe
fecwsdre geen ais Sicha. | Sadana Rete,
re ea
a at coh sea ore
fies eeacea "sha bcact ta fae as
‘numbers:
Teg “Hacc” wi an ea-aselemsna
apa
Gasset herd: because st
‘change; even.
[turbos 12 ___Auttor-grayeoncoing __Sujae-Gross;Out_Dato: 22/6 8:14:47 P2500Table of Contents
Executive Summary ......
Introduction
Methodology .....-..:sessessessseee:
Participant Performance
Key Findings
Figure 1.1... Thies..Fansnet. _
Conelusions and Recommendations
Appendix...
References ..
il
ffPage: 3
‘liner 1Aumon gysonconns —__SujevL Commeraan ed Oats 766 68508 PM
These figures can not be seenIntroduction
we
UNC Charlotte's 1M. Atkins Library introduced the WorldCat Discovery gatalog in
preparation for its student and facultyWedy. However, the interface was still in its alpha and beta
stages. The Atkins\BREB) noticed the flaws and decided to put the interface through a number of
trials and tests for improvement.
In collaboration with Associate Professor Dr. Gregory Wiekiff and his ENGL 4181/5181
class, Writing User Documents, the Atkins Library allowed us to perform usability testing with
the beta version of theSVerldGatBiseevery interface. This is for the purpose of testing how
usable the interface is for students and faculty on eampus,
Before we conducted the usability testing, ISAbiN GN COOrainalO RACHAeI WinTSEIAg)
visited the class to discuss WorldCat DiscoversSi@1 @lationship with the Atkin Library interfaces]
and the number of topics to explore for usability testing. Whe group-used Morae-e-video
recording software: Winterling ead wsy{@ugh the format ofthe software and the Online
Computer Library EUMRIMEHEGS, We asked her questions about the subject matter and she
answered everything we needed to know about OCLC and WorldCat before starting the tests.Page: 4
[Minter tAchor gmysoncling —Sueel Cross Out_Date 9/10, 61745 PM C500.
ont
ftinba:2Auho amsontns ec Cormenten Teel _ Dat 966, 65529 PH
am Sub 6, 4 Gat ed weet
brary
(atmecshute gmrcana supe Goss. Oa: 100,057.59
ume: tasatininsins Suc: Curmer.nYod__on- 08 79017
Rachel Winterling, the Usabily Coordinator,
fgNiatacsAutocoorins ac Gowranton Tet Oa 08,8914 P0500
(BNbecoAutocsemsnins ica Test__ sn 104800421 P-0507
She discussed the
(BNMOcPAMegmsnins Act uo Tet__Oxn'108 ats.
Womeiehstargarnalis Sec utes Tot___oa: 2126, 60040PH-0507
[Nate shu gmonotns se GossOx Os, 00229 8500
Fino __Adhorgrysnsins ut mara Yot_ ea 201037
‘the class
imparer.it __rmocgryeoronre _ sun Conmntenent_oaw:ans resem V~
(OCLe)
Nanton 12 _Autor.grayencoting _ Subject. Coss Out_Data- 82/6, 8:34:52 PM.0500VV
Janguages-ete: ott epee’
We reported these findings in order to assist Atkins Library and WorldCat Loerie
providing viable solutions to resolve the technical problems undergraduates and faculty run into,
After examining through the details of this study, the report can suggest way's to make the
WorldCat Discovery interface more focused, less confusing, and less intimidating for the
University’s undergraduate and faculty users,
Methodology
Hey ‘The usability tests allowed
Risacts Fron
for us to analyzaqindergraduate students from various majors, and to compare and contrast if
their major impacted their level of familiarity with the interface, Dye -ased-the software Moraeto
verbal-and-nonverbal-behevior-throughout-thetesting-proeess-During the usability session, there
\was at least one note taker recording the user's words, facial reactions and their body language.
‘We conducted six ta 1¢ participant's knowledge of the following:
fccess description of the item
Task ae an) see if the user understands the Get I resource
‘Task 3: To see if the user can find an eBook version of:
tem
Task 4: To see if user can access an online article
‘about the book's location and date/edition
‘Task 5: To see if user can access general informati
‘Task 6: To see if user can access how many different languages a specific item is distributed inPage: 5
(ENAMEL LAUT payeencling ———Suesl Gross Out Date: S216 89578 P0500
[Minoo 2h gayeoncolins Subject GrsOut_ Ose: 30/16, 7.9242 Ht
MUMer Shur gaysonclins Subject Gress Out_Ot AN8/8, ORSP PAE
irjRunbaranutrargrycencoing Subject Cross Out_ Date: 66 205 40 PMParticipant Performance
All of the users were able to complete four out of the six task-based questions and there
were no general difficulties in navigating through the beta website, Problems encountered with
task two and task six will be explained further in the next section.
The average time ofall six tasks performed per user was fen minutes and forty seven
seconds, The graph below illustrates how long each user took to complete all the tasks.
Ta AU cate Ue
z
8
f
A
eee
bal ed
Figure 1.1
Key Findings
Got It! Function
With all six of our participants not being able to complete task two, we suspected that
something was wrong. We edited the task question after the first participant’s performance in
hopes of making itQiBHBE)As we continued with the other participants, we noticed that it did not
make a difference. Prior to taking the test, we asked the participant
‘among thenmthey-were-asked Hleir overall cS FormerPage: 6
[Nunbor 1 ur gaysoncolins Subject Canvnenton Text Dale 16/16, LONTO PM
‘more clear
[xlNuntex 2Auhor:grayeoncotine ___Subjac insert Text ate 92216, 8449 Pasco ee
‘aboutfamiliarity withthe Atkins Library Catalog. our outof-ive-partoipants- answered yes: None of
them claimed to be experts of the interface, but instead stated they would occasionally use it to
search for resources pertained Blassignments given in class. With this information, especially
after the first participant, we tried our best to ease task 2 question, but as stated earlier it did not
make a difference for the other participants. We pinned the problem to the library catalog not
providing any indication of the Get It! Function to the user, When the user's cursor hovered over
the icon, the icon to the Get I! fhotion did not appear to the user, which made it hard to
recognize it asa link. Most users were just one step away from accomplishing the task if they
only knew about the Get It! resouree,
Below fAigure 1.2 illustrates how small the “Get It!” icon is and how the icon did not
indicate that it was a link to access the journal,Page: 7
[i Mumber 1A praysonanins
Number: Bauer: raysonootns.
poriaining
()Munber sautnr-prayeoncoans
F
(eyeneccuncemaas
(pNuber SAuthor:raysonootns
“This figure is not displayed
Bubjeck Goes Oa bale GANG 6482 POUT
Subject nseed Text
Sujet Comment on Text
Subject Comment on Text
Subp: Comarton Tet
Date-anen6, 705 PU
ono: 9/16/16, 70550 PL
to: 16/16, 70608 PL
te: 16/6, 64424 PAL‘The library catalog was inefficient in communicating what the function does. Lateg hen we
finished the usability tests, we performed a website search on the catalog for the Get It! function,
and nothing popped up indicating its use.
Appearance
All five participants clicked on many links for information that was already posted. For
example, on task-fivg Bers were asked to locate what floor in the UNC Charlotte library a
particular book was in and to find what Date/Edition the UNC Charlotte library holds. Once the
user searched the title to the book, it was listed as the first result and all the information was
posted right on the link to the book. However, the users clicked on the book’s link to complete
task-53 5)
Figure 1.3 illustrates how the font size is very small on the link to the book, which
resulted in the user not being able to recognize all attributes of the book posted as additional
information on the link to the book. Participant three stated “the teximages could be larger.”Page: 8
[T)Sunben TA prayeoneotng
Number: 2a: uaysonolins
Task Five, users
Number: sauna raysncolins
Task Five
Nuts ryaoneoos
This figure isnot displayed
Sock ones Ta
‘Subject Inserted Text
Subject inserted Text
‘Subject Commanton Text
Date S66, 7O6aT PE
Date: 96/6, 7.0790 Pik
Date: an6i6, 70756 Pu
Date: 2/6/6,64720 7Every time a user clicked on the link to a specific item, there would be dree-Heny GPtail
tabs as follows: Description, Edition/Formats, and Availability@-Holdings. Most users elicked on
the book’s link, and still had difficulty in locating the information needed for task five because
the three item detail tabs did not pop out at the user. There was a play symbol next to each tab,
but that was not a good indicator that the tab was a link, Even after figuring out that the tab was a
link, the user could not spot the information they needed because the text was too small ot the
page was cluttered, causing the user to overlook the objective of the task.
Figure 1.4 illustrates how the three item detail tabs do not pop out at the user to click on.
‘They had a play symbol next to each tab, but that is not a good indicator that the tab isa link,
V
Fgae 14
Also, when a user would try go back to the item search page by clicking the back arrow,
it would redirect the user back to the main search interface. This is because the user was
supposedPage: 9
unter taumorgaysoroome
‘hree-tem
(g]Numvor: 2auor grysorotns
Number sau grayeoncoins
Can't see the figure
‘Sues seed Tot
‘Da a676, FoR Pw
Subject Gross Ou Date: 36/6, 7.0001 PM
‘Subject Conant on Text
ate 31616,7.0059 PHA
4
v
aeto click on the link at the top tight that says “close item detail” to return back to their item
search. The reason most users were unaware of that was because it is written in very small text
and the page itself was too cluttered for the user to identify the item.
if Figure 1.5 illustrates how the close button is too small and this creates a problem for the
(airs just want to go back to their search results otherwise by clicking the back button the
‘webpage will redirect you back to the main search interface,
Shiga ns 1
ary catalog is cluttered or has too many options to do one
When a website such as a
thing, it ean overwhelm the user. We suggest keeping the website simple so thatitcould be easy
to navigate tours maybe enlarging some of the text to make things easier to wnt | ee ie
Inconsistency
‘The inconsistency within the library’s catalog made it hard for some participants to
complete tasks. For example, when participant four entered the title of the first task in the search
bar, he accidentally misspelled one word in the title. This completely changed the search results
far from the expected results. The book was nowhere to be found and the userPage: 10
“A]MUTRSR TAUneLeayorsvine Subject Conmerson te Dsio- 1/1, 20865 PH
‘Cant see the figurequestioned Ya if we gave him the right information to search. Misspelling one letter in the word
“practitioner's” Gan gfips9 up the search results to the point where the title of the book cannot be
identified at all and list titles that are not close to the initial search.
—_”
Another interesting factor we discovered was that when it came to accessing a specific
journal, the interface would require some users to login with a username and password to access
the next page in order to retrieve the journal. However, some users did not have to login at all.
Conclusions and Recommendations
After the usability tests, the key findings suggested that navigation through the WorldCat
Discovery search function can prove fgimbersome and time-consuming, depending on the tasks
being completed. Also, based on the user's complaints about the style, we concluded that thePage: 11
[Flume 1Auhon grayeorenmns
(jumbo: 2A uno grayeonccains
Mums 9 Auer: raysonooting
‘messed
Numtor Autor: graysonoaing
Can't see figure
(g)Munbar sAuror gryeonctins
‘Tobe
‘Sbjsat Goes O_Oats SHITE, PHOZAPM
Subjst Cross Out_ Dat: siti, 721030 PM .
Subject Iosred Text____ Ole: N66, 71047 PM
Subject Cone on ox Oa: 216N6, 70159 4
Subject ned Text Date. 216116, 71200784style and the design played a large part in a user’s experience jfsearching for a book, an article,
ora subject.
Based on the results of our usability tests, we have compiled recommendations for
improving the Library's catalog. The Get it! Function icon could be enlarged especially while the
‘mouse cursor is hovering over it, so that users can recognize itis a link to accessing a journal
online, Also, the catalog can improve raising the awareness of the Get it! Function. A brief
description displayed while the cursors hovers over the icon would be helpful to any user trying
to access a journal online. Figure 1.7 illustrates a rough draft of an edited version of the icon for
better use.
4
igure 1.7
Second, the overall design can be altered a little to ease a user’s experience. The size of
the texts and icons could be changed so that users can find things easily and also reduce having
many options that ultimately do the same thing. That way, the user will not be overwhelmed with
too much elutter of the webpage resources or overlook some critical information,
To solve inconsistency issues, such as a misspelling creating a blunder in search results, a
‘warning could appear letting users know that there was a large possibility in that misspelling
their search keywords can produce irrelevant and off key results. In the meanwhile, this error can
be fixed by adjusting which keywords determines what shows up based on title, author, and.
relevancy rather than going off from the keywords themselves.Page: 12
Tomer tAimorgreworwonis _ SWEpELWeotsd Tew bals SEV, TBSP
"whether itbe
jppMunber 2Auncrgrysoncotns Subject Commentan Text__ Date: 6, 7.1197 PM
Can't see the figureAppendix A: Users Test Observations
Duration Success
of each task
Summary
Item 1 min, 25 sec | Yes Was unsure if they found the
Description correct book
Get It! 4min No. The link did not work
Resource
E-book 1 min, 30 sec | Yes The book is not available at
Version, UNSE=)
Online Article | 1 min Yes Used the left-pane to click the
article
Book's 1 min, 25sec | Yes Easily completed task
Location:
Languages |3min, 30sec |No Difficult to locate
Item 45 sec Yes Clicked on the description to
Description find the ISBN
Get It! 2 min, 15 No. Not sure where to locate
Resource sec
E-book 1 min, 20 Yes Task #4 helped him to
Version sec complete this task
Online 1 min, 50 Yes Used a filter to search for
Article sec articles
Book's 2min,5sec | Yes Clicked on availability to find
Location: the location and edition3 min Language options were ‘not
clear"
41min, 35 No problem finding the
sec ISBN #
2min, 10 Was not able to complete
sec
41 min, 15 No trouble finding issue
sec
50 sec Used filter section
1 min, 30 Used the description tab to
sec find item info
41min, 15 Was not able to find exact
sec number of languages
3 min, 45 Asked if we gave him the
sec right title because it did not
show up.
41 min, 50 Searched publication
sec details and found the 2016
issue.
1 min, 30 Could not see eBook
sec version because it was not
available.
1 min, 50 Found article, but not
sec available at UNC Charlotte.
4 min, 5 sec Went to login page, butthen was redirected to
search results.
1 min, 5 sec
40 sec
1 min, 40
55 sec
Found that the book was
written in one language.
Found the ISBN number
quickly. Clicked first result,
clicked on description and
located it.
Found the edition, but “none
say 2016.”
Clicked on the eBook filter
and clicked on the eighth
result to find it.
45 sec
“I don't know how to do
that.”
2 min, 45
Clicked out of the Beta
version onto the actual
weezy catalog, but
she still found the right year
and edition.
45 sec
“No idea how to figure that
out’, “There were too many
to count.”Task 1
Task 2
Appendix B: Task Questions
Search this book by title “Observing the User Experience: A Practitioner's Guide to
User Research." Then try to find the ISBN number.
Search the topic “Technical Wilting,” Then locate and click on the joumal with the tile
“Journal of Technical Writing and Communication” and see if you can access the
2016 issue of the journal online, Make sure the journal is the Sage Premier 2016
resource. pel et dlin
Task 3
Search the ttl The Voyage of the Beagle,” Once you see the item ty to see Ifyou
‘can find the item in the ¢-book version. Try to see if you can view it, ifnot successful
tty to find out why.
Task 4
‘Search the iille ‘A Modest Proposal’. Once done, search for the first online article
about the title and check its availability
Task 5
‘Search the book “Rich Dad's Cashfiow Quadrant: Rich Dad's Guide to Financial
Freedom” and find what floor in the UNC Charlotte library itis located at. Then see
‘what Date/Edition the UNC Chariotte library holds.
Task 6
‘Search for the book “The Art of Computer Programming” and try find how many
different languages it's written in
13References
Usability Test Participants
+ Biology Major, UNC Chariotte, 2/2/2016
+ Computer Science Major #1, UNC Charlotte, 2/9/2016
+ ArtiCommunication Studies Major, UNC Charlotte, 2/9/2016
+ Computer Science #2, UNC Charlotte, 2/16/2016
+ English Major, UNC Charlotte, 2/16/2016
Supporting Documents:
Goodman, Elizabeth, Mike Kuniavsky, and Andrea Mosd. Observing the User
Experience. 2nd ed, Waltham: Elsevier, 2012. Print.
“Search UNC Charlotte Libraries and Beyond.” Search Unce.on.worldcat.org. WorldCat,
Web. 20 Feb. 2016.
14