You are on page 1of 30
Grayson Collins English 4183 March 23, 2016 Assessment State how well the edited version meets the goals of your audience, your instructor, and yourself. Note the major informational, rhetorical, and technological problems you encountered and how you attempted to overcome each. Look ahead to changes you might want to make for the portfolio version of this work to be submitted at the end of the term. Project two was to edit the Usability Report that students in Professor Wickliff’s class wrote. The Usability report was testing the WorldCat Discovery Interface that is used in the Atkins Library, The edited version of the Usability Report meets many of the goals directed to the audience, Professor Wickliff, and myself. Throughout the editing process, we came across many challenges. Although the content of the Usability was well written as directed to the faculty at the library, the creators of the interface, Professor Wickliff, and myself, there were a few problems with repetitive statements and formatting errors. We noted where information was repeated and deleted some wordy sentences. We also looked at formatting and noted that the formatting of the figures could not be viewed. Overall, it was an exactly report and conveys the message needed. Usability Analysis of the Atkins Library WorldCat Discovery Interface By: Brooke Johnson, Joseph Samson & Sabrina Terry February 23, 2016 ‘Submitted to: «Rachael Winterling, Usability Coordinator ‘* Gregory Wickliff, Assoc. Professor of English Summary of Comments on Microsoft Word - Formal Report - Final Edit-2.docx Page: 1 [EOL IAutor orpeonconns Supa Gone Ten Dale. wee, SABE PE ‘A number is not needed on the tile page Executive Summary Qurctass ENGE4H8+ Writing ser Documenta Phalyzed the beta version of the WorldCat Discovery interface used by UNC Charlotte's J. M, Atkins Library. To examine Ghertd cat Discovery interface, our group recruited a total of five undergraduate students from UNEG,Fheh of whom were from various majors on eampus, By reruiting individuals from different majorg freempus we lessened our chances of having skewed or biased results. We used the software Morae on a laptop to record each participant's experience. Morae tracked each person's mouse movements, verbaly/EM nonverbal communication through the provided! webeam and audio recordings, Throughout each participant's usability test, we selected two people to act as the observers and one person to facilitate the testing. There very Cfow ponsstent problems that each participant encountered when navigating the WorldCat Discovery Interface. All five of our participants didnot successfully complete task QURRBER wo or six of our task-based questions. Task two involved locating the Sage Premiere 2016 Resource (Get it! function), and task six involved determining how many languages a particular book is CARMI Aer examining our resus with More, we discovered that certain AN fonts, images, and icons throughout the interface seemed too small. The small size caused. participants to be unsuccessful in their completion of certain tasks. Second, the HAASSBEIIINB o ‘words in the search field caused the results to drasticallEHAREOUENED leaving out just one letter ‘caused problems amongst our usability tests. Based on our usabi ly tests, our group recommends enlarging certain text and images on the Library’s site or writing a short reference guide instructing users how to find resources that Be-commonly cause problems, ‘Sapa rose Oo ale 2/6, 60ST PM OSOO, iti pein siti eased sor iin chirps "enero eee SE a wang Beer Osearone, sda teatra 1 adel ech a ene rr Biljana 1 fours ‘University of North Carolina at Charlotte (UNCOL. gyal 7 Ghee sicncounidin tes Oasis bic asain, (inet ssnss! ii i. "wi ara toe fecwsdre geen ais Sicha. | Sadana Rete, re ea a at coh sea ore fies eeacea "sha bcact ta fae as ‘numbers: Teg “Hacc” wi an ea-aselemsna apa Gasset herd: because st ‘change; even. [turbos 12 ___Auttor-grayeoncoing __Sujae-Gross;Out_Dato: 22/6 8:14:47 P2500 Table of Contents Executive Summary ...... Introduction Methodology .....-..:sessessessseee: Participant Performance Key Findings Figure 1.1... Thies..Fansnet. _ Conelusions and Recommendations Appendix... References .. il ff Page: 3 ‘liner 1Aumon gysonconns —__SujevL Commeraan ed Oats 766 68508 PM These figures can not be seen Introduction we UNC Charlotte's 1M. Atkins Library introduced the WorldCat Discovery gatalog in preparation for its student and facultyWedy. However, the interface was still in its alpha and beta stages. The Atkins\BREB) noticed the flaws and decided to put the interface through a number of trials and tests for improvement. In collaboration with Associate Professor Dr. Gregory Wiekiff and his ENGL 4181/5181 class, Writing User Documents, the Atkins Library allowed us to perform usability testing with the beta version of theSVerldGatBiseevery interface. This is for the purpose of testing how usable the interface is for students and faculty on eampus, Before we conducted the usability testing, ISAbiN GN COOrainalO RACHAeI WinTSEIAg) visited the class to discuss WorldCat DiscoversSi@1 @lationship with the Atkin Library interfaces] and the number of topics to explore for usability testing. Whe group-used Morae-e-video recording software: Winterling ead wsy{@ugh the format ofthe software and the Online Computer Library EUMRIMEHEGS, We asked her questions about the subject matter and she answered everything we needed to know about OCLC and WorldCat before starting the tests. Page: 4 [Minter tAchor gmysoncling —Sueel Cross Out_Date 9/10, 61745 PM C500. ont ftinba:2Auho amsontns ec Cormenten Teel _ Dat 966, 65529 PH am Sub 6, 4 Gat ed weet brary (atmecshute gmrcana supe Goss. Oa: 100,057.59 ume: tasatininsins Suc: Curmer.nYod__on- 08 79017 Rachel Winterling, the Usabily Coordinator, fgNiatacsAutocoorins ac Gowranton Tet Oa 08,8914 P0500 (BNbecoAutocsemsnins ica Test__ sn 104800421 P-0507 She discussed the (BNMOcPAMegmsnins Act uo Tet__Oxn'108 ats. Womeiehstargarnalis Sec utes Tot___oa: 2126, 60040PH-0507 [Nate shu gmonotns se GossOx Os, 00229 8500 Fino __Adhorgrysnsins ut mara Yot_ ea 201037 ‘the class imparer.it __rmocgryeoronre _ sun Conmntenent_oaw:ans resem V~ (OCLe) Nanton 12 _Autor.grayencoting _ Subject. Coss Out_Data- 82/6, 8:34:52 PM.0500 VV Janguages-ete: ott epee’ We reported these findings in order to assist Atkins Library and WorldCat Loerie providing viable solutions to resolve the technical problems undergraduates and faculty run into, After examining through the details of this study, the report can suggest way's to make the WorldCat Discovery interface more focused, less confusing, and less intimidating for the University’s undergraduate and faculty users, Methodology Hey ‘The usability tests allowed Risacts Fron for us to analyzaqindergraduate students from various majors, and to compare and contrast if their major impacted their level of familiarity with the interface, Dye -ased-the software Moraeto verbal-and-nonverbal-behevior-throughout-thetesting-proeess-During the usability session, there \was at least one note taker recording the user's words, facial reactions and their body language. ‘We conducted six ta 1¢ participant's knowledge of the following: fccess description of the item Task ae an) see if the user understands the Get I resource ‘Task 3: To see if the user can find an eBook version of: tem Task 4: To see if user can access an online article ‘about the book's location and date/edition ‘Task 5: To see if user can access general informati ‘Task 6: To see if user can access how many different languages a specific item is distributed in Page: 5 (ENAMEL LAUT payeencling ———Suesl Gross Out Date: S216 89578 P0500 [Minoo 2h gayeoncolins Subject GrsOut_ Ose: 30/16, 7.9242 Ht MUMer Shur gaysonclins Subject Gress Out_Ot AN8/8, ORSP PAE irjRunbaranutrargrycencoing Subject Cross Out_ Date: 66 205 40 PM Participant Performance All of the users were able to complete four out of the six task-based questions and there were no general difficulties in navigating through the beta website, Problems encountered with task two and task six will be explained further in the next section. The average time ofall six tasks performed per user was fen minutes and forty seven seconds, The graph below illustrates how long each user took to complete all the tasks. Ta AU cate Ue z 8 f A eee bal ed Figure 1.1 Key Findings Got It! Function With all six of our participants not being able to complete task two, we suspected that something was wrong. We edited the task question after the first participant’s performance in hopes of making itQiBHBE)As we continued with the other participants, we noticed that it did not make a difference. Prior to taking the test, we asked the participant ‘among thenmthey-were-asked Hleir overall cS Former Page: 6 [Nunbor 1 ur gaysoncolins Subject Canvnenton Text Dale 16/16, LONTO PM ‘more clear [xlNuntex 2Auhor:grayeoncotine ___Subjac insert Text ate 92216, 8449 Pasco ee ‘about familiarity withthe Atkins Library Catalog. our outof-ive-partoipants- answered yes: None of them claimed to be experts of the interface, but instead stated they would occasionally use it to search for resources pertained Blassignments given in class. With this information, especially after the first participant, we tried our best to ease task 2 question, but as stated earlier it did not make a difference for the other participants. We pinned the problem to the library catalog not providing any indication of the Get It! Function to the user, When the user's cursor hovered over the icon, the icon to the Get I! fhotion did not appear to the user, which made it hard to recognize it asa link. Most users were just one step away from accomplishing the task if they only knew about the Get It! resouree, Below fAigure 1.2 illustrates how small the “Get It!” icon is and how the icon did not indicate that it was a link to access the journal, Page: 7 [i Mumber 1A praysonanins Number: Bauer: raysonootns. poriaining ()Munber sautnr-prayeoncoans F (eyeneccuncemaas (pNuber SAuthor:raysonootns “This figure is not displayed Bubjeck Goes Oa bale GANG 6482 POUT Subject nseed Text Sujet Comment on Text Subject Comment on Text Subp: Comarton Tet Date-anen6, 705 PU ono: 9/16/16, 70550 PL to: 16/16, 70608 PL te: 16/6, 64424 PAL ‘The library catalog was inefficient in communicating what the function does. Lateg hen we finished the usability tests, we performed a website search on the catalog for the Get It! function, and nothing popped up indicating its use. Appearance All five participants clicked on many links for information that was already posted. For example, on task-fivg Bers were asked to locate what floor in the UNC Charlotte library a particular book was in and to find what Date/Edition the UNC Charlotte library holds. Once the user searched the title to the book, it was listed as the first result and all the information was posted right on the link to the book. However, the users clicked on the book’s link to complete task-53 5) Figure 1.3 illustrates how the font size is very small on the link to the book, which resulted in the user not being able to recognize all attributes of the book posted as additional information on the link to the book. Participant three stated “the teximages could be larger.” Page: 8 [T)Sunben TA prayeoneotng Number: 2a: uaysonolins Task Five, users Number: sauna raysncolins Task Five Nuts ryaoneoos This figure isnot displayed Sock ones Ta ‘Subject Inserted Text Subject inserted Text ‘Subject Commanton Text Date S66, 7O6aT PE Date: 96/6, 7.0790 Pik Date: an6i6, 70756 Pu Date: 2/6/6,64720 7 Every time a user clicked on the link to a specific item, there would be dree-Heny GPtail tabs as follows: Description, Edition/Formats, and Availability@-Holdings. Most users elicked on the book’s link, and still had difficulty in locating the information needed for task five because the three item detail tabs did not pop out at the user. There was a play symbol next to each tab, but that was not a good indicator that the tab was a link, Even after figuring out that the tab was a link, the user could not spot the information they needed because the text was too small ot the page was cluttered, causing the user to overlook the objective of the task. Figure 1.4 illustrates how the three item detail tabs do not pop out at the user to click on. ‘They had a play symbol next to each tab, but that is not a good indicator that the tab isa link, V Fgae 14 Also, when a user would try go back to the item search page by clicking the back arrow, it would redirect the user back to the main search interface. This is because the user was supposed Page: 9 unter taumorgaysoroome ‘hree-tem (g]Numvor: 2auor grysorotns Number sau grayeoncoins Can't see the figure ‘Sues seed Tot ‘Da a676, FoR Pw Subject Gross Ou Date: 36/6, 7.0001 PM ‘Subject Conant on Text ate 31616,7.0059 PHA 4 v ae to click on the link at the top tight that says “close item detail” to return back to their item search. The reason most users were unaware of that was because it is written in very small text and the page itself was too cluttered for the user to identify the item. if Figure 1.5 illustrates how the close button is too small and this creates a problem for the (airs just want to go back to their search results otherwise by clicking the back button the ‘webpage will redirect you back to the main search interface, Shiga ns 1 ary catalog is cluttered or has too many options to do one When a website such as a thing, it ean overwhelm the user. We suggest keeping the website simple so thatitcould be easy to navigate tours maybe enlarging some of the text to make things easier to wnt | ee ie Inconsistency ‘The inconsistency within the library’s catalog made it hard for some participants to complete tasks. For example, when participant four entered the title of the first task in the search bar, he accidentally misspelled one word in the title. This completely changed the search results far from the expected results. The book was nowhere to be found and the user Page: 10 “A]MUTRSR TAUneLeayorsvine Subject Conmerson te Dsio- 1/1, 20865 PH ‘Cant see the figure questioned Ya if we gave him the right information to search. Misspelling one letter in the word “practitioner's” Gan gfips9 up the search results to the point where the title of the book cannot be identified at all and list titles that are not close to the initial search. —_” Another interesting factor we discovered was that when it came to accessing a specific journal, the interface would require some users to login with a username and password to access the next page in order to retrieve the journal. However, some users did not have to login at all. Conclusions and Recommendations After the usability tests, the key findings suggested that navigation through the WorldCat Discovery search function can prove fgimbersome and time-consuming, depending on the tasks being completed. Also, based on the user's complaints about the style, we concluded that the Page: 11 [Flume 1Auhon grayeorenmns (jumbo: 2A uno grayeonccains Mums 9 Auer: raysonooting ‘messed Numtor Autor: graysonoaing Can't see figure (g)Munbar sAuror gryeonctins ‘Tobe ‘Sbjsat Goes O_Oats SHITE, PHOZAPM Subjst Cross Out_ Dat: siti, 721030 PM . Subject Iosred Text____ Ole: N66, 71047 PM Subject Cone on ox Oa: 216N6, 70159 4 Subject ned Text Date. 216116, 71200784 style and the design played a large part in a user’s experience jfsearching for a book, an article, ora subject. Based on the results of our usability tests, we have compiled recommendations for improving the Library's catalog. The Get it! Function icon could be enlarged especially while the ‘mouse cursor is hovering over it, so that users can recognize itis a link to accessing a journal online, Also, the catalog can improve raising the awareness of the Get it! Function. A brief description displayed while the cursors hovers over the icon would be helpful to any user trying to access a journal online. Figure 1.7 illustrates a rough draft of an edited version of the icon for better use. 4 igure 1.7 Second, the overall design can be altered a little to ease a user’s experience. The size of the texts and icons could be changed so that users can find things easily and also reduce having many options that ultimately do the same thing. That way, the user will not be overwhelmed with too much elutter of the webpage resources or overlook some critical information, To solve inconsistency issues, such as a misspelling creating a blunder in search results, a ‘warning could appear letting users know that there was a large possibility in that misspelling their search keywords can produce irrelevant and off key results. In the meanwhile, this error can be fixed by adjusting which keywords determines what shows up based on title, author, and. relevancy rather than going off from the keywords themselves. Page: 12 Tomer tAimorgreworwonis _ SWEpELWeotsd Tew bals SEV, TBSP "whether itbe jppMunber 2Auncrgrysoncotns Subject Commentan Text__ Date: 6, 7.1197 PM Can't see the figure Appendix A: Users Test Observations Duration Success of each task Summary Item 1 min, 25 sec | Yes Was unsure if they found the Description correct book Get It! 4min No. The link did not work Resource E-book 1 min, 30 sec | Yes The book is not available at Version, UNSE=) Online Article | 1 min Yes Used the left-pane to click the article Book's 1 min, 25sec | Yes Easily completed task Location: Languages |3min, 30sec |No Difficult to locate Item 45 sec Yes Clicked on the description to Description find the ISBN Get It! 2 min, 15 No. Not sure where to locate Resource sec E-book 1 min, 20 Yes Task #4 helped him to Version sec complete this task Online 1 min, 50 Yes Used a filter to search for Article sec articles Book's 2min,5sec | Yes Clicked on availability to find Location: the location and edition 3 min Language options were ‘not clear" 41min, 35 No problem finding the sec ISBN # 2min, 10 Was not able to complete sec 41 min, 15 No trouble finding issue sec 50 sec Used filter section 1 min, 30 Used the description tab to sec find item info 41min, 15 Was not able to find exact sec number of languages 3 min, 45 Asked if we gave him the sec right title because it did not show up. 41 min, 50 Searched publication sec details and found the 2016 issue. 1 min, 30 Could not see eBook sec version because it was not available. 1 min, 50 Found article, but not sec available at UNC Charlotte. 4 min, 5 sec Went to login page, but then was redirected to search results. 1 min, 5 sec 40 sec 1 min, 40 55 sec Found that the book was written in one language. Found the ISBN number quickly. Clicked first result, clicked on description and located it. Found the edition, but “none say 2016.” Clicked on the eBook filter and clicked on the eighth result to find it. 45 sec “I don't know how to do that.” 2 min, 45 Clicked out of the Beta version onto the actual weezy catalog, but she still found the right year and edition. 45 sec “No idea how to figure that out’, “There were too many to count.” Task 1 Task 2 Appendix B: Task Questions Search this book by title “Observing the User Experience: A Practitioner's Guide to User Research." Then try to find the ISBN number. Search the topic “Technical Wilting,” Then locate and click on the joumal with the tile “Journal of Technical Writing and Communication” and see if you can access the 2016 issue of the journal online, Make sure the journal is the Sage Premier 2016 resource. pel et dlin Task 3 Search the ttl The Voyage of the Beagle,” Once you see the item ty to see Ifyou ‘can find the item in the ¢-book version. Try to see if you can view it, ifnot successful tty to find out why. Task 4 ‘Search the iille ‘A Modest Proposal’. Once done, search for the first online article about the title and check its availability Task 5 ‘Search the book “Rich Dad's Cashfiow Quadrant: Rich Dad's Guide to Financial Freedom” and find what floor in the UNC Charlotte library itis located at. Then see ‘what Date/Edition the UNC Chariotte library holds. Task 6 ‘Search for the book “The Art of Computer Programming” and try find how many different languages it's written in 13 References Usability Test Participants + Biology Major, UNC Chariotte, 2/2/2016 + Computer Science Major #1, UNC Charlotte, 2/9/2016 + ArtiCommunication Studies Major, UNC Charlotte, 2/9/2016 + Computer Science #2, UNC Charlotte, 2/16/2016 + English Major, UNC Charlotte, 2/16/2016 Supporting Documents: Goodman, Elizabeth, Mike Kuniavsky, and Andrea Mosd. Observing the User Experience. 2nd ed, Waltham: Elsevier, 2012. Print. “Search UNC Charlotte Libraries and Beyond.” Search Unce.on.worldcat.org. WorldCat, Web. 20 Feb. 2016. 14

You might also like