Professional Documents
Culture Documents
Engl 317 - Project 4 Deliverable 1
Engl 317 - Project 4 Deliverable 1
University Website
Usability Test
Tyler Clemens
Clemens 2
Table of Contents
INTRODUCTION .........................................................................................................................3
METHODOLOGY .......................................................................................................................3
Testing Environment/Equipment ............................................................................................3
Tasks ...........................................................................................................................................3
Test Metrics ...............................................................................................................................4
Evaluation ..................................................................................................................................4
RESULTS ......................................................................................................................................5
Task 1: Research Cost of Attendance and Calculate Net Price of Attendance ...................5
Task 2: Finding Available Financial Aid Resources ..............................................................5
Task 3: Locating Housing Options, Floor Plans, and Housing Registration .......................6
Task 4: Navigating the Undergraduate Website for a Specific Department (Geology) .....6
Task 5: Viewing the Degree Requirements for a B.S. in Geology/Earth Science ................7
Task 6: Accessing Class Registration Information and Linking to the Registration Page 8
Task 7: Finding Research, Clubs, Sports, and Volunteering Opportunities .......................8
Task 8: Locating an Academic School Calendar ....................................................................9
Task 9: Accessing the Graduate School Requirements Page (Geology in Particular) ......10
Task 10: Locate Area for Parents of Prospective Students .................................................10
RECOMMENDATIONS/CONCLUSION ...............................................................................11
Conclusion ................................................................................................................................11
University of Idaho Recommendations .................................................................................11
Washington State University Recommendations .................................................................11
BIBLIOGRAPHY .......................................................................................................................12
Introduction
University and college websites in the U.S. vary widely, and often have different resources
available to those using their websites. Not every site navigates and functions the same way. This
white paper presents the results from a usability test comparing the two websites in each of the
five standards of usability.
Methodology
Testing Environment/Equipment
The usability test was performed on a 2016 Dell Inspiron 3558 laptop running Windows 10,
Version 1709. The tests were performed using the Google Chrome web browser for both
websites to ensure consistency. Within the browser, tabs for both the University of Idaho and
Washington State University websites were open next to each other so that easy switching
between the two for testing could be performed.
The test was performed over a couple of days, allocated into periods of time 1-2 hours long. The
tests were conducted in an environment similar to one which would typically be used by the
intended users, prospective students and their parents. The testing environment was a well-lit
bedroom with minimal to no background noise to distract the user from testing the usability of
the websites.
The data retrieved was what was up to date on the website as far as the test was conducted. To
ensure that there would be no confusion in coming back after stopping, the criteria for each of
the tasks was immediately recorded and notes were taken.
Tasks
To effectively compare the two university websites, ten (10) tasks were established to complete
on both sites. When these tasks were performed, they could then be graded on a scale and notes
could be taken on potential problems, recommendations, or points of note for each site. The ten
tasks were as follows:
1. Research Cost of Attendance and Calculate Net Price of Attendance
2. Finding Available Financial Aid Resources
3. Locating Housing Options, Floor Plans, and Housing Registration
4. Navigating the Undergraduate Website for a Specific Department (Geology)
5. Viewing the Degree Requirements for a B.S. in Geology/Earth Science
6. Accessing Class Registration Information and Linking to the Registration Page
7. Finding Undergraduate Research, Clubs, Sports, and Volunteering Opportunities
8. Locating an Academic School Calendar
9. Accessing the Graduate School Requirements Page (Geology in Particular)
10. Locate Area for Parents of Prospective Students
Clemens 4
Test Metrics
Five criteria statements were written to create qualitative feedback from the test, and to provide
context for the Likert Scale mentioned later. Each criteria statement corresponded to one of the
five standards of usability: efficiency, effectiveness, engagement, error tolerance, and easiness to
learn. The statements were as follows:
Effective: I was able to successfully complete the task.
Efficient: I was able to complete the task in a reasonable amount of time/clicks.
Engaging: The website's design helped me to complete the task in an engaging manner.
Error Tolerant: I was able to complete the task with minimal to no error.
Easy to Learn: If errors occurred, the feedback was helpful in redirecting me.
Evaluation
The grading scale used to generate quantitative data was the Likert Scale, commonly used in
many surveys today. The scale ranged from 1 to 5, with 1 representing the statement Strongly
Agree and the number 5 representing the statement Strongly Disagree. In between were the
numbers 2 (representing the statement Agree), 3 (representing the statement Neither Agree
nor Disagree), and 4 (representing the statement Disagree). The selected choice was filled
with green to represent that number being picked. An example of the Likert Scale used for
testing can be seen below:
Neither
Strongly Strongly
Agree Agree nor Disagree
Agree Disagree
Disagree
1 2 3 4 5
Clemens 5
Results
Task 1: Research Cost of Attendance and Calculate Net Price of Attendance
WSUs site had a far more efficient system; even though the cost of attendance took three clicks to
find, the calculator, which was the same on both sites (Figure 1), was on the next page. The
financial aid options for incoming students was actually under Admissions on WSUs site. The
transition was much more efficient.
Both websites were quite the same for the third task.
U of Is site had a link to Housing straight from the
main page under Student Life, and apps were easy
to find. The floor plans were a bit hard to navigate to
though. Housing examples can be seen in (Figure 5).
WSU had a more engaging and flexible arrangement
with their housing search. Like with financial aid,
there was a checkbox field where a prospective
student or parent could narrow down their housing
based on preferences (Figure 6). Finding the apps for
housing took a bit longer, but they offered 3-D
virtual tours, which gave them a leg up in the
competition between the two. Figure 5: U of I housing choices.
In addition, there were two routes to the same undergraduate geology page on the
WSU website, which could be confusing. U of I had more concrete, user-friendly results.
Figure 8: An
error page when
trying to link to
the B.S. Geology
courses required
for the degree.
This task was one in which U of Is website suffered quite badly in each of the criteria. When
starting from the geology department page, it was easy enough to link to the undergraduate page
and find the degree requirement link, but it was broken (Figure 8). Eventually it was found.
Task 6: Accessing Class Registration Information and Linking to the Registration Page
There was better access to registration on the U of I website for sure. However, there was no
actual registration information for the prospective students. After not seeing any information in
the Prospective Student tab, a quick glimpse into Current Students led right there (Figure 11).
WSUs website did very poorly in this section. The link to either the registrar home page or
straight to class registration (like VandalWeb) were nowhere on the first page. Only after some
stumbling around did the search bar produce a link to a registrar page that immediately locked
out needing a sign-in prompt. Only upon searching more on the Admitted Students page did an
orientation page that possibly mentioned registering appear. It was very hard to navigate.
Both websites met all criteria perfectly. Each of the websites had
a calendar that was only one click away.
U of Is calendar (Figure 15) contained future calendars also.
WSUs calendar link (Figure 14) contained a series of several
calendars. The main academic calendar is present but there are
also sports and entertainment event ones also. It seems that
WSU has consolidated all calendars better than U of I.
Clemens 10
Figure 16:
University of
Idahos grad
studies main
page.
With WSUs website, both the graduate school page and the geology graduate page were two
clicks away from the main page, and quite easy to link to. Rather than having two ways to access
the page it could be more centralized, although it currently can be quicker than UI's search.
Recommendations/Conclusion
Conclusion
For the most part both websites were quite easy to navigate and contained almost all data that the
test called for. Each website suffered in specific categories (which will be covered in the section
Recommendations), but it is hard to say if one is better overall since college websites can vary
so widely.
As per the results of the test, University of Idaho came out ahead in half of the tasks (4, 5, 6, 7,
and 10) while Washington State University was better in the other five tasks (1, 2, 3, 8, and 9). In
the cases where the two tied, WSU usually had a factor that would give it an edge.
Overall, the design of U of Is website seemed more user-friendly, as did its navigation, but it
was offset by WSUs better functionality and lack of errors on some tasks.
University of Idaho Recommendations
As stated above, University of Idaho performed poorly being able to quickly search through
financial aid, cost of attendance, and housing. It took more clicks to get to these pages, and they
were often less engaging (for example, WSU had a scholarship retrieval tool while U of I did
not). U of I could benefit more from reducing the number of clicks necessary to view these
pages, and by making them more interactive rather than forcing the user to slog through them.
Another shortcoming of the U of I website was its roundabout multiple access points. With the
graduate school and academic calendar tasks (8 and 9 respectively), there were multiple ways to
access the same page, so this could be consolidated.
Washington State University Recommendations
Washington State did poorly in a few rather crucial areas. Being able to navigate degree
requirements and department pages is vital for those who want to explore majors at a college and
see what kind of courses are offered/must be taken, and this is where WSUs site falls through.
WSU lacked a department page altogether for the test department (geology), and the degree
course requirement page was very bland, unintuitive, and unhelpful. U of I outshone it by far.
Another missing important part was the muddling of the volunteering/clubs/research/etc. Many
prospective students (and current ones as well) look to getting involved with organizations,
sports, and volunteering as a way to make friends, broaden their horizons, gain experience, and
enrich their college careers. The utter confusion in not being able to find these can be off-putting
to a prospective student who may not be able to find interests on the campus. WSU should do
like U of I and put this all in one easy to navigate, user-friendly, aesthetically-pleasing area.
The lack of a dedicated Parents page needs addressing as well. Parents should be given
information as to how the college process works, since this is most likely the first time their child
will be fully or mostly independent.
Clemens 12
Bibliography
http://www.uidaho.edu/
https://wsu.edu/
Clemens 13
Website www.uidaho.edu
Find the estimated cost of attendance and calculate the net
Task 1 price to attend.
Error
Tolerant I was able to complete the task with minimal to no error.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
1 2 3 4 5
Easy-to-
Learn Completing the task was easy to do.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Error
Tolerant I was able to complete the task with minimal to no error.
Clemens 15
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Easy-to-
Learn Completing the task was easy to do.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Notes Finding the scholarships for incoming students was very easy to do (on
the "Prospective Students" page in the same area as COA). All aid was
one click away, and any descriptions or apps were 1 or 2 after that.
Plus there was plenty of additional info and resources. Great.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Error
Tolerant I was able to complete the task with minimal to no error.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Easy-to-
Learn Completing the task was easy to do.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Notes Finding the housing pge was easy (under "Student Life" which seems
reasonable) and from there the application was only another two
clicks away. The floor plans took a little bit extra in a different
direction, but otherwise it was easy to find.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Error
Tolerant I was able to complete the task with minimal to no error.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Easy-to-
Learn Completing the task was easy to do.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Error
Tolerant I was able to complete the task with minimal to no error.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Easy-to-
Learn Completing the task was easy to do.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Notes
Clemens 19
Starting from the geology department page, it was easy enough to find
the degree roadmap for a B.S. The only problem was, it gave me a 404
error saying it didn't exist. After a search, I came back to the same
page and clicked on a less obvious link to get my answer. Not very
good.
Task 6 Access class registration page; find link to register for classes.
Error
Tolerant I was able to complete the task with minimal to no error.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Easy-to-
Learn Completing the task was easy to do.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Notes After a quick glimpse into the drop-down menu for Prospective
Students and seeing nothing, I checked the Current Students tab and
found a link right away, which was easy to follow to a link to
VandalWeb. It appears that once admitted this would be accessible.
Error
Tolerant I was able to complete the task with minimal to no error.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
Clemens 21
1 2 3 4 5
Easy-to-
Learn Completing the task was easy to do.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Notes Very easy, only one click to find the page that linked to volunteering,
leadership, diversity, studying abroad, reasearch, intramurals,
athletics, and more. Clubs and other info were only an additional one
or two clicks ahead.
1 2 3 4 5
Error
Tolerant I was able to complete the task with minimal to no error.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Easy-to-
Learn Completing the task was easy to do.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Notes Straight off the main page under both the Current and Prospective
Student tabs was a link to the same page with an academic calendar,
so it was easy to find. There are also future calendars available.
1 2 3 4 5
Error
Tolerant I was able to complete the task with minimal to no error.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Easy-to-
Learn Completing the task was easy to do.
Neither
Strongly Somewhat Agree nor Disagree Strongly
Agree Agree Disagree Disagree
1 2 3 4 5
Notes There wasn't any trouble finding the graduate studies page, as it was
only two clicks away. As for the geology graduate page, there were
two separate ones, accessed from two different routes (department
page and College of Science page), so that could be fixed.
1 2 3 4 5
Error
Tolerant I was able to complete the task with minimal to no error.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Easy-to-
Learn Completing the task was easy to do.
Neither
Strongly Agree Agree nor Disagree Strongly
Agree Disagree Disagree
1 2 3 4 5
Notes Very easy to locate. There is a dropdown tab labeled "Parents" with
links to other resources, or it can be clicked for an overview to other
resource pages for parents. Nice information that is easily accessed
and well placed.
Clemens 25
www.wsu.edu
Find the estimated cost of attendance and calculate the net
price to attend.
Like U of I, WSU 's website had the financial aid page one click away
from the home page, although unlike UI aid for even the returning
students can be found here. All info and resources were only one click
further than the FinAid page. Even better than UI I'd say.
Like UI, finding the registration was only four clicks away. Finding the
housing page was immediate, but it took a little longer to find the app
than it did for UI. However, this had 3-D virtual tours and seemed
more informational overall. Pretty solid.
While it only took three to four clicks to find the geology undergrad
page, there wasn't a dedicated department page that I could find, and
there were two routes to the same page. UI definitely had a more
concrete result for what I was looking for.
1 2 3 4 5
After bumbling around and finding the registrar page after using the
search bar, I was locked out by needing to sign in. Upon searching
more on the Admitted Students page, I clicked a couple links and
found an orientation page that mentioned registering. Kind of hard to
find.
1 2 3 4 5
1 2 3 4 5
Similarly, right off the main page is a link to the series of WSU
calendars. One more click takes you to the academic one, but before
that is the list of entertainement and sports ones along with tickets.
These seem more consolidated and easier to find than U of I's.
1 2 3 4 5
Both the graduate school page and the geology graduate page were
two clicks away from the main page, and quite easy to link to. Rather
than having two ways to access the page it could be more centralized,
although it can be quicker than UI's search.
1 2 3 4 5