Usability

Testing Report
Manuela Santos
Salvador Itriago
Agenda
01 The Program 04 Results

02 Objective 05 Recommendations

03 Methodology 06 Challenges
The Program
• Master degree in Psychology with concentration:

• Human Factors

• Neuroscience and Behavior

• It’s extremely popular with International students (Factual, 2022)

• 2018 the number of International students decreased (Factual, 2022)

Objective
What did we want to achieve?
UX goals
Users will complete the task successfully with ease
The navigation in the website will be smooth
Users will be satisfied with the website
International students
Usability goals
95% of users will successfully complete the task path
95% of users will successfully complete the task with
no/minor problem
95% of users will complete the entire path in < 4
minutes.
The average SUS score will be >70
Methodology
How did we conduct the usability test?

1. Test date

November 28 and 29, 2022

2. Testing method

Unmoderated testing with Qualtrics | 8 participants

3. Metrics

Task success | Task level of success | Task time | SUS | User journey map

4. Paths
Path A Path B
1. Degree plan 1. Tuition
2. Tuition 2. Degree plan
3. Scholarship 3. App. deadline
4. App. deadline 4. App. requirements
5. App. requirements 5. Scholarship
Deliverables Results
What did we want to achieve? Did we achieve our goals?

• 95% of users will successfully complete the task 0% of users successfully completed the path A
path
33% of users successfully completed the path B
• 95% of users will successfully complete the task
37% of users successfully completed the tasks with
with no/minor problem
no/minor problem
• 95% of users will complete the entire path in < 4
Users completed path A 9 min and path B 16 min
minutes.
The average SUS score were 62
• The average SUS score >70
User Journey Map
How did we conduct the usability test?

Link
Recommendation
What did we learn from the results?

“Find the degree plan”

It was the task with the highest number of failures/give up

Issue: Participants did not recognize that under “degree requirements” was the access to “degree plan”.

Recommendation: Maintain the same vocabulary in the title and button

Priority:
Violation
#4 Consistency and standards
Recommendation
What did we learn from the results?

“Find full-year time tuition for an International student”

It was the task with the highest time on task (average of 3 min and 46 sec)

Issue: Users do not associate the word “non-resident” with “international students”

“Don't should be
international? Or
Am I crazy?”
Recommendation
What did we learn from the results?

“Find full-year time tuition for an International student”

Issue: The page uses a different term, “I-20 Cost of Attendance” than other pages related to the same
information, “non-resident”
Recommendation
What did we learn from the results?

“Find full-year time tuition for an International student”

Recommendation: Apply the same term across all pages

Priority:
Violation
#4 Consistency and standards
Recommendation
What did we learn from the results?

“Find scholarship for International students”

It was a major problem – level of success | It was the second task with a high time (2 min 46 sec)

Issue: There is too much information on the same page that challenges users to search for specific
requirements

"that it could be
done better"

"I don't see

specific for
International
students"
Recommendation
What did we learn from the results?

“Find scholarship for International students”

Recommendation: Modify the distribution of information and take off the details
Show the scholarships by type such as Scholarships for International Students, Scholarship for Transfer

Priority:
Violation
#8 Aesthetic and minimalist design (DESIGN)
Recommendation
What did we learn from the results?

“Find the application deadline”

Issue: Few users did not associate the title Admission with the application deadline

Recommendation: Maintain the same wording across the page

Priority:
Violation
#4 Consistency and standards
Recommendation
What did we learn from the results?

“Find the application requirements”

Issue: Information architecture confuses users

Recommendation: Based on this study we suggest reorganizing the information and distributing it by priority. However, a
follow-up study such as card sorting is most adequate. Thus, it will be able to identify the priority actions for this page

Priority:
Violation
#8 Aesthetic and minimalist design (DESIGN)
Challenges
What could we do differently?

• Our sample did not meet our criteria

• Most of the participants didn’t think aloud

• We could use other tool (e.g., UserTesting, Userzoom, or Uxtweak)