Usability

Testing

Portfolio Review
Task 4.9

By: Nuno
Portfolio Review
Usability Test Plan
Introduction
Vela: Moderated Remote and In-Person Usability Tests,
Mobile 

By – Nuno Cunha
BACKGROUND
Vela is a smartphone app that gives water sports enthusiasts everything they need to organize their activities, from a better method to measure wind, water, and waves to essential
notifications and alerts and a resource for networking with other users. The software is intended for novices and experts to use on the move or before going out on the water.

GOALS
To evaluate how easy it is for users to pick up the app's essential features and
interface
To spot any usability faults and mistakes when activities are being completed
To see how people use the app and see if their experience is satisfying and
stress-free
To determine if participants comprehend the value and goal of the app.

objectives
Through onboarding
Do they hesitate to omit any onboarding steps
Check to see if participants can find the Search option with ease
Does the participant understand and find value in the "Safety Advices" option
Analyze how quickly participants can locate an overview and specific
information about an area
Do they have any trouble identifying the sorts of data they are seeing?

Methodology
The study will be conducted as moderated in-person and remote test. Zoom software will be used to record the screen and audio for both test types. Each participant session lasts
between 10 and 15 minutes and includes a briefing, task-related questions, and a quick debrief to get any extra feedback.

Pag 2
Portfolio Review
Usability Test Plan
Participants & Schedule
Between February 3rd and 4th of 2023, six volunteers from a range of age groups and experience levels will be evaluated. Direct or online social media recruitment was used to find the
participants.

Sessions
It will take each session about 10 to 15 minutes.

Equipment
While remote testing will be conducted on Zoom or any other technology that will allow me to record the test, in-person testing will be conducted on mobile or desktop with an interactive
prototype.

Metrics
Errors will be measured using Jakob Nielsen’s scale¯

0 = I don't agree that this is a usability problem at al¨

1 = Cosmetic problem only: need not be fixed unless extra time is available on project

2 = Minor usability problem: fixing this should be given low priority

3 = Major usability problem: important to fix and should be given high priority

4 = Usability catastrophe: imperative to fix before product can be released

Pag 3
Portfolio Review
Usability Test Script
Introduction
Hello, and thanks again for taking the time to participate in some user testing!

Before we get started, let me tell you a little bit more about what today’s session will look like so you know what to expect. I’ll be asking you to try out a few features of my app Vela so that I
can better understand what is and isn’t working well. It’s important to remember that I am not testing you at all, but simply the app and my design decisions. There are no right or wrong
answers – 

I want to see how you interact with the app and hear your honest feedback about your experience. 

I’ll use any of your responses to make improvements on the app. The prototype has limited functionality, so you may want to click options that are not live. 

Throughout the session, I’ll ask you to complete a few specific tasks, and then will ask some general questions along the way. While you’re completing tasks, I’ll encourage you to think
out loud as much as possible so that I can understand your thought process as you navigate the app – feel free to talk through what you’re seeing or doing, or if anything is pleasing or
confusing to you.

Please also feel free to ask questions at any point during the session or to clarify what you should be doing! 

Before we start, do I have your consent to record today’s session? It will not be shared with anyone else, and I’ll only use it as a reference for further study after our session is complete. 

Demographic Information
Please select your age group:

21-25 26-30 31-35 36-40 41-50 50

How many hours a day would you say you spend on a mobile device, tablet, or desktop computer?
How often do you use your phone or laptop to check weather Forecast?  Which Apps, if any, do you use
How often do you spend time in the water over the year, either swimming or participating in another water activities?

Open-Ended Questions
Now I'd want to show you the prototype and get your thoughts on the Vela App.

I'll show you the first few screens

What are your first impressions
What do you believe you're looking at right now - what do these screens serve
What do you like and hate about it? Is there anything that stands out?

Allow me to show you another screen (the homepage)

Could you please repeat your opinions on what you're looking at
What do you believe you can do with this screen?

Now I'll ask you to share your screen and I'll provide you the prototype link so you may test some of these chores for yourself.

Pag 4
Portfolio Review
Usability Test Script
Direct Questions & Scenario Tasks
You are a first-time user who does not yet have an account. First, create an account and go through the onboarding procedure
Was this a simple task to complete
Do you have any queries concerning the steps that were included or why they were included?

Imagine that this is your first time using this new weather and water data app. You are located in Bidart, France, but want to visit another location in the region. Search for another
location in the region and add it as a favorite.
Do you find the direct search function?
Did you feel confused about where to start?
Was adding the location clear?

Examine the detailed data for Biarritz to find the 24H weather forecast .
Did you know how to start?
What do you think about accessing the data?

You're on the home screen and want to find surf Safety advice
Do you find the direct search function?
Did you feel confused about where to find it?

WRAP-UP
Okay! That’s the end of the session. Thank you for participating and helping us better understand how we can improve Vela App. Before you go, do you have any other questions or feedback
for us?

Pag 5
Portfolio Review
Usability Test Report
Introduction
All 6 participants were able to complete the 4 tasks asked of them. The main challenges experienced by participants are listed below:
ISSUE 1: Wants quick access “Locations/ Search” and didn't find it: [severity: Medium]
Suggested Change: Change the current icon for a magnitying glass, It was proposed by several participants that it would be easier to recognize this function.

Evidence 

4 out of 6 participants had difficulty identifying the “LOCATION” icon in the Bottom navigation bar.

ISSUE 2: Confused about the current location being the first thing on the homepage: [severity: Hight]
Suggested Change: Include some GPS-related information in the “onboarding” process.

Evidence 

4 out of 6 participants did not comprehend why the “Bidart/France” spot is their default location.

ISSUE 3: nclear what data was shown on verview [severity: Medium]

U O

Suggested Change: Change format of icons and maybe add te t labels.

Evidence 

2out of 6 participants had difficulties understanding what the weather symbols meant.

ISSUE 4: Confused what is verview and orecast: [severity: Low]

O F

Suggested Change: Change the Design of the buttons

Evidence  

3 out of 6 participants had difficulty to identify these two features.

ISSUE : Confused to find the

5 " Safety Advices [severity: High]
"

Suggested Change: Add text for " Safety Advices" Icon and add something in Notifications

Evidence  

5 out of 6 participants didn't find the “Safety advices” feature or had a lot of difficulty identify the Icon on the screen

Conclusion
Several errors were found during the usability testing, and participants immediately began to exhibit patterns that indicated the errors needed to be fixed. The user
experience and comprehension of the App as a whole will be considerably improved by the recommended adjustments.

Pag 6
Portfolio Review
Issue 1
Wants quick access “Locations/ Search” and didn't find it: [severity: Medium]
Suggested Change: Change the current icon for a magnitying glass, It was proposed by several participants that it would be easier to recognize this function.

Before After
Changes:

Brand
9:42 9:42
Change the current icon
for a magnitying glass,
Biarritz

France
It was proposed by
several participants that
it would be easier to SEARCH FOR A SPOT SEARCH FOR A SPOT
recognize this function.

Search Search
Overview Forecast The “Search bar” was
also added to a number
of other screens to Recents Nearby Filter Recents Nearby Filter

Biarritz

France
provide users with a
greater degree
search convenience.

of

32º
Sunny Cloudy
My Location Recent Search

Biarritz

France 30º
16 km/h 83 % Low 2/3Mts
Low
16 km/h 83 % 12.30H 2/3Mts 1 Biarritz

France 30º Location 2

16 km/h 83 % Low 2/3Mts 12 km/h 83 % Low 1/2Mts

1 Biarritz

France 30º
06.25H 19.35H Location 3
16 km/h 83 % Low 2/3Mts
Image 12 km/h 83 % Low 1/2Mts
1 Biarritz

France 30º
16 km/h 83 % Low 2/3Mts

Home Favourites Search Account Home Favourites Search Account

Pag 7
Portfolio Review
Issue 2
Confused about the current location being the first thing on the homepage
Suggested Change: Suggested Change: Include some GPS-related information in the “onboarding” process.

Before After

Changes:

9:42
Include some GPS-related 9:42 9:42
information in the
“onboarding” process.

ELA.APP I developed these two

solutions to make it
easier to comprehend ELA.APP Bidart

Login why a spot shows on the

dashboard.
Comments
France
S
!
afet d ices
y A v

Email
Email Address
Password
ALLOW “LOCATION”TO ACCESS

TO ACESS YOUR LOCATION? T

A llo w “ VELA”

y
to aces
our location
his app needs our location to searc
for nearbSunny
pots Cloudy
y
30º
y S
?
s

Password A llowW hile sing pp

U A

A llo wO nce
Low

Remember me Forgot password? 16 km/h

W ind H
83 %

umidit y
12.30H

T ides
1/2Mts

Wa es
v

D on t llo
’ A w

Login Notifications
Winds have calmed since yesterday so just expect

west winds around 5 to 10 mph.

Or login with Allow

Our Saturday starts off with blue skies and temps in

the low 30s before clouds arrive during the

afternoon.

The first swell for today (rated 1 star or higher) is

forecast to arrive on Friday ( Jan 27) at 9PM. The

No Thanks
primary swell is predicted to be 2.2m and 9s period

with a secondary swell of 0.2m and 16s. The wind is

predicted to be cross-offshore as the swell arrive.

Is not a good day for Beginners

Home Favourites Search Account

Pag 8
Portfolio Review
Issue 3
Unclear what data was shown on Overview [severity: Medium]
Suggested Change: Change format of icons and maybe add text labels.

Before After
Changes:

Change format of icons 9:42

Brand and maybe add text

labels.

Bidart

France
! In order to make the
information more
understandable, I choose
to add text on the
Bidart

France !
weather symbols.

30º
Comments Safety Advices

Sunny Cloudy
30º
Sunny Cloudy

Low
12.30H Low
16 km/h 83 % 1/2Mts 16 km/h 83 % 12.30H 1/2Mts
Wind Humidity Tides Waves

Notifications Notifications
Winds have calmed since yesterday so just expect Winds have calmed since yesterday so just
west winds around 5 to 10 mph.
expect west winds around 5 to 10 mph.

Our Saturday starts off with blue skies and temps in Our Saturday starts off with blue skies and
the low 30s before clouds arrive during the temps in the low 30s before clouds arrive
afternoon.

The first swell for today (rated 1 star or higher) is during the afternoon.

forecast to arrive on Friday (Jan 27) at 9PM. The The first swell for today (rated 1 star or
primary swell is predicted to be 2.2m and 9s period higher) is forecast to arrive on Friday (Jan 27)
with a secondary swell of 0.2m and 16s. The wind is at 9PM. The primary swell is predicted to be
predicted to be cross-offshore as the swell arrive.
2.2m and 9s period with a secondary swell of
Is not a good day for Beginners

0.2m and 16s. The wind is predicted to be

cross-offshore as the swell arrive.

Is not a good day for Beginners

Home Favourites Search Account

Pag 9
Portfolio Review
Issue 4
Confused what is Overview and Forecast: [severity: Low]
Suggested Change: Change the Design of the buttons

Before After
Changes:

Brand Brand
9:42 9:42
Change the Design of the
buttons.

Search Search
Biarrit z
Biarrit
France
z
In addition to the Design
being altered, the T oday Forecast oday
T Forecast
France “Overview” feature was
updated to “Today”. In
Overview Forecast Overview Forecast this way, I believe it will Fri
Sat
Sun

be simpler for the user to Bidart

! 20/05 21/05 22/05

+ !
understand what they are
going to be looking at.
Comments France
+
Safety Advices 32º 31º 30º

30º
ri

Biarrit
at
un

F S S
20/05 21/05 22/05
France
32º 30º 29º 2/3Mts 2/3Mts 2/3Mts

32º
Sunny Cloudy 83% 83% 83%
2/3Mts 3/4Mts 2/3Mts
Low 16km/h 16km/h 16km/h
83 % 20 % 39 % Sunny Cloudy 16 km/h
Wind
83 %
Humidity
12.30H
Tides
1/2Mts
Waves CURRENT SURF REPORT

16 km/h 5 km/h 14 km/h 2.3-3.6m

10.35H
About
Winds have calmed since yesterday so just expect
17 kmh MODERATE ONSHORE
CURRENT SURF REPORT
Low
12.30H west winds around 5 to 10 mph.
TIDE MAP

2.3-3.6m

16 km/h 83 % 2/3Mts Our Saturday starts off with blue skies and temps in
17 kmh MODERATE ONSHORE
10.35H the low 30s before clouds arrive during the High 5.30AM ow 11.30AM igh 17.30PM
H
afternoon.

4 orecast
2 HF 06.25H 19.35H
06.25H 19.35H 4 orecast
2 HF
Image

Home Favourites Search Account Home Favourites Search Account

Pag 10
Portfolio Review
Issue 5
Confused to find the " Safety Advices" [severity: High]
Suggested Change: Add text for " Safety Advices" Icon and add something in Notifications

Before After
B rand 9:42
Se arch
B iarrit z

a
Ch nges:

rance
F

T oday Forecast
Add text for "Safety
Advices" Icon and add
verview orecast something in Notifications

O F
Bidart

France
!
+
Due to the Comments Safety Advices
!
iarrit
30º
misunderstanding of the
B z
icon I decided to add text
France to the icon

Sunny Cloudy

32º
Sunny Cloudy 16 km/h 83 %
Low
12.30H 1/2Mts
Wind Humidity Tides Waves
About
Winds have calmed since yesterday so just expect
Low
12.30H west winds around 5 to 10 mph.

16 km/h 83 % 2/3Mts Our Saturday starts off with blue skies and temps in
the low 30s before clouds arrive during the
afternoon.

06.25H 19.35H
06.25H 19.35H
Image

Home Favourites Search Account

Pag 11
Portfolio Review
Preference Test Plan
INTRODUCTION
Vela –UnModerated Remote Preference Test, Mobile 

By – Nuno Cunha
BACKGROUND
Vela is a smartphone app that gives water sports enthusiasts everything they need to organize their activities, from a better method to measure wind, water, and waves to essential
notifications and alerts and a resource for networking with other users. The software is intended for novices and experts to use on the move or before going out on the water.
GOALS
This preference test compares two comparable designs for the application's
Splash Screen, LogIn Screen and Home Screen in order to determine which design
approach is preferable.
Methodology
The A/B preference test was accomplished using Google Forms. To evaluate the prototype and preferences, volunteers from friends and colleges were enlisted. There were a total of 13 test
subjects. It will take place over the course of two days.

Pag 12
Portfolio Review
Slasch Screen
1 2
9:42 RESULTS
The goal of this test was to determine which design best captured the user's
attention. In one, dark colors and a background picture were used; in the
second solution, a simpler design with more obvious colors was used. The
goal was to determine which style the users were more indulging in.
According to the graphic, the more evasive proposal was chosen as the
response. I believe that it will be possible to verify that young users were
responsible for the test. The end result may have been different if it had
been created using a different age group. As a result, the test is still ongoing,
enabling accurate prediction of the ultimate Splash Screen score.

VELA.APP VELA.APP
Be Wild and free,
Be Wild and free,

just like the

just like the

Sea!! Sea!!

Pag 13
Portfolio Review
Login
1 2
VELA.APP RESULTS
VELA.APP
The goal of this test was to determine which design best captured the user's
attention. There were two solutions presented that I believe will work best for
Login Login my application. The second solution, with a margin I wasn't expecting, was
the one that was most chosen. The solutions consist of the exact same
Email components with just minor visual differences. One is more Modern, the
Email Adress other a little more classic. I believe that it is crucial to have clear
Email Address information. And perhaps the second solution was chosen as a result.
Password
Password Forgot Password?
Password
Sign in with Facebook
Remember me Forgot password?
Sign in with Google

Login

Or login with

Don't have an account? Sign Up

Sign up
Login Sign up

Don’t have an account? Signup

Pag 14
Portfolio Review
Home Screen
1 2
9:42 9:42
RESULTS
In this test, the idea was to determine which design the users identified with
the most. Considering that it was also suggested that they leave a
Bidart

France ! Bidart

France ! comment if they so desired. In other words, one comment was made during
the exam, but many more were made by email. The graph indicates that the
Comments Safety Advices
majority prefers the first solution, but I realized that there needed to be

30º
Comments Safety Advices

30º
certain changes made in order to make the solution more credible. Here it
again became clear that the soberest design received the least support;
maybe, like in the Splash Screen test, the age of the test subjects had a
Sunny Cloudy Sunny Cloudy significant role. But I'm hoping to find out more information soon, in order to
have a more comprehensive and clear explanation.

Low Low
12.30H
16 km/h 83 % 12.30H 1/2Mts 16 km/h 83 % 1/2Mts
Wind Humidity Tides Waves Wind Humidity Tides Waves

Notifications Notifications
Winds have calmed since yesterday so just expect Winds have calmed since yesterday so just expect
west winds around 5 to 10 mph.
west winds around 5 to 10 mph.

Our Saturday starts off with blue skies and temps in Our Saturday starts off with blue skies and temps in
the low 30s before clouds arrive during the the low 30s before clouds arrive during the
afternoon.
afternoon.

The first swell for today (rated 1 star or higher) is
forecast to arrive on Friday (Jan 27) at 9PM. The
primary swell is predicted to be 2.2m and 9s period
with a secondary swell of 0.2m and 16s. The wind is
predicted to be cross-offshore as the swell arrive.
predicted to be cross-offshore as the swell arrive.
The first swell for today (rated 1 star or higher) is
forecast to arrive on Friday (Jan 27) at 9PM. The
primary swell is predicted to be 2.2m and 9s period
with a secondary swell of 0.2m and 16s. The wind is

Is not a good day for Beginners

Is not a good day for Beginners

Home Favourites Search Account Home Favourites Search Account

Pag 15
Usability

Testing

Interview Questions
If you had two products and had to ask one question to users to
determine which they preferred more, what would you ask?
How do you evaluate a design?
What kind of data have used to validate a design?
Are there usability testing methods you already have
experience in? If so, explain.

Thank
you!!!