Project 04 White Paper Final

A Cognitive Usability Test for
Off-Road Navigation Applications
Damon Miller
ENGL 317
04/18/2021
i
Table of Contents
Table of Contents .............................................................................................................ii
Introduction ..................................................................................................................... 1
Methodology.................................................................................................................... 1
Tasks ........................................................................................................................... 1
Test Environment......................................................................................................... 2
Location ................................................................................................................... 2
Computer Equipment ............................................................................................... 2
Smartphone Equipment ........................................................................................... 3
Test Metrics ................................................................................................................. 3
Results ............................................................................................................................ 4
Task 1 .......................................................................................................................... 4
Task 2 .......................................................................................................................... 5
Task 3 .......................................................................................................................... 7
Task 4 .......................................................................................................................... 8
Task 5 ........................................................................................................................ 10
Task 6 ........................................................................................................................ 11
Task 7 ........................................................................................................................ 12
Task 8 ........................................................................................................................ 14
Task 9 ........................................................................................................................ 16
Task 10 ...................................................................................................................... 17
Conclusion and Recommendations ............................................................................... 18
Bibliography .................................................................................................................. 21
Appendix ....................................................................................................................... 22
ii
Introduction
There are many navigation applications and websites available to consumers that assist
users with getting to most destinations. Gaia GPS and Rever are two such resources
that combine both on-road and off-road navigation capabilities into one convenient
platform. The users of these platforms enjoy off-roading in 4x4 vehicles or on
adventure/dual-sport motorcycles but must travel to these off-road locations and trails
via paved roads. A typical user has a solid understanding of navigation, including the
ability to read topographical maps and orienteer with a compass. These applications
designed to serve as a convenient supplemental resource to traditional paper maps
when traveling off-road. A cognitive walkthrough usability test was performed on these
two platforms, including on-road and off-road route creation, and route editing, using
both the website and phone application versions of these products. Using the five
component standards that define usability, this white paper presents the results of this
analysis.
Methodology
The test was designed to introduce the user to each platform with simple tasks, and
then gradually increase their knowledge by making the tasks more complicated and
difficult. The purpose of this design was to determine how each platform helps the user
to adapt to different navigation scenarios. The odd numbered tasks were performed on
the Gaia GPS platform first, while the even numbered tasks were performed on the
Rever platform first. This was done to help balance the potential advantages of
processes learned on one platform, assisting in the completion of the same process on
the other platform. The chronological order of the tasks and subtasks was designed to
emulate typical changes made to cognitive preconceived plans where details are ironed
out after initial ideas. Some tasks were designed to require the user to circumvent the
platform defaults to successfully complete the task. Each task has a
suggested/estimated time to complete the tasks to quantify efficiency of the platform.
The tasks are designed to represent several real-world situations that users frequently
encounter when using navigation tools both at home and in the field.
Tasks
1. Log in to the above website with your credentials and save your login
information. Log out, close your browser, and try to log in again without
reentering your credentials. (2 minutes)
2. Create and save a bookmark using the following address: 201 Bluffs Dr, Eagle,
CO. (2 minutes)
3. Using the bookmark created in Task 2 as a starting point, create a paved road
driving route to the “Rocky Mountain National Park Grand Lake Entrance”. (3
minutes)
4. Using the route from Task 3, create a pitstop to have lunch at “The Little Diner,
Vail, CO”. (3 minutes)
1
5. Using the route from Task 4, alter the route to include Forest Road 700 (Red and
White Road to Muddy Creek Road) to Highway 131 North and avoid traveling
west on I-70. Save the route to the account with the name “Muddy Pass”. (6
minutes)
6. Using the Samsung Galaxy Note 10+ provided (leave Wi-Fi OFF and use mobile
data for this task to emulate being in the field), log in to your account via the Gaia
GPS/Rever app and find the saved Muddy Pass route. Using the Gaia
GPS/Rever app, remove the stop in Vail, CO and add a stop at Radium Hot
Springs, Kremmling, CO. (8 minutes)
7. Using the Gaia GPS/Rever app, download (using mobile data) USGS
topographical maps for Trough Road between Hwy 131 and Hwy 9. Once the
download is complete, put the phone in Airplane mode to confirm access to the
offline maps. While in Airplane mode, determine the elevation difference
between State Bridge and Radium Hot Springs using the offline maps.
Document this figure in the notes. Once complete, turn airplane mode off for the
next task. (10 minutes)
8. Using the Gaia GPS/Rever app, create a new route from Love’s Travel Plaza in
Grand Junction, CO to the bookmark from Task 1 (201 Bluffs Dr, Eagle, Co).
After creating the route, add a gas stop at the Kum & Go in Rifle, CO. Save the
route “Test Trip”, log in to your account on the computer, and verify the route has
been saved for future editing. (8 minutes)
9. Using the website, create a new route from Minturn, CO to Vail, CO that goes
over Shrine Mountain Pass. Verify that the route contains information pertaining
to summer use only for high clearance vehicles on this route. (8 minutes)
10. Using the website, adjust the route from Task 9 to include the entire length of the
Lime Creek Jeep Trail. Use a map layer to estimate the elevation difference
between the west and east ends of Lime Creek Trail. Document this figure in the
notes. (8 minutes)
Test Environment
A test environment was chosen that would emulate the typical conditions of a user when
engaging with the two platforms.
Location
The online/computer tasks were conducted in a home office. The smartphone tasks
were conducted in a parked vehicle on a sunny day to emulate an outdoor environment.
Computer Equipment
Computer Hardware:
 Manufacturer: Custom-Built by Damon Miller
 Motherboard: MEG-X570-ACE
 Processor: AMD Ryzen 7 3800X 8-Core Processor 3.90 GHz
 Installed RAM: 32.0 GB
 Storage: 3x 1.0 TB Adata SX8200
2
 Display Adapter: AMD Radeon RX 5700 XT
 Screen Resolution: 2560 X 1440
 System type: 64-bit operating system, x64-based processor
Operating System:
 Edition Windows 10 Home
 Version 20H2
 Installed on 08/25/2020
 OS build 19042.867
 Experience Windows Feature Experience Pack 120.2212.551.0
Web Browser:
 Edition Mozilla Firefox Browser
 Version 87.0 (64-bit)
Smartphone Equipment
Manufacturer: Samsung
Model Name: Galaxy Note 10+
Model Number: SM-N975U
Android Version: 11
One UI Version: 3.1
Carrier: Verizon Wireless
Test Metrics
Test metrics were designed to be both qualitative and quantitative. Criteria statements
for each of the five components that define useability were created to measure
qualitative data. These criteria statements are as follows:
1. Efficient – User was able to complete the task within the suggested time.
2. Effective – User was able to successfully complete all aspects of the task.
3. Engaging – User enjoyed using the platform to perform the task and is satisfied
with the task results.
4. Error Tolerant – The platform corrected or notified user of mistakes. OR
provided suggestions when the information was entered into the platform.
5. Easy to Learn – User was able to complete task without consulting the help
menu on the platform or any other outside resource.
Quantitative data was measured using a six-point, labeled Likert scale for the user’s
level of agreement or disagreement with each criteria statement. A six-point scale was
chosen to eliminate a mid-point and motivate the user to engage in feedback for each
task. The tasks are designed so the outcome of each task is on the extreme ends of
the Likert scale: success or failure. To offset these extremes, each point on the Likert
scale is labeled; research has shown this to lower the extremeness of responses. The
Likert scale also goes from Strongly Disagree to Strongly Agree. This order was
chosen to encourage the user to spend more effort when thinking about their response,
3
rather than choosing the first option of agreement had the order been reversed. An
example of the Likert scale used in the study is as follows:
Strongly Disagree Slightly Slightly Agree Strongly
Disagree Disagree Agree Agree
1 2 3 4 5 6
Results
Task 1
Figure 1: Task 1 - Log in Screen Comparison (Note: Username has been removed to protect user ID.)
Task 1 Summary: Log in to the website and save credentials.

REVER Task Usability Score: 5.8/6.0 GAIA GPS Task Usability Score: 6.0/6.0
Task 1 Ratings
6
5
Likert Scale Rating
0
Efficient Effective Engaging Error Tolerant Easy to Learn
Pros: “Remember Me” option. Pros: Multiple Menu Options accessible from
home Page.
Cons: Slower to load. Lack of menu options Cons: None.
creates a gated feel.
4
Both websites have an engaging and inspirational background that portrays what the
website is about (figure 1). The Rever website had a gated feel as the only option was
to log in or create an account. Rever homepage did take noticeably longer to load than
the Gaia GPS homepage. The Gaia GPS website had several menus to explore more
about the service, get help, and view membership options. There is also an option to
conveniently download the mobile app. Both websites had an option for users to login
via their Facebook accounts, which prevents having to create a specific account for
either platform.
Task 2
Figure 2: Task 2 – Bookmark Comparison.
Task 2 Summary: Creating a Bookmark.

Task 2 Ratings
6
5
Likert Scale Rating
2
1
0
5
Pros: Suggestions for address. Pros: Suggestions for address. Can
create/save multiple waypoints.
Cons: Cannot create a bookmark. Must type Cons: Waypoints are different than
in home address/staring location every time a bookmarks (Google maps) as user cannot
new route is created or edit “bookmark” route automatically create route from a previously
which is tedious. saved waypoint.
Rever has no option to save a bookmarked location. This was circumvented to

complete the task by creating a very short route (figure 2, left). However, the design
purpose of the task was to create a reusable bookmark for creating future routes from a
specific location. (I inquired with Rever about adding this feature in May 2019, like
Google maps has, and creating a bookmark still does not exist on this platform.) While
Gaia GPS allowed the user to accomplish this task by creating a saved waypoint (figure
2, right), a new route could not be started directly from the saved waypoint; the waypoint
must be selected to find the location and then a new route is created by clicking on the
road near the waypoint.
While both platforms autocompleted the

address as it was entered, the Rever
search bar was too short to confirm that the
correct address was being selected (figure
3). This was especially true with longer
addresses and locations in later tasks.
There was no option to make this search
bar wider to verify the correct address was
being chosen. The scroll bar allows the
user to view a longer address but felt
cumbersome to use while typing. Screen
resolution did not affect search bar width.
Figure 3: REVER Search Bar
6
Task 3
Figure 4: Task 3 - Creating a Paved Route.
Task 3 Summary: Creating a Paved Route.

Task 3 Ratings
6
5
Likert Scale Rating
0
Pros: Destination was at the RMNP ranger Pros: Shortest route chosen.
station/visitor center.
Cons: Search bar too narrow to verify park Cons: Destination 1.5 miles away from actual
entrance. park entrance. More steps to complete task.
While neither platform was able to locate the actual park entrance where visitors pay to
enter park from the western side, the Rever website sent the user to the ranger
station/visitor center, arguably a better option for visitors. The Gaia GPS website route
ended approximately 1.5 miles away from the park entrance, at the border of the
7
national park rather than at any usable location. Another drawback of the Gaia platform
was how the destination was selected. After typing the destination into the search bar,
the location is highlighted on the map with a waypoint marker symbol. To make the
marker the destination, the user must zoom in on the marker and click the road at the
marker location create the destination. This is less than ideal because it creates extra
steps for the user and accidently clicking off the road creates a straight-line route which
must be deleted to correct. However, the Gaia GPS platform did find the shortest paved
route between the two locations (figure 4, right), whereas the Rever platform found the
more highly traveled route along I-70 (figure 4, left).
Task 4
Figure 5: Task 4 - Editing a Paved Route.
Task 4 Summary: Edit a Paved Route by adding a stop at The Little Diner.
8
Task 4 Ratings
6
5
Likert Scale Rating
0
Pros: Location found via search bar. Pros: None.

Cons: Could not add an additional stop Cons: Waypoints must be plotted in order 
directly to the planned route. unable to add stop directly to route.
Unfortunately, neither platform performed well at what was supposed to be a simple

task. Adding a stop to a route is something that users commonly do when planning a
trip. While the Rever platform found the location, there was no way to add it as an
intermediate stop to route. Adding the stop required dragging a portion of the planned
route to a random new location which created a waypoint, and then renaming the new
waypoint to the designated stop via the search bar. The Gaia GPS platform fared even
worse with this task. At this point in the usability test and the learning curve of Gaia
GPS, the only way to add the stop was to delete the destination, add the stop, and then
readd the destination. The diner was not found via the Gaia GPS search bar, despite it
being a very popular location in Vail, CO. The location was known because the Rever
platform task (even number) was performed before the Gaia GPS task. Therefore, the
user was able to use previous knowledge of the location to complete this task on the
Gaia GPS platform. Neither platform provided any information about parking in the area
(there is no parking at or near the diner). While the task was completed on both
platforms (figure 5), the user would encounter problems with parking once this
intermediate stop was reached. Adding an intermediate stop to a planned route proved
to be difficult on both platforms.
9
Task 5
Figure 6: Task 5 - Adding off-road section to a paved route.
Task Summary: Edit a paved route by adding off-road section. Save route.
Task 5 Ratings
6
5
Likert Scale Rating
0
Pros: Undo feature to correct mistakes. Pros: Help menu very useful. Layers made
finding FR 700 easy.
Cons: Route very slow to save. Multiple Cons: Tedious process to create a route line
roads with the same label/name. along the off-road section.
Both platforms are supposed to be designed to excel in off-road route creation. Due to
the nature of these types of roads and trails, public GPS tracks are not always accurate
or available as on most paved roads. The accuracy of the Rever route is difficult to
determine as there were multiple roads labeled “Red and White Road” and no roads
10
were marked FR 700. As can be seen in figure
6 (left), many waypoints had to be created and
dragged into position to follow the intended
road. The “undo/redo” feature on the Rever Figure 7: Rever Edit Route Options Bar
platform (figure 7) proved valuable during this task as it was easy to correct mistakes as
the route was created. However, fewer waypoints were required on the Gaia GPS
platform to add the off-road section (figure 6, right). The highlight of the Gaia GPS
platform on this task was the ability to use the MVUM (USFS) map layer to find FR 700.
While it was tedious on both platforms to create an accurate track along this off-road
section, Gaia GPS scored comparatively worse due to lack of an “undo/redo” editing
function and the usage of the help menu to learn how to drag/change a route. (The
Rever help menu requires the user contact customer service via chat with a 24–48-hour
response time.) However, I would argue that the user’s confidence in the Gaia GPS
platform’s accuracy is much higher than that of the Rever platform for this task, due to
map layers in Gaia GPS. Perceived accuracy was not measured in the test. Another
flaw in the Rever platform was that it locked up during the save process. After 10
minutes of watching the saving icon, the user reloaded the page and the route had been
saved.
Task 6
Task Summary: Edit a saved route on mobile app by adding Hot Springs stop.
Task 6 Ratings
6
5
Likert Scale Rating
0
Pros: None. Pros: Task completed within allotted time

despite requiring six iterations.
Cons: Unable to complete task. Help Cons: Platform could not find Hot Springs
menu/videos useless. Autocorrect kept via search bar. Was able to find location
sending me to Germany. using map layers.
Adding and/or removing a stop while on route via the mobile app allows users to change
their plans during a trip. Using a route created on the website platforms, an attempt
was made to add and remove a stop on the mobile platform version. The user was
unable to complete these tasks on the Rever app, even after reviewing the help menu
11
videos. The limited help videos only include very basic tasks and seem to focus on
recording a route rather than creating/editing a route on the mobile app. This platform
does not appear to have the capability to edit a saved route on the mobile app.
Furthermore, the autocorrect search bar kept sending the user to a hot spring located in
Germany. The autocorrect created a barrier to finding the location in this task.
The Gaia GPS mobile app fared slightly better but still left much to be desired. It took
the user six attempts to successfully complete the route edit as they kept having to
cancel changes and revert to the original saved route to start over. The only way to find
the hot spring was to know the general location and find a map layer on which it was
listed. While the road to this hot spring was always visible, the label was only visible on
certain map layers.
Overall, the results of this task were very disappointing as this seemingly simple and
common task proved difficult or impossible on both platforms. The option to explore
and deviate from the original route should be included on these platforms.
Task 7
Task Summary: Download offline USGS maps on mobile app. Calculate Elevation.
Task 7 Ratings
6
5
Likert Scale Rating
0
Pros: None. Pros: Map Layers shine again. Able to

download selected area with minimal effort.
Cons: Unable to download offline maps due Cons: None.
to technical difficulties with Android
compatibility.
12
Having the ability to download offline
maps is important when traveling in
remote areas. The Rever mobile failed
at this task, even with Wi-Fi enabled.
According to customer support, there is
an issue with this feature on the
Android version of the mobile platform.
Their suggestion was to keep trying;
the user in this test gave up after 30
minutes. From a consumer’s
standpoint, the inability to download
offline maps on an Android device
makes the Rever platform relatively
useless for its primary purpose:
navigating in remote areas. Had the
task been tested on an Apple device,
perhaps the results may have been
different (the creator/founder of Rever
uses an Apple device).
This task was successfully completed

on the Gaia GPS mobile app. The
map layers provided numerous
options, including various USGS and
USFS map scales, satellite imagery
maps, and MVUM maps to name a few
(figure 8). The user was able to
highlight the selected area and
download a USGS layer for only the
off-road section of the route. The
downloaded map layer was saved on
the Android device and remained
accessible while offline (airplane
mode). The elevations were easy to
view via the zoom function on the
mobile device. Gaia GPS also had the
option to download and save multiple
layers and then switch between the
layers on the mobile app. Gaia GPS
shined on this task with the only
downside being possibly too many
layers to choose from.
Figure 8: Some of the over 200 map
layers available on Gaia GPS.
13
Task 8
Figure 9: Task 8 – Route created in Mobile App.
Task Summary: Create new route on mobile app with one stop. Save Route.
14
Task 8 Ratings
6
5
Likert Scale Rating
0
Pros: Simple, straight forward, easy to use. Pros: None.

Cons: GPS must be on to create a route on Cons: Search bar could not find locations.
mobile app. Unable to save route to specified Had to manually find locations by panning on
name. map.
The Rever mobile app excelled in creating a new route when the locations were entered
in the sequential order of the route (figure 9, left). While possible to create a paved
route on the Gaia GPS mobile app, it was very tedious process, taking over 20 minutes
to complete as the locations could not be found via a search bar and were only found by
panning on the map and previous knowledge about the locations from the Rever portion
of this task. (figure 9, right). This arduous process on the Gaia GPS app can be
simplified by using the Google Maps app.
15
Task 9
Figure 10: Task 9 - Long way around route creation.
Task Summary: Create new route that is not shortest distance. Check for road
warnings.
Task 9 Ratings
6
5
Likert Scale Rating
0
Pros: Auto corrected to correct route once Pros: Location found via search bar.
waypoint was dragged close to location.
Cons: Unable to find Shrine Pass via search Cons: Had to adjust route manually to avoid
bar. No information about the Shrine Pass backtracking. No information about the
road. Shrine Pass road.
This task was designed to force the user to create and edit a path that was not the
shortest route between two points. While it was easier to perform this task on the Rever
16
platform with a simple drag and drop, the user benefited from the prior knowledge of the
Shrine Pass location as the task was performed first on the Gaia GPS platform. As with
previous tasks, the Gaia GPS platform finds the shortest route between the initial and
final destinations. This created a route that backtracked part of the route which had to
be corrected by the user. As can be seen in figure 10, the routes are identical after
these adjustments were made. However, there was no information about the 4x4, off-
road nature of Shrine Pass Road on either platform, as requested in the task.
Task 10
Figure 11: Task 10 - Editing off-road route and map layers.
Task Summary: Edit off-road route. Use map layers to calculate elevation.
Task 10 Ratings
6
5
Likert Scale Rating
0
17
Pros: Lime Creek Jeep Trail easy to find. Pros: Easy to find Lime Creek Jeep Trail via
MVUM (USFS) Layer. One waypoint
drag/drop, and route was complete.
Cons: Took multiple iterations to get route to Cons: None.
follow the jeep trail. Contour map layer in
meters rather than feet.
This task was designed to create an “off the beaten path” side trip on an existing route.
As can be seen in figure 11, the routes are very similar. However, it was much easier
for the user to complete this task on the Gaia GPS platform, primarily due to the map
layers available. On the Gaia GPS platform, the jeep portion of the route was created
by dragging only one point of the previous route, to a point on the Lime Creek trail. This
shows that the GPS track for this trail is cataloged in the Gaia GPS software or MVUM
map layer. To create the same side route on the Rever platform proved to be more
difficult as more waypoints had to be added to create the correct route (figure 11, left).
In addition, the contour map for calculating the elevation portion of the task was only
available in meters on the Rever platform, while the Gaia GPS platform had map layer
options for both meters and feet. Confidence level of accuracy for both routes was high
due to Lime Creek Jeep Trail being the only other through road in the area of the route.
Conclusion and Recommendations

While both platforms had strengths and weaknesses, neither shined on all tasks. The
Gaia GPS performed well when the variety of map layers helped the user to perform the
task more efficiently and effectively. However, there were issues when using the search
bar to find known locations. Gaia GPS also struggled when the user was creating a
new route in the Gaia GPS mobile app.
OVERALL USABILITY The Rever platform’s search bar
appeared to be more accurate when
6
finding known locations, until a location
5 was not in the database and the user was
4 3.28 3.64 sent to foreign lands. A wider search bar
would vastly increase the usability of this
3
feature on the Rever platform. The
2 Rever mobile app was proficient at
1 creating a new route but failed when
Rever Gaia GPS downloading offline maps, something the
Gaia GPS mobile app excelled at.
Figure 12: Overall Usability
18
Cumulative Rating by Task
30
25
Likert Scale Rating
20
15
10
0
Task 1 Task 2 Task 3 Task 4 Task 5 Task 6 Task 7 Task 8 Task 9 Task 10
Rever Gaia GPS
Figure 13: Cumulative Usability Rating by Task
Based on the tasks performed in this study, neither platform can be recommended as a
stand-alone, one stop GPS navigation platform/app for both on road and off-road use.
The overall useability score (figure 12) for both platforms is very similar which attests to
both platforms performing well on some tasks and poorly on other tasks. This variation
in usability also illustrated in figure 13. While Gaia GPS scores higher in overall
usability, both platforms would benefit when used in conjunction with each other, or with
a platform like Google Maps.
Cumulative Ratings
60
50
Likert Scale Rating
40
30
20
10
0
Rever Gaia GPS
Figure 14: Cumulative Ratings
While the Gaia GPS had a higher rating across all component standards that were used
to measure usability (figure 14), the following recommendations are made based on
both user feedback and cumulative ratings:
19
 For off-road use, the Gaia GPS platform performed better due to the vast array of
available map layers and is the recommended platform for off-road travel and
exploration, when the route is created in advance on the website and the offline
maps are downloaded via the Gaia GPS app.
 For on road use, the Rever platform performed better for paved routes and known
locations and is the recommendation when traveling on the beaten path, when
mobile phone data service is available.
20
Bibliography
Sign in. (n.d.). Rever. https://a.rever.co/
TrailBehind, Inc. (n.d.). Gaia GPS: Navigate, Track, and Explore. GaiaGPS.Com.
https://www.gaiagps.com/login/
21
Appendix
Tasks Gaia GPS Rever
https://www.gaiagps.com/login/ https://a.rever.co/
TASK 1 Log in to the website with your credentials and save Log in to the website with your credentials and save
your login information. Log out, close your browser, your login information. Log out, close your browser,
and try to log in again without reentering your and try to log in again without reentering your
credentials. (2 minutes) credentials. (2 minutes)
Efficient User was able to complete task within the suggested User was able to complete task within the suggested
time. time.
Strongly Disagree Slightly Slightly Agree Strongly Strongly Disagree Slightly Slightly Agree Strongly
Disagree Disagree Agree Agree Disagree Disagree Agree Agree
1 2 3 4 5 6 1 2 3 4 5 6
X X
Effective User was able to successfully complete all aspects User was able to successfully complete all aspects
of the task. of the task.
1 2 3 4 5 6 1 2 3 4 5 6
X X
Engaging User enjoyed using the platform to perform the task User enjoyed using the platform to perform the task
and is satisfied with task results. and is satisfied with task results.
1 2 3 4 5 6 1 2 3 4 5 6
X X
Error The platform corrected or notified users of mistakes, The platform corrected or notified users of mistakes,
Tolerant or provided suggestions when the information was or provided suggestions when the information was
entered into the platform. entered into the platform.
1 2 3 4 5 6 1 2 3 4 5 6
X X
Easy to User was able to complete task without consulting User was able to complete task without consulting
Learn the help menu on the platform or any other outside the help menu on the platform or any other outside
resource. resource.
1 2 3 4 5 6 1 2 3 4 5 6
X X
Additional Site automatically saved my username and Site automatically saved my username and
Notes password. Login with Facebook option. There was password. Option to “Remember Me”. Login with
also an option to retrieve a forgotten password. Facebook option. There was also an option to
retrieve a forgotten password. Slow to Load page.
22
https://www.gaiagps.com/login/ https://a.rever.co/
TASK 2 Create and save a bookmark using the following Create and save a bookmark using the following
address: 201 Bluffs Dr, Eagle, CO. (2 minutes) address: 201 Bluffs Dr, Eagle, CO. (2 minutes)
time. time.
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
resource. resource.
1 2 3 4 5 6 1 2 3 4 5 6
X X
Additional I was able to create a waypoint at the address on the I could not create a bookmark at the address. I had
Notes second attempt. The map does not automatically go to create/save a route to/from the address that is 3
to the waypoint on login but is saved under the feet long. I figured this out on the third attempt. The
waypoint menu. help menu was useless as there was no search bar
to look up “bookmarks”. Can be retrieved from
route menu.
23
TASK 3 Using the bookmark created in Task 2 as a starting Using the bookmark created in Task 2 as a starting
point, create a paved road driving route to the point, create a paved road driving route to the
“Rocky Mountain National Park Grand Lake “Rocky Mountain National Park Grand Lake
Entrance”. (3 minutes) Entrance”. (3 minutes)
time. time.
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
resource. resource.
1 2 3 4 5 6 1 2 3 4 5 6
X X
Additional Website suggested destination as I typed it in. Website suggested destination as I typed it in.
Notes However, first attempt was a straight line between Completed on first attempt. Destination on map is
the two locations. Zooming in and clicking on the at the ranger station/visitor center so more accurate
road at each location corrected this. Destination on than Gaia GPS. Route follows I-70, similar to Google
map is about 1.5 miles away from actual park Maps route.
entrance. Shortest Route.
24
TASK 4 Using the route from Task 3, create a pitstop to have Using the route from Task 3, create a pitstop to have
lunch at “The Little Dine, Vail, CO”. (3 minutes) lunch at “The Little Dine, Vail, CO”. (3 minutes)
time. time.
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
resource. resource.
1 2 3 4 5 6 1 2 3 4 5 6
X X
Additional Could not add stop or drag route to location. Had to I could not add the stop to the route but was able to
Notes delete destination, add stop, then add destination drag the route line to the location because I knew
again. Waypoints must be plotted in order. No the general vicinity. I was then able to type the
information about parking. After the route it saved, destination into the #1 location and the map found
it seems harder to edit. the diner. No information about parking.
25
TASK 5 Using the route from Task 4, alter the route to Using the route from Task 4, alter the route to
include Forest Road 700 (Red and White Road to include Forest Road 700 (Red and White Road to
Muddy Creek Road) to Highway 131 North and avoid Muddy Creek Road) to Highway 131 North and avoid
traveling west on I-70. Save the route to the account traveling west on I-70. Save the route to the account
with the name “Muddy Pass”). (6 minutes) with the name “Muddy Pass”). (6 minutes)
time. time.
1 2 3 4 5 6 1 2 3 4 5 6
X X
11 minutes
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
resource. resource.
1 2 3 4 5 6 1 2 3 4 5 6
X X
Additional Several Muddy Pass locations on the map. Used Discover search bar useless for adding waypoints.
Notes help menu to figure out how to drag/change route Multiple roads labeled Red and White. Undo feature
(via small black arrows). Had to create several is nice for making corrections. Easy to drag route to
waypoints to get route on correct roads. new location but must move all waypoints for
shortest route. Route very slow (+10 min) to save.
Uncertain if route over Muddy Pass is correct.
26
TASK 6 Using the Samsung Galaxy Note 10+ provided, log in Using the Samsung Galaxy Note 10+ provided, log in
to your account via the Gaia GPS app and find the to your account via the Rever app and find the saved
saved Muddy Pass route. Leave WiFi OFF and use Muddy Pass route. Leave WiFi OFF and use mobile
mobile data for this task to emulate being in the data for this task to emulate being in the field. Using
field. Using the Gaia GPS app, remove the stop in the Rever app, remove the stop in Vail, CO and add a
Vail, CO and add a stop at Radium Hot Springs, stop at Radium Hot Springs, Kremmling, CO.
Kremmling, CO. (8 minutes)
time. time.
1 2 3 4 5 6 1 2 3 4 5 6
X X
Gave up after 15 minutes.
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
resource. resource.
1 2 3 4 5 6 1 2 3 4 5 6
X X
Additional Took 6 attempts to complete this task but still within Unable to add this stop. App kept autocorrecting so I
Notes time limit. Kept having to cancel and start over from could not find the stop, sent me to Germany. Unable
saved route. No way to look up hot springs directly. to remove Vail stop. No help menu and help videos
Must drag a previous waypoint to the location if you useless. Unable to complete task.
know where it is. Again, app only adds new
waypoints to the end of the route.
27
TASK 7 Using the Gaia GPS app, download (using mobile Using the Rever app, download (using mobile data)
data) USGS topographical maps for Trough Road USGS topographical maps for Trough Road between
between Hwy 131 and Hwy 9. Once the download is Hwy 131 and Hwy 9. Once the download is
complete, put the phone in Airplane Mode to confirm complete, put the phone in Airplane Mode to confirm
access to the offline maps. While in Airplane Mode, access to the offline maps. While in Airplane Mode,
determine the elevation difference between State determine the elevation difference between State
Bridge and Radium Hot Springs using the offline Bridge and Radium Hot Springs using the offline
maps. Document this figure in the notes. (10 maps. Document this figure in the notes. (10
minutes) minutes)
time. time.
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
resource. resource.
1 2 3 4 5 6 1 2 3 4 5 6
X X
Additional 7425-6740=685 feet Unable to download offline maps. Contacted

Notes Numerous map layers to choose from. Only option customer support and they said it was an issue with
to download USGS for entire route wasting some Android devices and to just keep trying. Tried with
space. Easy to find elevation change on app. Wi-Fi, still nothing. Gave up after 30 minutes of
waiting.
28
TASK 8 Using the Gaia GPS app, create a new route from Using the Rever app, create a new route from Love’s
Love’s Travel Plaza in Grand Junction, CO to the Travel Plaza in Grand Junction, CO to the bookmark
bookmark from Task 1 (201 Bluffs Dr, Eagle, Co). from Task 1 (201 Bluffs Dr, Eagle, Co). After
After creating the route, add a gas stop at the Kum & creating the route, add a gas stop at the Kum & Go
Go in Rifle, CO. Save the route as “Test Trip”, log in in Rifle, CO. Save the route as “Test Trip”, log in to
to your account on the computer, and verify the your account on the computer, and verify the route
route has been saved for future editing. (8 minutes) has been saved for future editing. (8 minutes)
time. time.
1 2 3 4 5 6 1 2 3 4 5 6
X X
20 minutes
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
resource. resource.
1 2 3 4 5 6 1 2 3 4 5 6
X X
Additional I had to manually find the locations on the map, Very easy to create route on app by simply entering
Notes search bar could not find them. This entire process in locations. Make sure GPS is on or route cannot
was very tedious, and I do not recommend this be created. Unable to save route with specified
task/app combination. Better to use Google Maps. name.
29
TASK 9 Using the Gaia GPS website, create a new route from Using the Rever website, create a new route from
Minturn, CO to Vail, CO that goes over Shrine Minturn, CO to Vail, CO that goes over Shrine
Mountain Pass. Verify that the route contains Mountain Pass. Verify that the route contains
information pertaining to summer use only for high information pertaining to summer use only for high
clearance vehicles on this route. (8 minutes) clearance vehicles on this route. (8 minutes)
time. time.
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
resource. resource.
1 2 3 4 5 6 1 2 3 4 5 6
X X
Additional Able to find Shrine Mountain Pass via search bar. Unable to find Shrine Mountain Pass via search bar.
Notes Had to adjust route via dragging so route would go Must create route endpoints and then drag route to
over the pass and avoid backtracking. No Shrine Pass to get correct route. No information
information about the Shrine Pass road. about the Shrine Pass road.
30
TASK 10 Using the Gaia GPS website, adjust the route from Using the Rever website, adjust the route from Task 9
Task 9 to include the entire length of the Lime Creek to include the entire length of the Lime Creek Jeep
Jeep Trail. Use a map layer to estimate the elevation Trail. Use a map layer to estimate the elevation
difference between the west and east ends of Lime difference between the west and east ends of Lime
Creek Trail. Document this figure in the notes. (8 Creek Trail. Document this figure in the notes. (8
minutes) minutes)
time. time.
1 2 3 4 5 6 1 2 3 4 5 6
X X
Effective User was able to successfully complete all aspects of User was able to successfully complete all aspects of
the task. the task.
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
1 2 3 4 5 6 1 2 3 4 5 6
X X
Had to adjust so return was on I-70 west.
resource. resource.
1 2 3 4 5 6 1 2 3 4 5 6
X X
Additional 10,680-8920=1760 ft rise 3250m-2720m=530m ~1740 ft

Notes Lime Creek Trial easy to find. One waypoint drag and No way to use USGS/ft topo maps. Had to adjust
route was complete. USGS layer big help. route five times to make it follow Lime Creek Rd.
31

Project 04 White Paper Final

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Project 04 White Paper Final

Uploaded by

Copyright:

Available Formats

A Cognitive Usability Test for

Off-Road Navigation Applications

Computer Equipment ............................................................................................... 2

Smartphone Equipment ........................................................................................... 3

Test Metrics ................................................................................................................. 3

Conclusion and Recommendations ............................................................................... 18

Task 1 Summary: Log in to the website and save credentials.

Figure 2: Task 2 – Bookmark Comparison.

Task 2 Summary: Creating a Bookmark.

Rever has no option to save a bookmarked location. This was circumvented to

While both platforms autocompleted the

Figure 4: Task 3 - Creating a Paved Route.

Task 3 Summary: Creating a Paved Route.

Figure 5: Task 4 - Editing a Paved Route.

Pros: Location found via search bar. Pros: None.

Unfortunately, neither platform performed well at what was supposed to be a simple

Figure 6: Task 5 - Adding off-road section to a paved route.

Pros: None. Pros: Task completed within allotted time

Pros: None. Pros: Map Layers shine again. Able to

This task was successfully completed

Figure 9: Task 8 – Route created in Mobile App.

Pros: Simple, straight forward, easy to use. Pros: None.

Figure 10: Task 9 - Long way around route creation.

Figure 11: Task 10 - Editing off-road route and map layers.

Conclusion and Recommendations

Figure 13: Cumulative Usability Rating by Task

Figure 14: Cumulative Ratings

Additional 7425-6740=685 feet Unable to download offline maps. Contacted

Additional 10,680-8920=1760 ft rise 3250m-2720m=530m ~1740 ft

You might also like