Usability Testing: Pre and Post-Questionnaire #2

Pre-Test Questionnaire

What is your gender?

❏ Male (including transgender male)

❏ Female (including transgender female)

❏ Gender Variant/Non-conforming

How old are you?

❏ 12-17

❏ 18-24

❏ 25-34

❏ 35-44

❏ 45-54

❏ 55-64

❏ Over 65

What is your occupation?

Stay at Home Mom

What is your highest level of education?

❏ Partial High School Completion

❏ High School Diploma or GED

❏ Trade School Degree

❏ Associates Degree
 ❏ Bachelor’s degree

❏ Master’s degree

❏ Professional Degree

❏ Doctorate Degree

How would you define your computer skills?

❏ Beginner

❏ Intermediate

❏ Advanced

How frequently do you use the computer?

❏ Daily

❏ Weekly

❏ Monthly

❏ Never

Which device do you access the internet the most frequently with?

❏ Smart phone

❏ Desktop computer

❏ Laptop computer

❏ Tablet

On average, how many hours do you spend on the Internet per day?

❏ Under 1 hour

❏ 1-2 hours

❏ 2-4 hours
 ❏ 4-6 hours

❏ over 6 hours

Within the past 6 months, how many times have you visited the Dutch Bros

website?

❏ 0

❏ 1-5

❏ 6-10

❏ 11 or more

Within the past 6 months, what other coffee shop websites have you visited?

❏ Starbucks

❏ Peet’s Coffee

❏ Other:

❏ N/A

How does the Dutch Bros website compare to the other coffee shop websites you

have used?

❏ Better

❏ Worse

❏ About the same

❏ I don’t know

What would make you decide to buy coffee or coffee products from the Dutch Bros

website?

I don’t buy coffee online it is easier to pick it up at the store.

Pre-Test Questionnaire after Site is Open

What is your initial reaction?

It has a lot of white. The font is very big. Not many options to click on.

Is there anything that stands out? Why?

“Find your Drink” and “Ready to Fall in Love” stands out to me. The font is really big.

Is there anything you like or dislike? Why do you say this?

I like that there are not many options to pick from.

No dislikes

Just look around and do a little narrative.

I like that I can find where to get the drink menu and where they are located right

away. It also shows their feature drink.

Post-Test Questionnaire

How would you describe your overall experience with the Dutch Bros website now
that you used it to complete a few tasks?

It was easy to find drinks but the other tasks were more difficult since some of the
menu links were at the bottom of the page.

What did you like the most about the website? Why?

I like that the two things I would want most are right in the front – menu and
locations.

What did you like least about the website? Why?

It seems like the drinks were a little overwhelming and I didn’t link the employment
page. It was too difficult to find what I was looking for.

What, if anything, surprised you about the experience?

Nothing

What, if anything, caused you frustration?

Trying to find the application.

If you could change one thing about the website, what would it be? Why?

I would fix the menu so I could find things without having to scroll to the bottom of
the page.

Who do you know that would like this website? What are they like?

My neighbor. She is my age, has children, and loves her coffee.

On a scale from 1 to 5 (1=not at all likely, 5=likely), how likely are you to recommend
this product to a friend?

Why will you continue to use this website? What will stop you from using this
website in the future?

I would use it to find different options for drinks other than my regular ones.

Nothing

How frequently would you use this website?

1: Never

2. Very Rarely (once per month)

3. Rarely (2-3 times/week)

4. Occasionally (2-3 times/week)

5. Frequently (1-2 times/day)

6. Very Frequently (3+ times/day)

Usability Testing: Observation #2

Scenario 1: Filtering Through Options and Finding Specific

Information

You are with your friend driving around town running some errands. Your

friend suggests you guys go through the Dutch Bros drive thru to grab a drink. You

don’t frequently go to Dutch Bros, but you remember seeing an advertisement

online for the campout cold brew coffee, which happened to spark your interest.

However, because you are somewhat unfamiliar with Dutch Bros, you look to their

website in hopes of finding an image and nutritional facts for the campout cold

brew coffee.

Task 1

➔ Open up Dutch Bros website on your mobile phone and open the menu page.

Task Completion Completed

Completed when The menu page is displayed on the screen.

Expected Time on 6 seconds

Task

Actual Time on Task 3 sec

 Expected Path Home > Menu

Actual Path Home > Menu

Error count/ None

description

Observations:

The user immediately clicked on the “Full Menu” button under the Find your Drink
heading.

User Comments/Quotes:
“That was easy”

Task 2

➔ From the menu page, find the page where you can find specific information

(nutritional values) for the campout cold brew coffee.

Task Completion Completed

Completed when The campout cold brew coffee drink is displayed on the
screen, with corresponding nutritional facts displayed below
 Expected Time on 4 seconds

Task

Actual Time on Task 1 min 30 seconds

Expected Path Home > Menu > Cold Brew > Campout Cold Brew

Actual Path Home > Menu > Cold Brew > Campout Cold Brew

Coffee

Error count/ Clicked on “Campout Cold Brew” first to find the

description nutritional values

Observations:
User scanned the page and clicked on the Cold Brew menu option. She then
clicked on “Campout Cold Brew” instead of the Nutritional Facts button. She then
was able to open up the nutritional facts.

User Comments/Quotes:
I saw the “Find your perfect drink” after I clicked on everything.
Scenario 2: Applying for a job with Dutch Bros Coffee

You have a lot of free time on the weekend and you want to make some

extra money. A friend recommended you apply for a part-time job working as a

barista at Dutch Bros Coffee.

Task 1

➔ Open up the DutchBros.com website on your mobile phone and locate

employment opportunities.

Task Completion Completed

Completed when Employment page is displayed on the screen.

Expected Time on 12 seconds

Task

Actual Time on Task 15 seconds

Expected Path Home > Employment

Actual Path Home > Employment

Error count/ Looked in the main menu first

description
Observations:
User went to main menu first and then scrolled to the footer and clicked on
“Employment.”

User Comments/Quotes:
“It doesn’t look like anything is in the menu for employment opportunities.”

Task 2

➔ Open an employment application for the Dutch Bros. location in Bakersfield,

CA.

Task Completion Completed

Completed when Fillable application page for Bakersfield, CA location is

displayed

Expected Time on 10 seconds

Task

Actual Time on Task 15 seconds

 Expected Path Home > Employment> Apply > 1

Actual Path Home > Employment > Apply Button > Apply 1

Error count/ None

description

Observations:
User scrolled through the facts and then clicked on “Employment Application”
button 2/3 down the page. Then she entered in the location and brought up the
application.

User Comments/Quotes:
“Where is the application button?”
Scenario 3: Determine Corporate Values and Select a Drink for
Purchase

In the past you’ve usually purchased coffee from a large chain because it is

conveniently on your way to work, though you’ve always thought their drinks were

mediocre. You try to buy from small coffee shops that hold the same values as you

and to support local business, but it is often inconvenient to do so in the morning

so you still go to the large chain. A new Dutch Bros location has opened up on your

way to work and you're interested to try it out, but you’d like to know more about

their corporate values and need help deciding which drinks to try.

Task 1

➔ Navigate to the Dutch Bros website, DutchBros.com, and find more information

about their values.

Task Completion Completed

Completed when User states that they have found sufficient

information on Dutch Bros values

Expected Time on 2.5 minutes

Task

Actual Time on Task 5 seconds

 Expected Path Home > The Dutch Bros Foundation and/or Home > Our

Story

Actual Path Home > Our Story

Error count/ None

description

Observations:
The user immediately went to the main menu and clicked on “Our Story”

User Comments/Quotes:
“That was a total guess”

Task 2

➔ Find the Dutch Bros menu and, using the information available, choose a

drink to purchase on your first visit.

Task Completion Completed

 Completed when User selects a drink

Expected Time on 3 minutes

Task

Actual Time on Task 20 seconds

Expected Path Home > Menu > [Browse Menu Items]

Actual Path Home > Menu > Mocha > found her drink

Error count/ None

description

Observations:
User went to the menu and chose “Menu.” She then scrolled through the drink
menu, clicked on the Mocha and found the Cocomo.

User Comments/Quotes:
“I really like the cocomos”