Chapter 9 - Evaluation Techniques

1.Usability Testing: Usability testing involves observing users as they interact with a system to identify
usability problems. This can be done through tasks, scenarios, or simply by observing users navigating
the interface. For example, suppose you're designing a mobile banking application. You could ask users
to perform tasks such as transferring money between accounts or paying a bill online while observing
their interactions and noting any difficulties they encounter.

2.Heuristic Evaluation: Heuristic evaluation involves experts examining a system to identify usability
problems based on established principles or heuristics. Nielsen's 10 usability heuristics are commonly
used for this purpose. For instance, if you're designing an e-commerce website, a heuristic evaluation
might reveal issues with navigation consistency or unclear error messages during the checkout process.

3.Cognitive Walkthrough: In a cognitive walkthrough, evaluators simulate users' thought processes as

they perform tasks step-by-step. This helps identify potential usability issues related to task complexity
or system feedback. For example, in designing a productivity software, evaluators might walk through
the process of creating a new document, observing if users can easily find the necessary features and
understand feedback prompts along the way.

4.Think-Aloud Protocol: Think-aloud protocol involves users verbalizing their thoughts and actions as
they interact with a system. This provides insights into users' decision-making processes and helps
identify areas of confusion or frustration. For instance, in testing a mobile gaming app, users could be
asked to narrate their thoughts while playing a level, revealing whether they understand the game
mechanics or encounter any challenges.

5.Surveys and Questionnaires: Surveys and questionnaires gather quantitative and qualitative feedback
from users about their experiences with a system. These can be administered after users have
interacted with the system or as part of longitudinal studies to track changes over time. For example,
after using a social media platform, users could be asked to rate their satisfaction with the interface
design and report any specific features they found helpful or problematic.

6.Analytics and Log Analysis: Analytics tools and log analysis provide quantitative data about users'
interactions with a system, such as click-through rates, time on task, and error frequencies. This data can
help identify patterns and trends in user behavior, informing design decisions. For instance, analyzing
website traffic data might reveal which pages users visit most frequently and where they tend to drop
off, indicating areas for optimization.
In the context of Human-Computer Interaction (HCI), evaluation techniques are methods used to
understand how people interact with technology and to identify any problems or difficulties they might
encounter. These techniques are essential for creating user-friendly and effective systems.

Imagine you're trying to build a new app or website. You want to make sure it's easy to use and meets
the needs of your users. Evaluation techniques help you achieve this by allowing you to:

1.Watch Users Interact: Through methods like usability testing, you can observe real people using your
app or website. This helps you see firsthand where they might struggle or get confused.

2.Get Expert Feedback: Heuristic evaluation involves having experts review your design based on
established principles. This can uncover issues that you might not notice on your own.

3.Understand User Thinking: Techniques like cognitive walkthroughs and think-aloud protocols help you
understand how users think and make decisions while using your system. This insight is invaluable for
improving the user experience.

4.Gather Feedback: Surveys, questionnaires, and analytics tools allow you to collect feedback from a
larger group of users. This helps you understand broader trends and preferences.

By using these evaluation techniques, you're not only improving your design but also showing empathy
towards your users. It's normal to feel overwhelmed when facing a complex task like this, but remember
that these techniques are here to help guide you through the process.
What do evaluation techniques in HCI help with?

a) Making tea

b) Testing how easy a system is to use

c) Calculating rocket trajectories

d) Growing plants

How do users typically share their thoughts during the think-aloud protocol?

a) By remaining silent

b) By talking aloud about their actions

c) By writing a report

d) By sending a text message

What do surveys and questionnaires gather from users?

a) Recipes

b) Feedback and opinions

c) Weather data

d) Song lyrics

What is the purpose of analytics tools in HCI evaluation?

a) Measuring user satisfaction

b) Predicting lottery numbers

c) Analyzing bird migration patterns

d) Naming stars

What is usability testing?

a) Testing if a website is visible from space

b) Testing how easy a system is to use

c) Testing the strength of bridges
d) Testing the speed of cheetahs