HUMAN-CENTERED DESIGN

EVALUATING DESIGNS
motivation and menu

Scott Klemmer
How can we measure success?

2
Why Evaluate Designs with People?

3
What are some things you might
want to learn about an interface?
How would you find them out?

4
 Different Methods
Achieve Different Goals
Some Examples...

5
Usability Studies
informal formal

6
Surveys & Focus Groups

http://sfpuc.c.topica.com/maapeWDab5NjaaU3oZpeaeQK6z/ 7
Feedback from Experts
!Peer Critique
!Dogfooding
!Heuristic Evaluation

http://www.useit.com/papers/heuristic
Comparative Experiments

Joel Brandt et al., comparing Community Help and Blueprint 9

Participant Observation

e.g., Sutton & Hargadon, brainstorming groups

Simulation & Formal Models

courtesy Shumin Zhai courtesy Peter Pirolli

11
Issues to Consider
!Reliability/Precision
!Generalizability
!Realism
!Comparison
!Work Involved

12
What do you want to
learn?

13