Professional Documents
Culture Documents
ScholarlyCommons
Departmental Papers (ASC) Annenberg School for Communication
2017
Klaus Krippendorff
University of Pennsylvania, kkrippendorff@asc.upenn.edu
Recommended Citation
Celikoglu, O. M., Ogut, S. T., & Krippendorff, K. (2017). How Do User Stories Inspire Design? A Study of Cultural Probes. Design
Issues, 33 (2), 84-98. https://doi.org/10.1162/DESI_a_00441
Krippendorff, K., Celikoglu, O. M., & Ogut, S. T. (2017). How do user stories inspire design? A study of cultural probes. Design Issues, 33(2), 84-98.
doi:10.1162/DESI_a_00441
Comments
Krippendorff, K., Celikoglu, O. M., & Ogut, S. T. (2017). How do user stories inspire design? A study of
cultural probes. Design Issues, 33(2), 84-98. doi:10.1162/DESI_a_00441
Introduction
1 Jane Fulton Suri, “Design Expression and
Human Experience: Evolving Practice,” in
User-centered design relies on methods that elicit, describe, and
Design and Emotion: The Experience of interpret user experiences on the one hand and that provide room
Everyday Things, ed. Deana McDonagh, for designers’ subjective insights on the other.1 The methods typi-
Paul Hekkert, Jeroen van Erp, and Diane cally used include surveys, post facto evaluations, user laborato-
Gyi (London: Taylor and Francis, 2004),
ries, brainstorming techniques, participatory design or co-design,
13–17.
and ethnography.2
2 For research on survey methods, see
Joseph Pine and James Gilmore, “Wel- Among these methods, the use of ethnography has become
come to the Experience Economy,” Har- widespread because it offers design researchers relatively less
vard Business Review 76, no. 4 (1998): obtrusive methods of identifying users and eliciting data about
96–105; and Bruce Hanington, “Methods how they live and what they do in their everyday lives. According
in the Making: A Perspective on the State
to Fetterman, ethnography is “the art and science of describing a
of Human Research in Design,” Design
Issues 19, no. 4 (Autumn 2003): 9–18.
group or a culture.”3 Ethnography calls on researchers to partici-
User labs have been studied and ana- pate in people’s daily lives—watching what happens, listening to
lyzed in Per Ehn, Work-Oriented Design what is said, and asking questions.4 In this sense, participant
of Computer Artifacts (Falköping, Swe- observation and semi-structured interviews require researchers to
den: Arbetslivcentrum/Almqvist and Wik-
immerse themselves in people’s lives by joining them in their
sell International, 1988); Thomas Binder
everyday activities.5 As a result, they are far from being unobtru-
and Eva Brandt, “The Design:Lab as Plat-
form in Participatory Design Research,” sive. However, spontaneous, informal conversations in the course
CoDesign: International Journal of CoCre- of other activities are one of the less obtrusive methods that allows
ation in Design and the Arts 4, no. 2 the distinction between interviewer and interviewee to dissolve.6
(2008): 115–29; Jacob Buur and Susanne In joining ongoing conversations, ethnographers do not seek to
Bodker, “From Usability Lab to Design
establish a fixed sequence in which relevant topics are covered;
Collaboratorium,” DIS: Processes, Prac-
tices, Methods, and Techniques (New
they adopt a more flexible approach, allowing the discussion to
York: ACM Press , 2000): 297–307; JoAnn flow in a way that seems natural. They do not have to restrict
T. Hackos and Janice C. Redish, User and themselves to a single mode of questioning.7 Similarly, through
Task Analysis for Interface Design (New virtual ethnography, in which data can be generated through
York: John Wiley & Sons, 1998). For work
immersion in virtual worlds and virtual communities, even partic-
on participatory design and user co-
ipant observation becomes less obtrusive.8 With its anthropological
design, see Joan Greenbaum and Morten
Kyng, Design at Work: Cooperative and sociological origins, ethnography is an important method for
Design of Computer Systems (Hillsdale, any research that aims at a deeper understanding of people’s lives.9
NJ: Lawrence Erlbaum, 1991); Doug In user-centered design, ethnographic methods are used to
Schuler and Aki Namioka, Participatory observe, talk to, and understand users to incorporate their views
Design: Principles and Practices (Hills-
into the evaluation and creation of design solutions.10 Ethnogra-
dale, NJ: Lawrence Erlbaum, 1993); Eliza-
beth B.-N. Sanders, “From User-Centered
phies tend to bring to a design problem significant redundancy
to Participatory Design Approaches,” in and broader contextual information by focusing on how people
Design and the Social Sciences: Making
Connections, ed. Jorge Frascara (New
© 2017 Massachusetts Institute of Technology
84 DesignIssues: Volume 33, Number 2 Spring 2017 doi: 10.1162/DESI_a_00441
live, while surveys—the epistemological opposite of ethnogra-
phy—elicit answers to questions posed from the perspectives of
producers or designers, leaving respondents no space to respond
York: Taylor and Francis, 2002); Tuuli Mat-
telmäki, Design Probes (Helsinki: Univer- on their own terms.
sity of Art and Design Helsinki, 2006); In this study, we tested a method intended to strike a
and Kirsikka Vaajakallio and Tuuli Mattel- balance between the impositions of structured surveys and
mäki, “Design Games in Codesign: As a the broader outcomes of ethnographies, eliciting design-relevant
Tool, a Mindset and a Structure,” CoDe-
information while preserving the conceptions of users. One such
sign: International Journal of CoCreation
in Design and the Arts 10, no. 1 (2014):
method is cultural probes, conceived by Gaver, Dunne, and
63–77. For ethnography studies, see Rob Pacenti.11 Cultural probes rely on participants’ self-documentation
J.F.M. Van Veggel, “Where the Two Sides through photographs and narratives. This method is particularly
of Ethnography Collide,” Design Issues helpful in environments where an observer’s presence can distract
21, no. 3 (Summer 2005): 3–16; Bill from the everyday behavior of participants, such as in hospitals
Gaver, Tony Dunne, and Elena Pacenti,
or domestic spaces. We investigated how data generated through
“Cultural Probes,” Interactions (January/
February 1999): 21–29; Anita DeLongis, cultural probes were interpreted by individual designers when
Kenneth J. Hemphill, and Darrin R. they were expected to relate them to design ideas. To do so, we
Lehman, “A Structured Diary Methodol- prepared cultural probes packages consisting of daily tasks and
ogy for the Study of Daily Events,” in sent them to users, who voluntarily participated. After we received
Methodological Issues in Applied Psy-
these packages with participants’ records of completed tasks, we
chology, ed. Fred B. Bryant, John
Edwards, R. Scott Tindale, Emil J.
turned them over to designers and asked them to make sense of
Posavac, Linda Heath, Eaaron Henderson, these data in terms of certain design tasks. The limited number of
Yolanda Suarez-Balcazar (New York: our participants prevented us from making broader general-
Plenium Press, 1992), 83–109; and Tony izations; nevertheless, with the depth of the information we
Salvador, Genevieve Bell, and Ken received from users and designers, we have sought to open up
Anderson, “Design Ethnography,” Design
new perspectives and opportunities for further studies based on
Management Journal (Fall 1995): 35–41.
3 David M. Fetterman, Ethnography: a user-centered design approach. Through follow-up interviews
Step by Step (Thousand Oaks, CA: and a content analysis of designers’ interpretations and idea gen-
Sage, 1998). eration, we identified concepts that would be helpful in generat-
4 Alan Bryman, Ethnography: Overview ing user narratives and in embedding the narratives into design
(London: Sage, 2001); Martyn Hammers-
considerations.
ley and Paul Atkinson, Ethnography (Lon-
don: Routledge 1995).
5 Hammersley and Atkinson, Ethnography. Cultural Probes and Design Processes in User-Centered
6 David Silverman, Doing Qualitative Approaches
Research: A Practical Handbook (London Broadbent describes four generations in design methodology:
UK: Sage Publications, 2000); Hammers- craft methods, in which product information is transmitted
ley and Atkinson, Ethnography.
through apprenticeship; design-by-drawing methods, in which
7 James A. Holstein and Jaber F. Gubrium,
The Active Interview (Thousand Oaks, design is separate from production; hard systems methods,
CA: Sage, 1995), 40–43. directed to defining and solving problems in systematic order; and
8 See, e.g., Tom Boellstorff, Bonnie Nardi, soft systems methods, based on the approach that designers
Celia Pearce, and T. L. Taylor, Ethnogra- should be aware of the social aspects of the everyday life of users.12
phy and Virtual Worlds: A Handbook of
In addition, Bredies, Chow, and Joost present constructivist
Method (Princeton: Princeton University
Press, 2012); Annette Markham, Life
approaches, such as human-centered, participatory, non-inten-
Online: Researching Real Experience in tional, and critical design.13 Among these approaches, human-cen-
Virtual Space (Lanham, MD: AltaMira tered design aims at understanding all stakeholders and creating
Press, 1998); and Christine Hine, Virtual artifacts that make sense to them by seeking to understand the
Ethnography (London: Sage, 2000). everyday life of users.
9 Boellstorff, Nardi, Pearce and Taylor,
Ethnography and Virtual Worlds: A
Handbook of Method, 13–22
Figure 2
Projective tools of the ironing probes package.
John Bowers, Andrew Boucher, Hans Although the number of our participant users was limited,
Gellerson, Sarah Pennington, Albrecht using probes with large numbers of participants is not considered
Schmidt, Anthony Steed, Nicholas Villars, feasible. 37 Our main objective was to describe an approach that
and Brendan Walker, “The Drift Table,” could enable designers to use probe data in a systematic way,
Proceedings: Extended Abstracts on
rather than generating more varied data on the practice of ironing.
Human Factors in Computing Systems
Thus, the limited number of participants did not cause any prob-
CHI ’04 (New York: ACM Press, 2004),
885–900, doi: 10.1145/985921.985947. lems within the scope of this study. We sent cultural probes pack-
For an example of empathy probes, see ages to users who volunteered to participate. We had conversations
Tuuli Mattelmäki and Katja Battarbee, with each user to explain the aim and context of our research,
“Empathy Probes,” Proceedings of the explaining that the outcomes generated by this process would be
Participatory Design Conference, http://
analyzed by designers as important information in generating
ojs.ruc.dk/index.php/pdc/article/
view/265 (accessed September 20, design ideas to improve users’ housework experience. The users
2010). For value probes, see Amy Voida, had no previous experience in participating in this kind of
and D. Mynatt Elizabeth, “Conveying research and were concerned about “doing something wrong”
User Values Between Families and during the probing process. We made clear that they could com-
Designers,” in Proceedings CHI ’05 (New
municate with us whenever they had difficulties completing the
York: ACM Press, 2005); and Kirsten
tasks and stressed that all the feedback they provided us would be
Boehner, Janet Vertesi, Phoebe Sengers,
and Paul Dourish, “How HCI Interprets valuable. Finally, we delivered our ironing probes packages (see Fig-
the Probes,” Proceedings of the SIGCHI ures 1 and 2).
Conference on Human Factors in Comput- Our ironing probes package included a diary, a task book and
ing Systems CHI ’07 (New York: ACM a variety of projective tools as depicted in Figure 2.
Press, 2007): 1077–86. For technology
probes, see Tuuli Mattelmäki, “Applying
Probes—From Inspirational Notes to
Designers
We invited designers who were interested in user-centered
design—in particular, cultural probes—to voluntarily participate
in our research: The four who participated were industrial design-
ers with an average age of 30. They were familiar with ethnogra-
phy and had some information on the cultural probes method.
During our conversations, the designers asked questions about the
cultural probes and their different applications. They learned that
our aim was ultimately to construct a systematic approach that
would allow designers to use the outcomes from probes.
The Procedure
The procedure with designers consisted of two sessions: an infor-
mation and work session and a follow-up interview. The first ses-
sion included a 15-minute information period and a 90-minute
Users’ tasks for Day 8 and Day 9 focused on ironing practices and
related experiences and generated the following responses:
• “Ironing Rule 3: Cool times of the days should be chosen
(if it is summer). If it is winter, it should be done while
watching TV.” (User 3)
• “It is important to iron the clothes sequentially that need
to be ironed in the same temperature.” (User 1)
• “While ironing shirts, first the shoulders and then the
back parts should be ironed.” (User 2)
For the task of replacing the ironing board with alternative meth-
ods, users responded with these ideas:
• “… ironing clothes on the hangers” (User 1), and
• “I would like to be able to iron on the floor. I really
hate setting up the ironing board and then carrying it
back to its place.” (User 3)
Conclusion
In this examination of the cultural probes method as a source of
inspiration for designers, we asked how ethnographic data might
be interpreted and translated into design ideas. In the process, we
investigated two main issues: What types of probes data would be
of interest to designers, and how might designers make use of
these data? Our test demonstrates the usefulness of the cultural
probes method for gathering ethnographic data relevant to design;
it also reveals limitations of the method.
The most salient limitations are that users consider the
probes packages “too structured” in terms of impositions on
their daily lives and that interaction between the researchers and
users during the probing process is lacking. Users related that
they enjoyed the writing tasks; however, they had difficulties tak-
ing pictures and completing some tasks that required basic draw-
ing skills.