Professional Documents
Culture Documents
Using A - Dark Horse - Prototype To Manage Innovative Teams
Using A - Dark Horse - Prototype To Manage Innovative Teams
Tyler Bushnell 1, Scott Steber 2, Annika Matta 3, Mark Cutkosky 4, and Larry Leifer 5
1
Mechanical Engineering Department, Stanford University; busht@stanford.edu
2
Mechanical Engineering Department, Stanford University; steber@stanford.edu
3
Mechanical Engineering Department, Stanford University; amatta@stanford.edu
4
Mechanical Engineering Department, Stanford University; cutkosky@stanford.edu
5
Mechanical Engineering Department, Stanford University; larry.leifer@stanford.edu
KEYWORDS: Innovation, Prototyping, Design and Design Thinking, Creativity Thinking and Innovation
process. In 1999 Stanford Professor Mark There are three requirements for a Dark Horse
Cutkosky created the “Dark Horse” prototype prototype:
as part of this process. This prototype 1. The prototype vision is “dark.”
explicitly calls for the exploration ideas that The prototype must explore a space that is
may never otherwise be explored in an effort to “dark,” meaning that it is risky, radical,
“colonize” the design space, an idea set forth infeasible, and/or in a direction orthogonal to
from the Design Space Colonization project previously explored solutions. The technical
(www.cdr.stanford.edu/DSC/) (Cutkosky et al, implementation, questionable user perception,
1993) (Toye et al., 1993). The Dark Horse or its departure from a plausible direction
consistently results in interesting and already converged on, should make the team
innovative ideas, evaluated through physical feel uncomfortable in pursuing it as a direction.
prototyping and objective user testing. 2. It is initiated after a cohesive product
The authors consist of five teaching team vision has been formed.
members for the 2012-2013 ME310 program In some ways all prototypes are “dark.” For
who were responsible for coaching and this reason, an already established product
evaluating design teams and have seen the vision should exist as reference for what is
positive impacts of the Dark Horse prototype. radical and what is not. The Dark Horse is
This paper presents three case studies usually a clear departure from this vision.
personally witnessed from the ME310 3. It is refined enough to be objectively
program. This is followed by discussion of tested.
possible reasons for the positive impacts and The prototype must be taken to a point where it
possible uses of the prototype for design can be tested with objective users.
innovation and management of product Assumptions and preconceptions of the design
development. team cloud the whole prototyping process, so
external testing is the only way to properly
THE “DARK HORSE” evaluate the prototype.
The title of this prototype is borrowed from the
world of horse racing. Conventionally, a “dark BACKGROUND & LITERATURE REVIEW
horse” refers to a contender (such a race horse) Physical prototyping stands as a significant and
who is little known and believed to be unlikely multifaceted tool within the iterative process of
to succeed. However, if such a contender has engineering design and development. In a very
an unexpectedly good performance, the payoff broad sense, prototypes “provide the means for
will be relatively huge. This is the guiding examining design problems and solutions”
spirit of the Dark Horse design mission. By (Houde and Hill, 1997).
trying something “out there” or seemingly Lim, Stolterman, and Tenenberg (2008)
“impossible,” Cutkosky explained that it describe prototypes as “tools for traversing a
“forced [teams] to take a fresh look.” As design space where all possible design
described later in the case studies, this alternatives and their rationales can be
prototype will result in a revolutionary design explored.” Lim et. al go on to describe how a
innovation at best. At worst, teams have a prototype’s “anatomy”—consisting of its
chance to gain tremendous insights about their material, resolution, and scope—can
users, the design space they are working vary. This results in prototypes, or exploratory
within, or the process they are following. In all “tools,” of varying styles and forms. They
cases, the Dark Horse prototype prevents the conclude that “the best prototype is one that, in
design space from shrinking too rapidly and the simplest and most efficient way, makes the
fosters an improved framework for analyzing possibilities and limitations of a design idea
future findings. visible and measurable.”
Tyler Bushnell, Scott Steber, Annika Matta, Mark Cutkosky, Larry Leifer
For the last 14 years, the Dark Horse prototype prototype at the same time, adding a level of
has served as an integral design space traversal complexity to the cycle of design thinking
tool within the ME310 program. Each year, as (Eris, 2003). From an overall point of view, the
part of a two to three week mission, each placement of this prototype after an initial
ME310 design team is prompted to explore a vision is formed helps to form new and
direction that by most standards would be different ideas, because the normally
considered too risky, too radical, or even too innovative space has already been considered,
technically difficult to complete. This and that is what the “dark” innovation space
prototype serves as an intentional (and isn’t.
somewhat forced) departure from any
previously explored design path: “the dark CASE STUDIES
horse gives designers the permission to think The three case studies that follow are from the
bigger and more creatively” (Carleton and teaching teams’ notes from the entire program
Cockayne, 2009). Students enter this cycle, the teams’ documentation, and team
particular design cycle with many member interviews. They describe the teams’
preconceived notions regarding their user early prototypes and initial project direction,
group, their product vision, and the scope of the Dark Horse vision and prototype, and the
their project. The Dark Horse explicitly impact of the Dark Horse on the team’s
releases teams from this vision, requiring an product vision moving forward. The three
entirely new direction to be explored. Teams exemplify common project outcomes of this
are asked “specifically to invest some time on prototype, which include:
a prototype that uses a concept or technology 1. The Dark Horse concept becomes the
that they did not seriously consider in the final prototype, as exemplified in the
[previous quarter]” (Cutkosky, 2000). Thales case study.
Rhinow, Köppen, and Meinel (2012) discuss 2. An element of the Dark Horse
the role of prototypes within organizations and prototype is carried through into the
go on to describe three major categories: “(1) final product vision, as exemplified in
the role of prototypes as a manifestation for the Swisscom case study.
user feedback, (2) the role of prototypes as a 3. The Dark Horse concept is not carried
tool to improve team experience, and (3) forward, but the team aligns on a new
prototypes as a force to converge thinking and different direction based on
during the design phase.” The Dark Horse findings, as exemplified in the Audi
prototype, along with each and every prototype case study.
built into the ME310 curriculum, fits within
this categorization. As teams reflect on their CASE STUDY 1: THALES (2011-2012)
process thus far, brainstorm potential The Thales team of 2011-2012 is an example
prototypes, and create and test a tangible of a team for whom the successful
representation of their collective vision, the implementation of a Dark Horse solution was
Dark Horse transitions amongst each of these received well enough to become the new
three roles. product vision. The precision optics
Finally, the Dark Horse aligns with the manufacturer Angénieux, a subsidiary of the
iterative process of divergent behaviors French electrical systems group Thales,
following converging behaviors for radical sponsored the project, a cooperation of
changes (Alexander, 1964), both because of its Stanford and the Ecole des Ponts ParisTech.
own prompt and because of its chronological Initially given the prompt to “design the next-
placement during the ME310 program. As a generation cinema/broadcasting imaging
prompt, teams are asked to diverge on a system,” the team ended the year with an
concept and converge on an idea for a optical system that captures the entire 3D
Tyler Bushnell, Scott Steber, Annika Matta, Mark Cutkosky, Larry Leifer
information of a film scene, allowing directors operators.” To free directors of the burdens of
to select from an infinite number of their equipment, the radical idea that the team
perspectives and camera movements post- kept returning to was a movie set with no
filming. This technically impressive solution cameras at all: “We had often jokingly
was arrived at in pursuit of a Dark Horse idea brainstormed about ‘what if the camera could
that seemed technologically infeasible on be everywhere?’” (Brero et al., 2012)
conception. After much exploration, the team arrived at a
By the end of the first term of the project, the Dark Horse solution that freed filmmakers
team had settled on a movie viewer-centric from the limitations of needing to record
approach to the project prompt. They had great scenes from an exact location. They called it
success with two early prototypes: 1) A focus- the “OmniCam Studio”: rigs of multiple
shifting prototype involving webcam motion- Microsoft Kinects and software compilations
capture technology in a helmet and selective- that captured the 3D and color information of a
focusing software to allow a viewer’s eye film scene and allowed for post-capture scene
movement to control an image’s focus and 2) manipulation (Figure 2).
A perspective-shifting prototype involving The directors and actors who tried it were
infrared sensors in a pair of glasses to track a immediately excited and intrigued by the
viewer’s head movement and display an image possibilities, and the team was off and running
in the corresponding perspective. They in the new direction, electing to refine their
combined these prototypes into a single vision Dark Horse direction for their final product. In
that they planned to move forward with: To the final implementation, they integrated
create an immersive movie-watching hardware and software into the technology
experience in which the viewer’s head and eye developed for their Dark Horse to capture and
positions affect both the perspective and focus replay movies.
of a scene (Figure 1).
Figure 1 ParisTech and Stanford students test a helmet Figure 2 A director tests a refined version of the Thales
and glasses that shift the focus and perspective of an team’s Dark Horse scene-capturing setup, including
image based on the user's movement, elements of the multiple Microsoft Kinects and a compilation of
team's initial product vision. software.
On being asked to pursue an orthogonal Interestingly, the team later reflected in their
direction, for the Dark Horse prototype the documentation that manipulating the way a
team decided to return to a focus on assisting scene is captured was not as orthogonal from
the filmmaker rather than the viewer, as their their perspective-shift and focus-shift
early user research had shown them that they prototypes as they thought, and in fact it
had the greater need. They had heard in touched on “many ideas that we have scribbled
multiple interviews that directors are often on our whiteboards over the course of the
constrained in their visions by their own project.” As most ME310 teams realize by the
filming equipment, and that they often feel “as end of the course, in hindsight they are able to
though their vision of each shot risked being see the intrinsic relationships among their
diluted or misinterpreted by their camera prototypes and how their seemingly disparate
Tyler Bushnell, Scott Steber, Annika Matta, Mark Cutkosky, Larry Leifer
learnings contribute to a final validated user could remotely control to move around a
prototype. In most cases, such as the Swisscom space and have a physical presence. The team
case study that follows, the Dark Horse results documented that it was “conceived as a way to
in a selection of important and useful learnings create a guest-host relationship by giving the
that carry through to the final prototype; in guest a self-mobile, physical avatar in the host
cases like the Thales team, the successful and environment.” The zeppelin can be seen in
well-received implementation of a truly radical Figure 4 below.
Dark Horse prototype can result in an
innovative new direction.
Because a Dark Horse prototype necessarily the prompt definition contribute to the
aims for something risky, it can be used to effectiveness. The psychology of releasing the
exaggerate risks for easier identification and expectations while simultaneously pressuring
management thereof. By requiring the creation teams to do the impossible pays off in nearly
of the prototype, a design team is forced to every project. This is even more significant
evaluate what is possible or not and dive into because it occurs after the teams have already
possibilities that may not be apparent, lending developed notions of what the product’s
itself to a Heuristic approach to risk potential value may be.
management as suggested in Grubisic et al The case studies described above are not
(2011). exhaustive, but do represent the majority of
For planning, prior to the prototyping phase the cases witnessed in the course. It needs to be
estimations of resources required and the noted that the cases are all derived from the
impact of a job can be optimistic (Dailey & academic setting of ME310 with graduate
Mumford 2006). When attempting something students at Stanford University. The students
possibly unreachable, expectations can be are operating with real budgets and are
managed and compensated for the team, producing products, but going to market is not
whether they are unable to reach their goals or usually the responsibility of the team members.
they in fact completed what they thought was It should also be recognized that not every
an impossible task. Dark Horse is a success. Teams sometimes fail
Lastly, the Dark Horse also exists as a tool for to execute their prototypes or gain real insights
minimizing risk and fostering a viable for the project. This most often happens if a
prototyping “culture” within the team does not push an idea far enough, or does
program. Schrage (2006) discusses the not put enough effort into execution or user
implications of crafting such a culture. If an testing.
organization or group creates a culture where Future work on the Dark Horse prototype will
only safe, highly refined prototypes are shared involve more emphasis on iteration and user
amongst the team, advisors, and management, testing. The definition and best practices of the
then prototypes become a tool to prove a point prototype develop with each year’s iteration on
and the potential “design dialogue around the class and hopefully lead to better, more
emerging prototypes” may be lost. In a innovative projects with compelling results.
professional setting, Schrage implies that
prototype information is then only shared with ACKNOWLEDGEMENTS
managers when it is too late in the design cycle We would like to acknowledge the help of
and they are being “asked to approve—rather George Toye for his continuous effort and
than to review or assist—new product support in making Stanford’s ME310 course a
creation.” The Dark Horse ensures that teams world renowned course in innovation and
are open with and accepting of their dance with product development. We also thank the
ambiguous (and seemingly risky) design students who worked on these teams and
solutions. In this case, as Schrage concludes, provided pictures and interviews for creating
“prototypes are as much a medium for this paper. Finally, the projects could not have
managing risks as they are a medium for existed had it not been for the project sponsors
exploring opportunities.” mentioned in the case studies, Thalés
Angenieux, Swisscom, and Audi.
CONCLUSIONS
The Dark Horse prototype as it is used in the REFERENCES
ME310 has been a powerful tool for spurring Alexander, C. (1964). Notes on the Synthesis of Form. Harvard
Univ Pr.
innovation in the product design process. The
placement in the sequence of prototypes and
Tyler Bushnell, Scott Steber, Annika Matta, Mark Cutkosky, Larry Leifer
Bennett et al. “Reinventing Video Communication”, [Swisscom moderating influence of fear of invalidity.” Personality and
project documentation], Unpublished report, Stanford Social Psychology Bulletin, Vol. 33(6), 855-866.
University, 2010.
Schrage, M., “Cultures of Prototyping”, Bringing Design to
Bjelajac et al. “Transforming the Journey into the Destination”, Software, ACM Press, Vol. 4(1), 1-11, 2006.
[Audi team project documentation], Unpublished report,
Stanford University, 2013. Toye, G. Cutkosky, M. Leifer, L. Tenenbaum, J. Glicksman, J.,
“SHARE: A Methodology and Environment for Collaborative
Brero et al. “Project Euclid”, [Thales project documentation], Product Development”, In Proceeding of 2nd Workshop on
Unpublished report, Stanford University, 2012. Enabling Technologies: Infrastructure for Collaborative
Enterprises, IEEE Computer Press, 1993.
Carleton, T. Cockayne, W., “The Power of Prototypes in
Foresight Engineering”, International Conference on
Engineering Design, 2009.