Professional Documents
Culture Documents
net/publication/353979714
CITATION READS
1 749
4 authors:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Regan Stevenson on 10 November 2021.
Mark T. Bolinger
Walker College of Business, Appalachian State University
4071 Peacock Hall
Boone, NC 28608, USA
Phone: 208-251-6497
Email: bolingermt@appstate.edu
Matthew A. Josefy
Kelley School of Business, Indiana University
1309 E. Tenth Street, Suite 3100
Bloomington, IN 47405, USA
Phone: 812-855-3683
Email: mjosefy@iu.edu
Regan Stevenson
Kelley School of Business, Indiana University
1309 E. Tenth Street, Suite 3100
Bloomington, IN 47405, USA
Phone: 812-855-2182
Email: rstev@indiana.edu
Michael A. Hitt
Mays School of Business, Texas A&M University
210 Olsen Boulevard
College Station, Texas 77843, USA
Phone: 979-845-4851
Email: mhitt@mays.tamu.edu
Acknowledgements: The authors would like to gratefully acknowledge the thoughtful responses
from 10 prominent scholars who helped us further understand the particular challenges of using
experiments in strategic management, insightful feedback on previous versions of the manuscript
from Mike Withers, Christina Carnes, and Jeff Covin, helpful comments on the Best Practices Guide
from Jeff Gish, Emily Neubert, and June Ryu, additional assistance from Tammy Rader and
Amanda Tolen, and very helpful direction from anonymous reviewers. Regan Stevenson also
acknowledges research support from the John and Donna Shoemaker Fellowship.
ABSTRACT
We review extant experimental work in strategic management and argue that experiments
constitute an underused methodology that has significant potential. We examine and categorize
179 experiments from 119 published articles over a 20-year period, delineating the contributions
of these experiments to the strategic management literature. In doing so, we identify topic areas
in which experiments have been effectively deployed, as well as several literature streams that
have a limited amount of prior experimental research. We discuss specific challenges of using
experiments in strategy research, especially given its strong focus on the firm-level of analysis.
of past contributions and gaps, we discuss specific opportunities and means of designing
innovative experiments, propose novel potential research questions, and provide a best practices
methodological guide which scholars can use when considering experimental designs. Overall,
our work documents experimental research and provides a methodological practicum, thereby
RESEARCH OPPORTUNITIES
management research; put another way, strategy scholars study what causes some firms to be
more successful than others. Accordingly, endogeneity in strategic management has historically
been considered a “pervasive problem” due to the inherent complexity of organizations and the
discipline’s focus on field studies (Aguinis, Edwards & Bradley, 2017; Busenbark, Gamache,
Yoon, Certo, & Withers, 2019). Although researchers routinely take great methodological care to
control for or rule out the potential for endogeneity (Hamilton & Nickerson, 2003; Hill, Johnson,
Greco, O’Boyle, & Walter, 2021; Semadeni, Withers, & Certo, 2014), experimental
experimental conditions (e.g., Grigoriou & Rothaermel, 2017) and carefully explain how their
research design compares to the ideal experiment (e.g., Angrist & Pischke, 2010; Berchicci,
Dowell & King, 2017; Cummings & Knott, 2018, Rawley, Godart, & Shipilov, 2018). Yet,
experiments (ideal or otherwise) remain rare in strategic management research. There are at least
three reasons that greater adoption of experimental methodologies could be beneficial for the
field. First, strategy scholars frequently conclude their papers by documenting an agenda for
future experimental work that would meaningfully advance their line of inquiry. For example,
this is evident in strategic leadership research, where scholars have noted that archival
approaches could be augmented by experimental studies. Tang, Mack, and Chen (2018:1384)
state: “there might be some noise associated with these archival-based measures. We encourage
EXPERIMENTS IN STRATEGY RESEARCH 4
future research to employ more direct measures in surveys and experimental studies to confirm
and extend our findings.” They are among many prominent scholars who have called for more
strategy experiments to extend their work (Aggarwal, Posen & Workiewicz, 2017; Bettis, 1991;
Powell, 2011; Powell, Lovallo & Fox, 2011; Shepherd, McMullen & Ocasio, 2017). Second,
several experiments published in the strategic management literature have proven to be highly
influential (Audia, Locke & Smith, 2000; Choi & Shepherd, 2005; Okhuysen & Eisenhardt,
2002; Shah & Swaminathan, 2008; Weber & Camerer, 2003). Third, the field has recently
exhibited a greater emphasis on microfoundations and behavioral strategy (e.g., Felin, Foss &
Ployhart, 2015; Foss & Pederson, 2016; Powell et al., 2011), which provides increased
opportunities for the use of experimental approaches. While experiments may be impractical for
some research questions, and concerns regarding the level of analysis or the ability to establish
external validity may be difficult to overcome, we argue that experiments have tremendous
potential in strategic management, as they are a powerful and underutilized methodology with
strengths that are distinct from and complementary to the more commonly used methods.
Building on previous studies that have documented and advocated for additional
experimental work in strategic management (Chatterji, Findley, Jensen, Meier, & Nielson, 2016;
Di Stefano & Gutierrez, 2018; Priem, Walters, & Li, 2011)1, we complete an extensive review of
published experiments in strategic management. We then analyze, synthesize, and explain how
this prior experimental work has contributed to the strategy literature, identify best practices, and
present avenues for future research, particularly how experiments can assist strategy researchers’
efforts to supplement existing research to develop and extend theory. To demonstrate how one
could design an impactful strategy experiment, we provide sample study designs and a best
contribute to the developing body of work concerned with understanding the behavioral and
psychological antecedents of firm performance. It has been argued that strategy research, “lacks
adequate psychological grounding” and that “recent developments provide new opportunities for
merging psychology and strategy” (Powell et al., 2011:1370). Our review highlights ways in
which experiments could be used to advance several strategy topics from a psychological
governance. Researchers could leverage the structured recommendations and example designs
Second, our review establishes a methodological launchpad for future experimental work,
documenting best practices and approaches that have been used to craft effective strategy
experiments. Our review includes in-depth analysis of past study characteristics so that trends
can be visualized within specific methodological, topic, and theoretical areas, and exemplar
studies, so that best practices can be highlighted and examined in detail. Moreover, we consider
how novel approaches from other disciplines could be used to conduct impactful strategy
research. Building on the desires articulated by strategy scholars to randomly assign treatments
to CEOs, firms, or markets (e.g., Bennett, Seamans & Zhu, 2015; Carnahan, 2017; Cummings &
levels of analysis. Ultimately, we identify several ways in which scholars can leverage
established experimental techniques to complement robust archival and field studies and advance
Each research method has tradeoffs, because generalizability, contextual validity, and
researchers sometimes seek to triangulate by using a combination of methods (e.g., Audia et al.,
2000; Flammer & Kacperczyk, 2019; Greenberg & Mollick, 2017), therefore accumulating the
despite the benefits of this approach, a large portion of strategic management research continues
to be based on archival data (Jemison, 1981; Ketchen Jr, Boyd & Bergh, 2008; Scandura &
Williams, 2000). To develop a deeper understanding as to why this is the case, we augmented
our own observations by gathering qualitative insights from a panel of prominent strategic
management scholars (see Table S1 for a summary of these scholarly viewpoints on the
We concluded that there are multiple reasons why experimental methods remain
relatively rare. First, strategic management scholars seem to place a priority on the value of
external validity (e.g., Garg, Li, & Shaw, 2018) For example, one of our strategic management
scholars noted that it is “[d]ifficult to simulate the gravity and implications of strategic decisions
measurement and the elimination of alternative explanations in the lab, such benefits are offset in
part by lower external validity (Scandura & Williams, 2000). Therefore, researchers conducting
experiments grapple with decisions regarding external validity tradeoffs as they consider ways to
increase the internal validity via tightly controlled experimental tasks. Given the incredibly
EXPERIMENTS IN STRATEGY RESEARCH 7
dynamic nature of strategic management, complex models that maximize external validity have
A second reason is that experiments may be less suitable at the level of analysis that
strategy scholars desire/need to study. This was evident in several comments from our panel,
including one in which a scholar questioned whether researching firm-level activities via
economics literature concentrated on firms (Jemison, 1981), strategic management scholars are
often focused on a different level of analysis than “mother” disciplines like psychology where
experiments are more prevalent. As noted in a key article defining behavioral strategy:
Indeed, despite a large volume of output, experimental psychology has done little to
address the problems of strategy theory and practice. Many strategy researchers regard
the core unit of analysis in strategy as the firm or business unit rather than the individual,
and there is skepticism about the scaling of psychological concepts to firms and
industries. Strategy practitioners are, if anything, more skeptical than researchers,
doubting whether the field can go beyond cognitive biases to produce useful frameworks
that integrate psychology and strategy practice. (Powell et al., 2011: 1370)
employ other methods that consider the temporal relationships between variables (Shook,
Ketchen Jr, Hult & Kacmar, 2004). Strategic management scholars have employed a variety of
analytical techniques including longitudinal studies to address causality (Shook, Ketchen Jr,
Cycyota & Crockett, 2003), and these methods may often provide sufficient assurance. This
seems to be the case for one of our scholars, who noted “I also buy into Judea Pearl’s (2009)
arguments that randomized controlled experiments need not be put on a pedestal in terms of
causal identification.” Particularly given the level of analysis considerations already noted, such
methods are likely being used as a substitute for experiments (Bascle, 2008; Hill et al., 2021;
econometric methods, meaning students may not formally be trained in experimental methods.
For example, one of our scholars noted, “I have not had the proper training to do it
[experiments], and I would probably not have the technical resources (labs to run the
yet another research methodology is a significant requirement given the wide range of techniques
they are already expected to learn (Shook et al., 2003). Thus, pursuing experimental designs may
require partnerships with other scholars more likely to have previous experience with
Given the unique and very real obstacles to conducting experiments in the strategy
context combined with the existence and acceptance of substitute methods, why should strategic
First, as the “gold standard” for establishing cause and effect relationships, experiments
have unique advantages for social science researchers in that they facilitate accounting for
unmeasured variables and alternative explanations through randomization (Hill et al., 2021;
Shadish, Cook, & Campbell, 2002). The primary advantage of random assignment is its “ability
randomization provide a way for researchers to account for all explanatory variables in a
particular model by creating highly controlled settings (Aguinis & Vandenberg, 2014; Stevenson
& Josefy, 2019). Thus, strategic management experiments could be particularly useful to expose
the causal links between the actions of the individuals within a firm and the firm as an entity.
Scholars have long noted that certain firm members often have a disproportionate amount of
EXPERIMENTS IN STRATEGY RESEARCH 9
influence over firm outcomes (Hambrick & Mason, 1984) and that the firm embodies a complex
set of interactions among its members (March, 1962). Experiments are useful in isolating the
limited, hard to obtain due to secrecy, or highly specific to a firm, making it difficult to obtain a
sufficient sample size. For instance, scholars have sometimes struggled to obtain access to board
room discussions or other unique situations faced by large firms such as decision making related
be useful for addressing such research questions. Researchers can use experiments to examine
high degree of control over dimensions of interest. In this way, research can be conducted even
before archival data is available on a variety of important strategy topics, including grand
challenges (e.g., global pandemic response or climate change scenarios). Indeed, given their
emergent nature such topics are inherently difficult to study using archival methodologies.
Despite their limitations, experiments can isolate mechanisms in complex decisions, which may
Finally, while experiments are generally perceived as more readily designed for studies at
the individual-level of analysis, strategic management scholars are increasingly considering the
key role that individuals and groups within the organization play in affecting firm-level
outcomes. This has resulted in an increased focus on meso and multi-level research (Hitt,
Beamish, Jackson & Mathieu, 2007; Ployhart & Moliterno, 2011), a new emphasis on the
microfoundations of strategy (e.g., Felin et al., 2015; Foss & Pederson, 2016), and the emergence
of a strong line of work focused on behavioral strategy (e.g., Powell et al., 2011), all of which
EXPERIMENTS IN STRATEGY RESEARCH 10
have increased opportunities to more feasibly employ experiments. Concomitantly, this emerging
emphasis on micro-level research may be decreasing the suitability of other methods. For
example, strategic management researchers have long used archival proxies, or measures that are
“used to represent a theoretical construct,” but these variables are typically repurposed, and
scholars have expressed concern over their validity (Ketchen Jr., Ireland, and Baker, 2013:32;
Priem, Lyon, & Dess, 1999). Scholars may find it especially difficult to identify valid archival
experimental variables can be collected with a specific construct in mind, and thus can be far
more targeted. In light of these developments, strategic management scholars have the
METHODS
management over the last two decades. Data for the current study were collected by reviewing all
Studies, Management Science, and Strategic Management Journal from January of 2000 through
August of 20203. To compile a list of strategy experiments, we began by searching all titles,
keywords, and abstracts using the terms experiment*, random*, field, policy captur*, laboratory,
and conjoint. This initial screen identified nearly 2,000 articles that were then subjected to
further screens to determine if an experiment had been conducted (the word “experiment” often
appeared to discuss actions taken by individuals or firms rather than the study’s methodology;
we also excluded natural and computer simulation experiments given this study’s focus on
random assignment). To narrow our scope to strategic management topics, we screened papers
EXPERIMENTS IN STRATEGY RESEARCH 11
by considering the theoretical and contextual keywords and research topics identified by the
authors of the research. While strategic management is a broad field that incorporates ideas and
theories from many different business and social science fields, it is at its core concerned with
and defined by attempts to better understand organizational performance (Makadok, Burton &
Barney, 2018; Rumelt, Schendel & Teece, 1991). Thus, we removed studies in which the central
topic was primarily related to organizational behavior, human resources, operations, finance,
economics, psychology, marketing, or methodology. For example, our initial screen included
several papers on leadership, any of which could have implications for strategy, but we only
included those that directly focused on CEOs or top management teams. We also used level of
analysis as an indicator, generally excluding papers that did not target firm-level outcomes unless
they were otherwise directly applicable to a Strategic Management Society (SMS) interest group.
Our screening and coding methods yielded 179 studies from 119 articles published from January
For each publication that contained one or more experiments, we extracted a variety of
information to support coding of theory, topics and methods. If a paper included multiple
experiments, each one was separately coded. We also categorized studies into 10 topic groups,
associated with a corresponding SMS interest group. We categorized papers into more than one
topic if applicable but did not utilize behavioral strategy or strategy practice as topic areas in our
coding because it could be argued that they apply to many if not all the experiments in our
review. We provide a listing of all reviewed papers and their classification by topic in Table S2.
theory, we also conducted a thorough methodological review and coded each paper according to
the nature of the experimental design (e.g., within or between subjects), the experimental context
EXPERIMENTS IN STRATEGY RESEARCH 12
and delivery method (laboratory, field, etc.), the experimental sample used and the number of
participants, the country in which the study was conducted, the dependent variable type, the
contingent reward or pay offered to participants, the use of manipulation checks, and the
experimental stimuli.
RESULTS
Our results indicate that while many experiments have been conducted in the strategy
domain and the number of experiments published is trending upward, studies featuring
experimental methodologies still represent a small fraction of the total studies published in the
nearly 20 years represented in our sample. Despite the strong emphasis on theory in management
(Colquitt & Zapata-Phelan, 2007; Hambrick, 2007), only 56 of the experiments (31%) in the
dataset explicitly drew upon a theory to motivate the research questions presented. We provide a
topics associated with SMS interest groups. Based on this approach, the most common topic
areas for strategy experiments were stakeholder strategies with 52 studies (29% of total studies),
followed by strategic leadership and governance with 42 studies (23% of total studies), and
entrepreneurship and strategy with 34 studies (19%). Additionally, while multiple experiments
were published in each of the interest groups we considered, our results nonetheless reveal that
experimental methods were highly concentrated, with over half of studies pertaining to the
stakeholder or leadership categories. Table 2 provides indicative exemplars for each topic area
with summary-level information regarding the studies, and Table S2 (online supplement) lists all
studies in our review by topic area. We review each topic area in the following sections with an
EXPERIMENTS IN STRATEGY RESEARCH 13
emphasis on how experimental methods enabled or at least facilitated the study in a way that
Stakeholder Strategy. The most common topic was stakeholder strategies, with 52
experiments. These studies considered a broad range of more specific topics including corporate
social responsibility (Crilly, Ni, & Jiang, 2016; Flammer & Kacperczyk, 2019; Shea & Hawn,
2019), the effects of responses to crisis or scandal on stakeholders (Baker, Derfler-Rozin, Pitesa
& Johnson, 2019; Connelly, Ketchen Jr, Gangloff, & Shook, 2016; Folkes & Whang, 2003;
Raithel & Hock, 2021), stakeholder input (Kim, John, Rogers & Norton, 2019; Krause, Whitler,
& Semadeni, 2014), and stakeholder perceptions of the firm including trustworthiness (Elsbach
& Elofson, 2000), authenticity (Hahl & Ha, 2020; Radoynovska & King, 2019), and reputation
In the strategy context, experiments are particularly helpful when studying complex
individual phenomena like stakeholder perceptions that involve interconnected variables. For
example, Coffman and Gotthard-Real (2019) consider whether firms can deflect responsibility
for unpopular actions when they are recommended by an adviser (such as an external
consultant). The authors employ a simulated decision-making game in which individuals make
decisions either by themselves or with advice given by advisers, and other game participants
affected by these decisions then have the option to punish or not punish the decision maker. The
researchers found that the presence of an adviser enables the decision-maker to deflect blame by
changing stakeholder perceptions of both the necessity and morality of the action. As prior work
has demonstrated, the formation of stakeholder perceptions of firm actions is a complex process
that other studies in our sample have shown is influenced by a variety of factors including
EXPERIMENTS IN STRATEGY RESEARCH 14
nationality (Crilly et al., 2016), familiarity (Brooks et al., 2003), and the firm’s explanation of
decisions (Elsbach & Elofson, 2000). This complexity makes it difficult to tease out the specific
effect of adviser advice on stakeholder views using correlational statistical methods. Coffman
and Gotthard-Real’s (2019) experiment provides an excellent example of how experiments can
extend our understanding of previous findings from archival studies and allow for determinations
relationships that strategy researchers observe in the field. Shea and Hawn (2019) consider the
question of why firms commit resources to CSR through a social psychology lens, and in doing
so, introduce warmth and competence as attributes that are often interconnected with CSR in the
minds of stakeholders. They show that warmth in particular mediates the relationship between
CSR and advantageous outcomes such as enhanced reputation. Approaching this research
experimentally allows for the direct assessment of the effects of these social psychology
concepts in the strategic management context in a way that would likely not be possible with
archival methodologies.
Experiments can also help make connections between strategic management and related
literature, for example the literature on charitable giving. There is a movement amongst charities
to report performance metrics and archival evidence that these outcomes influence subsequent
giving decisions, yet archival strategic management field studies cannot clearly indicate how and
why patrons value this information. Thus, Exley’s two experiments (2020) are particularly useful
for investigating seemingly paradoxical findings in prior field studies on giving behaviors. Exley
(2020) found that the prominence of administrative costs and processing fee indicators
negatively affected donations, suggesting that there may be a risk to charities in providing these
EXPERIMENTS IN STRATEGY RESEARCH 15
Strategic Leadership and Governance. The strategic leadership and governance area
contains 42 studies and among other topics addresses CEO and executive characteristics and
behaviors including truthfulness (Jacguemet, Luchini, Rosaz, & Shogren, 2019), diversity-
valuing (Hekman, Johnson, Foo & Yang, 2017), ethical leadership (Huang & Paterson, 2017),
decision making (Gary & Wood, 2011; Mitchell, Shepherd, & Sharfman, 2011; Mueller,
Melwani, Loewenstein & Deal, 2018; Tosi, Brownlee, Silva, & Katz, 2003), vision (Carton &
Lucas, 2018; Carton, Murphy & Clark, 2014; Venus, Stam, & van Knippenberg, 2019), and CEO
dismissal and succession (Connelly, Li, Shi, & Lee, 2020), particularly in the wake of scandal or
misconduct (Connelly et al., 2016; Connelly, Shi, Walker, & Hersel, 2020). Several of these
articles addressed questions that likely would have been difficult to investigate without
experiments. For example, Hekman and colleagues (2017) investigate the lack of diversity in
top-level leadership. While the effect is easily observed through archival or correlational
methods, the authors investigate its potential mechanisms, and find that diversity-valuing
behavior by female or minority leaders leads to lower performance ratings of those leaders. By
using an experiment, they were able to gather information that may not be available in the field,
mitigate potential privacy issues, largely avoid under reporting of biased views due to low social
desirability, and directly observe biased tendencies that may contribute to a lack of top-level
diversity.
Jacguemet and colleagues (2019) examine the issue of dishonesty in senior executives by
investigating whether voluntarily taking an oath decreases lying. The question of honesty in
firms is an important one that rose to prominence with notable scandals in the 2000s and led to
the creation of the MBA Oath at Harvard and the World Economic Forum’s Oath Project
EXPERIMENTS IN STRATEGY RESEARCH 16
(Anderson & Escher, 2010; Bishop & Green, 2011) with the goal of increasing honesty in the
business world. Assuming that objective information on leader truthfulness could be obtained,
determining the specific effects of oath taking on lying apart from other factors would be
difficult using archival data due to differences in such factors as firm and industry culture
regarding lying, the situation-specific consequences of truthfulness or lying, and others. The
authors were able to overcome these challenges experimentally and show that oath taking alone
decreases lying. Similarly, Connelly, Shi, and colleagues (2020) also performed a study on
unethical behavior, but at the organizational level, examining how such conduct affects CEO
succession. The authors suggest that in the aftermath of organizational wrongdoing, boards of
directors prioritize ethical behavior in their search for a new CEO, and that this criterion
increases the attractiveness of job candidates who have attended religiously affiliated schools.
Choosing a new CEO is complex because many factors are likely to contribute to the decision,
and the relative importance of these many factors is difficult to disentangle. The authors deal
with these challenges by using a policy capturing approach, which allows them to measure the
importance of criteria in the presence and absence of past firm misconduct while also controlling
for within subject variation and eliminating potentially confounding external factors. In
justifying their methodological choice, the authors note that archival data are poorly suited for
their research question because it cannot measure the importance of hiring criteria to individuals
apart from the influence of others. Using the policy capturing approach, the authors were able to
isolate the effects of prior unethical behavior, and ultimately confirm that concern for ethical
34 experiments which addressed topics such as entrepreneurial failure (Artinger & Powell,
EXPERIMENTS IN STRATEGY RESEARCH 17
2016), entrepreneurial action and hustle behaviors (Fisher, Stevenson, Neubert, Burnell, &
Kuratko, 2020), bias in entrepreneurial finance (Bigelow, Lundmark, Parks, & Wuebker, 2014;
Kanze, Huang, Conley, & Higgins, 2018; Younkin & Kuppuswamy, 2018), determinants of
entrepreneurial finance (Chen, Yao & Kotha, 2009; Clarke, Cornelissen & Healey, 2019), market
entry and exit (Elfenbein, Knott & Croson, 2017; Moore, Oesch & Zietsma, 2007), and
2015). These studies showcase the use of experiments for a variety of purposes including
define, and investigating questions set in uniquely entrepreneurial and uncertain contexts.
extend archival observations and unpack important psychological mediators at the individual-
level. For example, to extend their archival study on entrepreneurial hustle, Fisher and colleagues
(2020) conducted an exploratory qualitative study paired with a follow-up experiment to unpack
the mechanisms observed in the field. In their experiment these authors investigate precisely how
the entrepreneurial hustle construct (i.e., entrepreneur’s urgent, unorthodox actions to overcome
challenges under extreme uncertainty) enhances the likelihood that organizational leaders will
enlist stakeholders and garner resources for their growing firms. The experimental results
Jones Christensen and colleagues (2015) provide an effective example of how field
experiments can be both theoretically and practically beneficial. Their study examined the
consumption habits of water purification systems among villages in Malawi (at the village level)
and reported the somewhat counterintuitive finding that the proportion of villagers who used the
EXPERIMENTS IN STRATEGY RESEARCH 18
product increased when it was deeply discounted compared to when it was free. Using an
experimental design allowed the researchers to identify that the changes in consumption were the
Artinger and Powell (2016) assessed and compared two previously identified causes of
entrepreneurial failure, overconfidence, and random error due to uncertainty, using a mock
computerized marketplace. Participants were given a general knowledge quiz and offered the
chance to enter their score into the “market,” with the understanding that they would gain or lose
money depending on how high their score was relative to other participants. The authors found
that patterns of erroneous market entry (situations where participants entered the market and lost
money) were most consistent with overconfidence. Given that the study was comparative in
nature, the experimental approach was appropriate in that it isolated the two explanations from
potential confounding factors and allowed for an assessment of the two against real data.
Elfenbein and colleagues (2017) examined delayed exit from failing entrepreneurial
ventures and assessed whether equity stakes (access to firm cash flows) were involved. The
experiment found that undergraduate business students asked to make exit decisions as part of a
computer game delayed exit past the optimal point when they were given equity stakes. Defining
“optimal” exit is challenging given the many factors involved. The authors’ use of the lab for this
study enabled them to create a simulated environment where the definition of an optimal exit
was clear, thereby allowing them to assess the effects of equity stakes on this dependent variable.
in corporate strategy encompasses topics such as goal setting and organizational performance
(Gary, Yang, Yetton & Sterman, 2017; Hohnisch, Pittnauer, Selten, & Pfingsten, 2016), the
Eskildsen, Argote, Mønster, Burton & Obel, 2016; Stam, van Knippenberg, Wisse, & Pieterse,
2018), and market entry decisions (Gutierrez, Astebro & Obloj, 2020). This includes questions of
a behavioral (Bardolet, Fox & Lovallo, 2011), judgmental (Phadnis, Caplice, Sheffi & Singh,
2015), and cognitive (Shapira & Shaver, 2014) nature. The article by Bardolet and colleagues
allocated between business units and subunits in systematic ways, referred to as partition
dependence. The study dealt with the capital allocation decisions among the business units of a
hypothetical firm and the factors that influence this allocation. The authors observed capital
allocation patterns based on firm centralization and business unit and division numbers and argue
that executives have a cognitive bias towards proportional allocations. This study was able to
address many of the potential problems of studying such a complicated topic by presenting a
conflicts and other potential situation-specific confounding variables. Similarly, Shapira and
contribute to sub-optimal investments. Their experiment involves the anchoring heuristic and
shows that exposing individuals to materials that create an anchor is, on average, sufficient to
change decision makers’ intentions to make an investment. Such evidence supports the existence
of anchoring as a real phenomenon rather than as an artifact of other factors, which would have
A final example is the work on scenario planning. Phadnis and colleagues (2015)
conducted a series of experiments in which experts were asked their opinions on potential
investments before and after scenario planning. The authors found that experts’ confidence in
their own judgement was not affected by using multiple scenarios as had been previously
EXPERIMENTS IN STRATEGY RESEARCH 20
suggested, but instead was strengthened or weakened based on how the investment performed in
a particular scenario. The study was beneficial both in providing evidence that did not confirm
previous work and in offering concrete conclusions on a complex topic. Together, the studies in
this topic area illustrate that experiments can be valuable in correcting erroneous conclusions and
consolidating gains from previous studies, providing a solid foundation for subsequent research.
Knowledge and Innovation. The 27 experiments within the knowledge and innovation
topic area included studies of knowledge transfer and spillovers (Di Stefano, King & Verona,
2014; Flammer & Kacperczyk, 2019; Kachra & White, 2008; Kane, 2010), creativity and
ideation (Berg, 2016; Franke, Poetz & Schreier, 2014; Keum & See, 2017), and organizational
learning (Fang, 2012; Lawrence, 2020). Several studies in this topic area were conducted in
creative or nascent venturing contexts in which archival data may be difficult to obtain. For
example, one study gathered data from gourmet Italian chefs, who were asked how likely they
would be to share domain relevant information (recipes and techniques) based on the reputation
of competitors (Di Stefano et al., 2014). The experiment was notable both for the creative
context in which it was carried out, and because each participant answered questions for more
than one hypothetical situation (i.e., repeated trials). This allowed the authors to account for
Other studies in this category also sought to address creative research questions.
Motivated by the rejection of inevitable disclosure doctrines in parts of the U.S., Flammer and
deployed as a defense against knowledge spillovers and found support for this notion. This study
methods to exploit the advantages of multiple techniques in addressing the research question.
the roles of trust, social capital, and governance. Many of these studies focused on alliances
(Agarwal, Croson, & Mahoney, 2010; Amaldoss & Staelin, 2010; Arend, 2009; Fonti, Maoret &
Whitbred, 2017; Mellewigt, Thomas, Weller & Zajac, 2017; Patzelt & Shepherd, 2008; Shah &
Swaminathan, 2008), with other studies considering reputation (Arend, 2009), trust and violation
(Harmon, Kim & Mayer, 2015), partner selection (Shah & Swaminathan, 2008), and free riding
(Fonti et al., 2017). As with the research in the other major areas, studies on cooperative
strategies combined topic-specific inquiry with methods that mitigated endogeneity to allow
causal claims to be made. For example, Agarwal and colleagues (2010) performed a study in
which participants played a computerized game that simulated the dynamics of strategic
alliances. The game varied the extent to which participants would benefit from alliance success
and the levels of communication with alliance partners. The authors found that alliances with a
high level of common benefit were more likely to succeed than other forms, and that this effect
was enhanced when communication with alliance partners was allowed. These results are
insightful given the complexity of potentially critical factors in a strategic alliance and were
facilitated by the high degree of experimental control over potentially confounding variables.
Participants were led to believe that they had been the victims of contract infringement and were
put in a position to monetarily punish an unknown and unseen offender. Previous work in
strategy had not investigated individual reactions to contract disputes and had instead relied
EXPERIMENTS IN STRATEGY RESEARCH 22
largely on archival studies to answer related but less direct questions, such as the effect of
contract structure on dispute likelihood (Malhotra & Lumineau, 2011). In contrast, Harmon and
colleagues (2015) focused on how individuals interpreted contract violations and were able to
directly test how these micro-level interpretations affected trust and the management of
relationships. Other exemplar studies in this topic area include Fonti and colleagues’ (2017)
assessment of the role of alliance effectiveness and collaboration in multi-party alliance free
riding behavior and Shah and Swaminathan’s (2008) investigation of strategic alliance partner
selection. In both cases, the use of experimental methodology allows the authors to address
questions that would be difficult to evaluate with other methods, and to add contextual detail to
which had a cognitive theme such as decision making (Camuffo, Cordova, Gambardella &
Spina, 2020; Hohnisch et al., 2016; Lovallo, Clarke, & Camerer, 2012; Mitchell et al., 2011),
organizational learning (Fang, 2012) and mental models (Gary & Wood, 2011; Gary, Wood &
Pillinger, 2012), For example, Gary and Wood (2011) demonstrated that more accurate mental
models led to the adoption of better decision rules and in turn, to better performance. They noted
that it had long been assumed that managers who better understand the industry structure and the
capabilities of their own organization are able to use this knowledge to enhance its performance,
and experimentally, the authors were able to demonstrate a causal relationship. Likewise,
Lovallo and colleagues (2012) examined analogizing as a decision-making technique and found
that adopting an “outside view” in which the decision maker adopts a detached view of the
analogies resulted in a higher expected rate of return for a project. The precision of their method
allowed the authors to address specific questions about the quantity and types of analogies that
EXPERIMENTS IN STRATEGY RESEARCH 23
lead to good decisions, an area they note had previously received insufficient attention. Finally,
Reitzig and Maciejovsky (2015) studied behavior associated with hierarchical vertical
information flow using both a within and between-subjects paradigm, thereby contributing to the
predictions surrounding this topic. Participants were asked to make decisions on whether to
forward ideas to higher levels within a hypothetical firm based on idea quality. The study found
that steeper hierarchies discouraged idea passing due to apprehension regarding evaluation or
perceived lack of control. The use of experiments in these studies allowed for the testing of
such as the influence (or lack thereof) of competition on market entry decisions (Luoma, Falk,
Totzek, Tikkanen & Mrozek, 2018; Moore et al., 2007), information and competitive decision
making (Abramson, Currim & Sarin, 2005), mixed strategy games (Amaldoss & Jain, 2002), and
market dynamics and confidence in judgement (Radzevick & Moore, 2011). Conventional
methods are excellent for describing competitive behavior but are largely unequipped to identify
the more detailed components of these phenomena. Experiments can assist in filling this gap.
Luoma and colleagues (2018) conducted two experiments on firm posture when entering a new
market (highly aggressive or not very committed) and examined whether posture can affect the
competitive response of incumbent firms. Using both managers and university students as
participants, the authors determined that facilitating a perception of either high aggression or
minimal commitment reduced the strength of incumbent responses, in the process addressing the
As noted of previous studies from our sample, experiments are also useful for examining
EXPERIMENTS IN STRATEGY RESEARCH 24
paradoxical or counterintuitive phenomena. Amaldoss and Jain (2002) examine mixed strategy
games through a model-based simulation and report the surprising result that of two firms
competing to obtain a patent, the firm more likely to commit resources to product development
and ultimately be granted the patent is the one that values it less, not more. The counterintuitive
nature of this finding along with its origin in theory and simulation dictated the need for a
follow-up study, for which the authors could have used archival methods. However, an archival
study by its nature would have been affected by potentially confounding factors and would not
have been able to directly assess the firm behaviors responsible for the model’s predictions.
Thus, the authors used an experiment to avoid these concerns and complement the strengths of
the simulation. The follow-up study allowed for the confirmation of the model’s predictions and
demonstrated the potential of experiments to assess the voracity of theory and models.
Strategic Human Capital. Strategic human capital accounted for only five studies.
Choudhury and colleagues (2020) used MBA students and an online experiment in the patent
application context to show that human capital can complement machine learning by mitigating
the bias to which machine learning can be prone. By using a specialized task (patent
examination) and research subjects that were of similar age and experience to patent examiners,
the authors were able to capture the benefits of experiments while keeping external validity as
high as possible.
In another notable study, Berge and colleagues (2015) conducted a field experiment in
Tanzania in which they provided microenterprise owners with business training, a grant, both, or
neither one, then assessed the effects of their manipulations by examining observed behavior.
They found that participants benefited greatly when they received both a bump in human capital
(through the business training) and financial capital (the grant). Through the field context, they
EXPERIMENTS IN STRATEGY RESEARCH 25
were able to capitalize on the strengths of the experimental methodology while at least partially
mitigating some of the drawbacks. Likewise, Chatterji and colleagues (2016) initiated new
research in the strategic human capital area by examining the effects of firm and business unit
identity on the extent of engineer engagement with their firm’s internal question and answer
system. The authors experimentally manipulated the supposed identity of prospective recipients
of interfirm assistance, thus isolating its effect on engineer behavior. Both the Berge and
Global Strategy. The global strategy topic area contained five studies, two of which
(Chatterji et al., 2016; Crilly et al., 2016) examined the liability of foreignness, a topic for which
factors when attempting to draw causal conclusions on questions involving international firms.
Crilly and colleagues (2016) test for the presence of liabilities of foreignness within the CSR
context. They conducted a creative study in which due to cultural similarities, they listed a firm’s
country of origin as either the USA or Canada and asked employees of American NGOs for their
impressions of these firms given either a “do-good” or “do-no-harm” CSR program. The authors
found significant differences in impressions of the “do-no-harm” firms based on country and
were able to attribute these to the foreignness of the firms due to the careful experimental design
of the study. Decisions involving foreign direct investment (FDI) are similarly complicated, with
a long list of potential contributing factors. Tong and colleagues’ (2015) address this by running
an experiment to gauge the relative importance of various factors for FDI attractiveness. They
combine the advantages of the experimental methodology with a relatively high degree of
external validity using Chinese executives as participants, ultimately reporting results that would
EXPERIMENTS IN STRATEGY RESEARCH 26
not be attainable through survey or archival means. Taken together, the studies in the 10 topic
areas demonstrate how experiments can be creatively designed and deployed and can be
components of each study to identify best practices and future research opportunities.
Experimental Design. Among the benefits of well-designed experiments is that they rule
out potential alternative explanations. A classic experimental design is one in which groups
randomly receive either exposure to a treatment or a control condition. This design characterized
the majority (71%) of the experiments in our dataset (Table S3). Eleven percent (11%) of studies
used a within-subjects design in which individuals were compared with themselves after
receiving a specific treatment, thus serving as their own control, and an additional eleven percent
(11%) used a mixed approach that incorporated both between and within-subjects components.
Finally, seven percent (7%) of studies utilized a conjoint/policy capturing approach in which the
use of multiple independent variables in differing combinations allows the effect of each variable
to be assessed. For example, Mitchell and colleagues (2011) administered a conjoint decision-
making task to CEOs with the same decision being made multiple times. This allowed the extent
of erratic decision making and the specific factors that contribute to it to be assessed.
Experimental Context. Our findings regarding contexts are summarized in Table S4.
The most common context (i.e., means of administration) in our sample was online with 64
experiments. The surge in online experiments appears to be primarily driven by the introduction
of Amazon’s mechanical turk (MTurk) and similar services as a method for quickly identifying
and selecting respondents with desired characteristics, an approach validated by recent studies
EXPERIMENTS IN STRATEGY RESEARCH 27
(Buhrmester, Kwang & Gosling, 2016; Crump, McDonnell & Gureckis, 2013). In light of the
accelerating popularity of such sampling methods, it is perhaps not surprising that many of the
online studies in our sample were published in the past three years, and the obstacles to
interfacing with respondents in person due to the COVID-19 pandemic suggest that online panels
are likely to remain popular. Another popular method was traditional laboratory experiments (n =
54). Such studies included computerized business mock experiments (e.g., Elfenbein et al.,
2017), computer games (e.g., Arend, 2009), and teamwork activities (e.g., Døjbak Håkonsson et
al., 2016). Laboratory experiments in the classroom served as the context for 29 studies. These
studies were largely of a cognitive nature and less likely to include behavioral outcomes (e.g.,
Crilly, 2017; Shapira & Shaver, 2014; Wright & Goodwin, 2002). Finally, 27 studies involved
they influence an experiment’s external validity (Hsu, Simmons, & Wieland, 2017; Shadish et
al., 2002). In the current data set, 82 of the studies recruited students as the participants (see
Table S5). Despite skepticism regarding the generalizability of studies using students as
participants, they can be appropriate for certain questions that pertain to cognition and interactive
choices in business settings, particularly when the research question relates to the psychological
processes of non-specialists (Stevenson & Josefy, 2019). Business professionals (24) and
EMBAs (10) were also common participants, but few experiments were carried out using CEOs
or executives and board members (one and five studies, respectively). As previously mentioned,
crowd-based options (Aguinis & Lawal, 2012) such as MTurk (n = 36) increased in frequency
over the time covered by our review, and all were published in 2015 or later. While studies
varied in size with several having thousands of participants, the median number of participants
EXPERIMENTS IN STRATEGY RESEARCH 28
per study was 157. Seven experiments used group level participants such as retail chain stores
(Lawrence, 2020) or small businesses (Anderson, Chandy & Zia, 2018). In terms of participant
country of origin, the most sampled country in the dataset was the USA (75) followed by the
United Kingdom and China (8 each), signaling a need for increased sampling diversity at the
country-level in strategy.
Particularly in the field studies, some author teams compensated their participants by
providing them with a knowledge-based reward such as free training (Anderson et al., 2018;
Camuffo et al., 2020), or to incentivize firms to participate, the results of analysis (Chatterji et
al., 2016). For the experiments in our dataset, 50 percent paid their participants, while an
additional 10 percent provided a non-monetary reward like extra credit or a non-monetary good
such as chocolate or wine. Eleven percent did not pay, and the remaining 29 percent did not
Priming. Priming is useful in the experimental context to reliably bring forth specific
mindsets, emotions, or other cognitive states such as trust (Meier, Stephenson & Perkowski,
2019), particularly in the laboratory setting, in which contextual factors may otherwise be
lacking. While our sample includes examples of studies that primed mindsets (Crilly, 2017; Li et
al., 2018; Mueller et al., 2018) and trust (Meier et al., 2019), priming was used by only six
intention to act in a certain way or make a particular decision (intention-based measure, 49%), an
observed behavior under mock conditions (mock behavioral measure, 37%), or observed
behavior in real life (realistic behavior measure, 14%). Scholars have suggested that behavioral
outcomes are well-suited for strategy process research (Dutton & Stumpf, 1991; Hough & White,
EXPERIMENTS IN STRATEGY RESEARCH 29
2003; Miller & Tsang, 2011). Measuring an intention may not have the validity of the other two
options, but it increases design feasibility, especially in situations where conducting a behavioral
experiment would be prohibitive (e.g., firm acquisition). Mock behavioral measures constitute a
middle ground and allow for observation of simulated behavior. This is useful for maintaining
reasonably high validity in situations where the practical and ethical concerns of realistic
have been enumerated, they also suffer from some weaknesses, including a comparative lack of
complement an existing field study within a single paper can be useful. This approach was used
Audia and colleagues (2000) provide an excellent example of this approach using
differing methodologies to investigate strategic persistence. The first study uses archival data to
show that past success is associated with strategic persistence following radical environmental
change. This study has the advantage of high external validity due to its real-life setting and the
regarding the operative mechanism of the association from being reached, meaning that the
authors address these shortcomings using a subsequent experiment in which they assess strategic
persistence following simulated radical environmental change with all variables held constant
except for level of past performance. This provides confirmatory evidence with high internal
validity that the association observed in study one is due to the level of past performance. Use of
complementary methods allowed the authors to obtain results with high external validity based
EXPERIMENTS IN STRATEGY RESEARCH 30
on the archival study while still making causal claims with high internal validity from the
experiment. In this way, they were able to triangulate around the question of interest and exploit
While experiments in strategic management are still rare compared to other methods, our
review indicates that scholars are increasingly calling for and turning to experiments to advance
several strategic management topic areas. However, the degree of concentration in a small
number of interest groups raises concerns that perhaps experiments in strategic management are
overly narrow in their focus, contributing insights to only a few important strategy topics. We
believe that there is substantial opportunity for experiments to be used in other areas such as
global strategy, strategic human capital, and several additional topic areas where they have
seldom been deployed. For example, we were unable to identify recent experimental studies
connected to substantial research streams such as transaction cost economics or the resource-
Certainly, experiments are unlikely to be appropriate for all research questions. Chatterji
and colleagues note in reference to experiments, “We view this methodology as a complement,
not a substitute, for existing strategy research methods, since field experiments have strengths
and limitations that are often different from our traditional techniques” (2016:117). McGrath
(1981) refers to the incompatible nature of maximizing multiple study characteristics like
which maximization of one characteristic inevitably leads to concessions from others such that
no single approach can simultaneously maximize all three. Our conclusion from this review
echoes these sentiments and we suggest that experiments have an increasingly high potential to
EXPERIMENTS IN STRATEGY RESEARCH 31
balance in the field as a whole through increased use of randomized experiments will enhance
the ability to triangulate and establish causal relationships, thereby consolidating past gains and
“Only through repeated studies of a research question using different designs and
analyses can we gain confidence that a specific endogeneity threat is fully addressed.
Even the idealized experiment requires triangulation with different designs, samples, and
operationalization of variables before causal claims free of any validity threat can be
made.” (p. 138)
One reason why experiments are at times difficult to envision in strategic management
might be due to the organizational level of analysis. However, there are multiple ways to design
experiments and assign participants to roles for advancing macro-level research. Thus, we
present the following typology of participant roles and how they can be useful in advancing
developed designs in which firms are the participants and are randomly assigned to particular
conditions (e.g., Anderson et al., 2018; Camuffo et al., 2020). These studies are valuable because
they are at the level of analysis most central to strategic management scholarship. However, they
may suffer from generalizability criticisms because they are more likely to be conducted with
smaller firms, given the relative infeasibility of getting large firms to consent to researcher
assigned treatments. Perhaps, these studies may be more feasible in strategic entrepreneurship
settings, where there are a larger number of small firms. It may also be more feasible within an
EXPERIMENTS IN STRATEGY RESEARCH 32
organization to have multiple divisions as participants, with some implementing the intervention
and others not. Both options have promise for future experimental research conducted at the
firm-level.
participants in the study as proxies for a firm or organization (Amaldoss & Staelin, 2010; Fang,
2012). For instance, to study competitive dynamics, participants may be asked to represent an
airline making the choice of whether to expand by acquiring landing rights in a new location. In
such a study, the focus may not necessarily be on the decision-maker but instead to ascertain
how firms’ actions may impact the actions of competitors. This approach may be useful when the
researcher seeks to focus on the varied exchanges between firms in the competitive landscape.
scholars may be focused directly on the individual actors within the firm, particularly key
decision-makers. For example, strategic leadership scholars may use participants as proxies for
firm actors, directing the participant to take on the role of a CEO, CFO, or other decision maker
of a company (e.g., Chng, Rodgers, Shih, & Song, 2012; Gary & Wood, 2011; Stam et al., 2018).
We find that this is the most frequent approach to experimental design in strategic management.
This approach has numerous advantages, including the ability of many participants to grasp the
identity they have been assigned. However, it may attract criticism if the participants do not have
sufficient experience or background to be suitable proxies for the executive role they are asked to
imagine.
specific stakeholders, including for instance, investors (Greenberg & Mollick, 2017),
shareholders (Krause et al., 2014), and customers (Raithel & Hock, 2021). Participants can
EXPERIMENTS IN STRATEGY RESEARCH 33
provide strong indications of how these various stakeholders might interact, engage, or transact
with focal organizations under various manipulated conditions. This approach is useful given
growing interest in reputation and trust between firms and their stakeholders, and the developing
importance of research on the stakeholder view of the firm (Barney & Mackey, 2021).
One potential concern identified from our review is that few experiments in the sample
(approximately one third) were motivated explicitly by theory. Experiments have been
recognized as useful for advancing theory-based knowledge in other social science fields (Lude
& Prügl, 2021; Trochim & Donnelly, 2001; Stevenson, Josefy, McMullen, & Shepherd, 2020),
and the same could be true in strategic management. We propose that experimental
methodologies are particularly well suited for testing and advancing theory in strategy because
they are characterized by high internal validity and are thus able to isolate and test specific
variables that are central to a given theory, providing a higher degree of precision and certainty
studies in our review. This advancement can take various forms including evaluating or
extending to new contexts, and is applicable to both established, as well as more nascent
theories. For example, management control theory has classically been applied within rather than
across organizations (Giglioni & Bedeian, 1974), but Shah and Swaminathan (2008) apply it to
monitoring and when necessary, correcting processes that occur in such agreements. In contrast
to past studies which have focused on partner characteristics for determining partner
attractiveness, the authors suggest that alliance project type is a key moderator of partner
EXPERIMENTS IN STRATEGY RESEARCH 34
selection factors. They highlight the differing manageability and interpretability of various
alliance projects and predict that these will affect the relevance of specific partner characteristics
for a given alliance project. Thus, beyond providing nuance and insights into strategic alliance
Experiments are also useful for evaluating and extending nascent theories. For example,
Raithel and Hock (2021) examine how the type of crisis and response to it affects post-crisis firm
reputation. Crisis-response match theory suggests that firms can maximize their retained social
approval in the wake of scandal by matching their response, specifically the amount of
responsibility that they accept, with the “situational attributions of responsibility,” or the
perceptions of how responsible they are (Bundy & Pfarrer, 2015). This predicts that conforming
match, will be more beneficial in retaining social approval than nonconforming strategies in
which there is a mismatch. This means that the theory supports the counterintuitive conclusion
that an over-conforming crisis response strategy (i.e., a response that exceeds expectations such
as firm acceptance of a share of responsibility that exceeds stakeholder perceptions of what they
are responsible for) is nonconforming and thus increases social approval losses by external
stakeholders. Furthermore, the theory as proposed by Bundy and Pfarrer (2015) considers the
consequences for social approval, but not for the related concept of firm reputation, and Raithel
and Hock (2021) note that as of their study’s publication, no other authors had evaluated crisis-
response match theory empirically. Raithel and Hock (2021) address this gap by experimentally
testing the effects of various conforming and nonconforming strategies on perceived firm
reputation. Their results provide support for the predictions of crisis-match response theory and
EXPERIMENTS IN STRATEGY RESEARCH 35
extend its implications to include firm reputation. While the authors also conduct an archival
study on the effects of product recalls on stock price, their experiment allows them to extend
theory to firm reputation and to conclude that perceptions of firm reputation are due to crisis
response strategy rather than one of the many potential confounding variables present in the
archival study.
In summary, we propose that experiments are a particularly good method for extending
established theories under certain conditions, such as when there is the potential to apply an
extant theory to novel contexts (e.g., management control theory, Shah & Swaminathan, 2008),
or evaluate conflicting predictions at the intersection of multiple theories (e.g., regulatory focus
and regulatory fit theories, Stam et al., 2018). In such cases, the ability of experiments to assess
the effects of specific variables can be utilized in conjunction with theory-driven hypotheses to
clarify or establish the boundaries of specific theories. Previous studies have even recommended
specific theories that could potentially benefit from evaluation with experimental methods,
including stakeholder theory (Tantalo & Priem, 2016), real options theory (Trigeorgis & Reuer,
2017), and upper echelons theory (Tang et al., 2018). Similar to the example studies cited above,
scholars wishing to extend or evaluate these or other theories could employ experiments
carefully designed to evaluate established theories in novel contexts, evaluate the predictions of
new or untested theories, or even test which theory best explains a given phenomenon.
movement in strategy, which seeks to understand constructs on the firm-level through individual
actions and interactions (Foss, 2021). Strategic decisions are a central and unifying theme in
strategic management (Leiblein, Reuer, & Zenger, 2018), and scholars have previously noted
EXPERIMENTS IN STRATEGY RESEARCH 36
that decisions are made by individuals and groups of individuals within firms, particularly
influential individuals (e.g., CEOs, top management team members, Hambrick and Mason,
studying these groups and individuals (Felin et al., 2015), and includes papers on prominent
strategy issues such as dynamic capabilities (Teece, 2007), resource-based theory (Foss, 2011),
and firm performance (Eisenhardt, Furr, and Bingham, 2010). By 2011, the movement had
gained sufficient momentum that the Strategic Management Journal published a special issue on
than any other special issue in its history (Powell et al., 2011). It included studies applying a
micro lens to classic strategy concepts like corporate capital allocation (Bardolet et al., 2011),
strategy implementation (Huy, 2011), and dynamic capabilities (Hodgkinson and Healey, 2011).
Furthermore, it called for the integration of these new perspectives with more traditional
approaches while dissolving the “false divide” between them (Levinthal, 2011).
have a significant impact on the future role of experiments in strategy. A frequently cited
conditions (e.g., Grigoriou & Rothaermel, 2017). While strategy scholars have successfully
managed to overcome this challenge while sampling at the firm level (e.g., Anderson et al., 2018;
individual-level. Further, certain micro topics such as cognition (e.g., Carton & Lucas, 2018) and
strategic behavior (e.g., Audia et al., 2000) allow some questions to be addressed using readily
available participant pools such as students rather than requiring samples from difficult to access
populations like CEOs. We propose that the microfoundations movement has fundamentally
EXPERIMENTS IN STRATEGY RESEARCH 37
altered the relationship between strategy research and experimental methods such that
experiments are likely to be considered more appropriate, and even more necessary than in past
years. Experiments, we believe, have the potential to become a more frequently used tool
allowing the field to reap the benefits of micro theories in strategy (cf., Powell et al., 2011).
Our review reveals several areas in which scholars have recently begun to publish and
initiate experimental work. In this section, we discuss a sampling of specific opportunities for
future research along with illustrative examples or mock experiments that scholars could employ,
detailing how scholars can leverage best practices from strategy experiments (informed by our
review) and those from other fields. To organize this section, we develop and detail illustrations
that demonstrate how experiments could enhance strategic management scholarship in two
important ways. We draw on recent work which examined the advancing state of knowledge in
strategy (Duhaime, Hitt and Lyles, 2021) as a basis to illustrate specific experimental
opportunities with high potential to advance the strategic management literature. Specifically,
Duhaime and colleagues emphasized areas including sustainability strategies and a new and
unique understanding of stakeholder theory on which strategy research is likely to focus in the
firms as well as governments and will continue to increase in relevance as the effects of climate
change and other global disruptions become increasingly evident. Although it is well recognized
that the potentially devastating effects of climate change could have far reaching effects across
industries, the means by which managers respond to climate change is seldom studied for one
obvious reason; the most disruptive aspects of climate change involve future states that do not
EXPERIMENTS IN STRATEGY RESEARCH 38
yet exist. Indeed, considering hypothetical situations is where experiments, and particularly
knowledge. Mock-behavioral studies can use human subjects and observe human decisions in
make long-term strategic plans and resource allocations in direct response to (hypothetical)
changes related to the global climate crisis. Although scholars have found that access to the
deliberations of boards is difficult to obtain, many aspects of executive team and board room
behaviors can be simplified and simulated in experiments because they are fundamentally
discussions and interactions between individuals and groups. Indeed, we know from other social
science fields that experiments can be very useful for evaluating group decisions as well as social
conformity within groups. For example, psychology researchers Gino, Ayal and Ariely (2009)
studied how one “bad apple” embedded within a group can alter the saliency of ethicality and
increase the likelihood that other group members will prioritize financial gain over concern for
Shepherd (2017) highlight how social context negatively influences affective reactions and team
dynamics under high uncertainty. Also, at the group level, Mannix, Neale, and Northcraft (1995)
manipulate organizational culture using vignettes and a negotiation simulation task. Findings
reveal that organizational culture influences resource allocations. Using a similar type of vignette
the board or executive team level. This would afford researchers a high degree of experimental
control when considering how organizational culture could influence the openness of executives
Strategic management researchers might also consider how social pressure could alter
Asch’s (1956) classic social conformity experiments. Using experimental social conformity
designs strategic management researchers could consider if strategic level conformity influences
board decisions related to sustainability issues. For example, a researcher could adapt Asch’s
classic design to the context of strategic management by focusing factors that might affect
executives’ willingness to deviate from consensus including political ideologies, the salience of
the potential crisis, or the individual need for cognition. For example, the experiment could take
place in a company boardroom with actual board members or executives serving as confederates
(a situation with very high ecological validity) or might take place via an online Qualtrics survey
in which the participant is shown foil engagements from other hypothetical board members.
These approaches could be an effective way to assess how social influence could affect board
decisions related to climate crisis issues, complementing current archival approaches, and
weighing the influence of factors and processes that might alter the deliberations and perspective
Experimental research could also be used to study other important strategic management
questions related to sustainability. For example, an experiment could be used to test how climate
change salience (via priming) influences global alliance decisions and transactions between firms
with differing levels of primed environmental concern. Other prospective research that could be
tested experimentally includes how firms in threatened industries (e.g., petroleum) orchestrate
sustainability affects the characteristics firm stakeholders desire in a prospective CEO (possibly
Experiments for Studying Stakeholder Theory. Very few studies in our review
specifically considered stakeholder theory (e.g., Choi & Shepherd, 2005). However, in recent
years, both scholars (e.g., Barney and Mackey, 2021) and prominent business leaders (e.g.,
Benioff, 2019; Business Roundtable, 2019) have publicly stressed the importance of adopting a
holistic stakeholder perspective. Barney and Mackey (2021) suggest that some of the most
central theories in the field of strategic management could be affected by a corporate shift toward
renewed stakeholder logic. Yet, given the nascency of this phenomenon, little archival data are
available that allow researchers to compare how managerial shifts toward stakeholder logics
influence strategic decision-making. Similar to issues of sustainability, the lack of available data
priming” techniques.
behavior literature. Kay and colleagues (2004) developed a series of logic priming experiments
to determine if implicitly presented primes from material objects would influence individual
logics and associated behavioral norms (i.e., the presence of books as a prop to prime an
educational logic). They found that simple exposure to settings such as boardrooms or objects
such as briefcases increased the likelihood that participants would adopt a “competitive” logic
and decrease their tendency to rely on a “cooperative” logic, demonstrated through tasks
including accepting or rejecting monetary offers from other participants (see Messick, Moore &
Bazerman, 1997; Robert & Carnevale, 1997; Thaler, 1988). Strategic management scholars
could adapt this paradigm and present participants with organizational primes that relate to
shareholder versus stakeholder scenarios. For example, scholars interested in how dominant
EXPERIMENTS IN STRATEGY RESEARCH 41
shareholder versus stakeholder logics affect strategic decisions could prime participants with
corporate versus stakeholder cues to determine if situational primes could influence the use of
Other potentially important topics that could be explored via experiments include how
relationships could be experimentally manipulated from high to low). Choi and Shepherd (2005)
point out that catering to certain stakeholders may require trade-offs relative to other
stakeholders and call for additional studies on the interest in and impact of various types of
stakeholders on firm decisions. Other studies could consider how stakeholder pressure, influence,
or co-creation of a product could affect different types of strategy decisions. Overall, we argue
that experiments represent a major opportunity to carry out unique research on stakeholders
either through selecting respondents from specific stakeholder groups or priming the concerns of
specific stakeholder groups to respondents. Integrated ideas from the two proceeding sections,
we note that scholars could even investigate questions at the intersection of sustainability and
stakeholder theory, such as the effects of evolving stakeholder attitudes towards environmental
sustainability on firm behaviors (e.g., the likelihood that a firm would adopt a green CSR
program in direct response to stakeholders) or how stakeholders might influence firm efforts to
reduce their carbon footprint (e.g., through purchasing carbon offsets, allowing employees to
telecommute, building higher efficiency buildings, etc.). Such questions are likely to be
increasingly relevant to firms in the future and given the absence of historic data on such topics,
experience with experimental methodologies, we have developed a guide for strategy scholars
valuable insights from existing studies such as those described above along with innovative
experimental design practices in related fields. The guide presents (a) Initial considerations for
planning your study (b) The basic mechanics of the experimental method, (c) Experimental
methods considerations that are specific to strategy research, and (d) Additional/advanced
The guide is primarily intended to aid researchers who are relatively new to experiments,
allowing them to get started with planning an experiment. Several design considerations are put
forth in this guide including concerns that are somewhat unique to conducting experiments in the
strategic management context. By no means is this guide intended to be fully exhaustive of all
experimental considerations. Rather it should be used in conjunction with this review paper and
other best practice papers and texts on experimental research. We believe experiments constitute
an underused methodology that has significant potential for strategic management researchers,
and we hope this guide can serve as a catalyst for novel experimental work in our field.
CONCLUSION
review suggests that experiments have a tremendous opportunity to help advance knowledge in
conducted a review of critical knowledge and theoretical advancement that have been gained in
the field from extant experiments. We also summarized methodological approaches taken by
experimental work to recommend best practices. Finally, we suggested specific studies for future
For newcomers, our research provides value by outlining the specific opportunities to advance
the theory, methods, and the breadth of topics that novel experiments in strategy can address. For
more experienced experimental researchers, our review provides a broad overlay of the domain
of strategy experiments, which can be used to help seasoned experimental researchers bridge
sub-disciplines, presenting them with a path to accelerate their research and their use of
REFERENCES
Abramson, C., Currim, L. S., & Sarin, R. 2005. An experimental investigation of the impact of
Agarwal, R., Anand, J., Bercovitz, J., & Croson, R. 2012. Spillovers across organizational
Agarwal, R., Croson, R., & Mahoney, J. T. 2010. The role of incentives and communication in
413-437.
Aggarwal, V. A., Posen, H. E., & Workiewicz, M. 2017. Adaptive capacity to technological
Aguinis, H., & Bradley, K. J., 2014. Best practice recommendations for designing and
Aguinis, H., Edwards, J. R., & Bradley, K. J. 2017. Improving our understanding of moderation
665-685.
Aguinis, H., & Lawal, S. O. 2012. Conducting field experiments using eLancing's natural
Aguinis, H., & Vandenberg, R. J. 2014. An ounce of prevention is worth a pound of cure:
Amaldoss, W., & Jain, S. 2002. David vs. Goliath: An analysis of asymmetric mixed-strategy
Amaldoss, W., & Staelin, R. 2010. Cross-function and same-function alliances: How does
alliance structure affect the behavior of partnering firms? Management Science, 56: 302-
317.
Anderson, M., & Escher, P. 2010. The MBA oath: Setting a higher standard for business leaders.
Anderson, S. J., Chandy, R., & Zia, B. 2018. Pathways to profits: The impact of marketing vs.
Angrist, J. D., & Pischke, J. S. 2010. The credibility revolution in empirical economics: How
better research design is taking the con out of econometrics. Journal of Economic
Arend, R. J. 2009. Reputation for cooperation: Contingent benefits in alliance activity. Strategic
Artinger, S., & Powell, T. C. 2016. Entrepreneurial failure: Statistical and psychological
Atzmuller, C., & Steiner, P. M. 2010. Experimental vignette studies in survey research.
Methodology, 6: 128-138.
Audia, P. G., Locke, E. A., & Smith, K. G. 2000. The paradox of success: An archival and a
Baker, B., Derfler-Rozin, R., Pitesa, M., & Johnson, M. 2019. Stock market responses to
Bardolet, D., Fox, C. R., & Lovallo, D. 2011. Corporate capital allocation: A behavioral
Bargh, J. A., & Chartrand, T. L. 2000. Studying the mind in the middle: A practical guide to
priming and automaticity research. In H. Reis & C. Judd (Eds.), Handbook of research
Barney, J. 1991. Firm resources and sustained competitive advantage. Journal of Management,
17: 99-120.
Barney, J. B., & Mackey, A. 2021. What would the strategic management field look like if it
took stakeholder theory seriously? In I. M. Duhaime, M.A. Hitt, & M.A. Lyles (Eds.),
Strategic management: State of the field and its future. Oxford, UK: Oxford University
Press.
Benioff, M. 2019. Marc Benioff: We need a new capitalism. The New York Times. Retrieved
from https://www.nytimes.com/2019/10/14/opinion/benioff-salesforce-
Bennett, V. M., Seamans, R., & Zhu, F. 2015. Cannibalization and option value effects of
Berchicci, L., Dowell, G., & King, A. A. 2017. Environmental performance and the market for
Berg, J. M. 2016. Balancing on the creative highwire: Forecasting the success of novel ideas in
Berge, L. I. O., Bjorvatn, K., & Tungodden, B. 2015. Human and financial capital for
Bigelow, L., Lundmark, L., Parks, J. M., & Wuebker, R. 2014. Skirting the issues: Experimental
1732-1759.
Bishop, M., & Green, M. 2011. The road from ruin: How to revive capitalism and put America
Bono, J. E., & Judge, T. A. 2003. Self-concordance at work: Toward understanding the
554-571.
Breugst, N., & Shepherd, D. A. 2017. If you fight with me, I'll get mad! A social model of
Brooks, M. E., Highhouse, S., Russell, S. S., & Mohr, D. C. 2003. Familiarity, ambivalence, and
88: 904-914.
Buhrmester, M., Kwang, T., & Gosling, S. D. 2016. Amazon's Mechanical Turk: A new source
Bundy, J., & Pfarrer, M. D. 2015. A burden of responsibility: The role of social approval at the
Burtch, G., Ghose, A., & Wattal, S. 2015. The hidden cost of accommodating crowdfunder
Busenbark, J. R., Gamache, D., Yoon, E. H., Certo, S. T., & Withers, M. C. 2019. How much of
a problem is omitted variable bias really? Examining strategy research with the ITCV.
Management.
https://www.businessroundtable.org/business-roundtable-redefines-the-purpose-of-a-
Cain, D. M., Moore, D. A., Haran, U. 2015. Making sense of overconfidence in market entry.
Camuffo, A., Cordova, A., Gambardella, A., & Spina, C. 2020. A scientific approach to
Carnahan, S. 2017. Blocked but not tackled: Who founds new firms when rivals dissolve?
Carton, A. M., & Lucas, B. J. 2018. How can leaders overcome the blurry vision bias?
Carton, A. M., Murphy, C., & Clark, J. R. 2014. A (blurry) vision of the future: How leader
57: 1544-1570.
Chatterji, A., Delecourt, S., Hasan, S., & Koning, R. 2019. When does advice impact startup
Chatterji, A. K., Findley, M., Jensen, N. M., Meier, S., & Nielson, D. 2016. Field experiments in
Chen, X. P., Yao, X., & Kotha, S. 2009. Entrepreneur passion and preparedness in business plan
Chng, D. H. M., Rodgers, M. S., Shih, E., & Song, X. B. 2012. When does incentive
Choi, Y. R., & Shepherd, D. A. 2005. Stakeholder perceptions of age and other dimensions of
Choudhury, P., Starr, E., & Agarwal, R. 2020. Machine learning and human capital
Clarke, J. S., Cornelissen, J. P., & Healey, M. P. 2019. Actions speak louder than words: How
Clingingsmith, D., & Shane, S. 2018. Training aspiring entrepreneurs to pitch experienced
investors: Evidence from a field experiment in the United States. Management Science,
64: 5164-5179.
Coffman, L. C., & Gotthard-Real, A. 2019. Moral perceptions of advised actions. Management
Colquitt, J. A., & Zapata-Phelan, C. P. 2007. Trends in theory building and theory testing: A
Connelly, B. L., Ketchen Jr, D. J., Gangloff, K. A., & Shook, C. L. 2016. Investor perceptions of
CEO successor selection in the wake of integrity and competence failures: A policy
Connelly, B. L., Li, Q., Shi, W., & Lee, K. B. 2020. CEO dismissal: Consequences for the
strategic risk taking of competitor CEOs. Strategic Management Journal, 41: 2092-2125.
Connelly, B. L., Miller, T., & Devers, C. E. 2012. Under a cloud of suspicion: Trust, distrust, and
33: 820-833.
EXPERIMENTS IN STRATEGY RESEARCH 51
Connelly, B. L., Shi, W., Walker, H. J., & Hersel, M. C. 2020. Searching for a sign: CEO
10.1177/0149206320924119
Crilly, D. 2017. Time and space in strategy discourse: Implications for intertemporal choice.
Crilly, D., Ni, N., & Jiang, Y. W. 2016. Do-no-harm versus do-good social responsibility:
Attributional thinking and the liability of foreignness. Strategic Management Journal, 37:
1316-1329.
Crump, M. J., McDonnell, J. V., & Gureckis, T. M. 2013. Evaluating Amazon's Mechanical
Cummings, T., & Knott, A. M. 2018. Outside CEOs and innovation. Strategic Management
Di Stefano, G., & Gutierrez, C. 2018. Under a magnifying glass: On the use of experiments in
Di Stefano, G., King, A. A., & Verona, G. 2014. Kitchen confidential? Norms for the use of
1670.
Døjbak Håkonsson, D., Eskildsen, J. K., Argote, L., Mønster, D., Burton, R. M., & Obel, B.
Duhaime, I. M., Hitt, M. A., & Lyles, M. A., (Eds.). 2021. Strategic management: State of the
Dutton, J. E., & Stumpf, S. A. 1991. Using behavioral simulations to study strategic processes.
Elfenbein, D. W., Knott, A. M., & Croson, R. 2017. Equity stakes and exit: An experimental
Elsbach, K. D., & Elofson, G. 2000. How the packaging of decision explanations affects
Exley, C. L. 2020. Using charity performance metrics as an excuse not to give. Management
Fang, C. 2012. Organizational learning as credit assignment: A model and two experiments.
Felin, T., Foss, N. J., & Ployhart, R. E. 2015. The microfoundations movement in strategy and
Fisher, G., Stevenson, R., Neubert, E., Burnell, D., & Kuratko, D. F. 2020. Entrepreneurial
hustle: Navigating uncertainty and enrolling venture stakeholders through urgent and
Flammer, C., & Kacperczyk, A. 2019. Corporate social responsibility as a defense against
Folkes, V. S., & Whang, Y. O. 2003. Account-giving for a corporate transgression influences
moral judgment: When those who "spin" condone harm-doing. Journal of Applied
Fonti, F., Maoret, M., & Whitbred, R. 2017. Free‐riding in multi‐party alliances: The role of
Foss, N. J. 2011. Invited editorial: Why micro-foundations for resource-based theory are needed
and what they may look like. Journal of Management, 37: 1413-1428.
Foss, N. J. 2021. Microfoundations in strategy: Content, current status, and future prospects. In I.
M. Duhaime, M.A. Hitt, & M.A. Lyles (Eds.), Strategic management: State of the field
Foss, N. J., & Pederson, T. 2016. Microfoundations in strategy. Strategic Management Journal,
37: E22-E34.
Franke, N., Poetz, M. K., & Schreier, M. 2014. Integrating problem solvers from analogous
Garg, S., Li, Q., & Shaw, J. D. 2018. Undervaluation of directors in the board hierarchy: Impact
Gary, M. S., & Wood, R. E. 2011. Mental models, decision rules, and performance
Gary, M. S., Wood, R. E., & Pillinger, T. 2012. Enhancing mental models, analogical transfer,
and performance in strategic decision making. Strategic Management Journal, 33: 1229-
1246.
EXPERIMENTS IN STRATEGY RESEARCH 54
Gary, M. S., Yang, M. M., Yetton, P. W., & Sterman, J. D. 2017. Stretch goals and the
Giglioni, G. B., & Bedeian, A. G. 1974. A conspectus of management control theory: 1900-
Gino, F., Ayal, S., & Ariely, D. 2009. Contagion and differentiation in unethical behavior: The
effect of one bad apple on the barrel. Psychological Science, 20: 393-398.
Gino, F., Norton, M. I., & Ariely, D. 2010. The counterfeit self: The deceptive costs of faking
Goldstein, N.J., Cialdini, R.B., Griskevicius, V., 2008. A room with a viewpoint: Using social
35: 472–482.
Green, E. A., Rao, J. M., & Rothschild, D. 2019. A Sharp Test of the Portability of
Greenberg, J., & Mollick, E. 2017. Activist choice homophily and the crowdfunding of female
Grigoriou, K., & Rothaermel, F. T. 2017. Organizing for knowledge generation: Internal
knowledge networks and the contingent effect of external knowledge sourcing. Strategic
Gunia, B. C., Gish, J. J., & Mensmann, M. 2021. The weary founder: Sleep problems, ADHD-
Gutierrez, C., Astebro, T., & Obloj, T. 2020. The impact of overconfidence and ambiguity
Hahl, O., & Ha, J. 2020. Committed diversification: Why authenticity insulates against penalties
Hambrick, D. C. 2007. The field of management's devotion to theory: Too much of a good
Hambrick, D. C., & Mason, P. A. 1984. Upper echelons: The organization as a reflection of its
Hamilton, B. H., & Nickerson, J. A. 2003. Correcting for endogeneity in strategic management
Harmon, D. J., Kim, P. H., & Mayer, K. J. 2015. Breaking the letter vs. spirit of the law: How
the interpretation of contract violations affects trust and the management of relationships.
Hekman, D. R., Johnson, S. K., Foo, M. D., & Yang, W. 2017. Does diversity-valuing behavior
result in diminished performance ratings for non-white and female leaders? Academy of
Hertwig, R., & Ortmann, A. 2008. Deception in experiments: Revisiting the arguments in its
Highhouse, S., 2009. Designing experiments that generalize. Organizational Research Methods,
12: 554–566.
Hill, A. D., Johnson, S. G., Greco, L. M., O’Boyle, E. H., & Walter, S. L. 2021. Endogeneity: A
review and agenda for the methodology-practice divide affecting micro and macro
Hitt, M. A., Beamish, P. W., Jackson, S. E., & Mathieu, J. E. 2007. Building theoretical and
1500-1516.
Hohnisch, M., Pittnauer, S., Selten, R., & Pfingsten, A. 2016. Designing for deliberative goal-
based decision making in environments with rare adverse events-an experimental study.
Hoogendoorn, S., Parker, S. C., & van Praag, M. 2017. Smart or diverse start-up teams?
Hossain, T., Minor, D., & Morgan, J. 2011. Competing matchmakers: An experimental
Hough, J. R., & White, M. A. 2003. Environmental dynamism and strategic decision‐making
481-489.
Hsu, D. K., Simmons, S. A., & Wieland, A. M. 2017. Designing entrepreneurship experiments:
A review, typology, and research agenda. Organizational Research Methods, 20: 379-
412.
Huang, L., & Paterson, T. A. 2017. Group ethical voice: Influence of ethical leadership and
Huang, L., & Pearce, J. L. 2015. Managing the unknowable: The effectiveness of early-stage
Huy, Q. N. 2011. How middle managers' group‐focus emotions and social identities influence
Jacguemet, N., Luchini, S., Rosaz, J., & Shogren, J. F. 2019. Truth telling under oath.
Jacquart, P., & Antonakis, J. 2015. When does charisma matter for top-level leaders? Effect of
Jago, A. S., & Laurin, K. 2019. Inferring commitment from rates of organizational transition.
Jones Christensen, L., Siemsen, E., & Balasubramanian, S. 2015. Consumer behavior change at
the base of the pyramid: Bridging the gap between for‐profit and social responsibility
Jung, H. J., Vissa, B., & Pich, M. 2017. How do entrepreneurial founding teams allocate task
Kachra, A., & White, R. E. 2008. Know-how transfer: The role of social, economic/competitive,
Kanze, D., Huang, L., Conley, M. A., & Higgins, E. T. 2018. We ask men to win and women not
to lose: Closing the gender gap in startup funding. Academy of Management Journal, 61:
586-614.
Kay, A. C., Wheeler, S. C., Bargh, J. A., & Ross, L. 2004. Material priming: The influence of
Ketchen Jr, D. J., Boyd, B. K., & Bergh, D. D. 2008. Research methodology in strategic
Ketchen Jr, D. J., Ireland, R. D., & Baker, L. T. 2013. The use of archival proxies in strategic
management studies: Castles made of sand? Organizational Research Methods, 16: 32-
42.
Keum, D. D., & See, K. E. 2017. The influence of hierarchy on idea generation and selection in
Kim, T., John, L. K., Rogers, T., & Norton, M. I. 2019. Procedural justice and the risks of
Krause, R., Whitler, K. A., & Semadeni, M. 2014. Power to the principals! An experimental look
LaRiviere, J., McMahon, M., & Neilson, W. 2018. Shareholder protection and agency costs: An
Larson, R.B. 2019. Controlling social desirability bias. International Journal of Market
Lawrence, M. 2020. Replication using templates: Does the unit learn from itself, the template, or
Lazzarini, S. G., Miller, G. J., & Zenger, T. R. 2008. Dealing with the paradox of embeddedness:
Lee, M., Adbi, A., & Singh, J. 2020. Categorical cognition and outcome efficiency in impact
Leiblein, M. J., Reuer, J. J., & Zenger, T. 2018. What makes a decision strategic? Strategy
Science, 3: 558-573.
Li, J., Chen, X. P., Kotha, S., & Fisher, G. 2017. Catching fire and spreading it: A glimpse into
Li, W. W., Krause, R., Qin, X., Zhang, J. S., Zhu, H., Lin, S. S., & Xu, Y. H. 2018. Under the
Lovallo, D., Clarke, C., & Camerer, C. 2012. Robust analogizing and the outside view: Two
empirical tests of case‐based decision making. Strategic Management Journal, 33: 496-
512.
EXPERIMENTS IN STRATEGY RESEARCH 60
Lude, M., & Prügl, R. 2021. Experimental studies in family business research. Journal of Family
Luoma, J., Falk, T., Totzek, D., Tikkanen, H., & Mrozek, A. 2018. Big splash, no waves?
Makadok, R., Burton, R., & Barney, J. 2018. A practical guide for making theory contributions
Malhotra, D., & Lumineau, F. 2011. Trust and collaboration in the aftermath of conflict: The
Mannix, E. A., Neale, M. A., & Northcraft, G. B. 1995. Equity, equality, or need? The effects of
March, J. G. 1962. The business firm as a political coalition. The Journal of Politics, 24: 662-
678.
Massey, C., & Wu, G. 2005. Detecting regime shifts: The causes of under-and
McGrath, J. E. 1981. Dilemmatics: The study of research choices and dilemmas. American
Meade, A. W., & Craig, S. B. 2012. Identifying careless responses in survey data. Psychological
Meier, S., Stephenson, M., & Perkowski, P. 2019. Culture of trust and division of labor in
Mellewigt, T., Thomas, A., Weller, I., & Zajac, E. J. 2017. Alliance or acquisition? A
2369.
Messick, D. M., Moore, D. A., & Bazerman, M. H. 1997. Ultimatum bargaining with a group:
Miller, K. D., & Tsang, E. W. K. 2011. Testing management theories: Critical realist philosophy
Mitchell, J. R., Shepherd, D. A., & Sharfman, M. P. 2011. Erratic strategic decisions: When and
Montmarquette, C., Rullière, J. L., Villeval, M. C., & Zeiliger, R. 2004. Redesigning teams and
Moore, D. A., Oesch, J. M., & Zietsma, C. 2007. What competition? Myopic self-focus in
Mueller, J., Melwani, S., Loewenstein, J., & Deal, J. J. 2018. Reframing the decision-makers’
Okhuysen, G. A., & Eisenhardt, K. M. 2002. Integrating knowledge in groups: How formal
Patzelt, H., & Shepherd, D. A. 2008. The decision to persist with underperforming alliances: The
Phadnis, S., Caplice, C., Sheffi, Y., & Singh, M. 2015. Effect of scenario planning on field
36: 1401-1411.
Ployhart, R. E., & Moliterno, T. P. 2011. Emergence of the human capital resource: A multilevel
Powell, T. C., Lovallo, D., & Fox, C. R. 2011. Behavioral strategy. Strategic Management
Priem, R. L., Lyon, D. W., & Dess, G. G. 1999. Inherent limitations of demographic proxies in
Priem, R. L., Walters, B. A., & Li, S. 2011. Decisions, decisions! How judgment policy studies
Raaijmakers, A. G. M., Vermeulen, P. A. M., Meeus, M. T. H., & Zietsma, C. 2015. I need time!
Radoynovska, N., & King, B. G. 2019. To whom are you true? Audience perceptions of
Radzevick, J. R., & Moore, D. A. 2011. Competing to be certain (but wrong): Market dynamics
Raithel, S., & Hock, S. J. 2021. The crisis-response match: An empirical investigation. Strategic
Ranganathan, A. 2018. The artisan and his audience: Identification with work and price setting in
Rawley, E., Godart, F. C., & Shipilov, A. 2018. How and when do conglomerates influence the
Reitzig, M., & Maciejovsky, B. 2015. Corporate hierarchy and vertical information flow inside
Reuer, J. J., Tong, T. W., Tyler, B. B., & Ariño, A. 2013. Executive preferences for governance
Robert, C., & Carnevale, P. J. 1997. Group choice in ultimatum bargaining. Organizational
Rumelt, R. P., Schendel, D., & Teece, D. J. 1991. Strategic management and economics.
Sauer, S. J., Thomas-Hunt, M. C., & Morris, P. A. 2010. Too good to be true? The unintended
practices, trends, and implications for future research. Academy of Management Journal,
43: 1248-1264.
Schillebeeckx, S. J., Chaturvedi, S., George, G., & King, Z. 2016. What do I want? The effects
Semadeni, M., Withers, M. C., & Certo, S. T. 2014. The perils of endogeneity and instrumental
Shadish, W., Cook, T. D., & Campbell, D. T. 2002. Experimental and quasi-experimental
Shah, R. H., & Swaminathan, V. 2008. Factors influencing partner selection in strategic
alliances: The moderating role of alliance context. Strategic Management Journal, 29:
471-494.
Shapira, Z., & Shaver, J. M. 2014. Confounding changes in averages with marginal effects: How
Shea, C. T., & Hawn, O. V. 2019. Microfoundations of corporate social responsibility and
Shepherd, D. A., McMullen, J. S., & Ocasio, W. 2017. Is that an opportunity? An attention
model of top managers’ opportunity beliefs for strategic action. Strategic Management
Shepherd, D. A., & Patzelt, H. 2015. Harsh evaluations of entrepreneurs who fail: The role of
Shook, C., Ketchen Jr, D. J., Hult, G., & Kacmar, K. 2004. An assessment of the use of structural
397-404.
EXPERIMENTS IN STRATEGY RESEARCH 65
Shook, C., Ketchen Jr, D. J., Cycyota, C. S., & Crockett, D. 2003. Data analytic trends and
Shore, J., Bernstein, E., & Lazer, D. 2015. Facts and figuring: An experimental investigation of
Slade Shantz, A. F., Kistruck, G. M., Pacheco, D. F., & Webb, J. W. 2020. How formal and
Souitaris, V., Zerbinati, S., Peng, B., & Shepherd, D. 2020. Should I stay or should I go?
Founder power and exit via initial public offering. Academy of Management Journal, 63:
64-95.
Spencer, S.J., Zanna, M.P., Fong, G.T., 2005. Establishing a causal chain: Why experiments are
Stam, D., van Knippenberg, D., Wisse, B., & Pieterse, A. N. 2018. Motivation in words:
Stevenson, R., Ciuchta, M. P., Letwin, C., Dinger, J. M., & Vancouver, J. B. 2019. Out of
control or right on the money? Funder self-efficacy and crowd bias in equity
Stevenson, R. M., & Josefy, M. 2019. Knocking at the gate: The path to publication for
Stevenson, R., Josefy, M., McMullen, J. S., & Shepherd, D. 2020. Organizational and
Tang, Y., Mack, D. Z., & Chen, G. L. 2018. The differential effects of CEO narcissism and
Tantalo, C., & Priem, R. L. 2016. Value creation through stakeholder synergy. Strategic
Thaler, R. H. 1988. Anomalies: The ultimatum game. Journal of Economic Perspectives, 2: 195-
206.
Tong, T. W., Reuer, J. J., Tyler, B. B., & Zhang, S. 2015. Host country executives’ assessments
Tosi, H. L., Brownlee, A. L., Silva, P., & Katz, J. P. 2003. An empirical exploration of decision-
Trigeorgis, L., & Reuer, J. J. 2017. Real options theory in strategic management. Strategic
Trochim, W. M., & Donnelly, J. P. 2001. Research methods knowledge base. Cincinnati, OH:
van Balen, T., Tarakci, M., & Sood, A. 2019. Do disruptive visions pay off? The impact of
56: 303-342.
van Dijke, M., De Cremer, D., & Mayer, D. M. 2010. The role of authority power in explaining
van Knippenberg, B., & van Knippenberg, D. 2005. Leader self-sacrifice and leadership
Venus, M., Stam, D., & van Knippenberg, D. 2019. Visions of change as visions of continuity.
Voors, M., Turley, T., Bulte, E., Kontoleon, A., & List, J. A. 2018. Chief for a day: Elite capture
Wang, L. Y., Wu, B., Pechmann, C., & Wang, Y. T. 2019. The performance effects of creative
imitation on original products: Evidence from lab and field experiments. Strategic
Weber, M., Duffy, J., Schram, A. 2018. An experimental study of bond market pricing. Journal
Weber, R. A., & Camerer, C. F. 2003. Cultural conflict and merger failure: An experimental
Wood, M. S., Williams, D. W., & Drover, W. 2017. Past as prologue: Entrepreneurial inaction
decisions and subsequent action judgments. Journal of Business Venturing, 32: 107-127.
Wright, G., & Goodwin, P. 2002. Eliminating a framing bias by using simple instructions to
Younkin, P., & Kashkooli, K. 2020. Stay true to your roots? Category distance, hierarchy, and
the performance of new entrants in the music industry. Organization Science, 31: 604-
627.
Younkin, P., & Kuppuswamy, V. 2018. The colorblind crowd? Founder race and performance in
FOOTNOTES
1. Priem, Walters, and Li (2011) articulated the role that judgment policy studies could play in
spanning the multilevel nature of many judgements within organizations, including key questions
pertaining to strategic management and strategy implementation. Chatterji and colleagues (2016)
provide recommendations for and two demonstrations of field experiments; they complement
this work with an online appendix that provides counts of the number of experiments in leading
strategy and management journals compared to leading economics journals, illustrating the
relative lack of experiments in strategy and management. Finally, an essay by Di Stefano and
Gutierrez (2018) reports percentages comparing the abundance of experiments versus non-
experiments for selected management journals and categorizes these experiments as laboratory
or field experiments.
2. The experiment best practice guide and checklist is available as an online supplement and can
3. Our search was conducted on all articles that were either in print or available online as of
August of 2020. As a result, our sample includes one paper (Raithel & Hock, 2021) that was
available online when we conducted our search and has since been made available in print, and
Table 1
Table 2
Sample
Experiment Dependent
Authors Year Participants Key Finding / Contribution
Type Variable
(Number)
Competitive Strategy
Incumbent’s
Low-price market entrants
Luoma, Falk, price response,
Randomized can reduce incumbent
Totzek, perceived
2018 Between Managers (656) response by appearing high
Tikkanen, & aggressiveness,
Subjects in aggressiveness or low in
Mrozek commitment, and
commitment
consequence
As predicted by game theory,
Winning
individuals or entities that
frequency,
have less to gain from
Amaldoss & Randomized Students payoffs,
2002 winning a direct competition
Jain Mixed (36) frequency of
are paradoxically more likely
investing all
to out-invest their
capital
competition and win
Cooperative Strategy
Letter of the law violations
Trusting tend to be perceived as more
intentions, intentional than spirit of the
Randomized Mturk (97) and
Harmon, Kim, perceived law violations, and thus are
2015 Between MBA students
& Mayer intentionality, more damaging to trust and
Subjects (107)
willingness to lead to a greater willingness
punish by the wronged party to
pursue legal action
Alliance success, Both aligned economic
Agarwal, Randomized Business transfer of incentives and
Croson, & 2010 Between students, mostly resources, communication are needed to
Mahoney Subjects MBA (405) resources in maximize the probability of
alliance success in strategic alliances
Corporate Strategy
Percent of Managers tend to deviate
respondents who from profit maximizing
would make the decisions due to confusing
Shapira & Randomized MBA students
2014 profit versus marginal and average profits,
Shaver Within Subjects (216)
nonprofit particularly when average
maximizing profits are accessible and
investment relevant.
Internal capital allocations
show partition dependence
and a bias towards equality
Randomized
Bardolet, Fox, Executive MBA between divisions or
2011 Between Fund allocation
& Lovallo students (64) business units based on the
Subjects
centralization or
decentralization of the
budgeting procedure
EXPERIMENTS IN STRATEGY RESEARCH 72
Stakeholder Strategy
Organizations receive less
blame for unpopular
actions when they are
Randomized Punishment and recommended by an
Coffman & 2019
Between Students (716) punishment adviser because the
Gotthard-Real
Subjects average presence of advice shifts
stakeholder perceptions of
both the necessity and
morality of the action
The benefits of CSR and
Amount and penalties of CSI are driven
favorability of at least in part by
Randomized feedback, and perceptions of warmth and
Shea & Hawn 2019 Students (88)
Mixed whether they competence, and vary
bought the pen based on country
they had tested characteristics (such as
warmth)
Strategic Human Capital
Field experiments in
Chatterji, Employees at strategy can be feasibly
Randomized Cooperation
Findley, Jensen, large medical conducted. For example,
2016 Between (interacting with
Meier, & device firm stronger (or more salient)
Subjects question emails)
Nielson (4,185) identity increases
employee cooperation
Enhancing human and/or
financial capital (through
Business
business training and a
performance,
Microenterprise grant, respectively)
Berge, Bjorvatn, Randomized business
2015 owners improves a variety of
& Tungodden mixed structure, and
(644) performance outcomes for
management
male entrepreneurs, but
practices
less so for female
entrepreneurs
Strategic Leadership & Governance
Jacguemet, Voluntary taking of a
Randomized Students
Luchini, Rosaz, 2019 Lying truth-telling oath decreases
mixed (480)
& Shogren the incidence of lying
Leader self-sacrifice
van increases follower
Randomized Perceived
Knippenberg & Students performance and
2005 Between leadership
van (479) assessment of the leader,
Subjects effectiveness
Knippenberg especially if leader
prototypicality is low
Strategy Process
“Outside view” analogies,
Value of inside
Lovallo, Clarke, Randomized Private equity tend to result in better
2012 versus outside
& Camerer Within Subjects employees (33) decision performance than
view forecasts
“inside view” analogies.
Decision rules and
Randomized Performance
MBA students performance are improved
Gary & Wood 2011 Between (cumulative
(63) when managers have more
Subjects profit)
accurate mental models
EXPERIMENTS IN STRATEGY RESEARCH 74
Table 3
SUPPLEMENTAL MATERIAL
Table S1
Answers from a Panel of Strategy Scholars to Questions about the use of Experiments
What are one or Lack of training “I have not had the proper training to do it, and I would probably
two major not have the technical resources (labs to run the simulation).”
reasons
that you would Lack of reviewer receptivity “They are unlikely to be well received by the best journals.”
not
use experiments Access to participants is “Given my focus on boards of directors, it would be challenging
in your problematic to get a sample of directors who would participate in a study
research? employing an experimental design.”
Level of analysis “The levels of analysis and measurement which are usually at the
individual level in experiments. That can work to study
entrepreneurs or CEOs (or a small team) but I am not sure about
using this for organizational level variables which are, usually,
the variables of interest or the dependent variable in strategy
research. Is the experiment really describing what’s going on in
the firm?”
Sample size “Sample size would be another one [concern]. If we design a 2X2
scenario, we need a large number of top executives to
Are there participate.”
unique
concerns about Familiarity with method “Many scholars are not familiar with this method.”
using
experiments in
strategy versus
other related
Concerns with the review “I believe that there are specific biases or perceptions among
process strategy reviewers that may reduce their acceptance of
disciplines?
experiments in strategy research. For example, though a properly
executed randomized experimental design should address
concerns regarding endogeneity, strategy reviewers have formed
such a habit of criticizing studies through endogeneity that they
may unreasonably or mistakenly reject experiments. Also, the use
of experiments may lead to split reviewer teams – one or more
macro-level scholars combined with someone from the micro-
level. In those cases, each reviewer may understand and properly
evaluate the portion of the empirical study in her or his own area,
while rejecting the unfamiliar part.”
Decision making It seems the area of behavioral strategy and executive decision
making would benefit from this approach.
Many with the help of I would like to say that many strategy areas should be able to use
creativity experiments if you can use this method creatively. For example,
In what areas,
innovation, strategy implementation (e.g., new program
do you believe
adoption), or event-related studies (e.g., product recall, policy
strategy
changes) could be experimentally designed.
experiments
could provide
the greatest “I think the best use of experiments in strategy research is to
As a complement to complement other research methods. While archival research
value? conventional methods using large datasets has tremendous utility for the generalizability
of findings, it can often leave gaps in the face validity of our
research or limit our ability to directly examine underlying
mechanisms in our theoretical models. A well-designed and well-
executed experiment can nicely fill these gaps.”
Online Supplement
Table S2*
Competitive Strategy
Abramson, Currim, & Sarin, 2005; Amaldoss & Jain, 2002; Hossain, Minor, & Morgan, 2011;
Luoma, Falk, Totzek, Tikkanen, & Mrozek, 2018; Moore, Oesch, & Zietsma, 2007; Radzevick &
Moore, 2011; Wang, Wu, Pechmann, & Wang, 2019
Cooperative Strategy
Agarwal, Anand, Bercovitz, & Croson, 2012; Agarwal, Croson, & Mahoney, 2010; Amaldoss &
Staelin, 2010; Arend, 2009; Connelly, Miller, & Devers, 2012; Fonti, Maoret, & Whitbred, 2017;
Harmon, Kim, & Mayer, 2015; Kachra & White, 2008; Lazzarini, Miller, & Zenger, 2008;
Mellewigt, Thomas, Weller, & Zajac, 2017; Montmarquette, Rulliere, Villeval, & Zeiliger, 2004;
Patzelt & Shepherd, 2008; Reuer, Tong, Tyler, & Ariño, 2013; Schillebeeckx, Chaturvedi, George,
& King, 2016; Shah & Swaminathan, 2008; Tong, Reuer, Tyler, & Zhang, 2015; Weber &
Camerer, 2003
Corporate Strategy
Agarwal, Anand, Bercovitz, & Croson, 2012; Audia, Locke, & Smith, 2000; Bardolet, Fox, &
Lovallo, 2011; Crilly, 2017; Døjbak Håkonsson, Eskildsen, Argote, Mønster, Burton, & Obel,
2016; Elfinbein, Knott, & Croson, 2017; Gary, Yang, Yetton, & Sterman, 2017; Gutierrez, Astebro,
& Obloj, 2020; Hohnisch, Pittnauer, Selten, & Pfingsten, 2016; Jones Christensen, Siemsen, &
Balasubramanian, 2015; LaRiviere, McMahon, & Neilson, 2018; Lawrence, 2020; Massey & Wu,
2005; Meier, Stephenson, & Perkowski, 2019; Phadnis, Caplice, Sheffi, & Singh, 2015; Shapira &
Shaver, 2014; Stam, van Knippenberg, Wisse, & Pieterse, 2018; Tosi, Brownlee, Silva, & Katz,
2003; Younkin & Kashkooli, 2020
Entrepreneurship and Strategy
Anderson, Chandy, & Zia, 2018; Artinger & Powell, 2016; Bapna, 2019; Berge, Bjorvatn, &
Tungodden, 2015; Bigelow, Lundmark, Parks, & Wuebker, 2014; Burtch, Ghose, & Wattal, 2015;
Camuffo, Cordova, Gambardella, & Spina, 2020; Chatterji, Delecourt, Hasan, & Koning, 2019;
Chen, Yao, & Kotha, 2009; Clarke, Cornelissen, & Healey, 2019; Clingingsmith & Shane, 2018;
Elfinbein, Knott, & Croson, 2017; Fisher, Stevenson, Neubert, Burnell, & Kuratko, 2020;
Greenberg & Mollick, 2017; Hoogendoorn, Parker, & van Praag, 2017; Huang & Pearce, 2015;
Jones Christensen, Siemsen, & Balasubramanian, 2015; Jung, Vissa, & Pich, 2017; Kanze, Huang,
Conley, & Higgins, 2018; Li, Chen, Kotha, & Fisher, 2017; Moore, Oesch, & Zietsma, 2007;
Radoynovska & King, 2019; Ranganathan, 2018; Shepherd & Patzelt, 2015; Slade Shantz,
Kistruck, Pacheco, & Webb, 2020; Souitaris, Zerbinati, Peng, & Shepherd, 2020; van Balen,
Tarakci, & Sood, 2019; Younkin & Kashkooli, 2020; Younkin & Kuppuswamy, 2018
Global Strategy
Chatterji, Findley, Jensen, Meier, & Nielson, 2016; Crilly, Ni, & Jiang, 2016; Shea & Hawn, 2019;
Tong, Reuer, Tyler, & Zhang, 2015
Online Supplement
Table S3
Table S4
Table S5