You are on page 1of 86

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/353979714

Experiments in Strategy Research: A Critical Review and Future Research


Opportunities

Article  in  Journal of Management · August 2021


DOI: 10.1177/01492063211044416

CITATION READS
1 749

4 authors:

Mark T. Bolinger Matt Josefy


Appalachian State University Indiana University Bloomington
12 PUBLICATIONS   131 CITATIONS    20 PUBLICATIONS   605 CITATIONS   

SEE PROFILE SEE PROFILE

Regan Stevenson Michael A Hitt


Indiana University Bloomington Texas A&M University
34 PUBLICATIONS   570 CITATIONS    301 PUBLICATIONS   62,651 CITATIONS   

SEE PROFILE SEE PROFILE

Some of the authors of this publication are also working on these related projects:

COVID-19 and Entrepreneurial Decision-Making View project

Coachability and Coachable Entrepreneurs View project

All content following this page was uploaded by Regan Stevenson on 10 November 2021.

The user has requested enhancement of the downloaded file.


EXPERIMENTS IN STRATEGY RESEARCH 1

Experiments in Strategy Research: A Critical Review and Future Research Opportunities

Mark T. Bolinger
Walker College of Business, Appalachian State University
4071 Peacock Hall
Boone, NC 28608, USA
Phone: 208-251-6497
Email: bolingermt@appstate.edu

Matthew A. Josefy
Kelley School of Business, Indiana University
1309 E. Tenth Street, Suite 3100
Bloomington, IN 47405, USA
Phone: 812-855-3683
Email: mjosefy@iu.edu

Regan Stevenson
Kelley School of Business, Indiana University
1309 E. Tenth Street, Suite 3100
Bloomington, IN 47405, USA
Phone: 812-855-2182
Email: rstev@indiana.edu

Michael A. Hitt
Mays School of Business, Texas A&M University
210 Olsen Boulevard
College Station, Texas 77843, USA
Phone: 979-845-4851
Email: mhitt@mays.tamu.edu

Acknowledgements: The authors would like to gratefully acknowledge the thoughtful responses
from 10 prominent scholars who helped us further understand the particular challenges of using
experiments in strategic management, insightful feedback on previous versions of the manuscript
from Mike Withers, Christina Carnes, and Jeff Covin, helpful comments on the Best Practices Guide
from Jeff Gish, Emily Neubert, and June Ryu, additional assistance from Tammy Rader and
Amanda Tolen, and very helpful direction from anonymous reviewers. Regan Stevenson also
acknowledges research support from the John and Donna Shoemaker Fellowship.

In-Press at Journal of Management


Please cite as: Bolinger, M., Josefy, M., Stevenson, R., and Hitt, M. (2022). Experiments in
Strategy Research: A Critical Review and Future Research Opportunities. Journal of
Management. doi. 10.1177/01492063211044416

For published version, please check: https://journals.sagepub.com/doi/


full/10.1177/01492063211044416
EXPERIMENTS IN STRATEGY RESEARCH 2

ABSTRACT

We review extant experimental work in strategic management and argue that experiments

constitute an underused methodology that has significant potential. We examine and categorize

179 experiments from 119 published articles over a 20-year period, delineating the contributions

of these experiments to the strategic management literature. In doing so, we identify topic areas

in which experiments have been effectively deployed, as well as several literature streams that

have a limited amount of prior experimental research. We discuss specific challenges of using

experiments in strategy research, especially given its strong focus on the firm-level of analysis.

We also emphasize approaches for how experiments can be instrumental in extending

management theories and accelerating behavioral microfoundations of strategy research. In light

of past contributions and gaps, we discuss specific opportunities and means of designing

innovative experiments, propose novel potential research questions, and provide a best practices

methodological guide which scholars can use when considering experimental designs. Overall,

our work documents experimental research and provides a methodological practicum, thereby

offering a platform for future experiment-based research in strategic management.

Keywords: experiments, strategic management, review, research design; corporate social

responsibility; cooperative strategy; mergers & acquisitions; alliances


EXPERIMENTS IN STRATEGY RESEARCH 3

EXPERIMENTS IN STRATEGY RESEARCH: A CRITICAL REVIEW AND FUTURE

RESEARCH OPPORTUNITIES

Identifying the antecedents of firm performance is a primary goal of strategic

management research; put another way, strategy scholars study what causes some firms to be

more successful than others. Accordingly, endogeneity in strategic management has historically

been considered a “pervasive problem” due to the inherent complexity of organizations and the

discipline’s focus on field studies (Aguinis, Edwards & Bradley, 2017; Busenbark, Gamache,

Yoon, Certo, & Withers, 2019). Although researchers routinely take great methodological care to

control for or rule out the potential for endogeneity (Hamilton & Nickerson, 2003; Hill, Johnson,

Greco, O’Boyle, & Walter, 2021; Semadeni, Withers, & Certo, 2014), experimental

methodologies remain uncommon in strategic management research despite being an excellent

option for isolating causal relationships (Hill et al., 2021).

Frequently, strategic management scholars seek to identify contexts that approximate

experimental conditions (e.g., Grigoriou & Rothaermel, 2017) and carefully explain how their

research design compares to the ideal experiment (e.g., Angrist & Pischke, 2010; Berchicci,

Dowell & King, 2017; Cummings & Knott, 2018, Rawley, Godart, & Shipilov, 2018). Yet,

experiments (ideal or otherwise) remain rare in strategic management research. There are at least

three reasons that greater adoption of experimental methodologies could be beneficial for the

field. First, strategy scholars frequently conclude their papers by documenting an agenda for

future experimental work that would meaningfully advance their line of inquiry. For example,

this is evident in strategic leadership research, where scholars have noted that archival

approaches could be augmented by experimental studies. Tang, Mack, and Chen (2018:1384)

state: “there might be some noise associated with these archival-based measures. We encourage
EXPERIMENTS IN STRATEGY RESEARCH 4

future research to employ more direct measures in surveys and experimental studies to confirm

and extend our findings.” They are among many prominent scholars who have called for more

strategy experiments to extend their work (Aggarwal, Posen & Workiewicz, 2017; Bettis, 1991;

Powell, 2011; Powell, Lovallo & Fox, 2011; Shepherd, McMullen & Ocasio, 2017). Second,

several experiments published in the strategic management literature have proven to be highly

influential (Audia, Locke & Smith, 2000; Choi & Shepherd, 2005; Okhuysen & Eisenhardt,

2002; Shah & Swaminathan, 2008; Weber & Camerer, 2003). Third, the field has recently

exhibited a greater emphasis on microfoundations and behavioral strategy (e.g., Felin, Foss &

Ployhart, 2015; Foss & Pederson, 2016; Powell et al., 2011), which provides increased

opportunities for the use of experimental approaches. While experiments may be impractical for

some research questions, and concerns regarding the level of analysis or the ability to establish

external validity may be difficult to overcome, we argue that experiments have tremendous

potential in strategic management, as they are a powerful and underutilized methodology with

strengths that are distinct from and complementary to the more commonly used methods.

Building on previous studies that have documented and advocated for additional

experimental work in strategic management (Chatterji, Findley, Jensen, Meier, & Nielson, 2016;

Di Stefano & Gutierrez, 2018; Priem, Walters, & Li, 2011)1, we complete an extensive review of

published experiments in strategic management. We then analyze, synthesize, and explain how

this prior experimental work has contributed to the strategy literature, identify best practices, and

present avenues for future research, particularly how experiments can assist strategy researchers’

efforts to supplement existing research to develop and extend theory. To demonstrate how one

could design an impactful strategy experiment, we provide sample study designs and a best

practice methodology guide as part of our call to action2.


EXPERIMENTS IN STRATEGY RESEARCH 5

We make two primary contributions to strategic management literature. First, we

contribute to the developing body of work concerned with understanding the behavioral and

psychological antecedents of firm performance. It has been argued that strategy research, “lacks

adequate psychological grounding” and that “recent developments provide new opportunities for

merging psychology and strategy” (Powell et al., 2011:1370). Our review highlights ways in

which experiments could be used to advance several strategy topics from a psychological

perspective, including corporate strategy, cooperative strategy, strategic leadership, and

governance. Researchers could leverage the structured recommendations and example designs

we develop as a guide when creating experiments to supplement existing archival research in

their particular interest area.

Second, our review establishes a methodological launchpad for future experimental work,

documenting best practices and approaches that have been used to craft effective strategy

experiments. Our review includes in-depth analysis of past study characteristics so that trends

can be visualized within specific methodological, topic, and theoretical areas, and exemplar

studies, so that best practices can be highlighted and examined in detail. Moreover, we consider

how novel approaches from other disciplines could be used to conduct impactful strategy

research. Building on the desires articulated by strategy scholars to randomly assign treatments

to CEOs, firms, or markets (e.g., Bennett, Seamans & Zhu, 2015; Carnahan, 2017; Cummings &

Knott, 2018), we contribute a specific typology of approaches to strategy experiments that

acknowledges the different considerations necessary to employ random assignment based on

levels of analysis. Ultimately, we identify several ways in which scholars can leverage

established experimental techniques to complement robust archival and field studies and advance

strategic management theory.


EXPERIMENTS IN STRATEGY RESEARCH 6

EXPERIMENTS IN STRATEGIC MANAGEMENT


Why is Strategic Management Research Predominantly Archival?

Each research method has tradeoffs, because generalizability, contextual validity, and

measurement cannot all be maximized simultaneously (McGrath, 1981). Accordingly,

researchers sometimes seek to triangulate by using a combination of methods (e.g., Audia et al.,

2000; Flammer & Kacperczyk, 2019; Greenberg & Mollick, 2017), therefore accumulating the

benefits of multiple methodologies while simultaneously mitigating their weaknesses. However,

despite the benefits of this approach, a large portion of strategic management research continues

to be based on archival data (Jemison, 1981; Ketchen Jr, Boyd & Bergh, 2008; Scandura &

Williams, 2000). To develop a deeper understanding as to why this is the case, we augmented

our own observations by gathering qualitative insights from a panel of prominent strategic

management scholars (see Table S1 for a summary of these scholarly viewpoints on the

experimental method in strategy research).

We concluded that there are multiple reasons why experimental methods remain

relatively rare. First, strategic management scholars seem to place a priority on the value of

external validity (e.g., Garg, Li, & Shaw, 2018) For example, one of our strategic management

scholars noted that it is “[d]ifficult to simulate the gravity and implications of strategic decisions

in an experiment – e.g., a CEO’s performance or reputation is permanently affected by their

decisions.” In contrast, although it is commonly accepted that experiments in general and

laboratory experiments in particular increase confidence in internal validity due to precise

measurement and the elimination of alternative explanations in the lab, such benefits are offset in

part by lower external validity (Scandura & Williams, 2000). Therefore, researchers conducting

experiments grapple with decisions regarding external validity tradeoffs as they consider ways to

increase the internal validity via tightly controlled experimental tasks. Given the incredibly
EXPERIMENTS IN STRATEGY RESEARCH 7

dynamic nature of strategic management, complex models that maximize external validity have

often been preferred to models that focus on maximizing internal validity.

A second reason is that experiments may be less suitable at the level of analysis that

strategy scholars desire/need to study. This was evident in several comments from our panel,

including one in which a scholar questioned whether researching firm-level activities via

experiment was “effective and/or doable.” With connections to the industrial-organization

economics literature concentrated on firms (Jemison, 1981), strategic management scholars are

often focused on a different level of analysis than “mother” disciplines like psychology where

experiments are more prevalent. As noted in a key article defining behavioral strategy:

Indeed, despite a large volume of output, experimental psychology has done little to
address the problems of strategy theory and practice. Many strategy researchers regard
the core unit of analysis in strategy as the firm or business unit rather than the individual,
and there is skepticism about the scaling of psychological concepts to firms and
industries. Strategy practitioners are, if anything, more skeptical than researchers,
doubting whether the field can go beyond cognitive biases to produce useful frameworks
that integrate psychology and strategy practice. (Powell et al., 2011: 1370)

Third, an alternate method to establish causality is to conduct longitudinal studies or

employ other methods that consider the temporal relationships between variables (Shook,

Ketchen Jr, Hult & Kacmar, 2004). Strategic management scholars have employed a variety of

analytical techniques including longitudinal studies to address causality (Shook, Ketchen Jr,

Cycyota & Crockett, 2003), and these methods may often provide sufficient assurance. This

seems to be the case for one of our scholars, who noted “I also buy into Judea Pearl’s (2009)

arguments that randomized controlled experiments need not be put on a pedestal in terms of

causal identification.” Particularly given the level of analysis considerations already noted, such

methods are likely being used as a substitute for experiments (Bascle, 2008; Hill et al., 2021;

Semadeni, Withers, & Certo, 2014).


EXPERIMENTS IN STRATEGY RESEARCH 8

Fourth, pragmatically, strategic management doctoral programs tend to prioritize

econometric methods, meaning students may not formally be trained in experimental methods.

For example, one of our scholars noted, “I have not had the proper training to do it

[experiments], and I would probably not have the technical resources (labs to run the

simulation).” Furthermore, expecting students or new faculty members to obtain proficiency in

yet another research methodology is a significant requirement given the wide range of techniques

they are already expected to learn (Shook et al., 2003). Thus, pursuing experimental designs may

require partnerships with other scholars more likely to have previous experience with

experiments (Miller & Tsang, 2011).

Why Strategic Management Scholars Should Use Experiments More Often

Given the unique and very real obstacles to conducting experiments in the strategy

context combined with the existence and acceptance of substitute methods, why should strategic

management scholars use experiments? We present three main arguments.

First, as the “gold standard” for establishing cause and effect relationships, experiments

have unique advantages for social science researchers in that they facilitate accounting for

unmeasured variables and alternative explanations through randomization (Hill et al., 2021;

Shadish, Cook, & Campbell, 2002). The primary advantage of random assignment is its “ability

to illuminate causal inference” (Shadish et al., 2002:18), so well-designed experiments featuring

randomization provide a way for researchers to account for all explanatory variables in a

particular model by creating highly controlled settings (Aguinis & Vandenberg, 2014; Stevenson

& Josefy, 2019). Thus, strategic management experiments could be particularly useful to expose

the causal links between the actions of the individuals within a firm and the firm as an entity.

Scholars have long noted that certain firm members often have a disproportionate amount of
EXPERIMENTS IN STRATEGY RESEARCH 9

influence over firm outcomes (Hambrick & Mason, 1984) and that the firm embodies a complex

set of interactions among its members (March, 1962). Experiments are useful in isolating the

effects of individual actions under highly specified, albeit constrained, conditions.

Second, data for a particular strategic management phenomenon of interest may be

limited, hard to obtain due to secrecy, or highly specific to a firm, making it difficult to obtain a

sufficient sample size. For instance, scholars have sometimes struggled to obtain access to board

room discussions or other unique situations faced by large firms such as decision making related

to disruptive events (e.g., an unforeseen pandemic) or blockbuster acquisitions. Experiments can

be useful for addressing such research questions. Researchers can use experiments to examine

how strategic decision-makers respond to a variety of situations, emergent or hypothetical, with a

high degree of control over dimensions of interest. In this way, research can be conducted even

before archival data is available on a variety of important strategy topics, including grand

challenges (e.g., global pandemic response or climate change scenarios). Indeed, given their

emergent nature such topics are inherently difficult to study using archival methodologies.

Despite their limitations, experiments can isolate mechanisms in complex decisions, which may

otherwise be a “black-box” when archival data alone are used.

Finally, while experiments are generally perceived as more readily designed for studies at

the individual-level of analysis, strategic management scholars are increasingly considering the

key role that individuals and groups within the organization play in affecting firm-level

outcomes. This has resulted in an increased focus on meso and multi-level research (Hitt,

Beamish, Jackson & Mathieu, 2007; Ployhart & Moliterno, 2011), a new emphasis on the

microfoundations of strategy (e.g., Felin et al., 2015; Foss & Pederson, 2016), and the emergence

of a strong line of work focused on behavioral strategy (e.g., Powell et al., 2011), all of which
EXPERIMENTS IN STRATEGY RESEARCH 10

have increased opportunities to more feasibly employ experiments. Concomitantly, this emerging

emphasis on micro-level research may be decreasing the suitability of other methods. For

example, strategic management researchers have long used archival proxies, or measures that are

“used to represent a theoretical construct,” but these variables are typically repurposed, and

scholars have expressed concern over their validity (Ketchen Jr., Ireland, and Baker, 2013:32;

Priem, Lyon, & Dess, 1999). Scholars may find it especially difficult to identify valid archival

proxies for variables associated with cognitive or perceptual constructs. By contrast,

experimental variables can be collected with a specific construct in mind, and thus can be far

more targeted. In light of these developments, strategic management scholars have the

opportunity to reimagine how experiments can be deployed in the strategy field.

METHODS

We conducted a comprehensive review of published experiments in strategic

management over the last two decades. Data for the current study were collected by reviewing all

issues of Academy of Management Journal, Administrative Science Quarterly, Organization

Science, Journal of Applied Psychology, Journal of Management, Journal of Management

Studies, Management Science, and Strategic Management Journal from January of 2000 through

August of 20203. To compile a list of strategy experiments, we began by searching all titles,

keywords, and abstracts using the terms experiment*, random*, field, policy captur*, laboratory,

and conjoint. This initial screen identified nearly 2,000 articles that were then subjected to

further screens to determine if an experiment had been conducted (the word “experiment” often

appeared to discuss actions taken by individuals or firms rather than the study’s methodology;

we also excluded natural and computer simulation experiments given this study’s focus on

random assignment). To narrow our scope to strategic management topics, we screened papers
EXPERIMENTS IN STRATEGY RESEARCH 11

by considering the theoretical and contextual keywords and research topics identified by the

authors of the research. While strategic management is a broad field that incorporates ideas and

theories from many different business and social science fields, it is at its core concerned with

and defined by attempts to better understand organizational performance (Makadok, Burton &

Barney, 2018; Rumelt, Schendel & Teece, 1991). Thus, we removed studies in which the central

topic was primarily related to organizational behavior, human resources, operations, finance,

economics, psychology, marketing, or methodology. For example, our initial screen included

several papers on leadership, any of which could have implications for strategy, but we only

included those that directly focused on CEOs or top management teams. We also used level of

analysis as an indicator, generally excluding papers that did not target firm-level outcomes unless

they were otherwise directly applicable to a Strategic Management Society (SMS) interest group.

Our screening and coding methods yielded 179 studies from 119 articles published from January

2000 to August of 2020 as described below.

For each publication that contained one or more experiments, we extracted a variety of

information to support coding of theory, topics and methods. If a paper included multiple

experiments, each one was separately coded. We also categorized studies into 10 topic groups,

associated with a corresponding SMS interest group. We categorized papers into more than one

topic if applicable but did not utilize behavioral strategy or strategy practice as topic areas in our

coding because it could be argued that they apply to many if not all the experiments in our

review. We provide a listing of all reviewed papers and their classification by topic in Table S2.

In addition to categorizing and reviewing papers by strategic management topic and

theory, we also conducted a thorough methodological review and coded each paper according to

the nature of the experimental design (e.g., within or between subjects), the experimental context
EXPERIMENTS IN STRATEGY RESEARCH 12

and delivery method (laboratory, field, etc.), the experimental sample used and the number of

participants, the country in which the study was conducted, the dependent variable type, the

contingent reward or pay offered to participants, the use of manipulation checks, and the

experimental stimuli.

RESULTS

A Review of Strategy Experiments by Topic

Our results indicate that while many experiments have been conducted in the strategy

domain and the number of experiments published is trending upward, studies featuring

experimental methodologies still represent a small fraction of the total studies published in the

nearly 20 years represented in our sample. Despite the strong emphasis on theory in management

(Colquitt & Zapata-Phelan, 2007; Hambrick, 2007), only 56 of the experiments (31%) in the

dataset explicitly drew upon a theory to motivate the research questions presented. We provide a

summary by theory in Table 1 and a detailed review of by topic below.

We structured our topic review according to widely accepted strategic management

topics associated with SMS interest groups. Based on this approach, the most common topic

areas for strategy experiments were stakeholder strategies with 52 studies (29% of total studies),

followed by strategic leadership and governance with 42 studies (23% of total studies), and

entrepreneurship and strategy with 34 studies (19%). Additionally, while multiple experiments

were published in each of the interest groups we considered, our results nonetheless reveal that

experimental methods were highly concentrated, with over half of studies pertaining to the

stakeholder or leadership categories. Table 2 provides indicative exemplars for each topic area

with summary-level information regarding the studies, and Table S2 (online supplement) lists all

studies in our review by topic area. We review each topic area in the following sections with an
EXPERIMENTS IN STRATEGY RESEARCH 13

emphasis on how experimental methods enabled or at least facilitated the study in a way that

would be difficult for other methods.

-------------------------INSERT TABLES 1 & 2 HERE-------------------------

Stakeholder Strategy. The most common topic was stakeholder strategies, with 52

experiments. These studies considered a broad range of more specific topics including corporate

social responsibility (Crilly, Ni, & Jiang, 2016; Flammer & Kacperczyk, 2019; Shea & Hawn,

2019), the effects of responses to crisis or scandal on stakeholders (Baker, Derfler-Rozin, Pitesa

& Johnson, 2019; Connelly, Ketchen Jr, Gangloff, & Shook, 2016; Folkes & Whang, 2003;

Raithel & Hock, 2021), stakeholder input (Kim, John, Rogers & Norton, 2019; Krause, Whitler,

& Semadeni, 2014), and stakeholder perceptions of the firm including trustworthiness (Elsbach

& Elofson, 2000), authenticity (Hahl & Ha, 2020; Radoynovska & King, 2019), and reputation

(Brooks, Highhouse, Russell, & Mohr, 2003).

In the strategy context, experiments are particularly helpful when studying complex

individual phenomena like stakeholder perceptions that involve interconnected variables. For

example, Coffman and Gotthard-Real (2019) consider whether firms can deflect responsibility

for unpopular actions when they are recommended by an adviser (such as an external

consultant). The authors employ a simulated decision-making game in which individuals make

decisions either by themselves or with advice given by advisers, and other game participants

affected by these decisions then have the option to punish or not punish the decision maker. The

researchers found that the presence of an adviser enables the decision-maker to deflect blame by

changing stakeholder perceptions of both the necessity and morality of the action. As prior work

has demonstrated, the formation of stakeholder perceptions of firm actions is a complex process

that other studies in our sample have shown is influenced by a variety of factors including
EXPERIMENTS IN STRATEGY RESEARCH 14

nationality (Crilly et al., 2016), familiarity (Brooks et al., 2003), and the firm’s explanation of

decisions (Elsbach & Elofson, 2000). This complexity makes it difficult to tease out the specific

effect of adviser advice on stakeholder views using correlational statistical methods. Coffman

and Gotthard-Real’s (2019) experiment provides an excellent example of how experiments can

extend our understanding of previous findings from archival studies and allow for determinations

of cause and effect through experimental design (albeit in a simulated setting).

Experiments can also be used to examine the underpinnings of interesting or novel

relationships that strategy researchers observe in the field. Shea and Hawn (2019) consider the

question of why firms commit resources to CSR through a social psychology lens, and in doing

so, introduce warmth and competence as attributes that are often interconnected with CSR in the

minds of stakeholders. They show that warmth in particular mediates the relationship between

CSR and advantageous outcomes such as enhanced reputation. Approaching this research

experimentally allows for the direct assessment of the effects of these social psychology

concepts in the strategic management context in a way that would likely not be possible with

archival methodologies.

Experiments can also help make connections between strategic management and related

literature, for example the literature on charitable giving. There is a movement amongst charities

to report performance metrics and archival evidence that these outcomes influence subsequent

giving decisions, yet archival strategic management field studies cannot clearly indicate how and

why patrons value this information. Thus, Exley’s two experiments (2020) are particularly useful

for investigating seemingly paradoxical findings in prior field studies on giving behaviors. Exley

(2020) found that the prominence of administrative costs and processing fee indicators

negatively affected donations, suggesting that there may be a risk to charities in providing these
EXPERIMENTS IN STRATEGY RESEARCH 15

metrics because they can be directly responsible for lower giving.

Strategic Leadership and Governance. The strategic leadership and governance area

contains 42 studies and among other topics addresses CEO and executive characteristics and

behaviors including truthfulness (Jacguemet, Luchini, Rosaz, & Shogren, 2019), diversity-

valuing (Hekman, Johnson, Foo & Yang, 2017), ethical leadership (Huang & Paterson, 2017),

decision making (Gary & Wood, 2011; Mitchell, Shepherd, & Sharfman, 2011; Mueller,

Melwani, Loewenstein & Deal, 2018; Tosi, Brownlee, Silva, & Katz, 2003), vision (Carton &

Lucas, 2018; Carton, Murphy & Clark, 2014; Venus, Stam, & van Knippenberg, 2019), and CEO

dismissal and succession (Connelly, Li, Shi, & Lee, 2020), particularly in the wake of scandal or

misconduct (Connelly et al., 2016; Connelly, Shi, Walker, & Hersel, 2020). Several of these

articles addressed questions that likely would have been difficult to investigate without

experiments. For example, Hekman and colleagues (2017) investigate the lack of diversity in

top-level leadership. While the effect is easily observed through archival or correlational

methods, the authors investigate its potential mechanisms, and find that diversity-valuing

behavior by female or minority leaders leads to lower performance ratings of those leaders. By

using an experiment, they were able to gather information that may not be available in the field,

mitigate potential privacy issues, largely avoid under reporting of biased views due to low social

desirability, and directly observe biased tendencies that may contribute to a lack of top-level

diversity.

Jacguemet and colleagues (2019) examine the issue of dishonesty in senior executives by

investigating whether voluntarily taking an oath decreases lying. The question of honesty in

firms is an important one that rose to prominence with notable scandals in the 2000s and led to

the creation of the MBA Oath at Harvard and the World Economic Forum’s Oath Project
EXPERIMENTS IN STRATEGY RESEARCH 16

(Anderson & Escher, 2010; Bishop & Green, 2011) with the goal of increasing honesty in the

business world. Assuming that objective information on leader truthfulness could be obtained,

determining the specific effects of oath taking on lying apart from other factors would be

difficult using archival data due to differences in such factors as firm and industry culture

regarding lying, the situation-specific consequences of truthfulness or lying, and others. The

authors were able to overcome these challenges experimentally and show that oath taking alone

decreases lying. Similarly, Connelly, Shi, and colleagues (2020) also performed a study on

unethical behavior, but at the organizational level, examining how such conduct affects CEO

succession. The authors suggest that in the aftermath of organizational wrongdoing, boards of

directors prioritize ethical behavior in their search for a new CEO, and that this criterion

increases the attractiveness of job candidates who have attended religiously affiliated schools.

Choosing a new CEO is complex because many factors are likely to contribute to the decision,

and the relative importance of these many factors is difficult to disentangle. The authors deal

with these challenges by using a policy capturing approach, which allows them to measure the

importance of criteria in the presence and absence of past firm misconduct while also controlling

for within subject variation and eliminating potentially confounding external factors. In

justifying their methodological choice, the authors note that archival data are poorly suited for

their research question because it cannot measure the importance of hiring criteria to individuals

apart from the influence of others. Using the policy capturing approach, the authors were able to

isolate the effects of prior unethical behavior, and ultimately confirm that concern for ethical

behavior becomes a more important hiring criteria in the wake of wrongdoing.

Entrepreneurship and Strategy. The entrepreneurship and strategy category included

34 experiments which addressed topics such as entrepreneurial failure (Artinger & Powell,
EXPERIMENTS IN STRATEGY RESEARCH 17

2016), entrepreneurial action and hustle behaviors (Fisher, Stevenson, Neubert, Burnell, &

Kuratko, 2020), bias in entrepreneurial finance (Bigelow, Lundmark, Parks, & Wuebker, 2014;

Kanze, Huang, Conley, & Higgins, 2018; Younkin & Kuppuswamy, 2018), determinants of

entrepreneurial finance (Chen, Yao & Kotha, 2009; Clarke, Cornelissen & Healey, 2019), market

entry and exit (Elfenbein, Knott & Croson, 2017; Moore, Oesch & Zietsma, 2007), and

commerce in base-of-the-pyramid contexts (Jones Christensen, Siemsen & Balasubramanian,

2015). These studies showcase the use of experiments for a variety of purposes including

evaluating competing mechanisms, examining questions in which the outcome is difficult to

define, and investigating questions set in uniquely entrepreneurial and uncertain contexts.

Strategic entrepreneurship researchers have been effective at leveraging experiments to

extend archival observations and unpack important psychological mediators at the individual-

level. For example, to extend their archival study on entrepreneurial hustle, Fisher and colleagues

(2020) conducted an exploratory qualitative study paired with a follow-up experiment to unpack

the mechanisms observed in the field. In their experiment these authors investigate precisely how

the entrepreneurial hustle construct (i.e., entrepreneur’s urgent, unorthodox actions to overcome

challenges under extreme uncertainty) enhances the likelihood that organizational leaders will

enlist stakeholders and garner resources for their growing firms. The experimental results

demonstrate that entrepreneurial hustle positively influences stakeholder perceptions of firm

legitimacy through increased trustworthiness perceptions of the business leader.

Jones Christensen and colleagues (2015) provide an effective example of how field

experiments can be both theoretically and practically beneficial. Their study examined the

consumption habits of water purification systems among villages in Malawi (at the village level)

and reported the somewhat counterintuitive finding that the proportion of villagers who used the
EXPERIMENTS IN STRATEGY RESEARCH 18

product increased when it was deeply discounted compared to when it was free. Using an

experimental design allowed the researchers to identify that the changes in consumption were the

result of price rather than differences in water availability or other variables.

Artinger and Powell (2016) assessed and compared two previously identified causes of

entrepreneurial failure, overconfidence, and random error due to uncertainty, using a mock

computerized marketplace. Participants were given a general knowledge quiz and offered the

chance to enter their score into the “market,” with the understanding that they would gain or lose

money depending on how high their score was relative to other participants. The authors found

that patterns of erroneous market entry (situations where participants entered the market and lost

money) were most consistent with overconfidence. Given that the study was comparative in

nature, the experimental approach was appropriate in that it isolated the two explanations from

potential confounding factors and allowed for an assessment of the two against real data.

Elfenbein and colleagues (2017) examined delayed exit from failing entrepreneurial

ventures and assessed whether equity stakes (access to firm cash flows) were involved. The

experiment found that undergraduate business students asked to make exit decisions as part of a

computer game delayed exit past the optimal point when they were given equity stakes. Defining

“optimal” exit is challenging given the many factors involved. The authors’ use of the lab for this

study enabled them to create a simulated environment where the definition of an optimal exit

was clear, thereby allowing them to assess the effects of equity stakes on this dependent variable.

Corporate Strategy. We identified 27 studies pertaining to corporate strategy. Research

in corporate strategy encompasses topics such as goal setting and organizational performance

(Gary, Yang, Yetton & Sterman, 2017; Hohnisch, Pittnauer, Selten, & Pfingsten, 2016), the

influence of regulatory focus on organizational routines and motivation (Døjbak Håkonsson,


EXPERIMENTS IN STRATEGY RESEARCH 19

Eskildsen, Argote, Mønster, Burton & Obel, 2016; Stam, van Knippenberg, Wisse, & Pieterse,

2018), and market entry decisions (Gutierrez, Astebro & Obloj, 2020). This includes questions of

a behavioral (Bardolet, Fox & Lovallo, 2011), judgmental (Phadnis, Caplice, Sheffi & Singh,

2015), and cognitive (Shapira & Shaver, 2014) nature. The article by Bardolet and colleagues

(2011) is notable in that it was a response to an observed phenomenon in which capital is

allocated between business units and subunits in systematic ways, referred to as partition

dependence. The study dealt with the capital allocation decisions among the business units of a

hypothetical firm and the factors that influence this allocation. The authors observed capital

allocation patterns based on firm centralization and business unit and division numbers and argue

that executives have a cognitive bias towards proportional allocations. This study was able to

address many of the potential problems of studying such a complicated topic by presenting a

standardized experimental scenario to participants, thereby mitigating the effects of agency

conflicts and other potential situation-specific confounding variables. Similarly, Shapira and

Shaver (2014) consider how contingency factors and characteristics of decision-makers

contribute to sub-optimal investments. Their experiment involves the anchoring heuristic and

shows that exposing individuals to materials that create an anchor is, on average, sufficient to

change decision makers’ intentions to make an investment. Such evidence supports the existence

of anchoring as a real phenomenon rather than as an artifact of other factors, which would have

been difficult to rule out using other methods.

A final example is the work on scenario planning. Phadnis and colleagues (2015)

conducted a series of experiments in which experts were asked their opinions on potential

investments before and after scenario planning. The authors found that experts’ confidence in

their own judgement was not affected by using multiple scenarios as had been previously
EXPERIMENTS IN STRATEGY RESEARCH 20

suggested, but instead was strengthened or weakened based on how the investment performed in

a particular scenario. The study was beneficial both in providing evidence that did not confirm

previous work and in offering concrete conclusions on a complex topic. Together, the studies in

this topic area illustrate that experiments can be valuable in correcting erroneous conclusions and

consolidating gains from previous studies, providing a solid foundation for subsequent research.

Knowledge and Innovation. The 27 experiments within the knowledge and innovation

topic area included studies of knowledge transfer and spillovers (Di Stefano, King & Verona,

2014; Flammer & Kacperczyk, 2019; Kachra & White, 2008; Kane, 2010), creativity and

ideation (Berg, 2016; Franke, Poetz & Schreier, 2014; Keum & See, 2017), and organizational

learning (Fang, 2012; Lawrence, 2020). Several studies in this topic area were conducted in

creative or nascent venturing contexts in which archival data may be difficult to obtain. For

example, one study gathered data from gourmet Italian chefs, who were asked how likely they

would be to share domain relevant information (recipes and techniques) based on the reputation

of competitors (Di Stefano et al., 2014). The experiment was notable both for the creative

context in which it was carried out, and because each participant answered questions for more

than one hypothetical situation (i.e., repeated trials). This allowed the authors to account for

potential unobserved variables by computing participant-level fixed effects, strengthening the

robustness of their findings.

Other studies in this category also sought to address creative research questions.

Motivated by the rejection of inevitable disclosure doctrines in parts of the U.S., Flammer and

Kacperczyk (2019) investigated whether corporate social responsibility programs could be

deployed as a defense against knowledge spillovers and found support for this notion. This study

combined non-experimental techniques (a difference-in-differences approach) with experimental


EXPERIMENTS IN STRATEGY RESEARCH 21

methods to exploit the advantages of multiple techniques in addressing the research question.

Cooperative Strategies. Cooperative strategies accounted for 24 studies and addressed a

variety of non-competitive arrangements between organizations including alliances and

networks, thus seeking theory-based explanations of inter-organizational relationships including

the roles of trust, social capital, and governance. Many of these studies focused on alliances

(Agarwal, Croson, & Mahoney, 2010; Amaldoss & Staelin, 2010; Arend, 2009; Fonti, Maoret &

Whitbred, 2017; Mellewigt, Thomas, Weller & Zajac, 2017; Patzelt & Shepherd, 2008; Shah &

Swaminathan, 2008), with other studies considering reputation (Arend, 2009), trust and violation

(Harmon, Kim & Mayer, 2015), partner selection (Shah & Swaminathan, 2008), and free riding

(Fonti et al., 2017). As with the research in the other major areas, studies on cooperative

strategies combined topic-specific inquiry with methods that mitigated endogeneity to allow

causal claims to be made. For example, Agarwal and colleagues (2010) performed a study in

which participants played a computerized game that simulated the dynamics of strategic

alliances. The game varied the extent to which participants would benefit from alliance success

and the levels of communication with alliance partners. The authors found that alliances with a

high level of common benefit were more likely to succeed than other forms, and that this effect

was enhanced when communication with alliance partners was allowed. These results are

insightful given the complexity of potentially critical factors in a strategic alliance and were

facilitated by the high degree of experimental control over potentially confounding variables.

A second exemplary experiment is provided by Harmon and colleagues (2015).

Participants were led to believe that they had been the victims of contract infringement and were

put in a position to monetarily punish an unknown and unseen offender. Previous work in

strategy had not investigated individual reactions to contract disputes and had instead relied
EXPERIMENTS IN STRATEGY RESEARCH 22

largely on archival studies to answer related but less direct questions, such as the effect of

contract structure on dispute likelihood (Malhotra & Lumineau, 2011). In contrast, Harmon and

colleagues (2015) focused on how individuals interpreted contract violations and were able to

directly test how these micro-level interpretations affected trust and the management of

relationships. Other exemplar studies in this topic area include Fonti and colleagues’ (2017)

assessment of the role of alliance effectiveness and collaboration in multi-party alliance free

riding behavior and Shah and Swaminathan’s (2008) investigation of strategic alliance partner

selection. In both cases, the use of experimental methodology allows the authors to address

questions that would be difficult to evaluate with other methods, and to add contextual detail to

important strategic questions.

Strategy Process. There were 22 experimental studies on strategy process, several of

which had a cognitive theme such as decision making (Camuffo, Cordova, Gambardella &

Spina, 2020; Hohnisch et al., 2016; Lovallo, Clarke, & Camerer, 2012; Mitchell et al., 2011),

organizational learning (Fang, 2012) and mental models (Gary & Wood, 2011; Gary, Wood &

Pillinger, 2012), For example, Gary and Wood (2011) demonstrated that more accurate mental

models led to the adoption of better decision rules and in turn, to better performance. They noted

that it had long been assumed that managers who better understand the industry structure and the

capabilities of their own organization are able to use this knowledge to enhance its performance,

and experimentally, the authors were able to demonstrate a causal relationship. Likewise,

Lovallo and colleagues (2012) examined analogizing as a decision-making technique and found

that adopting an “outside view” in which the decision maker adopts a detached view of the

analogies resulted in a higher expected rate of return for a project. The precision of their method

allowed the authors to address specific questions about the quantity and types of analogies that
EXPERIMENTS IN STRATEGY RESEARCH 23

lead to good decisions, an area they note had previously received insufficient attention. Finally,

Reitzig and Maciejovsky (2015) studied behavior associated with hierarchical vertical

information flow using both a within and between-subjects paradigm, thereby contributing to the

reconciliation of the conflicting information economics and organizational psychology

predictions surrounding this topic. Participants were asked to make decisions on whether to

forward ideas to higher levels within a hypothetical firm based on idea quality. The study found

that steeper hierarchies discouraged idea passing due to apprehension regarding evaluation or

perceived lack of control. The use of experiments in these studies allowed for the testing of

assumptions and clarification and reconciliation of existing paradigms.

Competitive Strategy. Competitive strategy includes 13 experimental studies on topics

such as the influence (or lack thereof) of competition on market entry decisions (Luoma, Falk,

Totzek, Tikkanen & Mrozek, 2018; Moore et al., 2007), information and competitive decision

making (Abramson, Currim & Sarin, 2005), mixed strategy games (Amaldoss & Jain, 2002), and

market dynamics and confidence in judgement (Radzevick & Moore, 2011). Conventional

methods are excellent for describing competitive behavior but are largely unequipped to identify

the more detailed components of these phenomena. Experiments can assist in filling this gap.

Luoma and colleagues (2018) conducted two experiments on firm posture when entering a new

market (highly aggressive or not very committed) and examined whether posture can affect the

competitive response of incumbent firms. Using both managers and university students as

participants, the authors determined that facilitating a perception of either high aggression or

minimal commitment reduced the strength of incumbent responses, in the process addressing the

“cognitive foundations of competitive responses to market entry” (Luoma et al., 2018:1388).

As noted of previous studies from our sample, experiments are also useful for examining
EXPERIMENTS IN STRATEGY RESEARCH 24

paradoxical or counterintuitive phenomena. Amaldoss and Jain (2002) examine mixed strategy

games through a model-based simulation and report the surprising result that of two firms

competing to obtain a patent, the firm more likely to commit resources to product development

and ultimately be granted the patent is the one that values it less, not more. The counterintuitive

nature of this finding along with its origin in theory and simulation dictated the need for a

follow-up study, for which the authors could have used archival methods. However, an archival

study by its nature would have been affected by potentially confounding factors and would not

have been able to directly assess the firm behaviors responsible for the model’s predictions.

Thus, the authors used an experiment to avoid these concerns and complement the strengths of

the simulation. The follow-up study allowed for the confirmation of the model’s predictions and

demonstrated the potential of experiments to assess the voracity of theory and models.

Strategic Human Capital. Strategic human capital accounted for only five studies.

Choudhury and colleagues (2020) used MBA students and an online experiment in the patent

application context to show that human capital can complement machine learning by mitigating

the bias to which machine learning can be prone. By using a specialized task (patent

examination) and research subjects that were of similar age and experience to patent examiners,

the authors were able to capture the benefits of experiments while keeping external validity as

high as possible.

In another notable study, Berge and colleagues (2015) conducted a field experiment in

Tanzania in which they provided microenterprise owners with business training, a grant, both, or

neither one, then assessed the effects of their manipulations by examining observed behavior.

They found that participants benefited greatly when they received both a bump in human capital

(through the business training) and financial capital (the grant). Through the field context, they
EXPERIMENTS IN STRATEGY RESEARCH 25

were able to capitalize on the strengths of the experimental methodology while at least partially

mitigating some of the drawbacks. Likewise, Chatterji and colleagues (2016) initiated new

research in the strategic human capital area by examining the effects of firm and business unit

identity on the extent of engineer engagement with their firm’s internal question and answer

system. The authors experimentally manipulated the supposed identity of prospective recipients

of interfirm assistance, thus isolating its effect on engineer behavior. Both the Berge and

Chatterji-led author teams demonstrated how variables can be experimentally measured to

address important questions in under explored areas.

Global Strategy. The global strategy topic area contained five studies, two of which

(Chatterji et al., 2016; Crilly et al., 2016) examined the liability of foreignness, a topic for which

experimental methodology is potentially useful given the plethora of potential confounding

factors when attempting to draw causal conclusions on questions involving international firms.

Crilly and colleagues (2016) test for the presence of liabilities of foreignness within the CSR

context. They conducted a creative study in which due to cultural similarities, they listed a firm’s

country of origin as either the USA or Canada and asked employees of American NGOs for their

impressions of these firms given either a “do-good” or “do-no-harm” CSR program. The authors

found significant differences in impressions of the “do-no-harm” firms based on country and

were able to attribute these to the foreignness of the firms due to the careful experimental design

of the study. Decisions involving foreign direct investment (FDI) are similarly complicated, with

a long list of potential contributing factors. Tong and colleagues’ (2015) address this by running

an experiment to gauge the relative importance of various factors for FDI attractiveness. They

combine the advantages of the experimental methodology with a relatively high degree of

external validity using Chinese executives as participants, ultimately reporting results that would
EXPERIMENTS IN STRATEGY RESEARCH 26

not be attainable through survey or archival means. Taken together, the studies in the 10 topic

areas demonstrate how experiments can be creatively designed and deployed and can be

beneficial for addressing questions of importance to strategic management scholars.

A Review of Methodology in Strategy Experiments

In addition to a review of strategy topics, we also thoroughly examined methodological

components of each study to identify best practices and future research opportunities.

Experimental Design. Among the benefits of well-designed experiments is that they rule

out potential alternative explanations. A classic experimental design is one in which groups

randomly receive either exposure to a treatment or a control condition. This design characterized

the majority (71%) of the experiments in our dataset (Table S3). Eleven percent (11%) of studies

used a within-subjects design in which individuals were compared with themselves after

receiving a specific treatment, thus serving as their own control, and an additional eleven percent

(11%) used a mixed approach that incorporated both between and within-subjects components.

Finally, seven percent (7%) of studies utilized a conjoint/policy capturing approach in which the

use of multiple independent variables in differing combinations allows the effect of each variable

to be assessed. For example, Mitchell and colleagues (2011) administered a conjoint decision-

making task to CEOs with the same decision being made multiple times. This allowed the extent

of erratic decision making and the specific factors that contribute to it to be assessed.

Experimental Context. Our findings regarding contexts are summarized in Table S4.

The most common context (i.e., means of administration) in our sample was online with 64

experiments. The surge in online experiments appears to be primarily driven by the introduction

of Amazon’s mechanical turk (MTurk) and similar services as a method for quickly identifying

and selecting respondents with desired characteristics, an approach validated by recent studies
EXPERIMENTS IN STRATEGY RESEARCH 27

(Buhrmester, Kwang & Gosling, 2016; Crump, McDonnell & Gureckis, 2013). In light of the

accelerating popularity of such sampling methods, it is perhaps not surprising that many of the

online studies in our sample were published in the past three years, and the obstacles to

interfacing with respondents in person due to the COVID-19 pandemic suggest that online panels

are likely to remain popular. Another popular method was traditional laboratory experiments (n =

54). Such studies included computerized business mock experiments (e.g., Elfenbein et al.,

2017), computer games (e.g., Arend, 2009), and teamwork activities (e.g., Døjbak Håkonsson et

al., 2016). Laboratory experiments in the classroom served as the context for 29 studies. These

studies were largely of a cognitive nature and less likely to include behavioral outcomes (e.g.,

Crilly, 2017; Shapira & Shaver, 2014; Wright & Goodwin, 2002). Finally, 27 studies involved

active field experiments.

Experimental Samples. Sample characteristics are important in experiments, because

they influence an experiment’s external validity (Hsu, Simmons, & Wieland, 2017; Shadish et

al., 2002). In the current data set, 82 of the studies recruited students as the participants (see

Table S5). Despite skepticism regarding the generalizability of studies using students as

participants, they can be appropriate for certain questions that pertain to cognition and interactive

choices in business settings, particularly when the research question relates to the psychological

processes of non-specialists (Stevenson & Josefy, 2019). Business professionals (24) and

EMBAs (10) were also common participants, but few experiments were carried out using CEOs

or executives and board members (one and five studies, respectively). As previously mentioned,

crowd-based options (Aguinis & Lawal, 2012) such as MTurk (n = 36) increased in frequency

over the time covered by our review, and all were published in 2015 or later. While studies

varied in size with several having thousands of participants, the median number of participants
EXPERIMENTS IN STRATEGY RESEARCH 28

per study was 157. Seven experiments used group level participants such as retail chain stores

(Lawrence, 2020) or small businesses (Anderson, Chandy & Zia, 2018). In terms of participant

country of origin, the most sampled country in the dataset was the USA (75) followed by the

United Kingdom and China (8 each), signaling a need for increased sampling diversity at the

country-level in strategy.

Particularly in the field studies, some author teams compensated their participants by

providing them with a knowledge-based reward such as free training (Anderson et al., 2018;

Camuffo et al., 2020), or to incentivize firms to participate, the results of analysis (Chatterji et

al., 2016). For the experiments in our dataset, 50 percent paid their participants, while an

additional 10 percent provided a non-monetary reward like extra credit or a non-monetary good

such as chocolate or wine. Eleven percent did not pay, and the remaining 29 percent did not

disclose their compensation strategy.

Priming. Priming is useful in the experimental context to reliably bring forth specific

mindsets, emotions, or other cognitive states such as trust (Meier, Stephenson & Perkowski,

2019), particularly in the laboratory setting, in which contextual factors may otherwise be

lacking. While our sample includes examples of studies that primed mindsets (Crilly, 2017; Li et

al., 2018; Mueller et al., 2018) and trust (Meier et al., 2019), priming was used by only six

percent of experiments in our dataset.

Dependent Variable Type. We classified dependent variables into three categories: An

intention to act in a certain way or make a particular decision (intention-based measure, 49%), an

observed behavior under mock conditions (mock behavioral measure, 37%), or observed

behavior in real life (realistic behavior measure, 14%). Scholars have suggested that behavioral

outcomes are well-suited for strategy process research (Dutton & Stumpf, 1991; Hough & White,
EXPERIMENTS IN STRATEGY RESEARCH 29

2003; Miller & Tsang, 2011). Measuring an intention may not have the validity of the other two

options, but it increases design feasibility, especially in situations where conducting a behavioral

experiment would be prohibitive (e.g., firm acquisition). Mock behavioral measures constitute a

middle ground and allow for observation of simulated behavior. This is useful for maintaining

reasonably high validity in situations where the practical and ethical concerns of realistic

behavioral measures would likely preclude their use.

Experiments as Complementary Methods. For all the advantages of experiments that

have been enumerated, they also suffer from some weaknesses, including a comparative lack of

external validity. Consequently, a complementary approach in which an experiment is used to

complement an existing field study within a single paper can be useful. This approach was used

by 39 percent of the studies in our sample.

Audia and colleagues (2000) provide an excellent example of this approach using

differing methodologies to investigate strategic persistence. The first study uses archival data to

show that past success is associated with strategic persistence following radical environmental

change. This study has the advantage of high external validity due to its real-life setting and the

absence of experimenter manipulations, but these same characteristics prevent conclusions

regarding the operative mechanism of the association from being reached, meaning that the

observed association could be influenced by or attributable to unknown confounding factors. The

authors address these shortcomings using a subsequent experiment in which they assess strategic

persistence following simulated radical environmental change with all variables held constant

except for level of past performance. This provides confirmatory evidence with high internal

validity that the association observed in study one is due to the level of past performance. Use of

complementary methods allowed the authors to obtain results with high external validity based
EXPERIMENTS IN STRATEGY RESEARCH 30

on the archival study while still making causal claims with high internal validity from the

experiment. In this way, they were able to triangulate around the question of interest and exploit

the strengths of multiple approaches.

DISCUSSION AND FUTURE RESEARCH AGENDA

While experiments in strategic management are still rare compared to other methods, our

review indicates that scholars are increasingly calling for and turning to experiments to advance

several strategic management topic areas. However, the degree of concentration in a small

number of interest groups raises concerns that perhaps experiments in strategic management are

overly narrow in their focus, contributing insights to only a few important strategy topics. We

believe that there is substantial opportunity for experiments to be used in other areas such as

global strategy, strategic human capital, and several additional topic areas where they have

seldom been deployed. For example, we were unable to identify recent experimental studies

connected to substantial research streams such as transaction cost economics or the resource-

based view (Barney, 1991; Williamson, 1979).

Certainly, experiments are unlikely to be appropriate for all research questions. Chatterji

and colleagues note in reference to experiments, “We view this methodology as a complement,

not a substitute, for existing strategy research methods, since field experiments have strengths

and limitations that are often different from our traditional techniques” (2016:117). McGrath

(1981) refers to the incompatible nature of maximizing multiple study characteristics like

generalizability, measurement precision, and contextual validity as a three-horned dilemma in

which maximization of one characteristic inevitably leads to concessions from others such that

no single approach can simultaneously maximize all three. Our conclusion from this review

echoes these sentiments and we suggest that experiments have an increasingly high potential to
EXPERIMENTS IN STRATEGY RESEARCH 31

provide a valuable alternative approach for strategy researchers. We encourage more

experimental research in strategic management because achieving greater methodological

balance in the field as a whole through increased use of randomized experiments will enhance

the ability to triangulate and establish causal relationships, thereby consolidating past gains and

moving the field forward. As Hill and colleagues (2021) surmise:

“Only through repeated studies of a research question using different designs and
analyses can we gain confidence that a specific endogeneity threat is fully addressed.
Even the idealized experiment requires triangulation with different designs, samples, and
operationalization of variables before causal claims free of any validity threat can be
made.” (p. 138)

Experimental Design Considerations Particularly Relevant to Strategic Management

One reason why experiments are at times difficult to envision in strategic management

might be due to the organizational level of analysis. However, there are multiple ways to design

experiments and assign participants to roles for advancing macro-level research. Thus, we

present the following typology of participant roles and how they can be useful in advancing

scholarship to address particular types of questions (see also Table 3).

-------------------------INSERT TABLE 3 HERE-------------------------

Firms as Participants. While difficult, in rare instances, experimentalists have

developed designs in which firms are the participants and are randomly assigned to particular

conditions (e.g., Anderson et al., 2018; Camuffo et al., 2020). These studies are valuable because

they are at the level of analysis most central to strategic management scholarship. However, they

may suffer from generalizability criticisms because they are more likely to be conducted with

smaller firms, given the relative infeasibility of getting large firms to consent to researcher

assigned treatments. Perhaps, these studies may be more feasible in strategic entrepreneurship

settings, where there are a larger number of small firms. It may also be more feasible within an
EXPERIMENTS IN STRATEGY RESEARCH 32

organization to have multiple divisions as participants, with some implementing the intervention

and others not. Both options have promise for future experimental research conducted at the

firm-level.

Participants as Proxies for Firms/Organizations. Another approach is to consider

participants in the study as proxies for a firm or organization (Amaldoss & Staelin, 2010; Fang,

2012). For instance, to study competitive dynamics, participants may be asked to represent an

airline making the choice of whether to expand by acquiring landing rights in a new location. In

such a study, the focus may not necessarily be on the decision-maker but instead to ascertain

how firms’ actions may impact the actions of competitors. This approach may be useful when the

researcher seeks to focus on the varied exchanges between firms in the competitive landscape.

Participants as Proxies for Organizational Decision-Makers. In contrast, some

scholars may be focused directly on the individual actors within the firm, particularly key

decision-makers. For example, strategic leadership scholars may use participants as proxies for

firm actors, directing the participant to take on the role of a CEO, CFO, or other decision maker

of a company (e.g., Chng, Rodgers, Shih, & Song, 2012; Gary & Wood, 2011; Stam et al., 2018).

We find that this is the most frequent approach to experimental design in strategic management.

This approach has numerous advantages, including the ability of many participants to grasp the

identity they have been assigned. However, it may attract criticism if the participants do not have

sufficient experience or background to be suitable proxies for the executive role they are asked to

imagine.

Participants as Stakeholders. Many other studies assign participants to the role of

specific stakeholders, including for instance, investors (Greenberg & Mollick, 2017),

shareholders (Krause et al., 2014), and customers (Raithel & Hock, 2021). Participants can
EXPERIMENTS IN STRATEGY RESEARCH 33

provide strong indications of how these various stakeholders might interact, engage, or transact

with focal organizations under various manipulated conditions. This approach is useful given

growing interest in reputation and trust between firms and their stakeholders, and the developing

importance of research on the stakeholder view of the firm (Barney & Mackey, 2021).

Using Experiments to Extend Theory in Strategic Management

One potential concern identified from our review is that few experiments in the sample

(approximately one third) were motivated explicitly by theory. Experiments have been

recognized as useful for advancing theory-based knowledge in other social science fields (Lude

& Prügl, 2021; Trochim & Donnelly, 2001; Stevenson, Josefy, McMullen, & Shepherd, 2020),

and the same could be true in strategic management. We propose that experimental

methodologies are particularly well suited for testing and advancing theory in strategy because

they are characterized by high internal validity and are thus able to isolate and test specific

variables that are central to a given theory, providing a higher degree of precision and certainty

in evaluating theories than do other methods.

The advantages of evaluating theory experimentally are evident in a notable subset of

studies in our review. This advancement can take various forms including evaluating or

extending to new contexts, and is applicable to both established, as well as more nascent

theories. For example, management control theory has classically been applied within rather than

across organizations (Giglioni & Bedeian, 1974), but Shah and Swaminathan (2008) apply it to

the context of partner selection in strategic alliances by emphasizing the importance of

monitoring and when necessary, correcting processes that occur in such agreements. In contrast

to past studies which have focused on partner characteristics for determining partner

attractiveness, the authors suggest that alliance project type is a key moderator of partner
EXPERIMENTS IN STRATEGY RESEARCH 34

selection factors. They highlight the differing manageability and interpretability of various

alliance projects and predict that these will affect the relevance of specific partner characteristics

for a given alliance project. Thus, beyond providing nuance and insights into strategic alliance

dynamics, this research contributes to management control theory by extending it to and

demonstrating its applicability in a novel and very practical context.

Experiments are also useful for evaluating and extending nascent theories. For example,

Raithel and Hock (2021) examine how the type of crisis and response to it affects post-crisis firm

reputation. Crisis-response match theory suggests that firms can maximize their retained social

approval in the wake of scandal by matching their response, specifically the amount of

responsibility that they accept, with the “situational attributions of responsibility,” or the

perceptions of how responsible they are (Bundy & Pfarrer, 2015). This predicts that conforming

strategies, in which perceptions of responsibility and the amount of responsibility accepted

match, will be more beneficial in retaining social approval than nonconforming strategies in

which there is a mismatch. This means that the theory supports the counterintuitive conclusion

that an over-conforming crisis response strategy (i.e., a response that exceeds expectations such

as firm acceptance of a share of responsibility that exceeds stakeholder perceptions of what they

are responsible for) is nonconforming and thus increases social approval losses by external

stakeholders. Furthermore, the theory as proposed by Bundy and Pfarrer (2015) considers the

consequences for social approval, but not for the related concept of firm reputation, and Raithel

and Hock (2021) note that as of their study’s publication, no other authors had evaluated crisis-

response match theory empirically. Raithel and Hock (2021) address this gap by experimentally

testing the effects of various conforming and nonconforming strategies on perceived firm

reputation. Their results provide support for the predictions of crisis-match response theory and
EXPERIMENTS IN STRATEGY RESEARCH 35

extend its implications to include firm reputation. While the authors also conduct an archival

study on the effects of product recalls on stock price, their experiment allows them to extend

theory to firm reputation and to conclude that perceptions of firm reputation are due to crisis

response strategy rather than one of the many potential confounding variables present in the

archival study.

In summary, we propose that experiments are a particularly good method for extending

established theories under certain conditions, such as when there is the potential to apply an

extant theory to novel contexts (e.g., management control theory, Shah & Swaminathan, 2008),

or evaluate conflicting predictions at the intersection of multiple theories (e.g., regulatory focus

and regulatory fit theories, Stam et al., 2018). In such cases, the ability of experiments to assess

the effects of specific variables can be utilized in conjunction with theory-driven hypotheses to

clarify or establish the boundaries of specific theories. Previous studies have even recommended

specific theories that could potentially benefit from evaluation with experimental methods,

including stakeholder theory (Tantalo & Priem, 2016), real options theory (Trigeorgis & Reuer,

2017), and upper echelons theory (Tang et al., 2018). Similar to the example studies cited above,

scholars wishing to extend or evaluate these or other theories could employ experiments

carefully designed to evaluate established theories in novel contexts, evaluate the predictions of

new or untested theories, or even test which theory best explains a given phenomenon.

The Microfoundations of Strategic Management

During the past decade we have witnessed an intensification of the “microfoundations”

movement in strategy, which seeks to understand constructs on the firm-level through individual

actions and interactions (Foss, 2021). Strategic decisions are a central and unifying theme in

strategic management (Leiblein, Reuer, & Zenger, 2018), and scholars have previously noted
EXPERIMENTS IN STRATEGY RESEARCH 36

that decisions are made by individuals and groups of individuals within firms, particularly

influential individuals (e.g., CEOs, top management team members, Hambrick and Mason,

1984). The microfoundations literature emphasizes the importance of acknowledging and

studying these groups and individuals (Felin et al., 2015), and includes papers on prominent

strategy issues such as dynamic capabilities (Teece, 2007), resource-based theory (Foss, 2011),

and firm performance (Eisenhardt, Furr, and Bingham, 2010). By 2011, the movement had

gained sufficient momentum that the Strategic Management Journal published a special issue on

the “Psychological Foundations of Strategic Management,” which received more submissions

than any other special issue in its history (Powell et al., 2011). It included studies applying a

micro lens to classic strategy concepts like corporate capital allocation (Bardolet et al., 2011),

strategy implementation (Huy, 2011), and dynamic capabilities (Hodgkinson and Healey, 2011).

Furthermore, it called for the integration of these new perspectives with more traditional

approaches while dissolving the “false divide” between them (Levinthal, 2011).

The increasing emphasis on the microfoundations of strategic management is likely to

have a significant impact on the future role of experiments in strategy. A frequently cited

impediment to conducting strategy experiments is the difficulty of randomly assigning firms to

conditions (e.g., Grigoriou & Rothaermel, 2017). While strategy scholars have successfully

managed to overcome this challenge while sampling at the firm level (e.g., Anderson et al., 2018;

Camuffo et al., 2020), micro-oriented approaches increase opportunities to sample at the

individual-level. Further, certain micro topics such as cognition (e.g., Carton & Lucas, 2018) and

strategic behavior (e.g., Audia et al., 2000) allow some questions to be addressed using readily

available participant pools such as students rather than requiring samples from difficult to access

populations like CEOs. We propose that the microfoundations movement has fundamentally
EXPERIMENTS IN STRATEGY RESEARCH 37

altered the relationship between strategy research and experimental methods such that

experiments are likely to be considered more appropriate, and even more necessary than in past

years. Experiments, we believe, have the potential to become a more frequently used tool

allowing the field to reap the benefits of micro theories in strategy (cf., Powell et al., 2011).

Illustrative Examples of Experiments that Strategy Scholars Could Deploy

Our review reveals several areas in which scholars have recently begun to publish and

initiate experimental work. In this section, we discuss a sampling of specific opportunities for

future research along with illustrative examples or mock experiments that scholars could employ,

detailing how scholars can leverage best practices from strategy experiments (informed by our

review) and those from other fields. To organize this section, we develop and detail illustrations

that demonstrate how experiments could enhance strategic management scholarship in two

important ways. We draw on recent work which examined the advancing state of knowledge in

strategy (Duhaime, Hitt and Lyles, 2021) as a basis to illustrate specific experimental

opportunities with high potential to advance the strategic management literature. Specifically,

Duhaime and colleagues emphasized areas including sustainability strategies and a new and

unique understanding of stakeholder theory on which strategy research is likely to focus in the

future. We offer examples of future experimental research in these areas.

Experiments for Studying Sustainability Strategies. Sustainability is a concern for

firms as well as governments and will continue to increase in relevance as the effects of climate

change and other global disruptions become increasingly evident. Although it is well recognized

that the potentially devastating effects of climate change could have far reaching effects across

industries, the means by which managers respond to climate change is seldom studied for one

obvious reason; the most disruptive aspects of climate change involve future states that do not
EXPERIMENTS IN STRATEGY RESEARCH 38

yet exist. Indeed, considering hypothetical situations is where experiments, and particularly

mock-behavioral studies, have significant potential to contribute to strategic management

knowledge. Mock-behavioral studies can use human subjects and observe human decisions in

simulated environments in which decision-contexts can be manipulated and time accelerated.

As an illustration, a researcher could consider studying how executive board members

make long-term strategic plans and resource allocations in direct response to (hypothetical)

changes related to the global climate crisis. Although scholars have found that access to the

deliberations of boards is difficult to obtain, many aspects of executive team and board room

behaviors can be simplified and simulated in experiments because they are fundamentally

discussions and interactions between individuals and groups. Indeed, we know from other social

science fields that experiments can be very useful for evaluating group decisions as well as social

conformity within groups. For example, psychology researchers Gino, Ayal and Ariely (2009)

studied how one “bad apple” embedded within a group can alter the saliency of ethicality and

increase the likelihood that other group members will prioritize financial gain over concern for

ethical decision-making. In another experiment, entrepreneurship researchers Breugst and

Shepherd (2017) highlight how social context negatively influences affective reactions and team

dynamics under high uncertainty. Also, at the group level, Mannix, Neale, and Northcraft (1995)

manipulate organizational culture using vignettes and a negotiation simulation task. Findings

reveal that organizational culture influences resource allocations. Using a similar type of vignette

approach, strategic management scholars could manipulate aspects of organizational culture at

the board or executive team level. This would afford researchers a high degree of experimental

control when considering how organizational culture could influence the openness of executives

or the board to considering strategies that relate to climate threats.


EXPERIMENTS IN STRATEGY RESEARCH 39

Strategic management researchers might also consider how social pressure could alter

board-level strategic conformity related to sustainability strategizing, drawing for instance on

Asch’s (1956) classic social conformity experiments. Using experimental social conformity

designs strategic management researchers could consider if strategic level conformity influences

board decisions related to sustainability issues. For example, a researcher could adapt Asch’s

classic design to the context of strategic management by focusing factors that might affect

executives’ willingness to deviate from consensus including political ideologies, the salience of

the potential crisis, or the individual need for cognition. For example, the experiment could take

place in a company boardroom with actual board members or executives serving as confederates

(a situation with very high ecological validity) or might take place via an online Qualtrics survey

in which the participant is shown foil engagements from other hypothetical board members.

These approaches could be an effective way to assess how social influence could affect board

decisions related to climate crisis issues, complementing current archival approaches, and

weighing the influence of factors and processes that might alter the deliberations and perspective

taking of boards related to the impending climate crisis.

Experimental research could also be used to study other important strategic management

questions related to sustainability. For example, an experiment could be used to test how climate

change salience (via priming) influences global alliance decisions and transactions between firms

with differing levels of primed environmental concern. Other prospective research that could be

tested experimentally includes how firms in threatened industries (e.g., petroleum) orchestrate

strategic pivots under different (experimental) conditions, or how an increased emphasis on

sustainability affects the characteristics firm stakeholders desire in a prospective CEO (possibly

via conjoint analysis or a policy capturing experiment).


EXPERIMENTS IN STRATEGY RESEARCH 40

Experiments for Studying Stakeholder Theory. Very few studies in our review

specifically considered stakeholder theory (e.g., Choi & Shepherd, 2005). However, in recent

years, both scholars (e.g., Barney and Mackey, 2021) and prominent business leaders (e.g.,

Benioff, 2019; Business Roundtable, 2019) have publicly stressed the importance of adopting a

holistic stakeholder perspective. Barney and Mackey (2021) suggest that some of the most

central theories in the field of strategic management could be affected by a corporate shift toward

renewed stakeholder logic. Yet, given the nascency of this phenomenon, little archival data are

available that allow researchers to compare how managerial shifts toward stakeholder logics

influence strategic decision-making. Similar to issues of sustainability, the lack of available data

provides an opportunity to leverage experiments, particularly designs that feature “logic

priming” techniques.

To illustrate ways in which strategic management scholars could leverage existing

experimental paradigms to understand a shift to a stakeholder logic we turn to the organizational

behavior literature. Kay and colleagues (2004) developed a series of logic priming experiments

to determine if implicitly presented primes from material objects would influence individual

logics and associated behavioral norms (i.e., the presence of books as a prop to prime an

educational logic). They found that simple exposure to settings such as boardrooms or objects

such as briefcases increased the likelihood that participants would adopt a “competitive” logic

and decrease their tendency to rely on a “cooperative” logic, demonstrated through tasks

including accepting or rejecting monetary offers from other participants (see Messick, Moore &

Bazerman, 1997; Robert & Carnevale, 1997; Thaler, 1988). Strategic management scholars

could adapt this paradigm and present participants with organizational primes that relate to

shareholder versus stakeholder scenarios. For example, scholars interested in how dominant
EXPERIMENTS IN STRATEGY RESEARCH 41

shareholder versus stakeholder logics affect strategic decisions could prime participants with

corporate versus stakeholder cues to determine if situational primes could influence the use of

competitive versus stakeholder logic.

Other potentially important topics that could be explored via experiments include how

relations with stakeholders affects firm risk-taking (proximity or intensity of stakeholder

relationships could be experimentally manipulated from high to low). Choi and Shepherd (2005)

point out that catering to certain stakeholders may require trade-offs relative to other

stakeholders and call for additional studies on the interest in and impact of various types of

stakeholders on firm decisions. Other studies could consider how stakeholder pressure, influence,

or co-creation of a product could affect different types of strategy decisions. Overall, we argue

that experiments represent a major opportunity to carry out unique research on stakeholders

either through selecting respondents from specific stakeholder groups or priming the concerns of

specific stakeholder groups to respondents. Integrated ideas from the two proceeding sections,

we note that scholars could even investigate questions at the intersection of sustainability and

stakeholder theory, such as the effects of evolving stakeholder attitudes towards environmental

sustainability on firm behaviors (e.g., the likelihood that a firm would adopt a green CSR

program in direct response to stakeholders) or how stakeholders might influence firm efforts to

reduce their carbon footprint (e.g., through purchasing carbon offsets, allowing employees to

telecommute, building higher efficiency buildings, etc.). Such questions are likely to be

increasingly relevant to firms in the future and given the absence of historic data on such topics,

experimental methods provide scholars the ability to make important progress.

A Best Practice Guide for Conducting Experiments in Strategy

Based on our comprehensive review of strategic management experiments and prior


EXPERIMENTS IN STRATEGY RESEARCH 42

experience with experimental methodologies, we have developed a guide for strategy scholars

interested in conducting randomized experiments as an online appendix2. The guide consolidates

valuable insights from existing studies such as those described above along with innovative

experimental design practices in related fields. The guide presents (a) Initial considerations for

planning your study (b) The basic mechanics of the experimental method, (c) Experimental

methods considerations that are specific to strategy research, and (d) Additional/advanced

experimental methods considerations.

The guide is primarily intended to aid researchers who are relatively new to experiments,

allowing them to get started with planning an experiment. Several design considerations are put

forth in this guide including concerns that are somewhat unique to conducting experiments in the

strategic management context. By no means is this guide intended to be fully exhaustive of all

experimental considerations. Rather it should be used in conjunction with this review paper and

other best practice papers and texts on experimental research. We believe experiments constitute

an underused methodology that has significant potential for strategic management researchers,

and we hope this guide can serve as a catalyst for novel experimental work in our field.

CONCLUSION

Given the importance of establishing causality in strategic management research, our

review suggests that experiments have a tremendous opportunity to help advance knowledge in

the strategic management field. To stimulate future use of experimental methodology, we

conducted a review of critical knowledge and theoretical advancement that have been gained in

the field from extant experiments. We also summarized methodological approaches taken by

experimental work to recommend best practices. Finally, we suggested specific studies for future

experiments in strategic management and provided actionable best practice recommendations.


EXPERIMENTS IN STRATEGY RESEARCH 43

For newcomers, our research provides value by outlining the specific opportunities to advance

the theory, methods, and the breadth of topics that novel experiments in strategy can address. For

more experienced experimental researchers, our review provides a broad overlay of the domain

of strategy experiments, which can be used to help seasoned experimental researchers bridge

sub-disciplines, presenting them with a path to accelerate their research and their use of

experiments in several streams of strategic management research.

For a downloadable pdf version of the research guide go to https://www.researchguides.org/


EXPERIMENTS IN STRATEGY RESEARCH 44

REFERENCES

Abramson, C., Currim, L. S., & Sarin, R. 2005. An experimental investigation of the impact of

information on competitive decision making. Management Science, 51: 195-207.

Agarwal, R., Anand, J., Bercovitz, J., & Croson, R. 2012. Spillovers across organizational

architectures: The role of prior resource allocation and communication in post‐acquisition

coordination outcomes. Strategic Management Journal, 33: 710-733.

Agarwal, R., Croson, R., & Mahoney, J. T. 2010. The role of incentives and communication in

strategic alliances: An experimental investigation. Strategic Management Journal, 31:

413-437.

Aggarwal, V. A., Posen, H. E., & Workiewicz, M. 2017. Adaptive capacity to technological

change: A microfoundational approach. Strategic Management Journal, 38: 1212-1231.

Aguinis, H., & Bradley, K. J., 2014. Best practice recommendations for designing and

implementing experimental vignette methodology studies. Organizational Research

Methods, 17: 351–371.

Aguinis, H., Edwards, J. R., & Bradley, K. J. 2017. Improving our understanding of moderation

and mediation in strategic management research. Organizational Research Methods, 20:

665-685.

Aguinis, H., & Lawal, S. O. 2012. Conducting field experiments using eLancing's natural

environment. Journal of Business Venturing, 27: 493-505.

Aguinis, H., & Vandenberg, R. J. 2014. An ounce of prevention is worth a pound of cure:

Improving research quality before data collection. Annual Review of Organizational

Psychology and Organizational Behavior, 1: 569-595.


EXPERIMENTS IN STRATEGY RESEARCH 45

Amaldoss, W., & Jain, S. 2002. David vs. Goliath: An analysis of asymmetric mixed-strategy

games and experimental evidence. Management Science, 48: 972-991.

Amaldoss, W., & Staelin, R. 2010. Cross-function and same-function alliances: How does

alliance structure affect the behavior of partnering firms? Management Science, 56: 302-

317.

Anderson, M., & Escher, P. 2010. The MBA oath: Setting a higher standard for business leaders.

New York: Penguin.

Anderson, S. J., Chandy, R., & Zia, B. 2018. Pathways to profits: The impact of marketing vs.

finance skills on business performance. Management Science, 64: 5559-5583.

Angrist, J. D., & Pischke, J. S. 2010. The credibility revolution in empirical economics: How

better research design is taking the con out of econometrics. Journal of Economic

Perspectives, 24: 3-30.

Arend, R. J. 2009. Reputation for cooperation: Contingent benefits in alliance activity. Strategic

Management Journal, 30: 371-385.

Artinger, S., & Powell, T. C. 2016. Entrepreneurial failure: Statistical and psychological

explanations. Strategic Management Journal, 37: 1047-1064.

Asch, S. E. 1956. Studies of independence and conformity: I. A minority of one against a

unanimous majority. Psychological Monographs: General and Applied, 70: 1-70.

Atzmuller, C., & Steiner, P. M. 2010. Experimental vignette studies in survey research.

Methodology, 6: 128-138.

Audia, P. G., Locke, E. A., & Smith, K. G. 2000. The paradox of success: An archival and a

laboratory study of strategic persistence following radical environmental change.

Academy of Management Journal, 43: 837-853.


EXPERIMENTS IN STRATEGY RESEARCH 46

Baker, B., Derfler-Rozin, R., Pitesa, M., & Johnson, M. 2019. Stock market responses to

unethical behavior in organizations: An organizational context model. Organization

Science, 30: 319-336.

Bapna, S. 2019. Complementarity of signals in early-stage equity investment decisions: Evidence

from a randomized field experiment. Management Science, 65: 933-952.

Bardolet, D., Fox, C. R., & Lovallo, D. 2011. Corporate capital allocation: A behavioral

perspective. Strategic Management Journal, 32: 1465-1483.

Bargh, J. A., & Chartrand, T. L. 2000. Studying the mind in the middle: A practical guide to

priming and automaticity research. In H. Reis & C. Judd (Eds.), Handbook of research

methods in social psychology: 253–285. New York: Cambridge University Press.

Barney, J. 1991. Firm resources and sustained competitive advantage. Journal of Management,

17: 99-120.

Barney, J. B., & Mackey, A. 2021. What would the strategic management field look like if it

took stakeholder theory seriously? In I. M. Duhaime, M.A. Hitt, & M.A. Lyles (Eds.),

Strategic management: State of the field and its future. Oxford, UK: Oxford University

Press.

Bascle, G. 2008. Controlling for endogeneity with instrumental variables in strategic

management research. Strategic Organization, 6: 285-327.

Benioff, M. 2019. Marc Benioff: We need a new capitalism. The New York Times. Retrieved

from https://www.nytimes.com/2019/10/14/opinion/benioff-salesforce-

capitalism.html?auth=linked-google. Accessed July 24, 2021.


EXPERIMENTS IN STRATEGY RESEARCH 47

Bennett, V. M., Seamans, R., & Zhu, F. 2015. Cannibalization and option value effects of

secondary markets: Evidence from the US concert industry. Strategic Management

Journal, 36: 1599-1614.

Berchicci, L., Dowell, G., & King, A. A. 2017. Environmental performance and the market for

corporate assets. Strategic Management Journal, 38: 2444-2464.

Berg, J. M. 2016. Balancing on the creative highwire: Forecasting the success of novel ideas in

organizations. Administrative Science Quarterly, 61: 433-468.

Berge, L. I. O., Bjorvatn, K., & Tungodden, B. 2015. Human and financial capital for

microenterprise development: Evidence from a field and lab experiment. Management

Science, 61: 707-722.

Bettis, R. A. 1991. Strategic management and the straightjacket: An editorial essay.

Organization Science, 2: 315-319.

Bigelow, L., Lundmark, L., Parks, J. M., & Wuebker, R. 2014. Skirting the issues: Experimental

evidence of gender bias in IPO prospectus evaluations. Journal of Management, 40:

1732-1759.

Bishop, M., & Green, M. 2011. The road from ruin: How to revive capitalism and put America

back on top. New York: Crown Business.

Bono, J. E., & Judge, T. A. 2003. Self-concordance at work: Toward understanding the

motivational effects of transformational leaders. Academy of Management Journal, 46:

554-571.

Breugst, N., & Shepherd, D. A. 2017. If you fight with me, I'll get mad! A social model of

entrepreneurial affect. Entrepreneurship Theory and Practice, 41: 379-418.


EXPERIMENTS IN STRATEGY RESEARCH 48

Brooks, M. E., Highhouse, S., Russell, S. S., & Mohr, D. C. 2003. Familiarity, ambivalence, and

firm reputation: Is corporate fame a double-edged sword? Journal of Applied Psychology,

88: 904-914.

Buhrmester, M., Kwang, T., & Gosling, S. D. 2016. Amazon's Mechanical Turk: A new source

of inexpensive, yet high-quality data? Perspectives on Psychological Science, 6: 3-5.

Bundy, J., & Pfarrer, M. D. 2015. A burden of responsibility: The role of social approval at the

onset of a crisis. Academy of Management Review, 40, 345-369.

Burtch, G., Ghose, A., & Wattal, S. 2015. The hidden cost of accommodating crowdfunder

privacy preferences: A randomized field experiment. Management Science, 61, 949-962.

Busenbark, J. R., Gamache, D., Yoon, E. H., Certo, S. T., & Withers, M. C. 2019. How much of

a problem is omitted variable bias really? Examining strategy research with the ITCV.

Academy of Management Proceedings: 15526. Briarcliff Manor, NY: Academy of

Management.

Business Roundtable. 2019. Business roundtable redefines the purpose of a corporation to

promote ‘An economy that serves all Americans’. Retrieved from

https://www.businessroundtable.org/business-roundtable-redefines-the-purpose-of-a-

corporation-to-promote-an-economy-that-serves-all-americans. Accessed July 24, 2021.

Cain, D. M., Moore, D. A., Haran, U. 2015. Making sense of overconfidence in market entry.

Strategic Management Journal, 36: 1–18.

Camuffo, A., Cordova, A., Gambardella, A., & Spina, C. 2020. A scientific approach to

entrepreneurial decision making: Evidence from a randomized control trial. Management

Science, 66: 564-586.


EXPERIMENTS IN STRATEGY RESEARCH 49

Carnahan, S. 2017. Blocked but not tackled: Who founds new firms when rivals dissolve?

Strategic Management Journal, 38: 2189-2212.

Carton, A. M., & Lucas, B. J. 2018. How can leaders overcome the blurry vision bias?

Identifying an antidote to the paradox of vision communication. Academy of Management

Journal, 61: 2106-2129.

Carton, A. M., Murphy, C., & Clark, J. R. 2014. A (blurry) vision of the future: How leader

rhetoric about ultimate goals influences performance. Academy of Management Journal,

57: 1544-1570.

Chatterji, A., Delecourt, S., Hasan, S., & Koning, R. 2019. When does advice impact startup

performance?. Strategic Management Journal, 40: 331-356.

Chatterji, A. K., Findley, M., Jensen, N. M., Meier, S., & Nielson, D. 2016. Field experiments in

strategy research. Strategic Management Journal, 37: 116-132.

Chen, X. P., Yao, X., & Kotha, S. 2009. Entrepreneur passion and preparedness in business plan

presentations: A persuasion analysis of venture capitalists' funding decisions. Academy of

Management Journal, 52: 199-214.

Chng, D. H. M., Rodgers, M. S., Shih, E., & Song, X. B. 2012. When does incentive

compensation motivate managerial behaviors? An experimental investigation of the fit

between incentive compensation, executive core self‐evaluation, and firm performance.

Strategic Management Journal, 33: 1343-1362.

Choi, Y. R., & Shepherd, D. A. 2005. Stakeholder perceptions of age and other dimensions of

newness. Journal of Management, 31: 573-596.


EXPERIMENTS IN STRATEGY RESEARCH 50

Choudhury, P., Starr, E., & Agarwal, R. 2020. Machine learning and human capital

complementarities: Experimental evidence on bias mitigation. Strategic Management

Journal, 41: 1381-1411.

Clarke, J. S., Cornelissen, J. P., & Healey, M. P. 2019. Actions speak louder than words: How

figurative language and gesturing in entrepreneurial pitches influences investment

judgments. Academy of Management Journal, 62: 335-360.

Clingingsmith, D., & Shane, S. 2018. Training aspiring entrepreneurs to pitch experienced

investors: Evidence from a field experiment in the United States. Management Science,

64: 5164-5179.

Coffman, L. C., & Gotthard-Real, A. 2019. Moral perceptions of advised actions. Management

Science, 65: 3904-3927.

Colquitt, J. A., & Zapata-Phelan, C. P. 2007. Trends in theory building and theory testing: A

five-decade study of the Academy of Management Journal. Academy of Management

Journal, 50: 1281-1303.

Connelly, B. L., Ketchen Jr, D. J., Gangloff, K. A., & Shook, C. L. 2016. Investor perceptions of

CEO successor selection in the wake of integrity and competence failures: A policy

capturing study. Strategic Management Journal, 37: 2135-2151.

Connelly, B. L., Li, Q., Shi, W., & Lee, K. B. 2020. CEO dismissal: Consequences for the

strategic risk taking of competitor CEOs. Strategic Management Journal, 41: 2092-2125.

Connelly, B. L., Miller, T., & Devers, C. E. 2012. Under a cloud of suspicion: Trust, distrust, and

their interactive effect in interorganizational contracting. Strategic Management Journal,

33: 820-833.
EXPERIMENTS IN STRATEGY RESEARCH 51

Connelly, B. L., Shi, W., Walker, H. J., & Hersel, M. C. 2020. Searching for a sign: CEO

successor selection in the wake of corporate misconduct. Journal of Management. doi:

10.1177/0149206320924119

Crilly, D. 2017. Time and space in strategy discourse: Implications for intertemporal choice.

Strategic Management Journal, 38: 2370-2389.

Crilly, D., Ni, N., & Jiang, Y. W. 2016. Do-no-harm versus do-good social responsibility:

Attributional thinking and the liability of foreignness. Strategic Management Journal, 37:

1316-1329.

Crump, M. J., McDonnell, J. V., & Gureckis, T. M. 2013. Evaluating Amazon's Mechanical

Turk as a tool for experimental behavioral research. PloS One, 8: e57410.

Cummings, T., & Knott, A. M. 2018. Outside CEOs and innovation. Strategic Management

Journal, 39: 2095-2119.

Di Stefano, G., & Gutierrez, C. 2018. Under a magnifying glass: On the use of experiments in

strategy research. Strategic Organization, 17: 497-507.

Di Stefano, G., King, A. A., & Verona, G. 2014. Kitchen confidential? Norms for the use of

transferred knowledge in gourmet cuisine. Strategic Management Journal, 35: 1645-

1670.

Døjbak Håkonsson, D., Eskildsen, J. K., Argote, L., Mønster, D., Burton, R. M., & Obel, B.

2016. Exploration versus exploitation: Emotions and performance as antecedents and

consequences of team decisions. Strategic Management Journal, 37: 985-1001.

Duhaime, I. M., Hitt, M. A., & Lyles, M. A., (Eds.). 2021. Strategic management: State of the

field and its future. Oxford, UK: Oxford University Press.


EXPERIMENTS IN STRATEGY RESEARCH 52

Dutton, J. E., & Stumpf, S. A. 1991. Using behavioral simulations to study strategic processes.

Simulation & Gaming, 22: 149-173.

Eisenhardt, K. M., Furr, N. R., & Bingham, C. B. 2010. CROSSROADS—Microfoundations of

performance: Balancing efficiency and flexibility in dynamic

environments. Organization Science, 21: 1263-1273.

Elfenbein, D. W., Knott, A. M., & Croson, R. 2017. Equity stakes and exit: An experimental

approach to decomposing exit delay. Strategic Management Journal, 38: 278-299.

Elsbach, K. D., & Elofson, G. 2000. How the packaging of decision explanations affects

perceptions of trustworthiness. Academy of Management Journal, 43: 80-89.

Exley, C. L. 2020. Using charity performance metrics as an excuse not to give. Management

Science, 66: 553-563.

Fang, C. 2012. Organizational learning as credit assignment: A model and two experiments.

Organization Science, 23: 1717-1732.

Felin, T., Foss, N. J., & Ployhart, R. E. 2015. The microfoundations movement in strategy and

organization theory. The Academy of Management Annals, 9: 575-632.

Fisher, G., Stevenson, R., Neubert, E., Burnell, D., & Kuratko, D. F. 2020. Entrepreneurial

hustle: Navigating uncertainty and enrolling venture stakeholders through urgent and

unorthodox action. Journal of Management Studies, 57: 1002-1036.

Flammer, C., & Kacperczyk, A. 2019. Corporate social responsibility as a defense against

knowledge spillovers: Evidence from the inevitable disclosure doctrine. Strategic

Management Journal, 40: 1243-1267.


EXPERIMENTS IN STRATEGY RESEARCH 53

Folkes, V. S., & Whang, Y. O. 2003. Account-giving for a corporate transgression influences

moral judgment: When those who "spin" condone harm-doing. Journal of Applied

Psychology, 88: 79-86.

Fonti, F., Maoret, M., & Whitbred, R. 2017. Free‐riding in multi‐party alliances: The role of

perceived alliance effectiveness and peers' collaboration in a research consortium.

Strategic Management Journal, 38: 363-383.

Foss, N. J. 2011. Invited editorial: Why micro-foundations for resource-based theory are needed

and what they may look like. Journal of Management, 37: 1413-1428.

Foss, N. J. 2021. Microfoundations in strategy: Content, current status, and future prospects. In I.

M. Duhaime, M.A. Hitt, & M.A. Lyles (Eds.), Strategic management: State of the field

and its future. Oxford, UK: Oxford University Press.

Foss, N. J., & Pederson, T. 2016. Microfoundations in strategy. Strategic Management Journal,

37: E22-E34.

Franke, N., Poetz, M. K., & Schreier, M. 2014. Integrating problem solvers from analogous

markets in new product ideation. Management Science, 60: 1063-1081.

Garg, S., Li, Q., & Shaw, J. D. 2018. Undervaluation of directors in the board hierarchy: Impact

on turnover of directors (and CEOs) in newly public firms. Strategic Management

Journal, 39: 429-457.

Gary, M. S., & Wood, R. E. 2011. Mental models, decision rules, and performance

heterogeneity. Strategic Management Journal, 32: 569-594.

Gary, M. S., Wood, R. E., & Pillinger, T. 2012. Enhancing mental models, analogical transfer,

and performance in strategic decision making. Strategic Management Journal, 33: 1229-

1246.
EXPERIMENTS IN STRATEGY RESEARCH 54

Gary, M. S., Yang, M. M., Yetton, P. W., & Sterman, J. D. 2017. Stretch goals and the

distribution of organizational performance. Organization Science, 28: 395-410.

Giglioni, G. B., & Bedeian, A. G. 1974. A conspectus of management control theory: 1900-

1972. Academy of Management Journal, 17: 292-305.

Gino, F., Ayal, S., & Ariely, D. 2009. Contagion and differentiation in unethical behavior: The

effect of one bad apple on the barrel. Psychological Science, 20: 393-398.

Gino, F., Norton, M. I., & Ariely, D. 2010. The counterfeit self: The deceptive costs of faking

it. Psychological Science, 21: 712-720.

Goldstein, N.J., Cialdini, R.B., Griskevicius, V., 2008. A room with a viewpoint: Using social

norms to motivate environmental conservation in hotels. Journal of Consumer Research,

35: 472–482.

Green, E. A., Rao, J. M., & Rothschild, D. 2019. A Sharp Test of the Portability of

Expertise. Management Science, 65: 2820-2831.

Greenberg, J., & Mollick, E. 2017. Activist choice homophily and the crowdfunding of female

founders. Administrative Science Quarterly, 62: 341-374.

Grigoriou, K., & Rothaermel, F. T. 2017. Organizing for knowledge generation: Internal

knowledge networks and the contingent effect of external knowledge sourcing. Strategic

Management Journal, 38: 395-414.

Gunia, B. C., Gish, J. J., & Mensmann, M. 2021. The weary founder: Sleep problems, ADHD-

like tendencies, and entrepreneurial intentions. Entrepreneurship Theory and

Practice, 45: 175-210.

Gutierrez, C., Astebro, T., & Obloj, T. 2020. The impact of overconfidence and ambiguity

attitude on market entry. Organization Science, 31: 308-329.


EXPERIMENTS IN STRATEGY RESEARCH 55

Hahl, O., & Ha, J. 2020. Committed diversification: Why authenticity insulates against penalties

for diversification. Organization Science, 31: 1-22.

Hambrick, D. C. 2007. The field of management's devotion to theory: Too much of a good

thing? Academy of Management Journal, 50: 1346-1352.

Hambrick, D. C., & Mason, P. A. 1984. Upper echelons: The organization as a reflection of its

top managers. Academy of Management Review, 9: 193-206.

Hamilton, B. H., & Nickerson, J. A. 2003. Correcting for endogeneity in strategic management

research. Strategic Organization, 1: 51-78.

Harmon, D. J., Kim, P. H., & Mayer, K. J. 2015. Breaking the letter vs. spirit of the law: How

the interpretation of contract violations affects trust and the management of relationships.

Strategic Management Journal, 36: 497-517.

Hekman, D. R., Johnson, S. K., Foo, M. D., & Yang, W. 2017. Does diversity-valuing behavior

result in diminished performance ratings for non-white and female leaders? Academy of

Management Journal, 60: 771-797.

Hertwig, R., & Ortmann, A. 2008. Deception in experiments: Revisiting the arguments in its

defense. Ethics & Behavior, 18: 59-92.

Highhouse, S., 2009. Designing experiments that generalize. Organizational Research Methods,

12: 554–566.

Hill, A. D., Johnson, S. G., Greco, L. M., O’Boyle, E. H., & Walter, S. L. 2021. Endogeneity: A

review and agenda for the methodology-practice divide affecting micro and macro

research. Journal of Management, 47: 105-143.

Hinkin, T. R. 1995. A review of scale development practices in the study of

organizations. Journal of Management, 21: 967-988.


EXPERIMENTS IN STRATEGY RESEARCH 56

Hitt, M. A., Beamish, P. W., Jackson, S. E., & Mathieu, J. E. 2007. Building theoretical and

empirical bridges across levels: Multilevel research in management. Academy of

Management Journal, 50: 1385-1399.

Hodgkinson, G. P., & Healey, M. P. 2011. Psychological foundations of dynamic capabilities:

Reflexion and reflection in strategic management. Strategic Management Journal, 32,

1500-1516.

Hohnisch, M., Pittnauer, S., Selten, R., & Pfingsten, A. 2016. Designing for deliberative goal-

based decision making in environments with rare adverse events-an experimental study.

Organization Science, 27: 1417-1434.

Hoogendoorn, S., Parker, S. C., & van Praag, M. 2017. Smart or diverse start-up teams?

Evidence from a field experiment. Organization Science, 28: 1010-1028.

Hossain, T., Minor, D., & Morgan, J. 2011. Competing matchmakers: An experimental

analysis. Management Science, 57: 1913-1925.

Hough, J. R., & White, M. A. 2003. Environmental dynamism and strategic decision‐making

rationality: An examination at the decision level. Strategic Management Journal, 24:

481-489.

Hsu, D. K., Simmons, S. A., & Wieland, A. M. 2017. Designing entrepreneurship experiments:

A review, typology, and research agenda. Organizational Research Methods, 20: 379-

412.

Huang, L., & Paterson, T. A. 2017. Group ethical voice: Influence of ethical leadership and

impact on ethical performance. Journal of Management, 43: 1157-1184.


EXPERIMENTS IN STRATEGY RESEARCH 57

Huang, L., & Pearce, J. L. 2015. Managing the unknowable: The effectiveness of early-stage

investor gut feel in entrepreneurial investment decisions. Administrative Science

Quarterly, 60: 634-670.

Huy, Q. N. 2011. How middle managers' group‐focus emotions and social identities influence

strategy implementation. Strategic Management Journal, 32: 1387-1410.

Jacguemet, N., Luchini, S., Rosaz, J., & Shogren, J. F. 2019. Truth telling under oath.

Management Science, 65: 426-438.

Jacquart, P., & Antonakis, J. 2015. When does charisma matter for top-level leaders? Effect of

attributional ambiguity. Academy of Management Journal, 58: 1051-1074.

Jago, A. S., & Laurin, K. 2019. Inferring commitment from rates of organizational transition.

Management Science, 65: 2842-2857.

Jemison, D. B. 1981. The importance of an integrative approach to strategic management

research. Academy of Management Review, 6: 601-608.

Jones Christensen, L., Siemsen, E., & Balasubramanian, S. 2015. Consumer behavior change at

the base of the pyramid: Bridging the gap between for‐profit and social responsibility

strategies. Strategic Management Journal, 36: 307-317.

Jung, H. J., Vissa, B., & Pich, M. 2017. How do entrepreneurial founding teams allocate task

positions? Academy of Management Journal, 60: 264-294.

Kachra, A., & White, R. E. 2008. Know-how transfer: The role of social, economic/competitive,

and firm boundary factors. Strategic Management Journal, 29: 425-445.

Kane, A. A. 2010. Unlocking knowledge transfer potential: Knowledge demonstrability and

superordinate social identity. Organization Science, 21: 643-660.


EXPERIMENTS IN STRATEGY RESEARCH 58

Kanze, D., Huang, L., Conley, M. A., & Higgins, E. T. 2018. We ask men to win and women not

to lose: Closing the gender gap in startup funding. Academy of Management Journal, 61:

586-614.

Kay, A. C., Wheeler, S. C., Bargh, J. A., & Ross, L. 2004. Material priming: The influence of

mundane physical objects on situational construal and competitive behavioral choice.

Organizational Behavior and Human Decision Processes, 95: 83-96.

Ketchen Jr, D. J., Boyd, B. K., & Bergh, D. D. 2008. Research methodology in strategic

management: Past accomplishments and future challenges. Organizational Research

Methods, 11: 643-658.

Ketchen Jr, D. J., Ireland, R. D., & Baker, L. T. 2013. The use of archival proxies in strategic

management studies: Castles made of sand? Organizational Research Methods, 16: 32-

42.

Keum, D. D., & See, K. E. 2017. The influence of hierarchy on idea generation and selection in

the innovation process. Organization Science, 28: 653-669.

Kidd, R. F. 1976. Manipulation checks: Advantage or disadvantage? Representative Research in

Social Psychology, 7: 160-165.

Kim, T., John, L. K., Rogers, T., & Norton, M. I. 2019. Procedural justice and the risks of

consumer voting. Management Science, 65: 5234-5251.

Krause, R., Whitler, K. A., & Semadeni, M. 2014. Power to the principals! An experimental look

at shareholder say-on-pay voting. Academy of Management Journal, 57: 94-115.

LaRiviere, J., McMahon, M., & Neilson, W. 2018. Shareholder protection and agency costs: An

experimental analysis. Management Science, 64: 3108-3128.


EXPERIMENTS IN STRATEGY RESEARCH 59

Larson, R.B. 2019. Controlling social desirability bias. International Journal of Market

Research, 61: 534–547.

Lawrence, M. 2020. Replication using templates: Does the unit learn from itself, the template, or

both? Strategic Management Journal, 41: 1955-1982.

Lazzarini, S. G., Miller, G. J., & Zenger, T. R. 2008. Dealing with the paradox of embeddedness:

The role of contracts and trust in facilitating movement out of committed

relationships. Organization Science, 19: 709-728.

Lee, M., Adbi, A., & Singh, J. 2020. Categorical cognition and outcome efficiency in impact

investing decisions. Strategic Management Journal, 41: 86-107.

Leiblein, M. J., Reuer, J. J., & Zenger, T. 2018. What makes a decision strategic? Strategy

Science, 3: 558-573.

Levinthal, D. A. 2011. A behavioral approach to strategy—what’s the alternative? Strategic

Management Journal, 32: 1517-1523.

Li, J., Chen, X. P., Kotha, S., & Fisher, G. 2017. Catching fire and spreading it: A glimpse into

displayed entrepreneurial passion in crowdfunding campaigns. Journal of Applied

Psychology, 102: 1075-1090.

Li, W. W., Krause, R., Qin, X., Zhang, J. S., Zhu, H., Lin, S. S., & Xu, Y. H. 2018. Under the

microscope: An experimental look at board transparency and director monitoring

behavior. Strategic Management Journal, 39: 1216-1236.

Lovallo, D., Clarke, C., & Camerer, C. 2012. Robust analogizing and the outside view: Two

empirical tests of case‐based decision making. Strategic Management Journal, 33: 496-

512.
EXPERIMENTS IN STRATEGY RESEARCH 60

Lude, M., & Prügl, R. 2021. Experimental studies in family business research. Journal of Family

Business Strategy, 12: 100361.

Luoma, J., Falk, T., Totzek, D., Tikkanen, H., & Mrozek, A. 2018. Big splash, no waves?

Cognitive mechanisms driving incumbent firms’ responses to low‐price market entry

strategies. Strategic Management Journal, 39: 1388-1410.

Makadok, R., Burton, R., & Barney, J. 2018. A practical guide for making theory contributions

in strategic management. Strategic Management Journal, 39: 1530-1545.

Malhotra, D., & Lumineau, F. 2011. Trust and collaboration in the aftermath of conflict: The

effects of contract structure. Academy of Management Journal, 54: 981-998.

Mannix, E. A., Neale, M. A., & Northcraft, G. B. 1995. Equity, equality, or need? The effects of

organizational culture on the allocation of benefits and burdens. Organizational Behavior

and Human Decision Processes, 63: 276-286.

March, J. G. 1962. The business firm as a political coalition. The Journal of Politics, 24: 662-

678.

Massey, C., & Wu, G. 2005. Detecting regime shifts: The causes of under-and

overreaction. Management Science, 51: 932-947.

McGrath, J. E. 1981. Dilemmatics: The study of research choices and dilemmas. American

Behavioral Scientist, 25: 179-210.

Meade, A. W., & Craig, S. B. 2012. Identifying careless responses in survey data. Psychological

Methods, 17: 437-455.

Meier, S., Stephenson, M., & Perkowski, P. 2019. Culture of trust and division of labor in

nonhierarchical teams. Strategic Management Journal, 40: 1171-1193.


EXPERIMENTS IN STRATEGY RESEARCH 61

Mellewigt, T., Thomas, A., Weller, I., & Zajac, E. J. 2017. Alliance or acquisition? A

mechanisms‐based, policy‐capturing analysis. Strategic Management Journal, 38: 2353-

2369.

Messick, D. M., Moore, D. A., & Bazerman, M. H. 1997. Ultimatum bargaining with a group:

Underestimating the importance of the decision rule. Organizational Behavior and

Human Decision Processes, 69: 87-101.

Miller, K. D., & Tsang, E. W. K. 2011. Testing management theories: Critical realist philosophy

and research methods. Strategic Management Journal, 32: 139-158.

Mitchell, J. R., Shepherd, D. A., & Sharfman, M. P. 2011. Erratic strategic decisions: When and

why managers are inconsistent in strategic decision making. Strategic Management

Journal, 32: 683-704.

Montmarquette, C., Rullière, J. L., Villeval, M. C., & Zeiliger, R. 2004. Redesigning teams and

incentives in a merger: An experiment with managers and students. Management

Science, 50: 1379-1389.

Moore, D. A., Oesch, J. M., & Zietsma, C. 2007. What competition? Myopic self-focus in

market-entry decisions. Organization Science, 18: 440-454.

Mueller, J., Melwani, S., Loewenstein, J., & Deal, J. J. 2018. Reframing the decision-makers’

dilemma: Towards a social context model of creative idea recognition. Academy of

Management Journal, 61: 94-110.

Okhuysen, G. A., & Eisenhardt, K. M. 2002. Integrating knowledge in groups: How formal

interventions enable flexibility. Organization Science, 13: 370-386.

Patzelt, H., & Shepherd, D. A. 2008. The decision to persist with underperforming alliances: The

role of trust and control. Journal of Management Studies, 45: 1217-1243.


EXPERIMENTS IN STRATEGY RESEARCH 62

Pearl, J. 2009. Causality. New York: Cambridge University Press.

Phadnis, S., Caplice, C., Sheffi, Y., & Singh, M. 2015. Effect of scenario planning on field

experts’ judgment of long‐range investment decisions. Strategic Management Journal,

36: 1401-1411.

Ployhart, R. E., & Moliterno, T. P. 2011. Emergence of the human capital resource: A multilevel

model. Academy of Management Review, 36: 127-150.

Powell, T. C. 2011. Neurostrategy. Strategic Management Journal, 32: 1484-1499.

Powell, T. C., Lovallo, D., & Fox, C. R. 2011. Behavioral strategy. Strategic Management

Journal, 32: 1369-1386.

Priem, R. L., Lyon, D. W., & Dess, G. G. 1999. Inherent limitations of demographic proxies in

top management team heterogeneity research. Journal of Management, 25: 935-953.

Priem, R. L., Walters, B. A., & Li, S. 2011. Decisions, decisions! How judgment policy studies

can integrate macro and micro domains in management research. Journal of

Management, 37: 553-580.

Raaijmakers, A. G. M., Vermeulen, P. A. M., Meeus, M. T. H., & Zietsma, C. 2015. I need time!

Exploring pathways to compliance under institutional complexity. Academy of

Management Journal, 58: 85-110.

Radoynovska, N., & King, B. G. 2019. To whom are you true? Audience perceptions of

authenticity in nascent crowdfunding ventures. Organization Science, 30: 781-802.

Radzevick, J. R., & Moore, D. A. 2011. Competing to be certain (but wrong): Market dynamics

and excessive confidence in judgment. Management Science, 57: 93-106.

Raithel, S., & Hock, S. J. 2021. The crisis-response match: An empirical investigation. Strategic

Management Journal, 42: 170-184.


EXPERIMENTS IN STRATEGY RESEARCH 63

Ranganathan, A. 2018. The artisan and his audience: Identification with work and price setting in

a handicraft cluster in Southern India. Administrative Science Quarterly, 63: 637-667.

Rawley, E., Godart, F. C., & Shipilov, A. 2018. How and when do conglomerates influence the

creativity of their subsidiaries? Strategic Management Journal, 39: 2417-2438.

Reitzig, M., & Maciejovsky, B. 2015. Corporate hierarchy and vertical information flow inside

the firm—a behavioral view. Strategic Management Journal, 36: 1979-1999.

Reuer, J. J., Tong, T. W., Tyler, B. B., & Ariño, A. 2013. Executive preferences for governance

modes and exchange partners: An information economics perspective. Strategic

Management Journal, 34: 1104-1122.

Robert, C., & Carnevale, P. J. 1997. Group choice in ultimatum bargaining. Organizational

Behavior and Human Decision Processes, 72: 256-279.

Rumelt, R. P., Schendel, D., & Teece, D. J. 1991. Strategic management and economics.

Strategic Management Journal, 12: 5-29.

Sauer, S. J., Thomas-Hunt, M. C., & Morris, P. A. 2010. Too good to be true? The unintended

signaling effects of educational prestige on external expectations of team

performance. Organization Science, 21: 1108-1120.

Scandura, T. A., & Williams, E. A. 2000. Research methodology in management: Current

practices, trends, and implications for future research. Academy of Management Journal,

43: 1248-1264.

Schillebeeckx, S. J., Chaturvedi, S., George, G., & King, Z. 2016. What do I want? The effects

of individual aspiration and relational capability on collaboration preferences. Strategic

Management Journal, 37: 1493-1506.


EXPERIMENTS IN STRATEGY RESEARCH 64

Semadeni, M., Withers, M. C., & Certo, S. T. 2014. The perils of endogeneity and instrumental

variables in strategy research: Understanding through simulations. Strategic Management

Journal, 35: 1070-1079.

Shadish, W., Cook, T. D., & Campbell, D. T. 2002. Experimental and quasi-experimental

designs for generalized causal inference. Boston: Houghton Mifflin.

Shah, R. H., & Swaminathan, V. 2008. Factors influencing partner selection in strategic

alliances: The moderating role of alliance context. Strategic Management Journal, 29:

471-494.

Shapira, Z., & Shaver, J. M. 2014. Confounding changes in averages with marginal effects: How

anchoring can destroy economic value in strategic investment assessments. Strategic

Management Journal, 35: 1414-1426.

Shea, C. T., & Hawn, O. V. 2019. Microfoundations of corporate social responsibility and

irresponsibility. Academy of Management Journal, 62: 1609-1642.

Shepherd, D. A., McMullen, J. S., & Ocasio, W. 2017. Is that an opportunity? An attention

model of top managers’ opportunity beliefs for strategic action. Strategic Management

Journal, 38: 626-644.

Shepherd, D. A., & Patzelt, H. 2015. Harsh evaluations of entrepreneurs who fail: The role of

sexual orientation, use of environmentally friendly technologies, and observers’

perspective taking. Journal of Management Studies, 52: 253-284.

Shook, C., Ketchen Jr, D. J., Hult, G., & Kacmar, K. 2004. An assessment of the use of structural

equation modeling in strategic management research. Strategic Management Journal, 25:

397-404.
EXPERIMENTS IN STRATEGY RESEARCH 65

Shook, C., Ketchen Jr, D. J., Cycyota, C. S., & Crockett, D. 2003. Data analytic trends and

training in strategic management. Strategic Management Journal, 24: 1231-1237.

Shore, J., Bernstein, E., & Lazer, D. 2015. Facts and figuring: An experimental investigation of

network structure and performance in information and solution spaces. Organization

Science, 26: 1432-1446.

Slade Shantz, A. F., Kistruck, G. M., Pacheco, D. F., & Webb, J. W. 2020. How formal and

informal hierarchies shape conflict within cooperatives: A field experiment in

Ghana. Academy of Management Journal, 63: 503-529.

Souitaris, V., Zerbinati, S., Peng, B., & Shepherd, D. 2020. Should I stay or should I go?

Founder power and exit via initial public offering. Academy of Management Journal, 63:

64-95.

Spencer, S.J., Zanna, M.P., Fong, G.T., 2005. Establishing a causal chain: Why experiments are

often more effective than mediational analyses in examining psychological processes.

Journal of Personality and Social Psychology, 89: 845-851.

Stam, D., van Knippenberg, D., Wisse, B., & Pieterse, A. N. 2018. Motivation in words:

Promotion- and prevention-oriented leader communication in times of crisis. Journal of

Management, 44: 2859-2887.

Stevenson, R., Ciuchta, M. P., Letwin, C., Dinger, J. M., & Vancouver, J. B. 2019. Out of

control or right on the money? Funder self-efficacy and crowd bias in equity

crowdfunding. Journal of Business Venturing, 34: 348–367.

Stevenson, R. M., & Josefy, M. 2019. Knocking at the gate: The path to publication for

entrepreneurship experiments through the lens of gatekeeping theory. Journal of Business

Venturing, 34: 242-260.


EXPERIMENTS IN STRATEGY RESEARCH 66

Stevenson, R., Josefy, M., McMullen, J. S., & Shepherd, D. 2020. Organizational and

management theorizing using experiment-based entrepreneurship research: Covered

terrain and new frontiers. Academy of Management Annals, 14: 759-796.

Tang, Y., Mack, D. Z., & Chen, G. L. 2018. The differential effects of CEO narcissism and

hubris on corporate social responsibility. Strategic Management Journal, 39: 1370-1387.

Tantalo, C., & Priem, R. L. 2016. Value creation through stakeholder synergy. Strategic

Management Journal, 37: 314-329.

Teece, D. J. 2007. Explicating dynamic capabilities: The nature and microfoundations of

(sustainable) enterprise performance. Strategic Management Journal, 28: 1319-1350.

Thaler, R. H. 1988. Anomalies: The ultimatum game. Journal of Economic Perspectives, 2: 195-

206.

Tong, T. W., Reuer, J. J., Tyler, B. B., & Zhang, S. 2015. Host country executives’ assessments

of international joint ventures and divestitures: An experimental approach. Strategic

Management Journal, 36: 254-275.

Tosi, H. L., Brownlee, A. L., Silva, P., & Katz, J. P. 2003. An empirical exploration of decision-

making under agency controls and stewardship structure. Journal of Management

Studies, 40: 2053-2071.

Trigeorgis, L., & Reuer, J. J. 2017. Real options theory in strategic management. Strategic

Management Journal, 38: 42-63.

Trochim, W. M., & Donnelly, J. P. 2001. Research methods knowledge base. Cincinnati, OH:

Atomic Dog Publishing.


EXPERIMENTS IN STRATEGY RESEARCH 67

van Balen, T., Tarakci, M., & Sood, A. 2019. Do disruptive visions pay off? The impact of

disruptive entrepreneurial visions on venture funding. Journal of Management Studies,

56: 303-342.

van Dijke, M., De Cremer, D., & Mayer, D. M. 2010. The role of authority power in explaining

procedural fairness effects. Journal of Applied Psychology, 95: 488-502.

van Knippenberg, B., & van Knippenberg, D. 2005. Leader self-sacrifice and leadership

effectiveness: The moderating role of leader prototypicality. Journal of Applied

Psychology, 90: 25-37.

Venus, M., Stam, D., & van Knippenberg, D. 2019. Visions of change as visions of continuity.

Academy of Management Journal, 62: 667-690.

Voors, M., Turley, T., Bulte, E., Kontoleon, A., & List, J. A. 2018. Chief for a day: Elite capture

and management performance in a field experiment in Sierra Leone. Management

Science, 64: 5855-5876.

Wang, L. Y., Wu, B., Pechmann, C., & Wang, Y. T. 2019. The performance effects of creative

imitation on original products: Evidence from lab and field experiments. Strategic

Management Journal, 1-26

Weber, M., Duffy, J., Schram, A. 2018. An experimental study of bond market pricing. Journal

of Finance, 73: 1857–1892.

Weber, R. A., & Camerer, C. F. 2003. Cultural conflict and merger failure: An experimental

approach. Management Science, 49: 400-415.

Williamson, O. E. 1979. Transaction-cost economics: The governance of contractual relations.

The Journal of Law and Economics, 22: 233-261.


EXPERIMENTS IN STRATEGY RESEARCH 68

Wood, M. S., Williams, D. W. 2014. Opportunity evaluation as rule-based decision making.

Journal of Management Studies, 51: 573–602.

Wood, M. S., Williams, D. W., & Drover, W. 2017. Past as prologue: Entrepreneurial inaction

decisions and subsequent action judgments. Journal of Business Venturing, 32: 107-127.

Wright, G., & Goodwin, P. 2002. Eliminating a framing bias by using simple instructions to

‘think harder’and respondents with managerial experience: Comment on ‘breaking the

frame’. Strategic Management Journal, 23: 1059-1067.

Younkin, P., & Kashkooli, K. 2020. Stay true to your roots? Category distance, hierarchy, and

the performance of new entrants in the music industry. Organization Science, 31: 604-

627.

Younkin, P., & Kuppuswamy, V. 2018. The colorblind crowd? Founder race and performance in

crowdfunding. Management Science, 64: 3269-3287.


EXPERIMENTS IN STRATEGY RESEARCH 69

FOOTNOTES

1. Priem, Walters, and Li (2011) articulated the role that judgment policy studies could play in

spanning the multilevel nature of many judgements within organizations, including key questions

pertaining to strategic management and strategy implementation. Chatterji and colleagues (2016)

provide recommendations for and two demonstrations of field experiments; they complement

this work with an online appendix that provides counts of the number of experiments in leading

strategy and management journals compared to leading economics journals, illustrating the

relative lack of experiments in strategy and management. Finally, an essay by Di Stefano and

Gutierrez (2018) reports percentages comparing the abundance of experiments versus non-

experiments for selected management journals and categorizes these experiments as laboratory

or field experiments.

2. The experiment best practice guide and checklist is available as an online supplement and can

be downloaded as a PDF at https://www.researchguides.org/

3. Our search was conducted on all articles that were either in print or available online as of

August of 2020. As a result, our sample includes one paper (Raithel & Hock, 2021) that was

available online when we conducted our search and has since been made available in print, and

been given a 2021 publication date.


EXPERIMENTS IN STRATEGY RESEARCH 70

Table 1

Number of Strategy Experiments by Theory

Theory Number of Citations (Number of Experiments in Paper)


Experiments
Bapna, 2019 (1); Connelly, Ketchen Jr, Gangloff, &
Signaling Theory 9
Shook, 2016 (1); Jago & Laurin, 2019 (7)
Krause, Whitler & Semadeni, 2014 (2); Li, Krause, Qin,
Agency Theory 5 Zhang, Zhu, Lin, & Xu, 2018 (1); Tosi, Brownlee, Silva
& Katz, 2003 (2)
Behavioral Decision Theory 4 Brooks, Highhouse, Russell & Mohr, 2003 (4)
Crilly, Ni & Jiang, 2016 (1); Jacquart & Antonakis, 2015
Attribution Theory 3
(1); Shepherd & Patzelt, 2015 (1)
Kanze, Huang, Conley & Higgins, 2018 (1); Stam, van
Regulatory Focus Theory 3
Knippenberg, Wisse & Pieterse, 2018 (2)
Theory of Statistical
3 Younkin & Kuppuswamy, 2018 (3)
Discrimination
Behavioral Theory of the Hohnisch, Pittnauer, Selten & Pfingsten, 2016 (1); Keum
2
Firm & See, 2017 (1)
Game Theory 2 Amaldoss & Jain, 2002 (1); Arend, 2009 (1)
Management Control Theory 2 Shah & Swaminathan, 2008 (2)
Power Theory 2 Souitaris, Zerbinati, Peng & Shepherd, 2020 (2)
Theory of Disconfirmation of
2 Wang, Wu, Pechmann & Wang, 2019 (2)
Expectations
Case-Based Decision Theory 1 Lovallo, Clarke & Camerer, 2012 (1)
Commitment Theory 1 Jacguemet, Luchini, Rosaz & Shogren, 2019 (1)
Complexity Theory 1 Okhuysen & Eisenhardt, 2002 (1)
Core Self-Evaluation Theory 1 Chng, Rodgers, Shih & Song, 2012 (1)
Crisis Response Match
1 Raithel & Hock, 2021 (1)
Theory
Emotional Contagion Theory 1 Li, Chen, Kotha & Fisher, 2017 (1)
Expectation States Theory 1 Bigelow, Lundmark, Parks & Wuebker, 2014 (1)
Image Theory 1 Connelly, Shi, Walker & Hersel, 2020 (1)
Impression Management
1 van Balen, Tarakci & Sood, 2019 (1)
Theory
Institutional Theory 1 Raaijmakers, Vermeulen, Meeus & Zietsma, 2015 (1)
Property Rights Theory 1 Agarwal, Croson & Mahoney, 2010 (1)
Real Options Theory 1 Clingingsmith & Shane, 2018 (1)
Self-Concept Based Theory 1 Bono & Judge, 2003 (1)
Social Cognitive and Social
1 Huang & Paterson, 2017 (1)
Learning Theory
Social Identity Theory 1 Venus, Stam & van Knippenberg, 2019 (1)
Stakeholder Theory 1 Choi & Shepherd, 2005 (1)
Status Characteristics Theory 1 Jung, Vissa & Pich, 2017 (1)
Theory of Choice Homophily 1 Greenberg & Mollick, 2017 (1)
EXPERIMENTS IN STRATEGY RESEARCH 71

Table 2

Summary of Exemplary Strategy Experiments by Topic Area

Sample
Experiment Dependent
Authors Year Participants Key Finding / Contribution
Type Variable
(Number)
Competitive Strategy
Incumbent’s
Low-price market entrants
Luoma, Falk, price response,
Randomized can reduce incumbent
Totzek, perceived
2018 Between Managers (656) response by appearing high
Tikkanen, & aggressiveness,
Subjects in aggressiveness or low in
Mrozek commitment, and
commitment
consequence
As predicted by game theory,
Winning
individuals or entities that
frequency,
have less to gain from
Amaldoss & Randomized Students payoffs,
2002 winning a direct competition
Jain Mixed (36) frequency of
are paradoxically more likely
investing all
to out-invest their
capital
competition and win
Cooperative Strategy
Letter of the law violations
Trusting tend to be perceived as more
intentions, intentional than spirit of the
Randomized Mturk (97) and
Harmon, Kim, perceived law violations, and thus are
2015 Between MBA students
& Mayer intentionality, more damaging to trust and
Subjects (107)
willingness to lead to a greater willingness
punish by the wronged party to
pursue legal action
Alliance success, Both aligned economic
Agarwal, Randomized Business transfer of incentives and
Croson, & 2010 Between students, mostly resources, communication are needed to
Mahoney Subjects MBA (405) resources in maximize the probability of
alliance success in strategic alliances
Corporate Strategy
Percent of Managers tend to deviate
respondents who from profit maximizing
would make the decisions due to confusing
Shapira & Randomized MBA students
2014 profit versus marginal and average profits,
Shaver Within Subjects (216)
nonprofit particularly when average
maximizing profits are accessible and
investment relevant.
Internal capital allocations
show partition dependence
and a bias towards equality
Randomized
Bardolet, Fox, Executive MBA between divisions or
2011 Between Fund allocation
& Lovallo students (64) business units based on the
Subjects
centralization or
decentralization of the
budgeting procedure
EXPERIMENTS IN STRATEGY RESEARCH 72

Entrepreneurship and Strategy


Failure to exit,
various measures
Compensation type can
Elfinbein. Randomized Undergraduate of belief
affect both belief and
Knott, & 2017 Between business (probability that
behavior, and lead to sub-
Croson Subjects students (133) they are in a high
optimally timed exits
profit firm for
example)
Provides evidence that high
rates of entrepreneurial
Randomized Participants failure are more attributable
Artinger &
2016 Between (does not Market entry to psychological factors like
Powell
Subjects specify, 112) overconfidence than
statistical factors like random
error
Global Strategy
Liability of foreignness is
Company
Randomized NGO attenuated to a greater extent
Crilly, Ni, & impression,
2016 Between Representatives when firms engage in “do-
Jiang internal
Subjects (29) good” CSR compared with
attribution
“do-no-harm” CSR
Host country executives
consider a variety of factors
International
including partner firm
joint venture
resources, potential
attractiveness,
transaction hazards, and
Tong, Reuer, Conjoint/Policy Chinese divestiture
2015 remedial mechanisms in
Tyler, & Zhang Capturing executives (84) attractiveness,
determining whether they
and preference
prefer foreign direct
for IJV versus
investment in the form of
divestiture
international joint ventures
or divestitures
Knowledge & Innovation
Disclosure of Firms can use corporate
Randomized
Flammer & previous social responsibility
2019 Between Students (585)
Kacperczyk employer’s trade programs to help protect
Subjects
secrets against knowledge leakage
Knowledge transfer is
determined not only by its
context (recipient reputation,
degree of competition, and
Di Stefano, Randomized Head chefs Knowledge
2014 visibility of behavior), but
King, & Verona Mixed (492) transfer intention
also by the expectation that
the recipient will conform to
certain norms of knowledge
use
EXPERIMENTS IN STRATEGY RESEARCH 73

Stakeholder Strategy
Organizations receive less
blame for unpopular
actions when they are
Randomized Punishment and recommended by an
Coffman & 2019
Between Students (716) punishment adviser because the
Gotthard-Real
Subjects average presence of advice shifts
stakeholder perceptions of
both the necessity and
morality of the action
The benefits of CSR and
Amount and penalties of CSI are driven
favorability of at least in part by
Randomized feedback, and perceptions of warmth and
Shea & Hawn 2019 Students (88)
Mixed whether they competence, and vary
bought the pen based on country
they had tested characteristics (such as
warmth)
Strategic Human Capital
Field experiments in
Chatterji, Employees at strategy can be feasibly
Randomized Cooperation
Findley, Jensen, large medical conducted. For example,
2016 Between (interacting with
Meier, & device firm stronger (or more salient)
Subjects question emails)
Nielson (4,185) identity increases
employee cooperation
Enhancing human and/or
financial capital (through
Business
business training and a
performance,
Microenterprise grant, respectively)
Berge, Bjorvatn, Randomized business
2015 owners improves a variety of
& Tungodden mixed structure, and
(644) performance outcomes for
management
male entrepreneurs, but
practices
less so for female
entrepreneurs
Strategic Leadership & Governance
Jacguemet, Voluntary taking of a
Randomized Students
Luchini, Rosaz, 2019 Lying truth-telling oath decreases
mixed (480)
& Shogren the incidence of lying
Leader self-sacrifice
van increases follower
Randomized Perceived
Knippenberg & Students performance and
2005 Between leadership
van (479) assessment of the leader,
Subjects effectiveness
Knippenberg especially if leader
prototypicality is low
Strategy Process
“Outside view” analogies,
Value of inside
Lovallo, Clarke, Randomized Private equity tend to result in better
2012 versus outside
& Camerer Within Subjects employees (33) decision performance than
view forecasts
“inside view” analogies.
Decision rules and
Randomized Performance
MBA students performance are improved
Gary & Wood 2011 Between (cumulative
(63) when managers have more
Subjects profit)
accurate mental models
EXPERIMENTS IN STRATEGY RESEARCH 74

Table 3

Typology of Participant Roles for Strategy Experiments

Participant When is the approach Considerations and Most Relevant Indicative


Example
Role most beneficial? Difficulties Interest Groups Cites
Enhanced Competitive
feasibility and ease Dynamics,
Proxies for or Amaldoss
Market of measurement; Cooperative
Equivalent to Examining potential & Staelin,
simulation concerns about the Strategy,
Firms/ responses of firms 2010;
studies overlap of Corporate
Organizations Fang, 2012
individual and firm Strategy,
decision making Global strategy
Examining general
Strategic
Imagining cognition of Agarwal et
Leadership,
oneself on a executives or al., 2010;
Proxies for Behavioral
board of managers or Similarity of Connelly,
Firm Actors or Strategy,
directors, and evaluating decisions respondents to their Shi, et al.,
Decision- Knowledge &
ranking CEO that assume rational proxy role 2020; Gary
Makers Innovation,
selection decision-making with & Wood,
Strategic
criteria some allowance for 2011
Human Capital
behavioral variance.
Representativeness
of respondents to
Asking firm or industry
respondents to Examining the stakeholders;
estimate the responses of various relying on Choi &
Stakeholder
likelihood of stakeholder groups to respondents who Shepherd,
Proxies for Strategy,
them providing hypothetical actions or may be outside the 2005; Jago
Stakeholders Behavioral
support to isolating firm actions influence of & Laurin,
Strategy
organizations from other influential 2019
with various confounding events cultural/social
characteristics factors that impact
stakeholder
responses
When testing the
effects of a firm Entrepreneur-
Testing the May be difficult to
characteristic such as ship and
effects of a get larger firms to Anderson
business model or firm Strategy,
Firms as manipulation participate. Often et al., 2018;
structure; may be Cooperative
Participants like training on used in bottom of Camuffo et
particularly useful Strategy,
firm the pyramid al., 2020
(and feasible) in Corporate
performance contexts
entrepreneurial Strategy
contexts
Online Supplement

SUPPLEMENTAL MATERIAL
Table S1

Answers from a Panel of Strategy Scholars to Questions about the use of Experiments

Question Notable Themes Representative Quote(s)


Experiments are difficult to “Strategy research mainly focuses on firm-level issues. It does
use with a firm level of not sound effective and/or doable by using experiments to study
analysis firm-level activities which are often more complex.”

What are one or Lack of training “I have not had the proper training to do it, and I would probably
two major not have the technical resources (labs to run the simulation).”
reasons
that you would Lack of reviewer receptivity “They are unlikely to be well received by the best journals.”
not
use experiments Access to participants is “Given my focus on boards of directors, it would be challenging
in your problematic to get a sample of directors who would participate in a study
research? employing an experimental design.”

External validity “Difficult to simulate the gravity and implications of strategic


decisions in an experiment – eg.. a CEO’s performance or
reputation is permanently affected by their decisions.”
Yes. Difficulties enrolling “Most of the strategy research may need top executives as the
participants and overcoming experiment participants. It will be very difficult and costly as
external validity and level of well to put them into the lab.”
analysis issues
“Yes. My sense is that the typical experiment applied in strategy
research most often involves the use of individual human
subjects… This would involve the difficult task of developing
cross-level theory.”

“Yes. In addition to the above answers in (a) [answers to the first


question], the strategic management scholars seem to view
Do you think experiments as having too much control such that the scenario
that scholars may not reflect the real-life situation.”
perceive
experiments as No, they are inappropriate, “I think it is more an appropriate than a difficult issue of using
difficult in not necessarily more experiments in strategy research.”
strategy? If so difficult
why? “I think strategy scholars believe they are difficult to publish. I
think they would find them difficult to fit to questions of interests
to other strategy scholars.”

“The methodology itself is not difficult; although, certainly


designing an experiment that properly identifies a causal effect
must be done with care. At the same time, strategy scholars may
perceive them as more difficult to sell to reviewers and, in turn,
publish. This partly goes back to my first point that some
research questions in strategy do not as easily lend themselves to
this methodological approach.”
Online Supplement

Level of analysis “The levels of analysis and measurement which are usually at the
individual level in experiments. That can work to study
entrepreneurs or CEOs (or a small team) but I am not sure about
using this for organizational level variables which are, usually,
the variables of interest or the dependent variable in strategy
research. Is the experiment really describing what’s going on in
the firm?”

Sample size “Sample size would be another one [concern]. If we design a 2X2
scenario, we need a large number of top executives to
Are there participate.”
unique
concerns about Familiarity with method “Many scholars are not familiar with this method.”
using
experiments in
strategy versus
other related
Concerns with the review “I believe that there are specific biases or perceptions among
process strategy reviewers that may reduce their acceptance of
disciplines?
experiments in strategy research. For example, though a properly
executed randomized experimental design should address
concerns regarding endogeneity, strategy reviewers have formed
such a habit of criticizing studies through endogeneity that they
may unreasonably or mistakenly reject experiments. Also, the use
of experiments may lead to split reviewer teams – one or more
macro-level scholars combined with someone from the micro-
level. In those cases, each reviewer may understand and properly
evaluate the portion of the empirical study in her or his own area,
while rejecting the unfamiliar part.”
Decision making It seems the area of behavioral strategy and executive decision
making would benefit from this approach.

Many with the help of I would like to say that many strategy areas should be able to use
creativity experiments if you can use this method creatively. For example,
In what areas,
innovation, strategy implementation (e.g., new program
do you believe
adoption), or event-related studies (e.g., product recall, policy
strategy
changes) could be experimentally designed.
experiments
could provide
the greatest “I think the best use of experiments in strategy research is to
As a complement to complement other research methods. While archival research
value? conventional methods using large datasets has tremendous utility for the generalizability
of findings, it can often leave gaps in the face validity of our
research or limit our ability to directly examine underlying
mechanisms in our theoretical models. A well-designed and well-
executed experiment can nicely fill these gaps.”
Online Supplement

Table S2*

List of Strategy Experiments Appearing from 2000-2020

Competitive Strategy
Abramson, Currim, & Sarin, 2005; Amaldoss & Jain, 2002; Hossain, Minor, & Morgan, 2011;
Luoma, Falk, Totzek, Tikkanen, & Mrozek, 2018; Moore, Oesch, & Zietsma, 2007; Radzevick &
Moore, 2011; Wang, Wu, Pechmann, & Wang, 2019
Cooperative Strategy
Agarwal, Anand, Bercovitz, & Croson, 2012; Agarwal, Croson, & Mahoney, 2010; Amaldoss &
Staelin, 2010; Arend, 2009; Connelly, Miller, & Devers, 2012; Fonti, Maoret, & Whitbred, 2017;
Harmon, Kim, & Mayer, 2015; Kachra & White, 2008; Lazzarini, Miller, & Zenger, 2008;
Mellewigt, Thomas, Weller, & Zajac, 2017; Montmarquette, Rulliere, Villeval, & Zeiliger, 2004;
Patzelt & Shepherd, 2008; Reuer, Tong, Tyler, & Ariño, 2013; Schillebeeckx, Chaturvedi, George,
& King, 2016; Shah & Swaminathan, 2008; Tong, Reuer, Tyler, & Zhang, 2015; Weber &
Camerer, 2003
Corporate Strategy
Agarwal, Anand, Bercovitz, & Croson, 2012; Audia, Locke, & Smith, 2000; Bardolet, Fox, &
Lovallo, 2011; Crilly, 2017; Døjbak Håkonsson, Eskildsen, Argote, Mønster, Burton, & Obel,
2016; Elfinbein, Knott, & Croson, 2017; Gary, Yang, Yetton, & Sterman, 2017; Gutierrez, Astebro,
& Obloj, 2020; Hohnisch, Pittnauer, Selten, & Pfingsten, 2016; Jones Christensen, Siemsen, &
Balasubramanian, 2015; LaRiviere, McMahon, & Neilson, 2018; Lawrence, 2020; Massey & Wu,
2005; Meier, Stephenson, & Perkowski, 2019; Phadnis, Caplice, Sheffi, & Singh, 2015; Shapira &
Shaver, 2014; Stam, van Knippenberg, Wisse, & Pieterse, 2018; Tosi, Brownlee, Silva, & Katz,
2003; Younkin & Kashkooli, 2020
Entrepreneurship and Strategy
Anderson, Chandy, & Zia, 2018; Artinger & Powell, 2016; Bapna, 2019; Berge, Bjorvatn, &
Tungodden, 2015; Bigelow, Lundmark, Parks, & Wuebker, 2014; Burtch, Ghose, & Wattal, 2015;
Camuffo, Cordova, Gambardella, & Spina, 2020; Chatterji, Delecourt, Hasan, & Koning, 2019;
Chen, Yao, & Kotha, 2009; Clarke, Cornelissen, & Healey, 2019; Clingingsmith & Shane, 2018;
Elfinbein, Knott, & Croson, 2017; Fisher, Stevenson, Neubert, Burnell, & Kuratko, 2020;
Greenberg & Mollick, 2017; Hoogendoorn, Parker, & van Praag, 2017; Huang & Pearce, 2015;
Jones Christensen, Siemsen, & Balasubramanian, 2015; Jung, Vissa, & Pich, 2017; Kanze, Huang,
Conley, & Higgins, 2018; Li, Chen, Kotha, & Fisher, 2017; Moore, Oesch, & Zietsma, 2007;
Radoynovska & King, 2019; Ranganathan, 2018; Shepherd & Patzelt, 2015; Slade Shantz,
Kistruck, Pacheco, & Webb, 2020; Souitaris, Zerbinati, Peng, & Shepherd, 2020; van Balen,
Tarakci, & Sood, 2019; Younkin & Kashkooli, 2020; Younkin & Kuppuswamy, 2018
Global Strategy
Chatterji, Findley, Jensen, Meier, & Nielson, 2016; Crilly, Ni, & Jiang, 2016; Shea & Hawn, 2019;
Tong, Reuer, Tyler, & Zhang, 2015
Online Supplement

Knowledge & Innovation


Abramson, Currim, & Sarin, 2005; Berg, 2016; Choudhury, Starr, & Agarwal, 2020; Di Stefano,
King, & Verona, 2014; Døjbak Håkonsson, Eskildsen, Argote, Mønster, Burton, & Obel, 2016;
Fang, 2012; Flammer & Kacperczyk, 2019; Franke, Poetz, & Schreier, 2014; Gary, Wood, &
Pillinger, 2012; Green, Rao, & Rothschild, 2019; Kachra & White, 2008; Kane, 2010; Keum &
See, 2017; Lawrence, 2020; Mueller, Melwani, Loewenstein, & Deal, 2018; Okhuysen &
Eisenhardt, 2002; Shore, Bernstein, & Lazer, 2015; van Balen, Tarakci, & Sood, 2019; Wang, Wu,
Pechmann, & Wang, 2019
Stakeholder Strategy
Baker, Derfler-Rozin, Pitesa, & Johnson, 2019; Brooks, Highhouse, Russell, & Mohr, 2003; Choi
& Shepherd, 2005; Coffman & Gotthard-Real, 2019; Connelly, Ketchen Jr, Gangloff, & Shook,
2016; Crilly, Ni, & Jiang, 2016; Elsbach & Elofson, 2000; Exley, 2020; Flammer & Kacperczyk,
2019; Folkes & Whang, 2003; Greenberg & Mollick, 2017; Hahl & Ha, 2020; Jacquart &
Antonakis, 2015; Jago & Laurin, 2019; Kim, John, Rogers, & Norton, 2019; Krause, Whitler, &
Semadeni, 2014; LaRiviere, McMahon, & Neilson, 2018; Lee, Adbi, & Singh, 2020; Raaijmakers,
Vermeulen, Meeus, & Zietsma, 2015; Radoynovska & King, 2019; Raithel & Hock, 2021; Sauer,
Thomas-Hunt, & Morris, 2010; Shea & Hawn, 2019; Shepherd & Patzelt, 2015
Strategic Human Capital
Berge, Bjorvatn, & Tungodden, 2015; Chatterji, Findley, Jensen, Meier, & Nielson, 2016;
Choudhury, Starr, & Agarwal, 2020; Hoogendoorn, Parker, & van Praag, 2017
Strategic Leadership & Governance
Bono & Judge, 2003; Carton & Lucas, 2018; Carton, Murphy, & Clark, 2014; Chng, Rodgers,
Shih, & Song, 2012; Connelly, Ketchen Jr, Gangloff, & Shook, 2016; Connelly, Li, Shi, & Lee,
2020; Connelly, Miller, & Devers, 2012; Connelly, Shi, Walker, & Hersel, 2020; Crilly, 2017;
Gary & Wood, 2011; Hekman, Johnson, Foo, & Yang, 2017; Huang & Paterson, 2017; Jacguemet,
Luchini, Rosaz, & Shogren, 2019; Jacquart & Antonakis, 2015; Lee, Adbi, & Singh, 2020; Li,
Krause, Qin, Zhang, Zhu, Lin, & Xu, 2018; Lovallo, Clarke, & Camerer, 2012; Mitchell, Shepherd,
& Sharfman, 2011; Montmarquette, Rulliere, Villeval, & Zeiliger, 2004; Mueller, Melwani,
Loewenstein, & Deal, 2018; Reitzig & Maciejovsky, 2015; Reuer, Tong, Tyler, & Ariño, 2013;
Sauer, Thomas-Hunt, & Morris, 2010; Slade Shantz, Kistruck, Pacheco, & Webb, 2020; Souitaris,
Zerbinati, Peng, & Shepherd, 2020; Stam, van Knippenberg, Wisse, & Pieterse, 2018; Tosi,
Brownlee, Silva, & Katz, 2003; van Dijke, De Cremer, & Mayer, 2010; van Knippenberg & van
Knippenberg, 2005; Venus, Stam, & van Knippenberg, 2019; Voors, Turley, Bulte, Kontoleon, &
List, 2018
Strategy Process
Camuffo, Cordova, Gambardella, & Spina, 2020; Fang, 2012; Gary & Wood, 2011; Gary, Wood,
& Pillinger, 2012; Gary, Yang, Yetton, & Sterman, 2017; Green, Rao, & Rothschild, 2019;
Gutierrez, Astebro, & Obloj, 2020; Hohnisch, Pittnauer, Selten, & Pfingsten, 2016; Keum & See,
2017; Lovallo, Clarke, & Camerer, 2012; Mitchell, Shepherd, & Sharfman, 2011; Patzelt &
Shepherd, 2008; Phadnis, Caplice, Sheffi, & Singh, 2015; Raaijmakers, Vermeulen, Meeus, &
Zietsma, 2015; Reitzig & Maciejovsky, 2015; Shapira & Shaver, 2014; Wright & Goodwin, 2002
*If applicable, articles were placed (and listed) in more than one interest group
Online Supplement

Table S3

Number of Strategy Experiments by Experimental Design

Experimental Design Number and Percentage


Random Between Subjects 127 (71%)
Random Within Subjects 20 (11%)
Random Mixed 20 (11%)
Conjoint/Policy Capture 12 (7%)
Online Supplement

Table S4

Number of Strategy Experiments by Experimental Context

Experimental Context Number and Percentage


Lab Experiment – Traditional lab 54 (30%)
Lab Experiment – Classroom 29 (15%)
Online/Mail Experiment 64 (35%)
Field Experiment 27 (15%)
Experiment by Phone 2 (1%)
Context Not Mentioned 7 (4%)
Online Supplement

Table S5

Number of Strategy Experiments by Population Sampled

Sample Detail Number and Percentage


Undergraduate/MBA Students 82 (44%)
EMBA Students 10 (5%)
CEOs 1 (1%)
Other Executives/Board Members 5 (3%)
Other Business Professionals 24 (13%)
MTurk 36 (20%)
Investors 5 (3%)
Other 21 (11%)
Online Supplement

For a downloadable pdf version go to https://www.researchguides.org/


Online Supplement

For a downloadable pdf version go to https://www.researchguides.org/


Online Supplement

For a downloadable pdf version go to https://www.researchguides.org/


Online Supplement

For a downloadable pdf version go to https://www.researchguides.org/

View publication stats

You might also like