You are on page 1of 14

J. Luft, M.D.

Shields / Accounting, Organizations and Society 28 (2003) 169–249 183

financial and operational realities in organiza- longer causal chains. It is not at all clear that this
tions, or to privilege the financial as the ultimate is feasible, however. Budget emphasis and partici-
reality and to integrate and subordinate opera- pative budgeting might have different meanings,
tional concerns to it. Some typical Map I studies and therefore different causes and effects, at indi-
show that the accounting through which an exter- vidual and organizational levels. For example, the
nal economic change is analyzed influences the reasons why some individuals participate more in
organizational (e.g. responsibility structure, setting their budgets than other individuals within
accounting control) response to the economic the same organization (individual-level participa-
change (link 8), and organizational, production, tion) are probably not identical to the reasons why
information-technology and accounting (e.g. cost- some organizations push budget participation
system) changes influence each other (links 3–7, 9). down to a broader range of employees than other
Other studies show that operational and financial organizations do (organizational-level participa-
separation in the organizational structure is rein- tion). More detailed consideration of levels of
forced by the prevalence of mental models that analysis is needed to determine whether similarly
represent the organization’s activities in financial named variables at different levels of analysis are
terms in some subunits and in operational terms in actually the same variable—or if they are not
other subunits (link 11). identical, how they relate to each other (see Sec-
Summary. The introduction to the nine maps tion 6 below).
above show that the choice of variables is a primary Questions about causal-model form arise, for
reason for the observed pattern of connections and example, in a comparison of Maps D and I.
disconnects in management accounting research Although (unlike Maps A and B), the variables in
within and between maps. Different streams of these two maps are not identically named, they
research simply focus on different variables. If these seem to address similar phenomena: Map D is
different variables represent largely unrelated phe- entitled ‘‘Implementing management accounting
nomena, then there is little reason to try to con- change’’ and Map I is ‘‘Organizational change
nect them. However, if these different variables processes. . .’’ The two maps represent manage-
describe the same phenomena from the viewpoint ment accounting change in different casual-model
of different theories that divide up and name the forms, however. Map D is the simplest of all the
phenomena differently, there is more reason for maps in terms of causal-model form—all the rela-
research in one stream to take account of analysis tions are unidirectional linear additive—while
and evidence produced by research in other Map I is perhaps the most causally complex of all
streams. Some portion of the different variables in the maps, showing lengthy bidirectional interven-
management accounting research fall in the latter ing-variable sequences, sometimes including inter-
category. However, as the following examples actions. It seems unlikely that both these
illustrate, understanding the relations among these representations of change can be equally valid if
variables requires resolution of questions about they are intended to describe the same or similar
levels of analysis and causal-model forms. phenomena.
Level-of-analysis questions arise, for example, in
a comparison of Maps A and B, which share 3.3. Causal-model forms and levels of analysis
variables such as budget emphasis, difficulty, and
participative budgeting. On Map A the individual- Table 1 presents the frequencies of appearance
level variation in budget emphasis or participative of each causal-model form and level of analysis on
budgeting is unexplained, while Map B shows each map and summed across all nine maps. These
organizational-level causes of variation in these frequencies are the basis for the percentages
budgeting practices. The question naturally arises reported below, where we comment on the uneven
whether Map B provides explanations for the distribution of causal-model forms and levels of
unexplained variation in budgeting on Map A, analysis across maps. The unit for the frequencies
and the two sets of studies could be connected into is a ‘‘link-study pair.’’ A link is an arrow (causal
184 J. Luft, M.D. Shields / Accounting, Organizations and Society 28 (2003) 169–249

relation) on the maps, for example an arrow con- predominance of additive causal-model forms, the
necting organizational life cycle with the use of predominance of unidirectional causal-model
management accounting (Map C, link 12). If only forms, the predominance of single-level models
one study provides evidence supporting the exis- (with levels unevenly distributed across maps), and
tence of this relation, there is one link-study pair. the uneven distribution of models that explain the
If three studies provide evidence supporting the causes of management accounting (the dependent
existence of the same relation, there are three link- variable), models that explain its effects (the inde-
study pairs. Multiple arrows in an additive model pendent variable), and models that explain both.
are defined as separate links, but an interaction Each feature indicates an important limitation on
model with multiple variables at the tail-end of the what can be learned from the management
arrow is one link, as is an intervening-variable accounting research represented on the maps.
model with multiple arrows. The maps in total These five features and their implications are
include 589 link-study pairs. described briefly below and discussed at more
Five striking features of the use of causal-model length in Sections 5–7.
forms and levels of analysis are evident in Table 1: Curvilinearity. Only six of the 589 link-study
the rarity of curvilinear causal-model forms, the pairs represent curvilinear relations. Linear

Table 1
Descriptive statistics of link-study pairs

Map A–Ia A B C D Ea F G H I

N 589 88 54 91 47 52 59 81 48 69
Causal-model form
Unidirectional
Curvilinear: U relation 4 0 0 1 0 1 0 2 0 0
Curvilinear: inverted-U relation 2 0 0 1 0 0 0 1 0 0
Linear:
Additive 371 45 32 64 47 43 32 62 33 13
Intervening variable 56 9 9 10 0 3 5 5 0 15
Ordinal independent-variable interaction 100 28 10 12 0 3 17 7 12 11
Ordinal moderator-variable interaction 16 3 2 3 0 2 3 3 0 0
Disordinal independent-variable interaction 8 3 1 0 0 1 2 1 0 0
Disordinal moderator-variable interaction 0 0 0 0 0 0 0 0 0 0
Bi-directional
Reciprocal nonrecursive 17 0 0 0 0 0 0 0 3 14
Cyclical recursive 16 0 0 0 0 0 0 0 0 16
Levels
Single 523 87 46 81 46 51 56 80 42 34
Top-down 55 1 8 10 1 1 3 1 2 28
Bottom-up 8 0 0 0 0 0 0 0 4 4
Top-down and bottom-up 3 0 0 0 0 0 0 0 0 3
Single-level
Individual 203 87 0 4 0 1 31 80 0 0
Subunit 101 0 26 25 18 4 25 0 0 3
Organization 177 0 20 52 28 46 0 0 0 31
Beyond organization 42 0 0 0 0 0 0 0 42 0
Management accounting
Independent variable 220 73 16 12 0 13 30 51 21 4
Dependent variable 242 5 32 70 47 37 15 21 14 1
Independent and dependent variable 127 10 6 9 0 2 14 9 13 64
a
For columns A–I and E, the number of observations for the causal-model form subsection is one greater than N because the
model in Banker, Lee, Potter, and Srinivasan (2001) is counted twice, once as a disordinal interacting independent variable model and
once as an inverted-U relation.
J. Luft, M.D. Shields / Accounting, Organizations and Society 28 (2003) 169–249 185

models can limit understanding by failing to show zations and society: 89% of the link-study pairs
when the effect of a variable may diminish, inten- are single-level. The distribution of levels is uneven
sify, or change direction at different levels of the across maps: Map A is almost entirely at the indi-
variable. A model without curvilinearity identifies vidual level, Maps B–E at the organization and
no limit, for example, to the performance subunit levels, Map F at the individual and sub-
improvements that can be achieved by setting unit levels, Map G at the individual level, Map H
more difficult budgets or providing more perfor- at the beyond-organization level, and Map I
mance-contingent compensation. In theory there mostly at the organization level. When similar
are certainly such limits (e.g. diminishing returns variables are studied at different levels (e.g. the
in economics), and managers in practice are likely budgeting variables in Maps A and B, the incen-
to be concerned about where the limits are. tive-contracting variables in Maps E and F),
Additivity. The majority of the link-study pairs questions arise about the possible relations
(79%) include no interactions: that is, they include between levels. There are few cross-level models,
no explicit recognition that the effect of one vari- however, and the majority of these (55 of 66 cross-
able depends on the presence or magnitude of level link-study pairs) are top-down. Studies on
other variables. Additive models can limit under- the maps thus provide some evidence about how
standing of management accounting by represent- organizations or subunits affect individuals but
ing its causes and effects (e.g. organizational- less about how individuals affect organizations or
structure causes and performance effects) as uni- subunits.
versal rather than conditional on a context of Single-level models can limit understanding in a
other variables such as markets, cultures, technol- variety of ways. If they are higher-level (e.g. orga-
ogies, and government regulation. nizational-level) models, they often have no clearly
Unidirectionality. Causal direction on the maps specified causal mechanism—that is, no explicit set
is almost always one-way: 95% of link-study pairs of individual actions and interpretations by which
are unidirectional. For example, budget difficulty organization-level causes lead to organization-
usually influences performance but not vice versa; level effects, such as how prospector strategy leads
production technology and organizational struc- to more difficult budgets (e.g. who does what to
ture influence management accounting but not make this happen, and what motivation and rea-
vice versa. Unidirectional models can limit under- soning causes them to do it?). If the models are
standing when they make the independent vari- only at the individual level, it is not clear how they
ables look like levers that can be pulled without relate to higher-level effects: knowing how a single
generating recoil from the other end of the lever. judgment is made is not the same as knowing the
The unidirectional models represent a world in effect of that judgment on the interpersonal inter-
which managers who want to raise performance changes and institutional structures that constitute
can simply raise the level of budget difficulty or management accounting practices. Finally, top-
performance-contingent compensation or increase down models can limit understanding by failing to
monitoring, without generating reverse effects or address higher-level problems as they appear to
resistances. These unidirectional links are occa- managers who, as individuals trying to steer orga-
sionally called into question, both by unidirec- nizations, often initiate bottom-up action.
tional links in the opposite direction (e.g. the effect Management accounting as independent or
of budget difficulty on performance on Map B, dependent variable. Some studies take management
link 7, and the effect of performance on budget accounting as given and show its effects (manage-
difficulty on Map B, link 14) and by the relatively ment accounting as the independent variable only:
few bidirectional links (33 link-study pairs, all on 37% of link-study pairs), while other studies show
Maps H and I). only causes but not effects of management
Single-level models. Management accounting accounting (management accounting as the
research tends to examine individuals or organi- dependent variable only: 41% of link-study pairs).
zations or society but not individuals and organi- Moreover, explanations of causes and effects are
186 J. Luft, M.D. Shields / Accounting, Organizations and Society 28 (2003) 169–249

unequally distributed across maps, with A, F, G, maps. Further discussions of one of these types is
and H mostly explaining effects and B, C, D, and deferred until Section 6 because it involves level-
E mostly explaining causes. These characteristics of-analysis as well as variable-identification issues;
limit understanding of management accounting in the other two types are discussed in Sections 4.2
two ways. First, if management accounting is and 4.3.
studied only as the independent variable or only as
the dependent variable, we learn something about 4.1. Types of partially shared meanings
how management accounting practices affect non-
accounting variables and vice versa; but we do not Management accounting practice does not cate-
learn how different parts of management account- gorize the world in the same way as any basic
ing affect each other. Second, insofar as studies of social science theory—for example, ABC and the
the causes and the effects of management balanced scorecard do not map one-to-one onto
accounting appear on different maps, they also variables in economics, psychology or sociology—
tend to identify different variables and provide nor do the basic variables in these social science
different, sometimes incompatible, explanations, theories map one-to-one onto each other. The use
which make it difficult to link causes and effects of of these multiple categorizations results in three
management accounting into valid longer chains distinct types of partially shared meanings among
of explanation. variables on the maps.
In spite of the limitations noted above, linear
additive unidirectional single-level models with 1. Some variables are derived directly from a
management accounting as only the dependent particular social-science theory (e.g. calcu-
variable or only the independent variable can lative discourse on Map H, performance-
provide valid understanding of management measure weights in incentive contracts on
accounting under certain conditions. The follow- Map E), while others are derived from
ing sections discuss the conditions under which management accounting practice (e.g. ABC
different causal-model forms and levels of analysis or the balanced scorecard on maps C-D). A
are valid choices, as well as relating causal-model practice-defined variable is likely to share
form and level-of-analysis choices to variable meaning with one or more theory-defined
choices. The discussion is summarized in a set of variables but not to have identical meaning
guidelines that appears in Fig. 4. with any of them. (See Section 4.2.)
2. Different theories define their variables
more or less broadly, so that a variable
4. What variables are researched: guidelines 1–4 derived from one theory captures a subset
of the phenomena described by a variable
Because management accounting research has derived from another theory: for example,
used a variety of ways of categorizing and naming general usefulness of specific types of
the phenomena it studies, variables that have the information in contingency theory versus
same names but are studied at different levels of usefulness of the information in making
analysis or identified and analyzed using different specific production decisions or in com-
theoretical perspectives may capture similar but pensating executives in information eco-
not identical phenomena. Moreover, variables nomics and agency theory. Different
with different names may capture similar though practice-based variables may also be
not identical phenomena. Identifying the meaning defined more or less broadly: for example,
shared (and not shared) by these variables is in Map C, some studies combine practices
an important part of identifying natural and like TQM and JIT into a single variable
artifactual connections in the research. Section 4.1 called advanced management practices,
identifies three key types of partially shared while other studies consider each practice
meaning among variables that appear on the separately (see Section 4.3).
J. Luft, M.D. Shields / Accounting, Organizations and Society 28 (2003) 169–249 187

Fig. 4. Guidelines for theory-consistent empirical management accounting research.

3. Variables with the same or similar names mon name would make the maps more compact
sometimes appear at different levels of and readable but also would risk loss of informa-
analysis, like the budgeting variables tion or misrepresentation of some studies’ results;
embedded in different social-science the- and the studies themselves often do not clearly
ories on Maps A and B. These similarly- demarcate shared and unshared meanings between
named variables at different levels share their variables and similar variables in other
meaning but are not necessarily identical streams of research. In general we use the names
(see Section 6) in the original studies, but we sometimes group
variables that are somewhat differently named in
These types of variables with partially shared the studies under a common name on the maps, if
meanings pose a dilemma in constructing the the different names do not seem to capture
maps. Grouping similar variables under a com- unshared meanings that are important to the
188 J. Luft, M.D. Shields / Accounting, Organizations and Society 28 (2003) 169–249

studies’ primary goals. For example, on Map F, defined variables. On the other hand, theory-
subordinates’ misrepresentation of private infor- defined variables are more likely to have well-
mation to increase their own payoffs appears as a defined, stable, unitary meanings, making it pos-
single variable, misrepresentation by subordinate, sible to identify consistent cause-and- effect rela-
regardless of whether it is misrepresentation of tions. A single practice-defined variable, in
individual skills, production costs, or signals contrast, can denote multiple phenomena with
about the favorability of the external environ- different causes and effects. Failure to distinguish
ment. The primary goal of the Map F studies is to these multiple phenomena has long been seen as a
test specific theories about influences on mis- disadvantage of using practice-defined variables:
representation of private information. These the- as Weick (1969, p.23) observed, ‘‘. . .working
ories predict that misrepresentation depends on within the constraints of managerial language is a
the payoffs it generates or on personality char- severe deterrent to understanding.’’
acteristics, not on the type of information mis- Disentangling the multiple meanings of practice-
represented; therefore the misrepresentations of defined variables such as ABC, TQM, and the
different types of private information are com- balanced scorecard remains a significant challenge
bined into a single variable. for management accounting researchers. A given
Map E provides an example of why theoretically practice-defined variable may represent variations
similar variables are sometimes not combined. The in communication, reward structures, symbolic
independent variables in most of these studies are value, or information characteristics such as pre-
indicators of the informativeness of specific per- cision or sensitivity. The degree to which a parti-
formance measures about executives’ actions. For cular practice has any of these underlying
example, a long product life cycle (link 14) is used properties may vary across instances of the prac-
as an indicator of the low level of informativeness tice observed: for example, ABC in different
of financial measures and thus a predictor that industries, time periods, or countries can have
organizations will instead use individual, often substantially different underlying theoretical
subjective evaluations of executives to determine properties with different causes and effects. More-
incentive pay. We do not combine all of the inde- over, even if instances of the practice are quite
pendent variables in these studies into one vari- similar, each instance might represent multiple
able, informativeness, because we believe one of underlying theoretical properties: the introduction
the primary goals of these studies is to show the of a particular new management accounting prac-
contexts (e.g. strategies, product characteristics, tice could change the precision of information and
organizational structures) in which particular the speed with which it is communicated and the
measures are more or less informative. Results set of individuals to whom it is communicated.
relevant to this goal would be lost if all the inde- Failing to take the multiple properties of prac-
pendent variables in these studies were collapsed tice-defined variables into account can result in
into informativeness. invalid conclusions from research. Nonfinancial
information, for example, is a practice-defined
variable; it is often identified as a leading indicator
4.2. Practice-defined and theory-defined variables of financial performance and its causes or effects
attributed to its greater timeliness in providing the
Practice-defined and theory-defined variables performance information that financial measures
each have distinctive advantages and dis- provide only later. However, nonfinancial infor-
advantages. Practice-defined variables have the mation in general is not necessarily more timely
advantage of capturing management accounting than financial information in general, and non-
phenomena practitioners want to understand, in financial information can have important theore-
practitioners’ own language. Studies using these tical properties besides timeliness. Some
variables may thus be attractive and accessible to nonfinancial information is more precise or sensi-
a broader audience than studies using theory- tive than financial information or more easily
J. Luft, M.D. Shields / Accounting, Organizations and Society 28 (2003) 169–249 189

understandable, or it can give greater visibility to influence the other variables studied (e.g. indivi-
some individuals and support different power duals’ choice of incentive contracts or their
relations in an organization. Different subsets of investment and production decisions).
nonfinancial information have more or less of A variable too broadly defined relative to the
these various theoretical properties; and thus, for underlying theory generates noise in the cause–
example, the use of particular nonfinancial infor- effect relation and makes it less likely that the
mation that is not more timely than financial effects specified in the theory will be detected, even
information but is more sensitive to managers’ when they exist. Too broad a definition also
actions will have different causes and effects than makes it more likely that effects other than those
the use of nonfinancial information that is more specified in the theory will be detected and
timely but less sensitive. Valid research on the wrongly interpreted (e.g. mistaking precision
causes and effects of nonfinancial information use effects for timeliness effects in the nonfinancial
depends on identifying the information as timely, information example above). In contrast, a vari-
precise, etc., rather than simply identifying it as able too narrowly defined captures only part of
nonfinancial. the proposed cause–effect relation and also makes
it less likely that the effects specified in theory will
Guidelines: be detected, even when they exist.

1. If a practice-defined variable is used, then Guidelines:


clearly define its underlying theoretical
properties—not only those that are of par- 4. A variable definition should not include
ticular interest in the current study, but content irrelevant to the research question
also other properties that the practice- and theory employed or exclude relevant
defined variable is likely to possess. content.
2. If a practice-defined variable can represent
multiple underlying theoretical properties,
then gather evidence that identifies their 5. Causal-model forms: guidelines 5–12
separate causes and effects.
3. If the theoretical property of interest The following sections discuss in more detail the
belongs to only a definable subset of issues of causal-model form that were initially
instances of the practice-defined variable raised in Section 3.3: curvilinearity (Section 5.1);
(e.g. only some ABC systems or some additive, intervening-variable, and interaction
nonfinancial information), then state this models (Section 5.2); and directionality (Section
limitation explicitly. 5.3).

4.3. Breadth of definition of variables 5.1. Curvilinearity

The breadth of both practice-defined and the- Much of the theory underlying empirical man-
ory-defined variables on the maps varies: see agement accounting research predicts curvilinear
Appendix L for examples. The research question relations. The contingency theory of organiza-
and theory determine the valid breadth of defini- tions, for example, predicts curvilinear relations
tion. For example, environmental uncertainty may between organizational size or technology and
be too broadly defined a variable if only a subset some other organizational characteristics
of the uncertainties in the environment influence (Donaldson, 2001). Economic theory predicts
the other variables in a given study; uncertainty of curvilinear functions for individual utility and for
bonus pay may be too narrow a definition if other organizational costs and profits. Some cognitive-
uncertainties (e.g. about other components of psychology theories predict U-shaped or inverted-
compensation or about nonmonetary payoffs) also U response curves. These relations are rarely
190 J. Luft, M.D. Shields / Accounting, Organizations and Society 28 (2003) 169–249

represented in empirical management accounting shape of the curve is particularly important if the
research, however: only 1% of the link-study pairs sign of the relation changes over the observed
on the maps represent curvilinear relations. range, so that for low values of the independent
Researchers often intentionally induce linear- variable the effect is positive but for high values it
ization by limiting the range of evidence collected is negative or vice versa.
(e.g. choosing typical cases rather than extreme The few studies of curvilinear relations on the
cases for qualitative studies) or transforming maps have the potential to generate unresolved
quantitative data to meet the assumptions of lin- inconsistencies with the linear studies. For exam-
ear statistical models. Although limited-range or ple, link 20 on Map C shows a curvilinear relation
linearized analyses of data can be consistent with between information asymmetry and the com-
theory, they represent only a portion of what plexity of one part of the management accounting
many theories can in principle explain. For exam- control system (sophistication of post-auditing in
ple, the studies of organizational size and man- capital budgeting), while link 1 on Map B shows a
agement accounting on maps B, C, and E linear relation between decentralization (often
commonly omit very large and very small organi- considered an indicator of information asym-
zations; and the organizational size variable within metry) and overall management accounting con-
the remaining sample is often linearly transformed trol system complexity. It is not clear whether the
for purposes of statistical analysis and not trans- difference in causal-model form between these two
formed back to the raw measure for purposes of links occurs because different ranges of the vari-
interpretation. In consequence, we know little ables are examined, because the relation is really
about management accounting in very small curvilinear for complexity in one part of the man-
organizations, which are numerous, and in very agement accounting control system but not in
large organizations, which are influential. More- other parts, or because the analyses in the different
over, even within the middle range of organiza- studies are more or less sensitive to curvilinearity
tional size, if the size variable is not back- for other reasons (e.g. how the variables are mea-
transformed for purposes of interpretation, erro- sured10).
neous conclusions may be drawn from the find-
ings. For example, if the size effect is positive but Guidelines:
concave over the range studied but only the results
of the linearized analysis are shown, it may be easy 5. If theory predicts nonlinearities in the rela-
not to recognize the fact that at the lower end of tion examined, then consider the value of
the range, a given (raw) increase in organizational capturing nonlinearities in the study.
size can have a very large effect on management 6. If a linear model is used for the sake of
accounting, but at the upper end of the range the simplicity, then be explicit about the
effect may be too small to be significant for practice. resulting limitations.
Similarly for studies of performance measure-
ment and incentives, a restriction to showing lim- 5.2. Additive, intervening-variable, and interaction
ited-range linear effects leaves important questions models
unanswered. For example, a number of studies on
Maps D–G show that making compensation more The same sets of variables sometimes appear in
dependent on performance increases performance. different linear unidirectional causal-model forms:
Incentive designers in practice are concerned with additive, intervening-variable, and interaction.11
the exact shape of the curve: at what point do the
10
expected costs of a further incentive increase out- For example, if survey respondents treat a response scale
as an ordinal scale rather than an interval scale, the data may
weigh the diminishing expected benefits? Linear-
not capture curvilinearities.
model studies, which can only say that bigger 11
Intervening-variable and interaction models can in princi-
bonuses are better, do not answer this question ple include curvilinear components, but only one of the studies
about the shape of the curve. Understanding the represented on the maps does so (see footnote to Table 1).
J. Luft, M.D. Shields / Accounting, Organizations and Society 28 (2003) 169–249 191

In Map A, for example, the relation between par- els, which identify links between the beginning and
ticipative budgeting and satisfaction is represented end of a causal chain, add supplementary non-
with several different causal-model forms: additive conflicting information to the two-variable addi-
(link 14), intervening variable (link 13), mod- tive model, which explicitly represents only the
erator-variable interaction (link 12), and an inde- beginning and the end of the chain. Including
pendent-variable interaction (link 11). Most of the intervening variables can sometimes help to
maps include similar instances of a set of variables explain weak X1 ! Y relations. The X1 ! X2
linked with different causal-model forms. Identi- relation may be strong while the X2 ! Y relation
fying valid connections among variables requires is weak or vice versa; or each separate step in a
understanding when these causal-model choices multiple-link causal chain may be moderately
are and are not in conflict with each other, and strong, but the total uncertainty accumulated in
when they are in conflict, understanding the con- many links may be the source of weak results for
sequences of using an invalid causal-model form. the X1 ! Y model.
Causal-model forms describe qualitative narra- In contrast to the example above, an additive
tives as well as statistical models. For example, if model that predicts
one observed action in a narrative is presented as
the consequence of the occurrence of two other
earlier actions, then this relation can be repre-
sented in a variety of ways. Perhaps the two earlier
actions and their effects are independent of each is in conflict with an intervening-variable model
other, and neither alone has a large enough effect that predicts only
to result in the occurrence of the third but both
together do (an additive model); or perhaps the
first action causes the second, which in turn causes
the third (an intervening-variable model); or per- with no separate direct link from X1 to Y. Sup-
haps the influence of the first event on the third is pose, first, that the intervening-variable model is a
much larger in the presence of the second than in valid representation of the causal relations among
its absence (an interaction model). The causal- the variables: there is no direct relation between
model form guides the collection of evidence in X1 and Y, but X1 strongly influences X2, which in
both qualitative and quantitative studies (e.g. the turn influences Y. In this case, using the additive
decision whether to search for evidence on inter- model and regressing Y on the two independent
vening and interacting variables); it also guides the variables may show that neither Xi has an effect on
analysis of evidence, determining the statistical Y—a completely misleading conclusion—because
tests that yield valid results with quantitative data the strong X1 ! X2 relation creates multi-
and the descriptive language that most exactly collinearity in the additive regression model. Con-
represents the observed events in a narrative. versely, suppose that the additive model is a valid
Additive versus intervening-variable models. A representation of the causal relations among the
two-variable additive model that predicts X1 ! Y variables: X1 and X2 are independent of each other
is not in conflict with an intervening-variable but both independently influence Y. If the inter-
model that predicts X1 ! X2 ! Y or X1 ! X2 ! vening-variable model with no direct X1 ! Y path
X3 ! Y. Examples of causal relations with and is used, then the result may show no effect of X1
without intervening variables are Map A, links 20 on Y—because there is no effect through X2—even
and 39 (direct path from motivation to perfor- though the X1 ! Y effect is strong.
mance and indirect path via commitment to the Additive versus interaction models. On maps that
budget goal) and Map C, links 24–25 (direct path display complex causal relations, a pattern often
from subunit interdependence to usefulness of appears in which two variables are linked both
aggregated information and indirect path via with and without an interaction with a third
decentralization). The intervening-variable mod- variable. For example, individuals’ performance
192 J. Luft, M.D. Shields / Accounting, Organizations and Society 28 (2003) 169–249

capability influences their choice of performance- Intervening-variable versus interaction models.


contingent compensation on Map F, link 16; on Intervening-variable and interaction models
Map F, link 15, this effect depends on the uncer- represent two kinds of conditional relations. For
tainty of incentive pay. (Similar examples can be example on Map C, link 6, the use of efficiency-
found elsewhere on Map F, as well as on Maps, A, based performance measures in manufacturing is
B, G, H, and I.) In these cases, do the interaction conditional on whether manufacturing organiza-
models like link 15 contradict the additive models tions pursue a flexibility strategy. The use of
like link 16 or can both be valid representations of efficiency-based performance measures in turn
the same phenomena? influences performance (an intervening-variable
Suppose, first, that the relation is interactive— model), but how much the efficiency measures
the effect of X1 on Y depends on the magnitude of X2 affect performance is conditional on the organiza-
and vice versa—and that an additive model includ- tions’ flexibility strategy (an interaction model).
ing an X1 ! Y relation is used. (The model may The more flexible their manufacturing strategy,
also include an X3 ! Y relation, an X4 ! Y rela- the less the organizations will use efficiency-based
tion, and so on.) If X2 is constant when the evi- measures, and the less beneficial these measures
dence is collected to support this additive model, will be for performance when they are used. The
then the resulting conclusion about the X1 ! Y intervening-variable and interaction relations are
relation is only valid at that level of X2; the addi- conceptually different, and using both with the
tive model is context dependent, with the level of same data can be problematic. If examining the
X2 as the relevant context. If X2 is not held con- link from strategy to performance-measure choice
stant and is either omitted or included as an addi- yields sufficiently strong results (i.e. most manu-
tive (not interacting) variable, then the detected facturing organizations with flexibility strategies
effect of X1 on Y is a weighted average of the dif- do not use efficiency-based performance mea-
ferent X1 effects that occur at different levels of X2. sures), then there will be insufficient variation in
How misleading it is to omit an interaction the sample (too few flexible-strategy organizations
depends in part on whether the interaction is using efficiency-based performance measures) to
ordinal or disordinal. (These two types of interac- provide a powerful test of the interaction model
tions are represented differently on the maps; see (see Section 7.2 for further discussion.)
Appendix J). If the interaction is ordinal, then Interacting independent-variable versus mod-
changes in X2 change the magnitude but not the erator-variable models. These two models repre-
sign of the effect of X1 on Y.12 Thus, if the sign of sent different causal relations that should be
the X1–Y relation is positive, then X1 will increase clearly described in the narrative of a qualitative
Y at all levels of X2; and individuals choosing study or the hypothesis motivation of a quantita-
more X1 without regard for the level of X2 will tive study, although the same statistical tests can
receive an increase in Y that is larger or smaller be used for both in a quantitative study (e.g.
than expected but will not (on average) receive a ANOVA interaction tests). For example on Map
decrease in Y. If the interaction is disordinal, B, a build strategy (link 26) is represented as a
however (e.g. Map F, links 8 and 26; Map G, link moderator variable. In such a model, a build
1), then X1 increases Y at some levels of X2 and strategy does not in itself cause higher-perfor-
decreases it at other levels; thus, ignoring a dis- mance than other strategies; but it does affect the
ordinal interaction can have more unexpected impact of subjective (versus formula-based) per-
effects (e.g. reducing performance when an formance evaluation on subunit performance. In
increase in performance was expected). contrast, on Map C (link 28), customer-focused
strategy is represented as an interacting indepen-
12
To limit the number of different models represented on the
dent variable, because the study assumes that cus-
maps, we have included in the ordinal-interaction category studies
in which Xi has a significant effect on Y at one level of Xj but has tomer-focused strategy causes superior new
no significant effect on Y at another level of Xj, even if these rela- product development performance, although the
tions were tested separately rather than in a single interaction test. magnitude of the effect depends on the use of cus-
J. Luft, M.D. Shields / Accounting, Organizations and Society 28 (2003) 169–249 193

tomer information in the management accounting Given these uncertainties about actual causal
control system. Whether strategy has any influ- direction, how should causal-model direction
ence on performance or only moderates the effect choices be made and what are the consequences of
of other variables on performance is an important making invalid choices? The following examples
theoretical and practical question; thus failing to from the maps suggest that choices of direction-
distinguish between moderator and independent- ality depend on the time length for which evidence
variable interactions can be misleading. is collected. The unidirectional studies on Maps A-
G are mostly cross-sectional while the bidirec-
Guidelines: tional studies on Maps H-I are mostly long-
itudinal, in some cases covering decades or
7. If the causal model proposed is additive, centuries. Similarly, the different signs and causal
then indicate both the reasons for assum- directions given to the budget difficulty-perfor-
ing there are no important intervening- mance relations on Maps A, B, and F seem to
variable or interaction relations and the depend on whether researchers are examining a
consequences of omitting these relations if single point in time (the cross-sectional budget
they exist. difficulty ! performance links on Map A, links
8. If the causal model proposed is conditional, 23, 25 and Map B, link 7), two distinct time peri-
then indicate the type of conditionality ods (past performance ! current budget diffi-
(intervening versus interacting). culty, on Map B, link 14) or three time periods
9. For interaction models, indicate whether (performance ! budget difficulty !, performance
the interaction is ordinal or disordinal. in ratchet systems, Map F, link 20).
10. For interaction models, indicate whether Valid research requires alignment of answers to
the interaction involves independent vari- two questions about time length. The first ques-
ables only or independent variables and tion is the time frame of the study, i.e. over how
moderator variables. long a period and at what intervals within that
period should evidence be collected. For example,
5.3. Directionality evidence might be collected at a single point in
time, at the beginning and end of 5 years, or at
Differing choices about causal direction lead to monthly intervals through 5 years. The second
disconnects between maps and between individual question is the causal interval of the relation
studies within or across maps. Although some of studied, i.e. how long it takes for a change in X to
the causal relations represented on the maps seem cause a change in Y. As the remainder of this sec-
unambiguously unidirectional, others do not. For tion shows, answers to these questions about time
example, strategy choice affects management length determine whether a unidirectional or
accounting (Maps B–E), but management account- bidirectional model is valid; and if a bidirectional
ing also influences strategy by affecting the infor- model is valid, answers to questions about time
mation available as a basis for strategy choice length also determine which bidirectional model—
(Gray, 1990). Support for ABC (whether by top reciprocal or cyclical—is valid. When causality is
management, unions or other employees) affects bidirectional, unidirectional models can provide
the success of an ABC implementation (Map D); valid evidence in limited circumstances, with
but initial successes in the implementation process appropriate acknowledgment of their limitations.
may also affect the degree of support that ABC Just as a linear model can be a valid simplification
receives (Cooper, Kaplan, Maisel, Morrissey, & of curvilinear phenomena within a limited range, a
Oehm, 1992). Organizational characteristics such unidirectional model can be a valid simplification
as assignment of decision responsibility affect per- of bidirectional phenomena within a limited time
formance evaluations (Map G), but it seems pos- frame.
sible that performance evaluations also affect A well-established way of conducting valid
future assignments of decision responsibility. unidirectional empirical studies is to identify a
194 J. Luft, M.D. Shields / Accounting, Organizations and Society 28 (2003) 169–249

variable that can be treated as exogenous because model form and in collecting and analyzing quan-
its response to other variables is too slow to be titative or qualitative evidence. In both long-
captured within the time frame of the study—i.e. itudinal and cross-sectional studies, collecting
the Y ! X causal interval is longer than the evidence about an effect before its cause has had
study’s time frame but the X ! Y interval is not time to act fully, or after effects in the reverse
(James, Mulaik, & Brett, 1982; Kozlowski and causal direction have begun to occur (i.e. the pro-
Klein, 2000; Simon, 1973). For example, if orga- posed effect has begun to influence the proposed
nizational structure changes much more slowly in cause) can lead to invalid conclusions. Collecting
response to management accounting than man- evidence for a time frame shorter than the causal
agement accounting changes in response to orga- interval can yield misleading results, for example,
nizational structure, then organizational structure with management accounting changes that gen-
can be treated as the exogenous variable within a erate short-term profit effects and longer-term
limited time frame, since it is not significantly resistance as employees eventually find ways of
influenced by management accounting during the subverting them. Conversely, collecting evidence
period under consideration. If changes in organi- for a time frame that is longer than the causal
zational structure have had time to cause changes interval can result in not detecting important
in management accounting, but the changes in short-term dynamics. For example, collecting evi-
management accounting have not yet had time to dence on an organization’s management account-
cause new changes in organizational structure, ing at only two points in time, before a new
then a unidirectional organizational structure ! practice is implemented and 3 years after imple-
management accounting model can be valid mentation when the practice appears to be oper-
(James et al., 1982). ating successfully, can give an impression of easy
If a researcher is interested in the slower effect implementation even if costly problems occur in
(management accounting ! organizational struc- the intervening period.
ture in this example) or if effects in both directions The alignment of time frame and causal interval
have similar causal intervals, then a bidirectional is important for both qualitative and quantitative
model is needed. A cyclical recursive model is studies. Identifying where a narrative begins and
valid if the causal interval and time frame are ends is as important as determining how long an
matched so that, for example, evidence collected experiment should run or how many years of
about the period t to t+1 (the first interval in the archival data to collect. Additional issues arise
study’s time frame) captures the causal influence with quantitative analysis, however, because dif-
in one direction, and evidence collected about the ferent statistical methods are valid for causal
period t+1 to t+2 (the second interval in the models with different directionality and causal
study’s time frame) captures the causal influence intervals. If the causal relation between two vari-
in the other direction (e.g. the studies in the upper ables is bidirectional within the study’s time frame,
part of Map I). If the mutual influences of the two then the coefficient in a single-equation OLS
variables are simultaneous or if the causal inter- regression relating the two variables will be biased.
vals are shorter than the intervals at which evi- If bidirectional models are used, then different
dence is collected, so that influences in both statistical methods are required for the two types
directions are captured by evidence gathered at t of model: for example, two-stage least squares for
and t+1, then a reciprocal nonrecursive model is reciprocal nonrecursive models and a system of
valid (Asher, 1983; Berry, 1984). In the lower part of regressions that treat X1,t as a different variable
Map I, studies that show how multiple attributes from X1,t+1 for cyclical recursive models (Asher,
of an organization (e.g. acquisition strategy, decen- 1983; Berry, 1984; Kennedy, 1998; see also Ittner
tralization) simultaneously affect each other are & Larcker, 2001).
represented with reciprocal nonrecursive models. When the causal interval and time frame for a
Identifying the causal interval is therefore cru- study are aligned, a unidirectional model can be
cially important in choosing the valid causal- valid even when the actual relation between the
J. Luft, M.D. Shields / Accounting, Organizations and Society 28 (2003) 169–249 195

phenomena studied is bidirectional. However, Guidelines:


always using the simplifying strategy of making
the slower-changing variable exogenous creates 11. If unidirectional causality is assumed, then
artifactual disconnects in the literature as a whole. indicate the reasons for excluding bidi-
First, slower-changing variables remain unex- rectionality.
plained: we learn about their effects but not their 12. Align the time frame of the study (length
causes. Second, even if the effects of the slower- and frequency of evidence collection) and
changing variables are large, they may be unde- the causal interval (the time required for the
tectable in cross-sectional studies if the variables cause examined in the study to have an effect).
themselves vary less in contemporaneous cross-
section than across longer periods of time. For
example: 6. Levels of analysis: guidelines 13–17

 Information technology may appear a less The following sections discuss in more detail the
important cause of management account- issues of level of analysis that were initially raised
ing in a cross-sectional study of organiza- in Section 3.3. Section 6.1 introduces criteria for
tions in (say) 2000 than in a longitudinal valid single-level studies and Section 6.2 identifies
study of changes between 1950 and 2000. criteria for valid multi-level studies.
Once variables like industry have been
controlled for, there may be too little var- 6.1. Single-level studies
iation in the 2000 sample to detect much
effect of information technology even if it is As noted in Sections 3.2 and 4.1, variables with
a very powerful cause of management the same or very similar names are often studied at
accounting. different levels of analysis, and it is not clear whe-
 Factors that explain why executive com- ther the meanings of the variables at different
pensation is higher in some organizations levels are identical. This phenomenon occurs else-
than others in 2000 may not be equally where in the social sciences, as well as in manage-
successful in explaining why real executive ment accounting research; for example:
compensation is higher in 2000 than in
1950. For example, would current relative Is worker participation an individual-level
levels of compensation have been socially phenomenon, describing the influence an
acceptable in 1950? Are the institutional individual exerts in unit decisions? Or is
mechanisms for determining compensa- worker participation at the unit level,
tion the same in 1950 and 2000? Social describing a set of formal structures and work
norms and institutional mechanisms are practices (for example, quality circles) char-
relatively constant in the 2000 sample and acteristic of units, not individuals?
so have no detectable effect, but a long- (Kozlowski & Klein, 2000, p. 27)
itudinal study might show substantial
effects. Similarly, subunit manager performance can be an
individual-level variable if it captures performance
Although cross-sectional variation in variables differences among different managers in the same
like information technology and social norms can or similar subunits; or it can be a subunit-level
be increased by increasing the heterogeneity of the variable if it captures performance differences
sample (e.g. samples including countries with among the same or similar managers assigned to
more diverse social norms or industries with subunits that differ with respect to characteristics
diverse technologies), this sampling strategy also such as technology or budget practices.
increases the possibility of confounds between the If the study is intended to examine causes and
variable of interest and other variables. effects at a single level of analysis only, then care
196 J. Luft, M.D. Shields / Accounting, Organizations and Society 28 (2003) 169–249

needs to be taken to insure that these causes and in an organization should be evaluated qualitatively
effects are not confounded with causes and effects in comparison to others. Quantitative responses
at other levels. These confounds are particularly from multiple individuals in an organization can
hazardous when variables at different levels have be averaged to remove individual-level ‘‘noise,’’
the same name but have different causes and thus using the level of data analysis to insure that
effects at different levels of analysis: in such cases, the level of variable measurement (individual)
a theory explaining a variable at one level may not does not result in conclusions out of alignment
provide a valid basis for a study of the variable with the level of theory (organizational).
with the same name at another level. For example, The effective sample size can vary depending on
the reasons why perceived uncertainty varies a study’s level of analysis. Consider, for example,
across industries (e.g. cross-industry variation in 40 organizations in four industries with 4000
competition or technology) are different from the employees. If the use of management accounting
reasons why perceived uncertainty varies across varies systematically across individuals within
individual managers within an industry or organi- organizations and the theory employed in the
zation (e.g. individuals’ knowledge or attitudes). study explains these differences across individuals,
In order to provide valid theory-consistent then management accounting is an individual-level
empirical evidence, the following choices must be variable and the available sample size is 4000. If
aligned (Hannan, 1991; Klein et al., 1994; the use of management accounting varies system-
Kozlowski & Klein, 2000; Rousseau, 1985): atically across organizations and the theory
employed in the study explains these differences
 Level of theory: what is being explained? across organizations, then management account-
 Level of variable measurement: what is the ing is an organizational-level variable and the
source of evidence? sample size is forty. If the use of management
 Level of data analysis: what is treated as an accounting varies systematically across industries
independent datum for purposes of analy- and the theory employed in the study explains
sis—an individual observation, a group these differences across industries, then manage-
mean, etc.?13 ment accounting is a beyond-organization (indus-
try) variable and the sample size is four (Klein et
If a study does not align these three choices of al., 1994; Rousseau, 1985).
level, a valid theory may not be supported or an
invalid theory may appear to be supported 6.2. Multiple-level studies
because the variable measurement and data ana-
lysis do not provide evidence on the chosen theory Much of the evidence collected on management
(Klein et al., 1994). accounting (e.g. organizational performance)
At any level of analysis, evidence may be gath- results from causes at multiple levels (e.g. indivi-
ered from individuals: that is, individuals may be dual, subunit, organization, beyond-organization).
the source of the evidence. If the theory is at a The observable measure that is available for a
higher level than the individual level, then various variable is therefore often an aggregate of theore-
actions can be taken in collecting and analyzing tical effects at multiple levels. Researchers then
evidence to insure that variable measurement and depend on data analysis to distinguish effects at
data analysis are aligned with the level of theory. different levels, either because they are interested
For example, if the variation of interest is at the in more than one level or because they want to
organizational level, evidence collection (e.g. separate the effect at the level that interests them
interview or survey questions) should be designed from the effects at other levels. Consider, for exam-
to capture organizational, not uniquely individual, ple, subunit managers’ performance as indicated
characteristics; and responses from one individual either by a subjective evaluation or by the profits
of the subunits they manage. Subunit-manager
13
Level of data analysis is also called unit of analysis. performance may include an industry-level effect

You might also like