You are on page 1of 27

Innovation management

81O
XX RIGINAL
Innovation
Blackwell
Oxford,
International
IJMR
©
1460-8545
Blackwell
UK ARTICLE
management
Publishing
Publishing
Journal of
Ltdmeasurement:
Management
Ltd 2006 A review
Reviews

measurement: A review
Richard Adams,1 John Bessant and Robert Phelps

Measurement of the process of innovation is critical for both practitioners and academics,
yet the literature is characterized by a diversity of approaches, prescriptions and practices that
can be confusing and contradictory. Conceptualized as a process, innovation measurement
lends itself to disaggregation into a series of separate studies. The consequence of this is the
absence of a holistic framework covering the range of activities required to turn ideas into
useful and marketable products. We attempt to address this gap by reviewing the literature
pertaining to the measurement of innovation management at the level of the firm. Drawing
on a wide body of literature, we first develop a synthesized framework of the innovation
management process consisting of seven categories: inputs management, knowledge
management, innovation strategy, organizational culture and structure, portfolio management,
project management and commercialization. Second, we populate each category of the
framework with factors empirically demonstrated to be significant in the innovation process,
and illustrative measures to map the territory of innovation management measurement. The
review makes two important contributions. First, it takes the difficult step of incorporating
a vastly diverse literature into a single framework. Second, it provides a framework against
which managers can evaluate their own innovation activity, explore the extent to which their
organization is nominally innovative or whether or not innovation is embedded throughout
their organization, and identify areas for improvement.

Ernst 2002; Globe et al. 1973; Griffin 1997;


Measuring the Management of
Rothwell 1992).
Innovation
Quantifying, evaluating and benchmarking
A considerable literature has accumulated innovation competence and practice is a sig-
on the subject of innovation, which is widely nificant and complex issue for many contem-
seen as the basis of a competitive economy porary organizations (Frenkel et al. 2000). An
(Porter and Ketels 2003). This literature important challenge is to measure the com-
includes evidence that competitive success is plex processes that influence the organiza-
dependent upon an organization’s manage- tion’s innovation capability, in order that they
ment of the innovation process and proposes can be optimally managed (Cordero 1990).
factors that relate to successful manage- The measurement of innovation is also import-
ment of the innovation process (cf. inter ant from an academic research perspective.
alia Balachandra and Friar 1997; Cooper Unless constructs relating to the phenomenon
1979a,b; de Brentani 1991; Di Benedetto 1996; are measurable using commonly accepted
© Blackwell Publishing Ltd 2006, 9600 Garsington Road, Oxford OX4 2DQ, UK and 350 Main Street, Malden, MA 02148, USA

International Journal of Management Reviews Volume 8 Issue 1 pp. 21–47 21


Innovation management measurement: A review

methods, there is a risk that different opera- ontological and epistemological positions to
tionalizations of the same effect will produce investigate, analyse and report on a phenome-
conflicting findings, and that theoretical non that is complex and multidimensional
advances become lost in the different termi- (Wolfe 1994). More specifically, this diversity
nologies that resist the accumulation of is reflected in the multitude of approaches
knowledge. to measurement and the number of different
Within the literature on the management of measures that can be found. It is difficult to
innovation, measures of aspects of innova- identify a bounded body of literature in which
tion management are frequently proposed, a comprehensive discussion of innovation
responding to the needs of both firms and measurement issues might be located. Repre-
academics to understand the effectiveness senting this diversity within a synthesized
of innovation actions (Barclay 1992; Kim and framework is a challenging task.
Oh 2002). However, their treatment is frag- Indeed, the term ‘innovation’ is notoriously
mented. It is possibly a consequence of this ambiguous and lacks either a single definition
fragmentation that empirical studies have or measure. We chose to adopt the UK Depart-
found many organizations tend to focus only ment of Trade and Industry’s (DTI 1998)
on the measurement of innovation inputs and broad definition of innovation, ‘the successful
outputs in terms of spend, speed to market exploitation of new ideas’, to guide our
and numbers of new products, and ignore the review, because it accommodates the range of
processes in-between (Cordero 1990). A gen- innovation types (product/service, process,
eralized measurement framework specified administrative, technological, etc.) that one
at the level of the organization would provide might reasonably expect to encounter in an
a useful basis for managers to monitor and organization. This holistic approach is clearly
evaluate their innovation processes, diagnose important from the practitioner’s perspective,
limitations and prescribe remedies (Cebon and as it obviates the need to collate measures on
Newton 1999). In an attempt to extend meas- a piecemeal basis from a diverse literature.
urement theory and practice beyond a focus So, while this review is broadly specified, its
on output performance, this paper reviews the breadth presents a number of methodological
literature as it relates to the measurement of challenges. We address these challenges by
innovation management in the context of a employing the approach of an adapted sys-
conceptual framework of process that pro- tematic review.
vides the basis for a general measurement The notion of systematic review has
framework. We bring together disparate sug- recently gained currency in the management
gestions for innovation management measure- literature (Denyer and Neely 2004), and the
ment made in various parts of the literature strategy for this review followed, in many
and summarize commonly used measures at respects, the methodology detailed by Tran-
different stages of innovation management. field et al. (2003). They state that systematic
We identify gaps in measurement theory and reviews include: development of clear and
practice and point the way toward the devel- precise aims and objectives; pre-planned
opment of a comprehensive set of innovation methods; comprehensive search of all poten-
management measures. tially relevant articles; use of explicit, repro-
ducible criteria in the selection of articles for
review; appraisal of the quality of the research
Developing an Analytic Framework for
and the strength of the findings; synthesis of
Innovation Management Measurement
individual studies using an explicit analytic
The innovation literature is a fragmented framework; and balanced, impartial and com-
corpus, and scholars from a diversity of prehensible presentation of the results. Our
disciplinary backgrounds adopt a variety of review strategy broadly adopted this model,

22 © Blackwell Publishing Ltd 2006


March 2006

but with some changes to suit the exigencies respondents were contacted by e-mail and asked
of our question and data sources, notably: first, to respond to a series of questions relating to
the inclusion of a Delphi study and, second, a innovation metrics at the level of manage-
relaxation of the requirement for reproducible ment practice, particularly addressing aspects
criteria for document selection and appraisal. of measuring the existence and effectiveness
The authors formed a review panel consist- of the innovation management process.
ing of domain-relevant experts from a range There was a high degree of consensus in the
of disciplines with an interest in both innova- 28 responses received. All respondents recog-
tion and measurement. Time was spent outlin- nized the existence of a plethora of extant
ing the research project, which was articulated measures, obviating the need for new meas-
in terms of the fragmented world of com- ures to be developed. Specifically, an absence
peting and contradictory measures addressing of measures well aligned to the activities of
the issue of the management of innovation. the innovation process was noted. Further,
Rather than attempting to generate an exhaus- our attention was drawn to the absence of
tive list, our objectives were defined in terms devices to help identify the appropriate
of the collation and synthesis of measures, metrics to apply.
better reflecting the needs of academics and Systematic review stresses the importance
practitioners: we ask ‘What are the measures of an audit trail in the review process to
that have been used, and to what extent do ensure clarity and replicability. Significant to
they adequately populate and dimensionalize this is the use of explicit, reproducible criteria
a comprehensive analytic framework?’ in the selection of articles for review and, an
McManus et al. (1998), reflecting upon sys- appraisal of the quality of the research and the
tematic review, identified the limitations of strength of the findings (Tranfield et al. 2003).
searching electronic databases as sometimes However, regardless of a study’s methodology
uncovering only half the relevant studies. They or generalizability, it might still incorporate
attribute this in part to a lack of sensitivity of measures of innovation management that could
electronic databases. Indeed, this may account contribute to the construction of a measure-
for the disappointing outcome in terms of ment framework, and so grey literature is
breadth that Leseure et al. (2004) report from included in this review. As we were not
their search of electronic databases for litera- reviewing an evidence base in the normally
ture relating to the adoption of promising accepted use of the term, quality criteria as
practices. Compensating strategies include used in previously published systematic reviews
either hand searching of journals (which we in the management literature (e.g. Leseure
had to discount on the grounds of time and et al. 2004; Pittaway et al. 2004), in which the
cost) or consultation with appropriate experts value of the evidence base is determined by
(McManus et al. 1998). The latter are partic- assessed levels of theory robustness, method-
ularly important when ‘performing a system- ology, implications for practice, generalizability
atic review in a developing field that does not and contribution, were felt not to be wholly
have a clearly defined specialist literature’ relevant in this case. We instead adopted a
(McManus et al. 1998, 1563). Using the Del- position akin to Glaser and Strauss’s (1967)
phi method, a process consisting of structured notion of ‘theoretical saturation’ which is
design for group communication relating to achieved when
complex problems (Linstone and Turoff 2002),
we extended our consultation process to no additional data are being found whereby the
incorporate the input of external experts. researcher can develop properties of the category.
A list of global experts in innovation and As he sees similar instances over and over again,
measurement (n = 100) based on the knowledge the researcher becomes empirically confident that
of the review panel was developed. Potential a category is saturated … when one category is

© Blackwell Publishing Ltd 2006 23


Innovation management measurement: A review

Table 1. Review strategy generated in the context of technology, and so


generalizability is constrained; third, with a
Step 1 Establish review team and scope and nature
of the question and search strings
focus on activities, models fail to take account
Step 2 Undertake Delphi investigation of the organizational pervasiveness of innova-
Step 3 Preliminary search of electronic databases tion and its socio-technical connectedness with
Step 4 Develop analytic framework
Step 5 Secondary search of electronic databases and
all aspects of the organization, or the levels
Delphi study of integration envisaged in Rothwell’s (1992)
Step 6 Content analysis of data set, sorting of fifth-generation process model. Finally, while
measures into first order categories defined
by the analytic framework
the range and sequence of activities may vary
Step 7 Review measures against framework for gaps across organizations and projects, their success-
ful management is affected by a number of
factors. Cebon and Newton (1999) call this
saturated, nothing remains but to go on to new
the ‘capacity to make change’, about which
groups for data on other categories, and attempt to
the literature generally is relatively silent
saturate these categories also. (Glaser and Strauss
(Neely and Hii 1998). Based on a review of
1967, 65)
models, we propose a seven-factor framework
of meaningful categories specified in terms of
That is, the incremental contribution of further the requisite organizational capabilities to
sampling is marginal and fails to add significant make and manage change (see Table 2).
value. The steps of our review are presented in In a review of the factors associated with
Table 1. new product development (NPD) success, Ernst
A plethora of studies operationalize meas- (2002) echoes Cooper and Kleinschmidt’s
ures of aspects of innovation management; (1995) influential five techno-centric factors
however, to provide some synthesis and iden- for new product performance: NPD process,
tify gaps, agreement regarding the nature of NPD strategy, organization, culture and manage-
innovation management is needed. The litera- ment commitment. This model, though, over-
ture lacks such consensus. The concept is fre- looks innovation in non-technical contexts
quently disaggregated into component parts, and other important factors such as the role of
and scholars adopt their own partial views. As knowledge (Leonard and Sensniper 1998).
a result, the operationalization of measures is In their technical innovation audit tool,
frequently idiosyncratic, owing more to the Chiesa et al. (1996) describe process and
predilections of the researcher and the exigen- performance as the two foci of innovation
cies of the data than to the overarching objec- management measures. They overlay ‘core
tives of synthesis or cumulation. To organize, processes’ with a set of ‘enabling processes’,
compare and contrast such measures, we pro- the latter describing the deployment of
pose a typology of elements of the innovation resources, and the effective use of appropriate
management process. systems and tools governed by top manage-
Many scholars have sought to identify the ment leadership and direction. Finding this
key activities of the innovation management applicable only to ‘hard’ innovations, Ver-
process (Wolfe 1994), some of which are pre- haeghe and Kfir (2002) extended the audit
sented as linear models (e.g. Daft 1978), and tool to an investigation of the processes that
others that are dynamic and recursive charac- support and enable both ‘hard’ and ‘soft’ (e.g.
terized by feedback and feed-forward loops a research or consultancy project) innovation.
(e.g. Schroeder et al. 1989). While useful, The changes they made may appear semantic,
these models are limited from a measurement for instance relabelling ‘process innovation’ as
perspective: first, there are many competing ‘technology transfer’. However, the important
models with consensus only evident at abstract implication is that the study extends the appli-
levels; second, models have principally been cation of the instrument to service contexts.

24 © Blackwell Publishing Ltd 2006


© Blackwell Publishing Ltd 2006

Table 2. Innovation management models and organizing framework

Cooper and Chiesa Cormican and Goffin and Verhaeghe and


Kleinschmidt (1995) et al. (1996) O’Sullivan (2004) Pfeiffer (1999) Burgelman et al. (2004) Kfir (2002)

Inputs Creativity and Resource availability Idea generation


human resources Technology acquisition
Knowledge Resource Understand relevant technological Networking
management provision developments and competitor
strategies
Strategy NPD strategy Strategy and Innovation Strategic management
leadership strategy
Organization and Organizational Leadership Culture and Structural and cultural context of
culture culture climate the organization
Management
commitment
Portfolio NPD process Systems Planning and Portfolio
management and tools selection management
Project management Communication Project Development
and collaboration management
Commercialization Structure and Commercialization
performance

March
2006
25
Innovation management measurement: A review

Furthermore, they explicitly bounded their Table 3. Innovation management measurement


model with notions of inputs and commercial- areas
ized outputs.
Framework category Measurement areas
Cormican and O’Sullivan (2004, 820), reflect-
ing earlier studies’ coverage of the organization Inputs People
of innovation, conceive of product innovation Physical and financial resources
Tools
as a continuous and cross-functional process Knowledge Idea generation
‘involving and integrating a growing number management Knowledge repository
of different competencies [inside the organiza- Information flows
Innovation strategy Strategic orientation
tion]’. So, effective management of the process Strategic leadership
requires successful adoption and adaption of a Organization and Culture
socio-technical systems approach to all aspects culture Structure
Portfolio Risk/return balance
of the organization, critically including people management Optimization tool use
and process as well as technology-related Project management Project efficiency
issues. Tools
Communications
While there are areas of commonality Collaboration
across these innovation management models, Commercialization Market research
no one model covers every dimension. This Market testing
Marketing and sales
suggests a need for a synthetic and integrative
framework to promote comparability and to
enable future work to build on results found in
previous studies. In column 1 of Table 2, we The construct research and development (R&D)
present such a framework derived from a intensity has frequently been used as a global
synthesis of the studies presented in the other measure of input. Typically, it is expressed as
columns of the table. The framework consists a ratio between expenditure (e.g. Parthasarthy
of seven categories: inputs, knowledge manage- and Hammond 2002) or numbers employed
ment, strategy, organization and culture, port- in R&D roles (Kivimäki et al. 2000) and some
folio management, project management and expression of output. The relationship between
commercialization. R&D intensity and firm or innovation per-
In the following sections, we use these seven formance has been empirically demonstrated
inductively derived categories as the organiz- in several studies (e.g. Deeds 2001; Greve
ing framework for a discussion of innovation 2003; Parthasarthy and Hammond 2002).
management measurement. For each of these However, there is some equivocality in the lit-
categories, we review the diverse literature erature. Stock et al. (2001) note an inverted-U
relevant to the measurement of that typological relationship between R&D intensity and NPD
category. Within each category, a series of sub- performance, and Bougrain and Haudeville
dimensions of measurement focus are identi- (2002) point out that it does not influence the
fied, reflecting the distinctions and emphases future prospects of a project and is, indeed, an
in the literature (see Table 3). imperfect measure of innovation activity.
Further, R&D is only one of several inputs into
the innovation process and, therefore, cannot
Measures of Innovation Management be regarded as an adequate proxy; it also does
not appear to be a very useful measure for
Inputs Management
small and medium-sized enterprises (SMEs),
Inputs management is concerned with the which may not have formal R&D activities or
resourcing of innovation activities and includes may not record them (Kleinknecht 1987), or,
factors ranging from finance, to human and indeed, for service industries, which tend to have
physical resources, to generating new ideas. low R&D intensity (Hipp and Grupp 2005).

26 © Blackwell Publishing Ltd 2006


March 2006

High levels of R&D intensity are therefore collaborative relationships can emerge and add
not necessarily evidence of good innovation significant value to innovation outcomes.
practice: they may simply mask process inef- Although Baldridge and Burnham (1975) argue
ficiencies (Cebon and Newton 1999; Dodgson that demographic characteristics (sex, age,
and Hinze 2000). However, adequate funding cosmopolitanism, education) do not appear
is clearly a critical input into the innovation to influence innovative behaviour among
process. Expenditure data have long been a individuals, more recent research suggests that
popular proxy measure of innovation input, innovating groups should comprise individuals
largely because of their ready availability. with a mix of these characteristics (Amabile
Several different approaches, both qualitative 1998). Members with high levels of education
and quantitative, to measuring funding can and self-esteem increase the effectiveness of
be identified: total expenditure, expenditure R&D project teams (Kessler and Chakrabarti
expressed as a proportion of sales or revenues, 1996), and individuals of greater educational
and expenditure by item (organizational depart- attainment with diverse backgrounds have
ment, patent, innovation or scientist) (Geisler been associated with more innovative teams
1995; Oliver et al. 1999). Also, there is a (Bantel and Jackson 1989).
series of perceptual measures that attempt to The propensity of an individual to innovate
determine the adequacy of funding (Atuahene- has received considerable attention, though it
Gima 1995). Measures, though, tend princi- is difficult to measure. Kirton (1976) devel-
pally to be quantitative and express little other oped a 32-item questionnaire designed to
than funding level; in particular, few measures establish an individual’s position on an
attempt to determine the adequacy of funding ‘adaptor–innovator’ continuum. Scott and
for the innovation project. Kerssens-van Bruce (1994) operationalized an ‘innovative
Drongelen and de Weerd-Nederhof (1999) behaviour measure’ consisting of six items
point to a lack of measurement procedures against which subordinates are measured by
to help managers diagnose poor innovation hierarchical superiors. Finally, the Innovation
performance or support improvement. Potential Indicator (Patterson 2003) provides
A more helpful measure of inputs may a framework for investigating individual
therefore be obtained by disaggregating inputs behaviours that might promote or inhibit
into different types and measuring each inde- innovation in the workplace. This measure
pendently, before aggregating back to a meas- is constructed around four dimensions: an
ure of overall inputs management. Brown and individual’s motivation to change, challeng-
Svenson (1988, 30) define the inputs into the ing behaviour, preferred approach to work,
R&D system as ‘the raw materials or stimuli and preference for tried and trusted
a system receives and processes’, including methods of work as opposed to doing things
people, equipment, facilities and funds. This differently.
fundamental distinction between people, tools Facilities, or physical resources, is a broad
and physical and financial resources is widely category that captures a range of inputs from
mirrored in the literature. buildings to computer equipment. Physical
People factors have been measured as the resources can be counted or measured in
number of people committed to the innovation dollar terms. However, one important general
task (absolute numbers and relative to total measure of facilities, which cannot be so read-
employees), in terms of the mix of types of ily measured, is slack. Slack resources or
people regarding cosmopolitanism and pro- unused capacity can be regarded as an import-
pensity to innovate and, in terms of skills, ant catalyst for innovation. Slack allows
experience and education. Damanpour (1991) failures to be absorbed, provides the opportu-
argues that a diversity of skills and experience nity for diversification, and fosters a culture
permits more differentiated units from which of experimentation and protects against the

© Blackwell Publishing Ltd 2006 27


Innovation management measurement: A review

uncertainty of project failure (Kimberly 1981).


Knowledge Management
An alternative view, however, suggests a nega-
tive relationship: slack can become synonymous Knowledge absorption, an organization’s
with waste and represents a cost that should be ability to identify, acquire and utilize external
eliminated (Nohria and Gulati 1996). Typically, knowledge, can be critical to a firm’s success-
financial measures of slack are used (Daman- ful operation (Zahra and George 2002). The
pour 1991), although Miller and Friesen (1982) concept of knowledge has received much
use both financial and human measures of attention in recent years (e.g. Blackler 1995;
slack. McAdam 1999; Nonaka 1991) and has been
Use of systems and tools is an important asserted to play a critical role in the innova-
input to the innovation process (Bessant and tion process (Hull et al. 2000). Knowledge
Francis 1997; Cooper et al. 2004). Measures management is concerned with obtaining
identified tend to relate to whether or not the and communicating ideas and information
organization has or makes use of formal sys- that underlie innovation competencies, and
tems and tools in support of innovation. These includes idea generation, absorptive capacity
can be of various sorts, such as the availability and networking. Knowledge management
and use of tools and techniques for promoting covers the management of explicit and
creativity (Amabile 1998; Rickards 1991; implicit knowledge held by the organization
Rochford 1991; Thompson 2003) or the avail- (Davis 1998; Nonaka 1991) as well as the
ability and use of systems of quality control processes of gathering and using informa-
ranging from informal methods to specific tion. The three areas within knowledge
techniques such as total quality management management of importance for innovation
(TQM) (Souitaris 2002). While tool use can management identified in the literature
be evaluated on a binary or degree of use scale, are: idea generation, knowledge repository
there is little other than Chiesa et al.’s (1996) (including the management of implicit
technical innovation audit that attempts to and explicit knowledge) and information
measure whether or not tool use is consistent flows (including information gathering and
with a firm’s innovation requirements and is networking).
integrated into its processes. The importance of generating sufficient
We conclude that, while there has been a numbers of ideas has been well established in
concentration on financial measurement of the literature. Ideas are the raw materials for
inputs, there is less emphasis on measuring innovation; it is relatively inexpensive to
other aspects of the category. Even within generate and screen ideas, yet this can have
financial measures, there are few that attempt significant impact on ultimate success or
to determine the adequacy of funding for the failure (Cooper 1988). Several authors have
innovation project. Further, most measures conceptualized the early stages of the innova-
reflect a preoccupation with R&D and NPD tion process as a somewhat fuzzy period
rather than other forms of innovation (e.g. (Kim and Wilemon 2002; Moenaert et al.
process, business model). In particular, the 1995; Verworn 2002), including opportunity
softer inputs of skills and knowledge are identification, opportunity analysis, idea gen-
poorly represented by measurement instru- esis, idea selection and concept development
ments. Tacit knowledge input appears not to (Koen et al. 2001).
be well captured by extant measures, and no At the commencement of the innovation
measures of appropriate skill levels have been process, when ideas are generated and
developed. This is an imbalance that needs explored, measures tend mostly to be quanti-
to be addressed by further work to develop tative, inexpensive and rapid. As the process
a balanced set of measures covering all progresses and uncertainties with regard to
sub-dimensions of the input category. appropriateness, feasibility and business case

28 © Blackwell Publishing Ltd 2006


March 2006

are reduced, measurement approaches become Several quantitative approaches have been
increasingly qualitative and possibly more developed for the measurement of imported
costly and time-consuming to deploy. Meas- tangible knowledge. The most frequently used
ures imply an assumption that the objective is approach counts numbers or value of patents
to generate as many ideas as possible through brought in. However, this restricts its applica-
the use of generative tools. Several measures tion to contexts in which patents are signifi-
attempt to count the number of ideas gener- cant, and overlooks those industries where
ated in a period (cf. Chiesa et al. 1996; Lee they do not feature. For a while, patent data
et al. 1996), while others probe the extent to was widely accepted as a proxy measure for
which organizations are using different gener- innovation. More recently, however, the valid-
ative tools and techniques (cf. Cebon and ity of patent statistics has been questioned:
Newton 1999; Chiesa et al. 1996; Loch et al. patents vary in their utility for organizations,
1996; Rochford 1991; Szakonyi 1994; and so their input value to the innovation can-
Thompson 2003). not adequately be judged in terms of a cash
If knowledge is fundamental to innovation, price (Griliches 1990; Pakes and Griliches
then it should be possible to measure the 1980). Only a few studies have attempted to
accumulated knowledge of the firm, its devise measures for other contexts. For exam-
knowledge repository. One aspect of innova- ple, Kleinknecht (1987) constructed a ques-
tion relates to combinations of new and tion designed to capture the informal hours of
existing knowledge, which privileges the con- R&D work that are hypothesized to be hidden
tribution of internal and external knowledge within other activities or to take place outside
and the mechanisms by which it flows into formal working hours.
and within an organization (Galunic and Patents represent codified knowledge, but
Rodan 1998; Nonaka and Takeuchi 1995; Pitt the importance of tacit knowledge to organi-
and Clarke 1999). Central to this perspective zational innovation is underscored in the
is the idea of ‘absorptive capacity’, the firm’s resource-based approach (Barney 1991; Galu-
ability to absorb and put to use new knowledge, nic and Rodan 1998; Grant 1991; Leonard
and involving ‘an ability to recognize the and Sensiper 1998). Tacit knowledge is an
value of new, external knowledge, assimilate important resource when it is has value for the
it, and apply it to commercial ends’ (Cohen organization, is difficult for competitors to
and Levinthal 1990, 128). Absorptive capacity imitate, is rare, and can be operationalized by
results from a prolonged process of invest- the organization. Of particular importance is
ment and knowledge accumulation within the its acquisition and use (Bess 1998). It can be
firm, and its development is path dependent. acquired opportunistically or by a deliberate
Firms with strong absorptive capabilities are policy of search.
more likely to acquire knowledge and learn Tacit knowledge is notoriously difficult to
effectively from outside. Higher levels of measure in organizational research, and
absorptive capacity appear to be positively methodologies for its investigation and
related to innovation and performance (Chen measurement can be complex. Ambrosini
2004; Tsai 2001), but it is impossible to and Bowman (2001), for example, propose
predict what is the ‘right’ level of investment an approach that consists of causal mapping
in absorptive capacity for any individual facilitated by story-telling and the use of meta-
firm (Cohen and Levinthal 1990), meaning phor. Other attempts to capture tacit know-
that it is not readily amenable to interna- ledge and group memory have been reported
tional benchmarking. However, the conceptual by Oliver et al. (1999). At the level of the
development and empirical studies infer or organization, Sveiby (1997) suggests the
imply a range of organizational knowledge difference between market value and net
states. book value as an indicator of the value to an

© Blackwell Publishing Ltd 2006 29


Innovation management measurement: A review

organization of intangible knowledge assets.


Innovation Strategy
The first method is resource intensive, while
in the second it is not clear how much of the Ramanujam and Mensch (1985) define
identified value can be attributed to inputs into innovation strategy as a timed sequence of
innovation. Tacit knowledge input appears not internally consistent and conditional resource
to be well captured by extant measures. allocation decisions that are designed to fulfil
Information flows into and within the firm an organization’s objectives. Activities must
are important in sparking ideas and in allow- be consistent with an overarching organiza-
ing the development of innovative concepts. tional strategy that implies that management
Three measurement approaches to informa- must take conscious decisions regarding
tion flows can be identified: first, measures of innovation goals (Sundbo 1997). Innovation
the linkages that the innovating group main- strategy is generally understood to describe an
tains with external organizations and sources; organization’s innovation posture with regard
second, measures of internal information to its competitive environment in terms of its
gathering processes. Third, measures of cus- new product and market development plans
tomer information contacts. (Dyer and Song 1998). This techno-centric
Linkage measures determine whether or not view predominates in the literature and
the organization has and maintains external overlooks those innovative initiatives that are
linkages with other organizations or sources internally focused (for example, the adoption
of information, e.g. through participation in of new management techniques and prac-
research projects, university links or attend- tices). In the conceptualization of innovation
ance at trade shows (Atuahene-Gima 1995; strategy as an articulation of the organization’s
Tipping and Zeffren 1995). These are princi- commitment to the development of products
pally dichotomous measures, only infre- that are new to itself and/or to its markets,
quently is there a measure that implies some and because strategy does not operate in a
sort of qualitative assessment of the nature of vacuum, but requires a structural context, two
the linkages. Cebon and Newton’s (1999) complementary approaches to its measure-
measures suggest that quality and diversity of ment, which have been described as objective
linkage might be an important factor, for and subjective (Li and Atuahene-Gima 2001),
example, visits to exemplary projects. can be identified.
Statistics on the use of formal methods of In the literature, scholars principally have
information gathering such as project reviews adapted measures from strategic management
and the use of technical reports (Oliver et al. research to explore the existence, nature and
1999) provide a frequently used approach to extent of innovation strategy. Richard et al.
the measurement of information gathering. (2003) use three scale items drawn from the
Cebon and Newton (1999) suggest bench- strategic posture scale devised by Covin and
marking information gathering against com- Slevin (1989), who, in turn, draw on Miles
petitors’ activities, to gauge how well the and Snow’s (1978) ‘prospectors’ and Mintz-
activity is performed. Another important area berg’s (1978) ‘entrepreneurial’ organizations,
about which a firm needs understanding and for their assessment of bank innovativeness.
information is customers; Atuahene-Gima These studies classify organizations based on
(1995) lists a series of measures specifically their approach to innovation using classifica-
aimed at examining the extent to which organ- tions that are ontologically grounded in the
izations make use of customers as a source of assumption that innovation orientation can be
information, and include measures assessing deciphered from quantitative interpretations
the adequacy of information and customer of new product and market activity.
contact time (Lee et al. 1996; Miller and Other objective evidence of an organization’s
Friesen 1982). innovation strategic posture may include many

30 © Blackwell Publishing Ltd 2006


March 2006

of the input measures (such as level of R&D Friesen 1982) and identifiable roles for new
expenditure) that we have already discussed. products and services (Cooper and Klein-
It is argued that it is not their absolute magni- schmidt 1990; Geisler 1995; Hauser and
tude but their magnitude relative to industry Zettelmeyer 1997; Tipping and Zeffren 1995).
rivals that is significant. As has been noted, The second type of measure regards strategy
although these may be useful indicators of as a dynamic instrument that shapes and
commitment or intent, they could mask pro- guides innovation in the organization. These
cess inefficiencies. However, O’Brien’s (2003) measures assume that strategy exists and asks
observation that an interaction between questions about how effective it is in shaping
intended strategy and slack will influence per- and guiding: ‘are structures and systems
formance suggests that process inefficiencies aligned’ (Bessant 2003), ‘do innovation goals
are less likely to occur where an innovation match strategic objectives’ (Tipping and
strategy is not merely nominally adopted, but Zeffren 1995) and further similar measures of
is embedded in the culture, behaviours and strategic fit (Bessant 2003).
actions of the organization. From a strategic leadership perspective,
In Li and Atuahene-Gima’s (2001) terms, Dougherty and Cohen (1995) found the
the evidence for an embedded innovation behaviour of senior managers to be influential.
strategy is subjective and may include evalua- Those chief executives most likely to make
tions of an organization’s emphasis on NPD, innovation happen are those with a clear
such as resource allocation. Saleh and Wang vision of the future operation and direction of
(1993) describe this as consisting of three organizational change and creativity (Shin and
main components: risk-taking, proactiveness McClomb 1998). Senior management are
and persistent commitment to innovation. responsible for developing and communicat-
These include top management responsibility ing a vision for innovation, being supportive
for innovation within the organization, includ- and adopting an attitude tolerant to change
ing specifying and communicating a direction and championing the notion of innovation
for innovation. Cooper (1984) demonstrated within the organization. Managerial tolerance
that new product performance is largely to change creates the right climate for the
decided by the strategy that top management implementation stage of innovation, where
adopts. The key components are the link conflict resolution might be necessary
between innovation strategy and overall busi- (Damanpour 1991).
ness goals (strategic orientation) and the Managerial attitude is also reflected in
provision of leadership to make innovation norms or support for innovation. These are the
happen via a strong vision (Pinto and Prescott expectation, approval and practical support of
1988) for innovation, a long-term commit- attempts to introduce new and improved ways
ment to innovation and a clear allocation of of doing things in the work environment.
resources (Cooper et al. 2004). This distinc- Measures are mostly qualitative in nature and
tion between strategic planning or orientation explore perceptions, mostly about the extent
and strategic vision or leadership is frequently to which respondents recognize factors to be
replicated in the literature. present (or absent).
Two distinct types of strategic orientation Relatively few measures of championing
measures can be identified in the literature. and leadership have been uncovered in this
First, those that measure whether the organi- review other than those that simply ask the
zation has an innovation strategy; this can be question whether or not one or other exists,
evaluated in several ways, such as commit- perhaps through evidence of signs of commit-
ment to differentiated funding (White 2002), ment in annual reports (Chiesa et al. 1996) or
explicit expression (does the organization levels of concern of top management (Coughlan
have an innovation strategy?) (Miller and et al. 1994) or whether or not an individual

© Blackwell Publishing Ltd 2006 31


Innovation management measurement: A review

has been physically assigned to a particular realignment of the fit between strategy and
role (Souitaris 2002). Shane et al. (1995) pro- structure. That is, to perform effectively, an
vide a series of reflective questions designed organization must be appropriately differenti-
to allow organizations to determine for them- ated, specialized and integrated. Pugh et al.
selves their expectations and understanding (1969) argued that the structure of an organi-
of the role of champion. For example, ‘to what zation is strongly related to the context within
extent should the organization make it possible which it functions. Our closing discussion in
for the people working on an innovation to the previous section, that the characteristics of
bend the rules of the organization to develop organizations following an innovation-focused
the innovation, or be allowed to bypass certain strategy will differ from those that do not, is
personnel procedures to get people committed consistent with this contingency approach and,
to an innovation?’ in the following, we focus on those dimen-
It must be emphasized that the dominant sions of culture and structure that have been
perspective on strategy in the literature is identified to differentiate between innovative
one that examines the relationship between and non-innovative organizations.
strategy and performance. However, a small Organizational culture and structure concern
number of studies have examined the nature the way staff are grouped and the organiza-
of the transitions of these states as organiza- tional culture within which they work. There
tions adopt and embed an innovation strategy. has been considerable work on the situational
This sub-section of the literature is under- and psychological factors supportive of inno-
pinned by the assumption that firms that fol- vation in organizations. Indeed, it has been
low innovation strategies differ from other widely demonstrated that the perceived work
firms in several respects. It is apparent that environment (comprising both structural and
more innovative firms adopt different opera- cultural elements) does make a difference to
tional strategies to accommodate flexibility the level of innovation in organizations (Ama-
and quality capabilities (Alegre-Vidal et al. bile et al. 1996; Ekvall 1996). Creative and
2004), have different capital management innovative behaviours appear to be promoted
practices to facilitate slack resources (O’Brien by work environment factors (Mathisen and
2003), are more tolerant of internal conflict in Einarsen 2004). Indeed, it is clear that organ-
support of creativity (Dyer and Song 1998), izations can create environments in which
and maintain organizational structures that are innovation can be encouraged or hampered
in the ‘intermediate zone between order and (Dougherty and Cohen 1995; Tidd et al.
disorder’ (Brown and Eisenhardt 1997, 22). 1997). A common theme is that of the poly-
What is clear from this literature is that any chronic organization – one with the capacity
transition towards an innovation strategy will to be in two states at once (Becker and
necessarily take several years because of the Whisler 1973). Shepard (1967) describes this
resources and energy that are necessary before as a two-state organization manoeuvreing
such a transformation can even be triggered between loose and tight, and Mitroff (1987)
(Hope Hailey 2001). as business-as-usual versus business-not-as-
usual. More prosaically, this means organiza-
tions need to be able, for example, to provide
Organizational Culture and Structure
sufficient freedom to allow for the exploration
Burns and Stalker (1961) described a contin- of creative possibilities, but sufficient control
gency approach to innovation management, to manage innovation in an effective and effi-
later developed to include concepts of func- cient fashion.
tional differentiation, specialization and inte- Ernst (2002) specifies a range of generic
gration (Lawrence and Lorsch 1967), which characteristics for the dedicated project group
suggests that environmental change prompts a assigned the innovation task: multidisciplinarity,

32 © Blackwell Publishing Ltd 2006


March 2006

dedicated project leader, inter-functional com- been shown to have a negative impact on organ-
munication and co-operation, qualifications izational innovation (Burns and Stalker 1961;
and know-how of the project leader, team Damanpour 1991). Indeed, rigidity in rules
autonomy and responsibility for the process. and procedures may prohibit organizational
And these factors are echoed throughout the decision-makers from seeking new sources of
literature. Rothwell (1992) refers to them as information (Vyakarnam and Adams 2001).
‘corporate conditions’, Chiesa et al. (1996) Underlying the concept of the workplace
‘enabling processes’ and O’Reilly and Tushman environment are issues related to the manage-
(1997) ‘norms for innovation and change’. ment of human resources and the creation of
However, despite their perceived importance, a culture or climate in which individuals per-
there is little guidance on how to measure ceive innovation to be a desired and supported
them. organizational objective. There has been con-
Volberda (1996) developed a conceptual siderable empirical work on organizational
model of alternative flexible organizational climates supportive of the innovation process,
forms that are argued to initiate or respond and several measurement instruments have
better to different types of competition. Yet, in been developed, which Mathisen and Einarsen
spite of its importance, there is relatively little (2004) review. The Team Climate Inventory
evidence of extant measures of flexibility in (TCI) (Anderson and West 1996, 1998) and
the literature. Rothwell (1992) and Ekvall the KEYS instrument for assessing the work
(1996) propose a range of foci for measures of environment for creativity (Amabile et al. 1996)
organizational and production flexibility, such have been found to be robust and rigorous.
as ‘corporate flexibility and responsiveness to The TCI has been applied and validated in
change’; Coughlan (1994) considers the flexi- several studies (Agrell and Gustafson 1994;
bility of resource allocation. Several measures Anderson and West 1998; Kivimäki et al.
of personnel flexibility are evident, such as 1997; West and Anderson 1996). Replication
‘the adaptiveness of R&D personnel to tech- studies using the TCI have found it can
nology changes’ (Lee et al. 1996) and ‘the explain a large part of the variance in teams’
willingness to try new procedures and to innovative performance (Agrell and Gustafson
experiment with change, so as to improve a 1994). The TCI is based around four main
situation or a process’ (Abbey and Dickson factors: participative safety (how participative
1983). At the level of the firm, Liao et al. is the team in decision-making procedures,
(2003) introduce a similar construct – ‘organ- and how psychologically secure do team
izational responsiveness’. members feel about proposing new and
Organizational complexity, the amount of improved ways of doing things), support for
specialization and task differentiation report- innovation (the degree of practical support for
edly have a positive relationship (Damanpour innovation attempts contrasted with the rheto-
1996), though Wolfe (1994) argues that it may ric of professed support by senior manage-
favour initiation at the expense of implemen- ment), vision (how clearly, defined, shared,
tation. Administrative intensity, that is the attainable and valued are the team’s objectives
ratio of managers to total employees, favours and vision) and task orientation (the com-
administrative innovation (Damanpour 1991, mitment of the team to achieve the highest
1996), but possibly at the cost of other pro- possible standards of task performance, includ-
duct or technological innovations (Dougherty ing the use of constructive progress monitor-
and Hardy 1996). Centralization, the concen- ing procedures) (Anderson and West 1996).
tration of decision-making authority at the top Kivimäki et al. (1997) suggested a fifth factor,
of the organizational hierarchy, and formaliza- ‘interaction frequency’ relating to the regularity
tion, the degree of emphasis on following rules of contact and communication within the
and procedures in role performance, have both project team.

© Blackwell Publishing Ltd 2006 33


Innovation management measurement: A review

There is general agreement about the while West (1990) contends that the quality of
importance of individual and group autonomy innovation is partly a function of vision.
in the innovation process (Amabile 1998). Keller (1986) adopts Kirton’s (1976) 32-item
Zien and Buckler (1997) emphasize the need adopter–innovator inventory to determine
for freedom to experiment and the creation of individual and team orientation to innovation.
safe havens, without which innovation out- Vision is operationalized in the team climate
come might be constrained. Measures of inventory (cf. Agrell and Gustafson 1994;
autonomy mix both qualitative and quantita- Anderson and West 1996, 1998; West and
tive approaches. For example, ‘the degree of Anderson 1996) and is deconstructed into a
freedom personnel have in day-to-day operat- series of sub-dimensions such as clarity, shared-
ing decisions such as when to work and ness, attainability and value with regard to
how to solve job problems, including freedom team objectives.
from constant evaluation and close supervi- Another aspect of culture is the propensity
sion’ (Abbey and Dickson 1983) or ‘percent- to take risks. Saleh and Wang (1993) describe
age of R&D portfolio with explicit business this as a willingness to confront risky oppor-
unit and/or corporate business management tunities and tolerate failure, and learn from
sign-off’ (Tipping and Zeffren 1995). Addition- doing so rather than recklessly gambling.
ally, several authors have proposed general Similarly, West (1990) demonstrated that
measures of autonomy such as ‘freedom to higher levels of participative safety facilitate
make operating decisions’ (Abbey and Dick- innovation. Participative safety is non-
son 1983) or ‘degree of empowerment’ (de judgmental, supportive and characterized by
Leede et al. 1999; Tipping and Zeffren socio-emotional cohesiveness. The attractive-
1995). ness of the organization as a place to work
Morale and motivation are dimensions of and undertake innovative activities is used by
the innovative organization that can be meas- Geisler (1995) as an indicator of the climate
ured as they pertain to individuals – ‘the for innovation, measured by numbers of can-
extent to which personnel are well rewarded’ didates applying for positions, and the age
(Abbey and Dickson 1983); to groups – ‘our profile of scientists and engineers. Keller
reward system is more group-based than (1986) offers a slightly different perspective
individual-based’ (Parthasarthy and Hammond on participative safety with the construct
2002); and to the organization as a whole – ‘group cohesiveness’, which he operational-
‘the degree to which the organization attempts izes using an established five-item measure.
to excel’ (Abbey and Dickson 1983). Aspects This review has described a wide variety of
of morale and motivation that have been measures proposed for organizational culture
measured include trust (Miller and Friesen and structure. Unlike some other aspects of
1982) and job satisfaction, which has been innovation management, this area has received
measured by Keller (1986) on a 20-item scale. extensive measurement attention. However,
Organizational culture may include a shared Holbek (1988) argues that innovating organi-
vision, and it has been argued that, the clearer zations must adopt contrasting structures and
the vision, the more effective it is as a facilitator climates as they move from the initiation to
of innovation, as it enables focused develop- the implementation stages of innovation.
ment of new ideas that can be assessed more Chesborough and Teece (1996) and Burns and
precisely (West 1990). Pinto and Prescott Stalker (1961) argue that there is a relation-
(1988) found that the only factor to have pre- ship between organizational design and type
dictive power in terms of potential for success of innovation. It is a significant gap in innova-
at all stages of the innovation process (con- tion measurement that there appears to be no
ception, planning, execution and termination) measures that adequately capture or articulate
was having a clearly stated mission /vision, this sense of structural shift.

34 © Blackwell Publishing Ltd 2006


March 2006

more qualitative factors involved in decision


Portfolio Management
processes.
The importance of portfolio management to Scoring models require respondents to
successful product innovation has recently specify the merit of any project proposal
emerged as a key theme in the literature. It according to a set of a priori criteria which
is important because of the rapidity at which may be objective or subjective (Hall and
resources are consumed in the innovation Nauda 1990). Economic and benefit models
process and the need for these to be managed attempt to compute the cost/benefit or finan-
(Cebon and Newton 1999). The effectiveness cial risk of pursuing a specific project, while
with which an organization manages its R&D mathematical programming approaches seek
portfolio is often a key determinant of its to optimize some objective function(s) subject
competitive advantage (Bard et al. 1988). The to specified resource constraints. Algorithms
focus of portfolio management is on making of varying complexity exist, requiring moni-
strategic, technological and resource choices toring and significant data entry, and, while
that govern project selection and the future many are conceptually attractive, surveys do
shape of the organization (Cooper et al. 1999). not show widespread utilization of these
The problems of allocation of resources, evalu- techniques (Hall and Nauda 1990). These
ation, selection and termination of projects in approaches are all based on financial meas-
achieving the optimal portfolio have been ures such as internal rate of return, net present
extensively investigated. The models all have value and return on investment. At the other
the objective of devising means to allocate end of the spectrum, qualitative approaches
resources to projects to obtain the optimal such as peer review and mental checklists
balance in the product development portfolio, rely on subjective perceptions and measures
that is, arriving at a portfolio that optimizes of portfolio balance (Cooper et al. 2001;
the trade-off between returns and risks. Henriksen and Traynor 1999).
The process of selecting innovation projects Cooper et al. (1999) find that best performers
requires evaluation and resource allocation use explicit formalized tools and consist-
under uncertain conditions. It is argued that a ently apply them to all projects considered to
systematic process guided by clear selection belong to a portfolio. A series of measures can
criteria can help optimize the use of limited be identified that evaluate the whole portfolio
resources and enhance an organization’s of innovation projects to answer questions
competitive position (Hall and Nauda 1990). such as ‘is it balanced in terms of quantity of
The earliest models used return on investment short- and long term-projects?’ and ‘is there a
as the primary decision criteria (Bard et al. 1988). balance between high and low risk projects
Following this, increasingly sophisticated and large and small projects?’ (Brenner 1994;
mathematical tools were developed to resolve Cooper et al. 2001). Another set seeks to iden-
what Schmidt and Freeland (1992) describe as tify the extent to which portfolio evaluation
the constrained optimization problem, that is, measures are formalized within the organiza-
to maximize the output (according to specified tion’s processes (Cebon and Newton 1999;
criteria) from a subset of available inputs. Chiesa et al. 1996; Farrukh et al. 2000; Miller
These project selection models ‘have been and Friesen 1982). Yet another approach is to
virtually ignored by industry’ (Schmidt and view project evaluation and selection as an
Freeland 1992, 190). Part of the reason for organizational capability and attempt to deter-
this is the inherent complexity of some of mine a level of proficiency (Szakonyi 1994).
these models, but also that they fail to take Finally, there is a series of post hoc measures
into account organizational decision and of the appropriateness of project selections in
communication processes. More recently, the light of results and alignment with busi-
models have tried to take account of these ness objectives (Lee et al. 1996).

© Blackwell Publishing Ltd 2006 35


Innovation management measurement: A review

ing and make use of tools and techniques


Project Management
that may facilitate innovative endeavours. The
Project management is concerned with the stage-gate process (Cooper 1990) is possibly
processes that turn the inputs into a marketa- the most familiar of these, but other method-
ble innovation. The innovation process is ologies for innovation project management
complex, comprising a myriad of events and exist, including Phased Development, Product
activities some of which can be identified as a and Cycle-time Excellence and Total Design
sequence and some of which occur concur- (see Jenkins et al. (1997) for a discussion).
rently, and it is clearly possible that innova- These methodologies have in common the
tion processes will differ to some degree, separation of the product development process
across organizations and even within organi- into structured and discrete stages, which each
zations on a project-by-project basis. Having have milestones in the form of quality control
an efficient process that is able to manage the checkpoints at which stop/go decisions are made
ambiguity of the innovation is universally agreed with regard to the progress of the project. These
to be critical to innovation (Globe et al. 1973). highly structured approaches to the manage-
Various approaches have been taken to ment of the innovation process began to
modelling innovation processes: as a series of emerge in the 1990s (Veryzer 1998). The use
events (Zaltman et al. 1973), as a social interac- of structured tools and processes can be
tion (Voss et al. 1999), as a series of transactions measured by project process evaluations, for
(Nelson and Winter 1982) and as a process of example the use of a formal problem-finding/
communication (Farrukh et al. 2000). The his- problem-solving cycle (Bessant 2003), the use
tory of project management research is partly of formal post-launch evaluation procedures
characterized by a debate regarding the extent (Atuahene-Gima 1995) or the use of certified
to which events and activities within the process processes (Chiesa et al. 1996). These rather
occur in linearly sequential, discrete, identifiable general process measures have been supple-
stages (Zaltman et al. 1973) or whether events mented by measures of the use of specific
are more disorganized (King 1992) or even instruments and tools, such as interactive
chaotic (Koput 1997). However, despite these CAD or CAM (Maylor 2001) or the use of
different viewpoints, there are a number of computer-integrated manufacturing processes
common elements that can be summarized as (Parthasarthy and Hammond 2002), but we
the major components of the innovation project note that these measures betray the technological
management. These are project efficiency, and NPD heritage that underpins many of the
tools, communications and collaboration. innovation measures identified in this review.
Several studies make efforts to measure Equivalents for service industry, public or
project management efficiency, mostly in the not-for-profit sector innovations are somewhat
form of comparisons between budget and actual lacking in the literature and constitute a
(project costs, project duration, revenue fore- research gap.
casting). Another measure of project manage- Communications are important in project
ment success is speed. Innovation speed has management. Damanpour (1991) demon-
been positively correlated with product qual- strated the existence of a positive relationship
ity or the degree to which it satisfies customer between internal communication and innova-
requirements; measures include speed (Hauser tion. Internal communication facilitates the
and Zettelmeyer 1997), performance against dispersion of ideas within an organization,
schedule (Chiesa and Masella 1994), and dura- increases the diversity and also contributes to
tion of the process (Cebon and Newton 1999). the team ‘climate’. Communication can be
To achieve efficiency, it is widely recom- measured by various integration mechanisms,
mended that organizations seeking to innovate e.g. committees, numbers of meetings and
should establish formal processes for innovat- contacts (Damanpour 1991). There are also

36 © Blackwell Publishing Ltd 2006


March 2006

measures of external communications, which process, that is, ‘implementation’. This can
tend to focus on whether communication is mean taking an innovation to market (Chakra-
taking place, the level at which it occurs and vorti 2004), but may also include convincing
with whom (Cebon and Newton 1999; Lee production managers to adopt a series of new
et al. 1996; Rothwell 1992; Souitaris 2002). techniques available to them (Single and
These measures of internal and external com- Spurgeon 1996). Indeed, the successful intro-
munication in the literature are based on both duction of new products and services into
subjective evaluations and objective frequency markets is important for the survival and
counts. Subjective measures include: ‘we always growth of organizations. Kelm et al. (1995)
consult suppliers/customers on new product regard commercialization as a transitional
ideas’ (Parthasarthy and Hammond 2002) and phase in which the organization becomes
‘degree of organization members involved and less reliant on its technological capabilities
participating in extra-organizational professional (important during the activities of initiation),
activities’ (Damanpour 1991). Objective counts but more dependent on market dynamics.
include (Damanpour 1991) ‘extent of commu- Commercialization is concerned with making
nication amongst organizational units or groups the innovative process or product a commer-
measured by various integrating mechanisms cial success; it includes issues such as market-
such as numbers of committees and frequency ing, sales, distribution and joint ventures.
of meetings’, (Anderson and West 1998) While technical capabilities are important for
‘frequency of formal meetings concerning the early stages of the innovation process and
new ideas’, (Souitaris 2002; Szakonyi 1994) development activities, for the launch and
‘how well do the technical and finance people implementation stage it is marketing capabili-
communicate with one another’. ties (market investigation, market testing,
It is widely recognized that collaborating promotion etc.) that are significant (Calantone
with suppliers (Bessant 2003) and customers and di Benedetto 1988; Globe et al. 1973).
(von Hippel 1986) can also make a significant Verhaeghe and Kfir (2002) consider aspects
contribution to the innovation process. of commercialization under the headings of
Measures of collaborative working include market analysis and monitoring, reaching the
the use of guest engineers (Maylor 2001), the customer and market planning.
percentage of projects in co-operation with Firm-level measures of the launch or com-
third parties (Kerssens-van Drongelen and mercialization process appear to be relatively
Bilderbeek 1999) and the extent to which thin. In their description of the R&D process,
decision-making at top levels is characterized Balachandra and Brockhoff (1995) character-
by cross-functional discussions (Miller and ize the commercialization stage as requiring
Friesen 1982). In addition, Jassawalla and ‘big bucks’, market reviews and organiza-
Sashittal (1999) identify some characteristics tional commitment. Most measures appear to
of internal collaboration, i.e. that teams are be not much more sophisticated than this.
characterized by their mindfulness, levels of Measures are frequently restricted to numbers
at-stakeness, synergy and transparency, but of products launched in a given period (e.g.
they do not suggest how these aspects might Yoon and Lilien 1985). There is, though,
be measured, which constitutes a further some focus on market analysis and monitor-
research gap. ing (Verhaeghe and Kfir 2002). Song and
Parry (1996) employ a set of measures of
launch proficiency (salesforce, distributional
Commercialization
and promotional support) that directly address
Commercialization can be considered to be the ‘adequacy’ of the organization’s facilities in
the second of the two phases in Zaltman et al.’s these areas, as do Avlonitis et al. (2001). And
(1973) conceptualization of the innovation there is a limited mention of the commercial

© Blackwell Publishing Ltd 2006 37


Innovation management measurement: A review

intentions of an organization’s competitors et al. 1974) and the task of generating and
(Calantone and di Benedetto 1988). The then converting ideas into usable and market-
themes of proficiency of personnel in this area able products requires high levels of inter-
(e.g. Atuahene-Gima 1995; Cebon and New- functional co-ordination and integration. This
ton 1999), of adherence to a commercializa- paper opened with the general observation
tion schedule (e.g. Griffin and Page 1993) and that innovation measurement does not appear
of formal post-launch reviews (Atuahene- to take place routinely within management
Gima 1995; von Zedtwitz 2002) can also be practice and that, where it does, it tends to
found in the literature. focus on output measures. Further, from the
Even in the work that addresses post- relatively small number of empirical studies
project reviews, very little attention is directed of measurement in practice, measurement of
towards measuring innovation launch or innovation management appears to be under-
commercialization. However, this comes as taken infrequently, in an ad hoc fashion, and
little surprise, as Hultink et al. (2000) recently relies on dated, unbalanced or under-specified
observed that little work has been done in the models of the innovation management phe-
area, perhaps because, at least in the innova- nomenon. This suggests that a large part of
tion literature, launch activities appear to be the contemporary conceptualization of the
considered the domain of other specialists, innovation management phenomenon is over-
particularly marketers, and the process is seen looked in practitioners’ measurement prac-
as separate from innovation. In their study, tices and, consequently, that opportunities for
they investigated launch decisions associated the more efficient and effective management
with success for consumer and business-to- of the innovation process are not realized.
business products. Much of the literature that Some possible reasons for this state of affairs
considers launch and commercialization does are: failure of academics to communicate ade-
so from the viewpoint of the adopter, and quately, inconsistency, inaccessibility and
assesses rates of adoption and diffusion of complexity of measures and poor synthesis
innovations over time across populations and packaging.
(Kessler and Chakrabarti 1996; Van Den Following a review and synthesis of the
Bulte 2000). literature, we proposed a seven-dimensional
The area of commercialization appears to conceptualization of the innovation manage-
be the least developed of the issues involved ment phenomenon and applied it to an exam-
in innovation management. This is a huge gap ination of the measurement problem. Through
because, without this last step, the previous the application of this framework to their own
steps of assembling inputs, project manage- particular context, it is suggested that practi-
ment, etc. will not result in a commercially tioners will be able to conduct an evaluation
viable outcome for the firm. We believe that of their own innovation management activity,
this area of innovation is in urgent need of identify gaps, weaknesses or deficiencies, and
further development, from both theory and also improvement potential. Further, it is
measurement viewpoints. hoped that organizations applying the frame-
work will be able to tease out areas where
innovation is only nominally adopted in their
Discussion
processes and identify areas where attention
Innovation management measurement is a and resources might be focused.
critical discipline for both academics and From the perspective of its management, it
practitioners. The capacity of organizations to is no longer sufficient to treat innovation as a
innovate is determined by multiple factors that linear process where resources are channelled
relate both to their own internal organization at one end, from which emerges a new prod-
and to their market environment (Rothwell uct or process. The measurement framework

38 © Blackwell Publishing Ltd 2006


March 2006

presented in Table 2 shows the breadth and we have noted the objections to counts of
variety of elements of innovation management patents or increasing expenditure on R&D being
that ideally need to be measured. There have used as measures of innovative organizations.
been several studies that have investigated the Similarly, there is an absence of evidence that
limitations of various approaches to measure- the large number of subjective perceptions of
ment (e.g. Werner and Souder 1997), and of innovation management practices proposed
specific measures (e.g. Trajtenberg 1990) as (‘we do A’, ‘we are good at B’) actually relate
they relate to the practice of innovation. The to innovation management performance.
choice of an appropriate R&D measurement Omission gaps occur where the importance
metric depends on the user’s needs in terms of of an aspect of innovation management is sup-
comprehensiveness of measurement, type of ported in the literature, but measures for this
R&D being measured, available data and aspect are lacking. Omission gaps are particu-
amount of effort the user can afford to allocate larly prevalent in the elements of innovation
to the exercise. Nonetheless, the common management such as knowledge management,
citing across various papers of the measures innovation strategy and commercialization
noted in the innovation management frame- that do not feature strongly in the literature on
work presented here suggests that a base set technological and manufacturing-based inno-
of innovation management measures is vation. Another area traditionally not given
implicitly present in the literature, even much emphasis in this literature is organiza-
though they may be fragmented in appearance tion and culture, which, fortunately, is better
and presentation. By pulling together the treated by the organizational behaviour litera-
innovation management framework from ture, where a number of measures have been
diverse sources, this paper aims to bring such developed. Much of the current state of meas-
issues into the open and identify relevant urement practice can be traced back to the dis-
research gaps. Table 2 can be viewed as the cipline’s early manufacturing, R&D and NPD
basis for a balanced scorecard (Kaplan and focus. While product innovation is undoubt-
Norton 1992) for innovation management, edly important, it is only one dimension of an
that is, as a balanced set of areas that need to organization’s innovation agenda. Process and
be measured in order to gain insight into an organizational innovations are recognized,
organization’s holistic ability to manage inno- too, as critical for competitiveness, yet these
vation. Such multidimensional approaches to perspectives are inadequately represented in
measurement have been found in other areas measurement terms.
of management to be an improvement on sim- General areas of omission in this field
ple one-dimensional measures and to be able relate to an over-reliance on financial meas-
to capture both short- and long-term aspects ures rather than process measures: for exam-
of value creation in the firm (Phelps 2004). ple, the use of financial measures of portfolio
We have identified a large number of meas- optimization, but an absence of portfolio
ures and approaches in a variety of innovation capability measures; a similar reliance on
management areas, and we have constructed a codified knowledge such as patents to the
generic set of innovation management meas- exclusion of more intangible measures such
urement areas to act as a framework for bal- as tacit knowledge; the measurement of levels
anced measurement. However, in several of of resources or activities with no indication of
these areas, measurement gaps have been what an optimal level would be; the measure-
identified. These gaps are of two types: valid- ment of drivers of innovation without meas-
ity gaps and omission gaps. Validity gaps arise ures of whether these drivers are aligned with
where there is insufficient evidence that pro- each other and with firm strategy; measures of
posed measures actually do capture drivers or presence that do not measure quality (e.g. the
outputs of innovation management; for example, use of dichotomous (yes/no) measures that do

© Blackwell Publishing Ltd 2006 39


Innovation management measurement: A review

not indicate how well an action is implemented, the authors gratefully acknowledge this support.
and measures of the presence of leadership Further, the authors are grateful to the editors
(such as champions), but not of quality of and two anonymous reviewers for their helpful
leadership); a general absence of measures and insightful comments on previous versions
for important properties of organizational of this paper.
structures such as flexibility, and a lack of
measures of the match between structure and
Note
environment; a technological and NPD bias to
project management measures and a relative 1 Corresponding author. Telephone: +44 (0) 20
absence of measures for service sectors; a 7594 9137; e-mail: r.adams@imperial.ac.uk
paucity of measures for internal communica-
tions; and a general lack of measures for
References
commercialization management – in particular,
around marketing and sales capabilities for Abbey, A. and Dickson, J. (1983). R&D work climate
innovative products and services. All these and innovation in semi-conductors. Academy of
gaps provide the potential for further research Management Journal, 26, 362–368.
in innovation management measurement. Agrell, A. and Gustafson, R. (1994). The team
The absence of an accepted framework of climate inventory (TCI) and group innovation: a
innovation management measures leads not psychometric test on a Swedish sample of work
groups. Journal of Occupational and Organiza-
only to the gaps identified above, but also to
tional Psychology, 67, 143–151.
other problems in the literature. One is that it Alegre-Vidal, J., Lapiedra-Alcami, R. and Chiva-
is frequently unclear whether or not the met- Gomez, R. (2004). Linking operations strategy and
rics used are of the researchers’ own devising, product innovation: an empirical study of Spanish
drawn from the literature or are what are used ceramic tile producers. Research Policy, 33, 829–
by the organizations being studied. Nor is it 839.
always clear when metrics are devised or Amabile, T.M. (1998). How to kill creativity. Harvard
recommended, whether they are intended for Business Review, September–October, 77–87.
use in a research capacity or for management Amabile, T.M., Conti, R., Coon, H., Lazenby, J. and
tasks. Further, the measures proposed in the Herron, M. (1996). Assessing the work environ-
literature often seem to be proposed abstractly, ment for creativity. Academy of Management Jour-
nal, 39, 1154–1184.
with little consideration given to the use of
Ambrosini, V. and Bowman, C. (2001). Tacit know-
measures as a management tool in the day-to- ledge: some suggestions for operationalisation.
day context of managing innovation. In the Journal of Management Studies, 38, 811–829.
absence of a comprehensive framework for Anderson, N. and West, M.A. (1996). The team
innovation management measurement, organ- climate inventory: development of the TCI and its
izations will inevitably resort to ad hoc and applications in teambuilding for innovativeness.
partial metrics, which can encourage wasteful European Journal of Work and Organizational Psy-
practice (e.g. measuring innovation management chology, 5, 53 – 66.
capability according to annual R&D spend). Anderson, N.R. and West, M.A. (1998). Measuring
We hope that the framework constructed in climate for work group innovation: development
this paper will be useful in the construction and validation of the team climate inventory. Jour-
nal of Organizational Behavior, 19, 235–258.
of comprehensive measures of innovation
Atuahene-Gima, K. (1995). An exploratory analysis
management. of the input of market orientation on new product
performance: a contingency approach. Journal of
Acknowledgements Product Innovation Management, 12, 275–293.
Avlonitis, G.J., Papastathopoulou, P.G. and Gounaris, S.P.
The research reported here was supported by (2001). An empirically-based typology of product
a grant from Cranfield School of Management, innovativeness for new financial services: success

40 © Blackwell Publishing Ltd 2006


March 2006

and failure scenarios. Journal of Product Innova- Brown, M.G. and Svenson, R.A. (1988). Measuring
tion Management, 18, 324 –342. R&D productivity. Research-Technology Manage-
Balachandra, R. and Brockhoff, K. (1995). Are R&D ment, July–August, 11–15.
project termination factors universal? Research- Brown, S.L. and Eisenhardt, K.M. (1997). The art of
Technology Management, 38, 31–36. continuous change: linking complexity theory and
Balachandra, R. and Friar, J. (1997). Factors for suc- time-paced evolution in relentlessly shifting organiza-
cess in R&D projects and new product innovation: tions. Administrative Science Quarterly, 42, 1–34.
a contextual framework. IEEE Transactions on Burgelman, R.A., Christensen, C.M. and Wheel-
Engineering Management, 44, 276 –287. wright, S.C. (2004). Strategic Management of Tech-
Baldridge, J.V. and Burnham, R.A. (1975). Organiza- nology and Innovation, 4th edition. New York:
tional innovation – individual, organizational and McGraw Hill/Irwin.
environmental impacts. Administrative Science Burns, T.R. and Stalker, G.M. (1961). The Manage-
Quarterly, 20, 165–176. ment of Innovation. London: Tavistock.
Bantel, K.A. and Jackson, S.E. (1989). Top manage- Calantone, R.J. and di Benedetto, C.A. (1988). An
ment and innovations in banking: does the compo- integrative model of the new product development
sition of the top team make a difference? Strategic process: an empirical validation. Journal of Prod-
Management Journal, 10, 107–124. uct Innovation Management, 5, 201–215.
Barclay, I. (1992). The new product development Cebon, P. and Newton, P. (1999). Innovation in firms:
process: part 2. Improving the process of new prod- towards a framework for indicator development.
uct development, R&D Management, 4, 307–317. Melbourne Business School Working Paper 99-9.
Bard, J.F., Balachandra, R. and Kaufmann, P.E. Chakravorti, B. (2004). The new rules for bringing
(1988). An interactive approach to R&D project innovations to market. Harvard Business Review,
selection and termination. IEEE Transactions on 82, 58 – 67.
Engineering Management, 35, 139–146. Chen, C.-J. (2004). The effects of knowledge
Barney, J. (1991). Firm resources and sustained com- attribute, alliance characteristics, and absorptive
petitive advantage. Journal of Management, 17, capacity on knowledge transfer performance. R&D
99 –120. Management, 34, 311–321.
Becker, S.W. and Whisler, T.L. (1973). The innova- Chesborough, H.W. and Teece, D.J. (1996). When is
tive organization: a selective view of current theory virtual virtuous? Organizing for innovation. Har-
and research. In Wills, G., Hayhurst, R. and Midg- vard Business Review, January–February, 65–73.
ley, D. (eds), Creating and Marketing New Prod- Chiesa, V. and Masella, C. (1994). Searching for an
ucts. London: Crosby Lockwood Staples. effective measure of R&D performance. In Pro-
Bess, G. (1998). A first stage organization life cycle ceedings, 2nd International Product Development
study of six emerging nonprofit organizations in Management Conference Gothenburg, Sweden,
Los Angeles. Administration in Social Work, 22, 30–31 May. Brussels: European Institute for
35–52. Advanced Studies in Management.
Bessant, J. (2003). High Involvement Innovation: Chiesa, V., Coughlan, P. and Voss, A. (1996). Devel-
Building and Sustaining Competitive Advantage opment of a technical innovation audit. Journal of
Through Continuous Change. Chichester: John Product Innovation Management, 13, 105–136.
Wiley. Cohen, W.M. and Levinthal, D.A. (1990). Absorptive
Bessant, J. and Francis, D. (1997). Implementing the capacity: a new perspective on learning and inno-
new product development process. Technovation, vation. Administrative Science Quarterly, 35, 128–
17, 189–197. 152.
Blackler, F. (1995). Knowledge, knowledge work and Cooper, R.G. (1979a). The dimensions of industrial
organizations: an overview and interpretation. new product success and failure. Journal of Mar-
Organization Studies, 16, 1021–1046. keting, 43, 93–103.
Bougrain, F. and Haudeville, B. (2002). Innovation Cooper, R.G. (1979b). Identifying industrial new
collaboration and SMEs internal research capaci- product success: Project NewProd. Industrial Mar-
ties. Research Policy, 31, 735–747. keting Management, 8, 124 –135.
Brenner, M.S. (1994). Practical R&D project prioriti- Cooper, R.G. (1984). The strategy–performance link
zation. Research Technology Management, 37, 38– in product innovation. R&D Management, 14, 247–
43. 259.

© Blackwell Publishing Ltd 2006 41


Innovation management measurement: A review

Cooper, R.G. (1990). Stage-gate systems: a new tool De Leede, J., Nijhof, A.H. and Fisscher, O.A. (1999).
for managing new products. Business Horizons, 33, The myth of self managing teams: a reflection on
44 –56. the allocation of responsibilities between individu-
Cooper, R.G. and Kleinschmidt, E.J. (1990). New als, teams and the organisation. Journal of Business
product success factors: a comparison of ‘kills’ Ethics, 21, 203 –215.
versus successes and failures. R&D Management, Deeds, D.L. (2001). The role of R&D intensity,
20, 47–64. technical development and absorptive capacity in
Cooper, R.G. and Kleinschmidt, E.J. (1995). Bench- creating entrepreneurial wealth in high technology
marking the firm’s critical success factors in new start-ups. Journal of Engineering and Technology
product development. Journal of Product Innova- Management, 18, 29 – 47.
tion Management, 12, 374 –391. Denyer, D. and Neely, A. (2004). Introduction to spe-
Cooper, R.G., Edgett, S.J. and Kleinschmidt, E.J. cial issue: innovation and productivity performance
(1999). New product portfolio management: prac- in the UK. International Journal of Management
tices and performance. Journal of Product Innova- Reviews, 4/5, 131–135.
tion Management, 16, 333–351. Di Benedetto, C.A. (1996). Identifying the key suc-
Cooper, R.G., Edgett, S.J. and Kleinschmidt, E.J. cess factors in new product launch. Journal of
(2001). Portfolio Management for New Products, Product Innovation Management, 16, 530 –544.
2nd edition. Cambridge, MA: Perseus. Dodgson, M. and Hinze, S. (2000). Indicators used to
Cooper, R.G., Edgett, S.J. and Kleinschmidt, E.J. (2004). measure the innovation process: defects and possi-
Benchmarking best NPD practices. Research- ble remedies. Research Evaluation, 8, 101–114.
Technology Management, 47, 50 –59. Dougherty, D. and Cohen, M. (1995). Product inno-
Cordero, R. (1990). The measurement of innovation vation in mature firms. In Bowman, E. and Kogut,
performance in the firm: an overview. Research B. (eds), Redesigning the Firm. New York: Oxford
Policy, 19, 185–192. University Press.
Cormican, K. and O’Sullivan, D. (2004). Auditing Dougherty, D. and Hardy, C. (1996). Sustained prod-
best practice for effective product innovation uct innovation in large, mature organizations: over-
management. Technovation, 24, 819–829. coming innovation-to-organization problems.
Coughlan, P., Chiesa, V. and Voss, C. (1994). Evalu- Academy of Management Journal, 39, 1120–1153.
ating leadership as an enabler of innovation. In DTI (1998). An Audience With Innovation: Innovation
Proceedings, 2nd International Product Develop- in Management. London: Department of Trade and
ment Management Conference, Gothenburg, Industry.
Sweden, 30 –31 May. Brussels: European Institute Dyer, B. and Song, X.M. (1998). Innovation strategy
for Advanced Studies in Management. and sanctioned conflict: a new edge in innovation?
Covin, J.G. and Slevin, D.P. (1989). Strategic manage- Journal of Product Innovation Management, 15,
ment of small firms in hostile and benign environ- 505–519.
ments. Strategic Management Journal, 10, 75–87. Ekvall, G. (1996). Organizational climate for creativ-
Daft, R. (1978). A dual-core model of organizational ity and innovation. European Journal of Work and
innovation. Academy of Management Journal, 21, Organizational Psychology, 5, 105–123.
193–210. Ernst, H. (2002). Success factors of new product
Damanpour, F. (1991). Organizational innovation: a development: a review of the empirical literature.
meta-analysis of effects of determinants and mod- International Journal of Management Reviews, 4,
erators. Academy of Management Journal, 34, 555– 1–40.
590. Farrukh, C., Phaal, R., Probert, D., Gregory, M. and
Damanpour, F. (1996). Organizational complexity and Wright, J. (2000). Developing a process for the
innovation: developing and testing multiple contin- relative valuation of R&D programmes. R&D
gency models. Management Science, 42, 693–716. Management, 30, 43–53.
Davis, M.C. (1998). Knowledge management. Infor- Frenkel, A., Maital, S. and Grupp, H. (2000). Meas-
mation Strategy: The Executive’s Journal, 15, 11– uring dynamic technical change: a technometric
22. approach. International Journal of Technology
De Brentani, U. (1991). Success factors in developing Management, 20, 429–441.
new business services. European Journal of Mar- Galunic, D.C. and Rodan, S. (1998). Resource recom-
keting, 25, 33–60. binations and the firm: knowledge structures and

42 © Blackwell Publishing Ltd 2006


March 2006

the potential for Schumpeterian innovation. A Cross-Disciplinary Perspective. Norwegian


Strategic Management Journal, 19, 1193–1201. University Press, pp. 253–277.
Geisler, E. (1995). An integrated cost–performance Hope Hailey, V. (2001). Breaking the mould? Innova-
model of research-and-development evaluation. tion as a strategy for corporate renewal. Inter-
Omega – International Journal of Management national Journal of Human Resource Management,
Science, 23, 281–294. 12, 1126–1140.
Glaser, B.G. and Strauss, A.L. (1967). The Discovery Hull, R., Coombs, R. and Peltu, M. (2000). Know-
of Grounded Theory: Strategies for Qualitative ledge management practices for innovation: an
Research. London: Aldine. audit tool for improvement. International Journal
Globe, S., Levy, G.W. and Schwartz, C.M. (1973). of Technology Management, 20, 633–656.
Key factors and events in the innovation process. Hultink, E.J., Hart, S., Robben, H.S.J. and Griffin, A.
Research Management, 16, 8–15. (2000). Launch decisions and new product success:
Goffin, K. and Pfeiffer, R. (1999). Innovation Man- an empirical comparison of consumer and indus-
agement in UK and German Manufacturing Com- trial products. Journal of Product Innovation Man-
panies. London: Anglo-German Foundation for the agement, 17, 5–23.
Study of Industrial Society. Jassawalla, A.R. and Sashittal, H.C. (1999). Building
Grant, R.M. (1991). The resource-based theory of collaborative cross-functional new product teams.
competitive advantage: implications for strategy Academy of Management Executive. 13, 50 – 63.
formulation. California Management Review, 33, Jenkins, S., Forbes, S., Durrani, T.S. and Banerjee,
114 –135. S.K. (1997). Managing the product development
Greve, H.R. (2003). A behavioral theory of R&D process 1. An assessment. International Journal of
expenditures and innovations: evidence from Technology Management, 13, 359–378.
shipbuilding. Academy of Management Journal, 46, Kaplan, R.S. and Norton, D.P. (1992). The balanced
685–702. scorecard – measures that drive performance. Harvard
Griffin, A. (1997). PDMA research on new product Business Review, January–February, 71–79.
development practices: updating trends and bench- Keller, R.T. (1986). Predictors of performance of
marking best practices. Journal of Product Innova- project groups in R&D organizations. Academy of
tion Management, 14, 429 – 458. Management Journal, 29, 715–726.
Griffin, A. and Page, A.L. (1993). An interim report Kelm, K.M., Narayanan, V.K. and Pinches, G.E. (1995).
on measuring product development success and Shareholder value creation during research-and-
failure. Journal of Product Innovation Manage- development innovation and commercialization stages.
ment, 10, 291–308. Academy of Management Journal, 38, 770 –786.
Griliches, Z. (1990). Patent statistics as economic Kerssens-van Drongelen, I.C. and Bilderbeek, J.
indicators: a survey. Journal of Economic Litera- (1999). R&D performance measurement: more
ture, 28, 1661–1707. than choosing a set of metrics. R&D Management,
Hall, D.L. and Nauda, A. (1990). An interactive 29, 35–46.
approach for selecting IR&D projects. IEEE Trans- Kerssens-van Drongelen, I.C. and de Weerd-
actions on Engineering Management, 37, 126 –133. Nederhof, P.C. (1999). The use of performance
Hauser, J.R. and Zettelmeyer, F. (1997). Metrics to measurement tools for balancing short- and long-
evaluate R,D&E. Research-Technology Manage- term NPD performance. International Journal of
ment, 40, 32–38. Innovation Management, 3, 397–426.
Henriksen, A.D. and Traynor, A.J. (1999). A practical Kessler, E.H. and Chakrabarti, A.K. (1996). Innova-
R&D project-selection scoring tool. IEEE Trans- tion speed: a conceptual model of context, anteced-
actions on Engineering Management, 46, 158– ents and outcomes. Academy of Management
170. Review, 21, 1143–1191.
Hipp, C. and Grupp, H. (2005). Innovation in the Kim, B. and Oh, H. (2002). An effective R&D per-
service sector: the demand for service specific- formance measurement system: survey of Korean
innovation measurement concepts and typologies. R&D researchers. Omega – International Journal
Research Policy, 34, 517–535. of Management Science, 30, 19–31.
Holbek, J. (1988). The innovation design dilemma: Kim, J. and Wilemon, D. (2002). Strategic issues in
some notes on its relevance and solutions. In managing innovation’s fuzzy front-end. European
Grønhaug, K. and Kaufmann, G. (eds), Innovation: Journal of Innovation Management, 5, 27–39.

© Blackwell Publishing Ltd 2006 43


Innovation management measurement: A review

Kimberly, J.R. (1981). Managerial innovation. In Liao, J., Welsch, H. and Stoica, M. (2003). Organiza-
Nystrom, P.C. and Starbuck, W.H. (eds), Handbook tional absorptive capacity and responsiveness:
of Organizational Design, Vol. 1. New York: an empirical investigation of growth-oriented
Oxford University Press, pp. 84 –104. SMEs. Entrepreneurship Theory and Practice, 28,
King, N. (1992). Modelling the innovation process: an 63–86.
empirical comparison of approaches. Journal of Linstone, H.A. and Turoff, M. (eds) (2002). The Del-
Occupational and Organizational Psychology, 65, phi Method: Techniques and Applications, http://
89–100. www.is.njit.edu/pubs/delphibook
Kirton, M.J. (1976). Adaptors and innovators: a Loch, C., Stein, L. and Terwiesch, C. (1996). Meas-
description and measure. Journal of Applied Psy- uring development performance in the electronics
chology, 61, 622–629. industry. Journal of Product Innovation Manage-
Kivimäki, M., Kuk, G., Elovainio, M., Thomson, L., ment, 13, 3–20.
Kalliomäki-Levanto, T. and Heikkilä, A. (1997). Mathisen, G.E. and Einarsen, S. (2004). A review of
The team climate inventory (TCI) – four or five instruments assessing creative and innovative envi-
factors? Testing the structure of TCI in samples of ronments within organizations. Creativity Research
low and high complexity jobs. Journal of Occupa- Journal, 16, 119–140.
tional and Organizational Psychology, 70, 375– Maylor, H. (2001). Assessing the relationship
389. between practice changes and process: improve-
Kivimäki, M., Lansisalmi, H., Elovainio, M., Heik- ment in new product development. Omega –
kila, A., Lindstrom, K., Harisalo, R., Sipila, K. and International Journal of Management Science, 29,
Puolimatka, L. (2000). Communication as a deter- 85–96.
minant of organizational innovation. R&D Man- McAdam, R.M.S. (1999). The process of knowledge
agement, 30, 33–42. management within organizations: a critical assess-
Kleinknecht, A. (1987). Measuring R&D in small ment of both theory and practice. Knowledge and
firms: how much are we missing? Journal of Indus- Process Management, 6, 101–113.
trial Economics, 36, 253–256. McManus, R.J., Wilson, S., Delaney, B.C., Fitzmau-
Koen, P., Ajamian, G., Burkart, R., Clamen, A., rice, D.A., Hyde, C.J., Tobias, R.S., Jowett, S. and
Davidson, J., D’Amore, R., Elkins, C., Herald, K., Hobbs, F.D.R. (1998). Review of the usefulness of
Incorvia, M., Johnson, A., Karol, R., Seibert, R., contacting other experts when conducting a litera-
Slavejkov, A. and Wagner, K. (2001). Providing ture search for systematic reviews. British Medical
clarity and a common language to the ‘fuzzy front end’. Journal, 317, 1562–1563.
Research-Technology Management, 44, 46 –55. Miles, R.E. and Snow, C.C. (1978). Organization Strategy,
Koput, K. (1997). A chaotic model of innovative Structure and Process. New York: McGraw-Hill.
search: some answers, many questions. Organiza- Miller, D. and Friesen, P.H. (1982). Innovation in
tion Science, 8, 528–542. conservative and entrepreneurial firms: two models
Lawrence, P.R. and Lorsch, J.W. (1967). Organization of strategic momentum. Strategic Management
and Environment. Harvard, MA: Harvard Univer- Journal, 3, 1–24.
sity Press. Mintzberg, H. (1978). Patterns in strategy formation.
Lee, M., Son, B. and Lee, H. (1996). Measuring R&D Management Science, 24, 934 –948.
effectiveness in Korean companies. Research- Mitroff, I. (1987). Business Not As Usual: Rethinking
Technology Management, 39, 28–31. our Individual, Corporate and Industrial Strategies
Leonard, D. and Sensiper, S. (1998). The role of tacit for Global Competition. London: Jossey-Bass.
knowledge in group innovation. California Man- Moenaert, R.K., De Meyer, A., Souder, W.E. and
agement Review, 40, 112–132. Deschoolmeester, D. (1995). R&D/Marketing com-
Leseure, M., Birdi, K., Bauer, J., Denyer, D. and munication during the fuzzy front-end. IEEE
Neely, A. (2004). Adoption of Promising Practice: Transactions on Engineering Management, 42,
A Systematic Review of the Literature. London: 243–257.
Advanced Institute of Management Research. Neely, A. and Hii, J. (1998). Innovation and Business
Li, H.Y. and Atuahene-Gima, K. (2001). Product Performance: A Literature Review, Report produced
innovation strategy and the performance of new for Government Office for the Eastern Region.
technology ventures in China. Academy of Man- Cambridge: The Judge Institute of Management
agement Journal, 44, 1123–1134. Studies, University of Cambridge.

44 © Blackwell Publishing Ltd 2006


March 2006

Nelson, R. and Winter, G. (1982). An Evolutionary Porter, M.E. and Ketels, C.H.M. (2003). UK Compet-
Theory of Economic Change. Cambridge, MA: itiveness: Moving to the Next Stage. DTI Econom-
Belknap Press. ics Paper No 3, URN 03/899.
Nohria, N. and Gulati, R. (1996). Is slack good or bad Pugh, D.S., Hickson, D.J., Hinings, C.R. and Turner,
for innovation? Academy of Management Journal, C. (1969). The context of organization structures.
39, 1245–1264. Administrative Science Quarterly, 14, 91–114.
Nonaka, I. (1991). The knowledge-creating company. Ramanujam, V. and Mensch, G.O. (1985). Improving
Harvard Business Review, November–December, the strategy–innovation link. Journal of Product
96 –104. Innovation Management, 2, 213–223.
Nonaka, I. and Takeuchi, H. (1995). The Knowledge Richard, O., McMillan, A., Chadwick, K. and Dwyer,
Creating Company: How Japanese Companies S. (2003). Employing an innovation strategy in
Create the Dynamics of Innovation. New York: racially diverse workforces – effects on firm per-
Oxford University Press. formance. Group & Organization Management, 28,
O’Brien, J.P. (2003). The capital structure implica- 107–126.
tions of pursuing a strategy of innovation. Strategic Rickards, T. (1991). Innovation and creativity, trees
Management Journal, 24, 415– 431. and pathways. R&D Management, 21, 97–108.
O’Reilly, C.A. and Tushman, M.L. (1997). Using cul- Rochford, L. (1991). Generating and screening new
ture for strategic advantage: promoting innovation product ideas. Industrial Marketing Management,
through social control. In Tushman, M.L. and 20, 287–296.
Anderson, P. (eds), Managing Strategic Innovation Rothwell, R. (1992). Successful industrial innovation:
and Change: A Collection of Readings. New York: critical factors for the 1990s. R&D Management,
Oxford University Press, pp. 200 –216. 22, 221–239.
Oliver, N., Dewberry, E. and Dostaler, I. (1999). New Rothwell, R., Freeman, C., Horseley, A., Jervis,
product development performance and practice: an V.T.P., Robertson, A.B. and Townsend, J. (1974).
international benchmarking study in the consumer SAPPHO updated – Project SAPPHO phase II.
electronics industry. In Proceedings, 6th Inter- Research Policy, 3, 258–291.
national Product Development Management Confer- Saleh, S.D. and Wang, C.K. (1993). The management
ence, Cambridge, UK. Brussels: European Institute of innovation – strategy, structure, and organiza-
for Advanced Studies in Management. tional climate. IEEE Transactions on Engineering
Pakes, A. and Griliches, Z. (1980). Patents and R&D Management, 40, 14–21.
at the firm level: a first report. Economic Letters, 5, Schmidt, R.L. and Freeland, J.R. (1992). Recent
377–381. progress in modelling R&D project-selection proc-
Parthasarthy, R. and Hammond, J. (2002). Product esses. IEEE Transactions on Engineering Manage-
innovation input and outcome: moderating effects ment, 39, 189–201.
of the innovation process. Journal of Engineering Schroeder, R.G., Van de Ven, A.H., Scudder, G.D.
and Technology Management, 19, 75–91. and Polley, D. (1989). The development of innova-
Patterson, F. (2003). Innovation potential indicator. tion ideas. In Van de Ven, A.H., Angle, H.L. and
Available at: www.opp.co.uk Poole, M. (eds), Research on the Management of
Phelps, B. (2004). Smart Business Metrics: Measure Innovation: The Minnesota Studies. New York:
What Really Counts and Manage What Makes the Harper & Row, pp. 107–133.
Difference. London: FT-Prentice Hall. Scott, S. and Bruce, R. (1994). Determinants of
Pinto, J.K. and Prescott, J.E. (1988). Changes in crit- innovative behaviour: a path model of individual
ical success factors over the stages in the project innovation. Academy of Management Journal, 37,
life cycle. Journal of Management, 14, 5–18. 580–607.
Pitt, M. and Clarke, K. (1999). Competing on compe- Shane, S., Venkataraman, S. and MacMillan, I. (1995).
tence: a knowledge perspective on the management Cultural differences in innovation championing
of strategic innovation. Technology Analysis and strategies. Journal of Management, 21, 931–952.
Strategic Management, 11, 301–316. Shepard, H.A. (1967). Innovation-resisting and inno-
Pittaway, L., Robertson, M., Munir, K., Denyer, D. and vation producing organizations Journal of Busi-
Neely, A. (2004). Networking and Innovation in the ness, 40, 470–477.
UK: a Systematic Review of the Literature. London: Shin, J. and McClomb, G.E. (1998). Top executive
Advanced Institute of Management Research. leadership and organizational innovation: an

© Blackwell Publishing Ltd 2006 45


Innovation management measurement: A review

empirical investigation of nonprofit human service Verhaeghe, A. and Kfir, R. (2002). Managing innovation
organizations (HSOS). Administration in Social in a knowledge intensive technology organisation
Work, 22, 1–21. (KITO). R&D Management, 32, 409–417.
Single, A.W. and Spurgeon, W.M. (1996). Creating Verworn, B. (2002). The fuzzy front end of product
and commercializing innovation inside a skunk development: an exploratory study. In Proceedings,
works. Research-Technology Management, 39, 38– 9th International Product Development Management
41. Conference, Sophia Antipolis, France, pp. 863–878.
Song, X.M. and Parry, M.E. (1996). What separates Brussels: European Institute for Advanced Studies
Japanese new product winners from losers. in Management.
Journal of Product Innovation Management, 13, Veryzer, R.W. (1998). Discontinuous innovation and
422–439. the new product development process. Journal of
Souitaris, V. (2002). Firm-specific competencies Product Innovation Management, 15, 304 –321.
determining technological innovation: a survey in Volberda, H.W. (1996). Towards the flexible form:
Greece. R&D Management, 32, 61–77. how to remain vital in hypercompetitive environ-
Stock, G.N., Greis, N.P. and Fischer, W.A. (2001). ments. Organizational Science, 7, 359 –374.
Absorptive capacity and new product development. Von Hippel, E. (1986). Lead users: a source of novel
Journal of High Technology Management product concepts. Management Science, 32, 791–805.
Research, 12, 77–91. Von Zedtwitz, M. (2002). Organizational learning
Sundbo, J. (1997). Management of innovation in through post-project reviews in R&D. R&D Man-
services. Service Industries Journal, 17, 432– agement, 32, 255–268.
455. Voss, C., Chase, R. and Roth, A. (1999). International
Sveiby, K.E. (1997). The New Organizational Wealth: service study. Decision Line, May, 4–7.
Managing and Measuring Knowledge-Based Vyakarnam, S. and Adams, R.J. (2001). Institutional
Assets. San Francisco, CA: Berrett-Koehler. barriers to enterprise support: an empirical study.
Szakonyi, R. (1994). Measuring R&D effectiveness I. Environment and Planning C: Government and
Research-Technology Management, 37, 27–32. Policy, 19, 335–353.
Thompson, L. (2003). Improving the creativity of Werner, B.M. and Souder, W.E. (1997). Measuring
organizational work groups. Academy of Manage- R&D performance – state of the art. Research-
ment Executive, 17, 96 –109. Technology Management, 40, 34 – 42.
Tidd, J., Bessant, J. and Pavitt, K. (1997). Managing West, M.A. (1990). The social psychology of innova-
Innovation: Integrating Technological, Market and tion in groups. In West, M.A. and Farr, J.L. (eds),
Organizational Change. Chichester, UK: John Innovation and Creativity at Work: Psychological
Wiley. and Organizational Strategies. Chichester, UK:
Tipping, J. and Zeffren, E. (1995). Assessing the John Wiley, pp. 309–333.
value of your technology. Research–Technology West, M.A. and Anderson, N.R. (1996). Innovation in
Management, 38, 22– 40. top management teams Journal of Applied Psychol-
Trajtenberg, M. (1990). A penny for your quotes – ogy, 81, 680–693.
patent citations and the value of innovations. Rand White, A. (2002). Enabling factors in the front end of
Journal of Economics, 21, 172–187. the innovation process. In Proceedings, 9th
Tranfield, D., Denyer, D. and Smart, P. (2003). International Product Development Management
Towards a methodology for developing evidence- Conference Sophia Antipolis, France. Brussels:
informed management knowledge by means of a European Institute for Advanced Studies in
systematic review. British Journal of Management, Management, pp. 879–887.
14, 207–222. Wolfe, R.A. (1994). Organizational innovation:
Tsai, W. (2001). Knowledge transfer in intraorganiza- review, critique and suggested research direc-
tional networks: effects of network position and tions. Journal of Management Studies, 31, 405 –
absorptive capacity on business unit innovation and 431.
performance. Academy of Management Journal, Yoon, E. and Lilien, G.L. (1985). A new product
44, 996 –1004. launch-time decision model. Journal of Product
Van Den Bulte, C. (2000). New product diffusion Innovation Management, 3, 134 –144.
acceleration: measurement and analysis. Marketing Zahra, S.A. and George, G. (2002). Absorptive
Science, 19, 366 –380. capacity: a review, reconceptualization, and

46 © Blackwell Publishing Ltd 2006


March 2006

extension. Academy of Management Review, 27,


185. Richard Adams and John Bessant are from the
Zaltman, G., Duncan, R. and Holbek, J. (1973). Inno- Innovation Studies Centre, Tanaka Business
vations and Organizations. New York: John Wiley. School, Imperial College London, South
Zien, K.A. and Buckler, S.A. (1997). From experience: Kensington Campus, London SW7 2AZ, UK.
dreams to market: crafting a culture of innovation. Robert Phelps is from Cranfield School of
Journal of Product Innovation Management, 14, Management, Cranfield, Beds MK43 0AL, UK.
274 –287.

© Blackwell Publishing Ltd 2006 47

You might also like