You are on page 1of 11

14678691, 2009, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/j.1467-8691.2009.00511.x by Readcube (Labtiva Inc.), Wiley Online Library on [22/10/2022].

See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
48 CREATIVITY AND INNOVATION MANAGEMENT

How to Use an Innovation Audit as a


Learning Tool: A Case Study of
Enhancing High-Involvement
Innovation
Erik W. Hallgren

Many types of innovation auditing exist, though there are few descriptions of them being
tested. Little effort has been made to examine their effect on companies, and even less to
considering whether these audits could be used more efficiently. First, this article discusses
some of the reasons for doing an innovation audit; then, it examines a new, facilitated,
interactive way of using an innovation audit to achieve/improve high-involvement innovation
in small- and medium-sized enterprises through a learning process.

Introduction letting them decide on the part(s) of the audit


on which to concentrate.
This article builds on existing innovation
M any types of innovation auditing exist;
however, little effort has been made to
examine their effect on companies, and even
audits and attempts to arrive at a new way of
using an innovation audit best suited to
less to consider whether these innovation improving high-involvement innovation. This
audits could be used more efficiently. This leads to the introduction of a ‘facilitated inter-
article proposes a new way of using an active innovation audit’ and subsequently to
innovation audit to achieve/improve high- testing this in an action research project that
involvement innovation as defined by Bessant ultimately aims to improve high-involvement
(2003) in small- and medium-sized enterprises innovation.
(SMEs). The article draws on two main sources in
Many current innovation audits are rooted developing the new audit approach, namely,
in new product development (NPD) theory, recommendations from other audits and the
with a natural focus on the various develop- high-involvement innovation concept, which
mental phases. A gap exists between these are treated in the following two sections. These
audits and those applicable to a company sources are then integrated in constructing the
wishing to focus on innovation in general, to audit, which is described using a five-layer
be able to draw on the mental potential of all model. The last part of the article is a case
employees and in circumstances other than study of an SME trying to enhance high-
simply product development. involvement innovation using this new inno-
Traditional innovation audits are still vation audit approach; the article ends with
needed, but there is also a need for another discussion and concluding sections.
type of audit approach. As van der Wiele et al.
(1996) discovered, not all companies benefit
from traditional innovation audits; they might Background to Developing the New
lack resources or training, or they might be Audit Approach
unable or unwilling to implement the pro-
posed improvements. This new way of execut- Searching for literature on innovation audits
ing an audit attempts to involve employees, reveals a certain amount of research. Some

Volume 18 Number 1 2009 © 2009 The Author


doi:10.1111/j.1467-8691.2009.00511.x Journal compilation © 2009 Blackwell Publishing
14678691, 2009, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/j.1467-8691.2009.00511.x by Readcube (Labtiva Inc.), Wiley Online Library on [22/10/2022]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
HOW TO USE AN INNOVATION AUDIT AS A LEARNING TOOL 49

authors describe the framework of how these implementing improvement projects; an audit
audits could be used (Radnor & Noke, 2002; process that emphasizes other parameters,
OECD-EU, 2005; Tidd et al., 2005), while such as employee involvement, engagement
others describe how they have built such an and learning, giving competence and legiti-
audit from scratch, what steps they have macy to the employees participating. The
undertaken in testing it, and the results results showed significant employee involve-
obtained thereby (Rickards & Bessant, 1980; ment and changed behaviour.
Chiesa et al., 1996; Tang, 1999; Dooley, 2000;
Francis, 2000; Cooper et al., 2004; Ozyilmaz &
Berg, 2004; Yam et al., 2004). Besides Cooper Recommendations of Existing
et al.’s (2004) audit being used as a benchmark, Audits and How to Apply Them
the other reported audits are tested on a small
scale. The identified audits were found in lit- In developing a new way to undertake an
erature databases and by following up refer- innovation audit, an obvious source of inspira-
ences in articles. Some older audits that were tion would be to review the literature concern-
only developed theoretically are not men- ing existing audits. The recommendations
tioned here. Two sources are PhD theses cited here come from reflections and conclu-
respectively developing audits for innovation sions found in the literature, concerning how
capability (Francis, 2000) and service innova- the reported audits could be improved.
tion (Ozyilmaz, 2001) with a substantial theo- Whenever an audit has been supported by a
retical foundation. One source is the Oslo facilitator, the conclusion is that the role of the
Manual (OECD-EU, 2005), which contains a facilitator is important in supplying external
very thorough background on building the expertise (Chiesa et al., 1996) and training for
questions in the European Community Inno- the persons involved (van der Wiele et al.,
vation Survey. One source concerns the most 1996). It is possible for an organization to
cited audit, undertaken with support from the conduct an audit on its own; as explained by
UK Department of Trade and Industry by van der Wiele et al. (1996), an organization
Chiesa et al. (1996); another source describes must be fairly advanced to be able to embark
an audit undertaken by a consultancy (von on self-assessment and has to start simply by
Stamm, 2003), and yet another describes a using specialists as assessors. Using an exter-
Danish audit involving 150 companies (Center nal facilitator both to guide the process and
for Ledelse, 2005). All the literature sources train internal personnel, the combination of
that include reflections on actual audit testing insiders and outsiders (Burgelman et al., 1995)
have been incorporated into the recommenda- allows the company to gain the desired com-
tions presented in the next section. None of the petence rapidly and seamlessly.
audits produce contradictory conclusions. One Little current literature examines how much
might wonder why these recommendations value companies have found in actually apply-
have not previously been incorporated into ing the innovation audit results and in choos-
newer audits; the answer might be the vast ing between, and implementing, any audit
legacy of quality audits and benchmarking, proposals. Chiesa et al. (1996) state that ‘the
where the audit report itself is the absolute long-term effectiveness will only be evaluated
goal. after some years of use’, indicating the pres-
The main criticism arising against the ence of a learning process. Francis (2000) states
reviewed literature is that the audit processes that some companies studied gained good
described end with feedback being presented results from the audits, while others tended to
to the company, and have too little employee disbelieve the results in the report. The author
involvement. Some newer literature on inno- (of the present article) participated in a project
vation, knowledge management and learning undertaken by CENTRIM in the town of Hast-
(de Bono, 1970; Nonaka & Takeuchi, 1995; ings (Francis and CENTRIM, 2004) and found
Boer & Bessant, 2002; Bessant, 2003; Argyris, that the 20 participating SMEs displayed only
2004; O’Reilly & Tushman, 2004; Senge, 2006) modest interest in the results of the self-
focuses on high-involvement innovation assessment audits but displayed much greater
and participation involving a broad base of interest in actual consultancy help or training
employees, not merely the R&D department in innovation matters. Audit results are better
or management. A new way of using the if the audit process involves as many people as
innovation audit might be necessary in order possible, and at the very least, a team should
to achieve/improve such high-involvement be formed (Chiesa et al., 1996) to take respon-
innovation. The new approach proposed here sibility for the process. Some audits only
takes these considerations into account, and involve the management group but suggest
has, moreover, been tested through an action that broader involvement should be con-
research project focusing on selecting and sidered (Francis, 2000), perhaps to prevent

© 2009 The Author


Journal compilation © 2009 Blackwell Publishing Volume 18 Number 1 2009
14678691, 2009, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/j.1467-8691.2009.00511.x by Readcube (Labtiva Inc.), Wiley Online Library on [22/10/2022]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
50 CREATIVITY AND INNOVATION MANAGEMENT

employees from dissociating themselves from Bessant and Caffyn (1997) defined a
the project (Schuring et al., 2003). new term, namely ‘high-involvement innova-
By discussing how the subject of innovation tion’. In his book published in 2003 (Bessant,
is treated within the organization, people nec- 2003) high-involvement innovation is devel-
essarily become more involved than if they oped into a concept spanning five steps
merely answered a number of questions. ranging from continuous improvement
Chiesa et al. (1996) found that ‘some compa- (Gertsen, 2001) to the learning and constantly
nies stated that the actual accomplishment of developing organization with emphasis on
the audit was, in a lot of cases, about the best involvement.
they had had’. Rickards and Bessant (1980) One might argue, why use high-
made the following evaluation: ‘the audit is involvement innovation at all? Two of the best
really useful when the outcome is used to insti- reasons are given by Tidd et al. and Bessant
gate a discussion in the company’; the same arguing that incremental improvements and
was said by a number of companies in a Danish innovation pay off and that collectively the
innovation survey (Center for Ledelse, 2005). small innovations often have a cumulative gain
Who, then, will decide which part of the in efficiency greater than that of occasional
audit is the most important? Even though radical changes (Tidd et al., 2005) and that
an audit could pinpoint issues requiring everyone carries the basic creative capabilities
improvement, employees might not agree for finding and solving problems and
with, or understand, the reasons for the recom- exploring new opportunities (Bessant, 2003).
mended changes. People within the company Involvement and participation are crucial ele-
ought to be those who know best; initially, one ments of high-involvement innovation and it is
might need to teach them how and what to imperative that employees accept the role of
observe, but thereafter they should be able to being actively engaged. The larger the power
select and decide for themselves. Chiesa et al. distance and the more political behaviour
(1996) found that asking questions that incor- resisting change that exist within a company,
porated metrics helped some companies but the more difficult it is for an employee to
certainly not all. They also found that best prac- accept the role of involvement and be allowed
tice and understanding of innovation are not and truly encouraged to participate.
static. One way of ensuring validity of the audit As high-involvement innovation is a frame-
is to change the audit questions when new work for the environment of innovation it does
ideas have taken root in best practice; another not define any size or type of innovation. High-
would be to allow employees to help select the involvement innovation is an approach where
areas of interest, guided by their experience of as many employees as possible are sought
daily work and with inspiration from the audit. to be involved in participating at any degree
By so doing the company does not merely in the innovation process (Bessant, 2003), a
follow a list of best practice but chooses those process that includes every step that leads to
projects that seem to suit their position best as improved business and by that, includes more
recommended by Tidd and Hull (2006). than the new product development (NPD)
The conclusions of the literature survey, process. Innovation is defined as any improve-
applicable in formulating the new audit, are ment introduced into any area given any size
that an external facilitator should always be of positive change in the business and with
included (at least on the first few occasions), inspiration and involvement from as many
and that it is also necessary to involve employ- employees as possible (Bessant, 2003). With
ees in a dedicated team. This is necessary in this definition it does not matter if the innova-
order to ensure broad involvement, which will tion is a small incremental innovation or a
create greater legitimacy than if the project disruptive radical innovation; it is still an inno-
were driven by management alone (Clausen & vation. The important aspect is how many
Kamp, 2001; Bessant, 2003; Argyris, 2004). were involved in the process and by that, indi-
The team then has to decide which parts of the cating the viability of utilizing the innovation
audit they wish to use, while keeping the process.
whole process, including selection and imple- This understanding of high-involvement
mentation, in view. innovation differs from the more product-
oriented NPD view used in many other
audits (Burgelman et al., 1995; Chiesa et al.,
High-Involvement Innovation 1996; Gardiner & Gregory, 1996; Cormican &
O’Sullivan, 2004). When the focus is broad,
The following presents a more detailed encompassing the full range of innovation,
description of high-involvement innovation in attention must also be paid to the environment
order to indicate the methodological basis of of the innovation and how all the employees
the new audit. are involved.

© 2009 The Author


Volume 18 Number 1 2009 Journal compilation © 2009 Blackwell Publishing
14678691, 2009, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/j.1467-8691.2009.00511.x by Readcube (Labtiva Inc.), Wiley Online Library on [22/10/2022]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
HOW TO USE AN INNOVATION AUDIT AS A LEARNING TOOL 51

How Learning Contributes tool, the material being grouped and collated
to Innovation with the focus on the conditions for high-
involvement innovation. The material for the
The learning and knowledge needed to gain audit was found through other traditional
competence in creating innovations have been innovation audits and through literature on
treated in theory, such as the learning organi- high-involvement innovation with the main
zation, where an example from management difference being how the material was used.
theory could be that by Senge (2006); whereas This new innovation audit approach is based
learning regarding change in cultural aspects on a group of employees who, co-operating
is more dependant upon theories such as with an external facilitator, discuss and choose
single- and double-loop learning, as espoused the points of interest from the audit material,
by Argyris (1977), or lateral thinking, by de to ensure involvement of employees and
Bono (1995). The employees in the accompany- implementation of selected improvement
ing case study were trained in the use of projects. This method of undertaking an audit
double-loop learning and lateral thinking and is described as ‘a facilitated interactive innova-
were encouraged to spread their knowledge tion audit’.
within the company. These tools were used for It is possible to identify five layers in mod-
challenging and changing underlying values, elling an innovation audit, as inspired by
routines and norms and for questioning ‘the Chiesa et al. (1996), Tang (1999), Francis (2000)
way we do things here’; these are approaches and Ozyilmaz and Berg (2004). These five
that comply well with the introduction and layers are used to demonstrate the difference
enhancement of high-involvement innovation. between the discussed innovation audit
approach, by concurrently comparing the tra-
ditional NPD audit approach and the new way
The Development and Description of using an audit. This traditional NPD audit,
of the New Audit Approach by as described by Chiesa et al. (1996), is among
Five Layers the most frequently cited; it represents an
audit developed from scratch and includes a
An audit comprises more than merely its description of a beta test. A brief comparison is
constituent questions. Other considerations presented in Table 1 followed by a more
include the underlying methodology of the detailed description.
questions, how the questions are applied,
and how feedback is given. Analysing these
matters can facilitate the development of a new Layer 1. The Innovation Theory Underlying
audit approach, based on the concurrent analy- the Methodology
sis of traditional audit approaches and the rec-
The Traditional Audit Approach
ommendations of others.
The ‘facilitated interactive innovation audit’ The main sources for the audit developed
was constructed mainly as an inspirational by Chiesa et al. (1996) were Freeman (1983),

Table 1. The Five Layers of an Audit, Comparing the Traditional Audit Approach Described by Chiesa
et al. (1996) and the New Innovation Audit Approach

The five layers The traditional audit The new audit approach
approach

1: Innovation theory Technological innovation High-involvement innovation


under-lying the
methodology
2: Methodology of the audit Performance and processes Involvement, participation,
learning
3: The materials used in Scorecards and questions Mind maps, information,
auditing inspirational questions
4: How the audit is used Assessing, identifying, Involving, selecting,
defining implementing
5: Type of feedback and results Report and presentation Implemented projects
motivated employees

© 2009 The Author


Journal compilation © 2009 Blackwell Publishing Volume 18 Number 1 2009
14678691, 2009, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/j.1467-8691.2009.00511.x by Readcube (Labtiva Inc.), Wiley Online Library on [22/10/2022]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
52 CREATIVITY AND INNOVATION MANAGEMENT

Roberts (1988), Adler et al. (1992) and Burgel- Layer 3. The Materials Used in Auditing,
man et al. (1995), with particular weighting e.g., Questions and Scorecards
given to Burgelman et al.’s audit framework.
Three other sources are mentioned in system- The Traditional Audit Approach
atizing the data, namely, Voss (1988), Clark and In their audit, Chiesa et al. (1996) provide
Fujimoto (1991) and Roussel et al. (1991). The many examples cited in the literature of best
theoretical inspiration stems from technologi- practice, divided into the following three
cal product and process innovation theory. categories:
• Scorecards for rapid overall assessment of
the practices adopted.
The New Audit Approach
• An in-depth audit for more detailed
The underlying rationale of this new audit investigation.
approach owes a great deal to Bessant (2003) • A performance audit.
and his concept of high-involvement innova-
tion. In addition, the theory of continuous The New Audit Approach
improvement and innovation (Caffyn, 1999;
Gieskes et al., 1999; CENTRIM, 2000; The materials used in this new audit approach
Coughlan et al., 2001; Boer & Bessant, 2002; are based on input from other audit types
Chesbrough, 2004) and new ways of looking at (Rothwell, 1994; Burgelman et al., 1995;
interfaces in the company (Cobbenhagen, Ahmed, 1998; Tang, 1999; Dooley, 2000;
2000; Chesbrough, 2004; von Hippel 2005) Francis, 2000; von Stamm, 2003), systematized
supported the development of the audit and grouped based on the theoretical founda-
approach. Inspiration was also drawn from tion mentioned in layer 1 and the literature
sources regarding learning (de Bono, 1970; review of best practice by van der Panne et al.
Argyris, 2004) and participation (Buhl, 2000), (2003). The audit material is structured using
with reference to employee involvement. two software systems: mind maps and search-
able web pages structured like mind maps but
dispersed over several hundred webpages.
Layer 2. Methodology of the Audit
The Traditional Audit Approach Layer 4. How the Audit is Used
The foundation of the audit methodology of The Traditional Audit Approach
Chiesa et al. (1996) is a process model of tech- The use of the traditional audit is broken down
nical innovation, divided between the follow- into three steps, as follows:
ing elements:
• Assessing current innovation practice and
• Core processes – concept generation, performance by answering the questions.
product development, process innovation • Identifying the gaps and the reasons for
and technology acquisition. them by comparing the responses to a data-
• Enabling processes – resources, systems base of previous responses.
and tools, and leadership. • Defining the action plan.
• Innovation performance – outcome of the
above processes.
The New Audit Approach
The following list indicates the steps and rules
The New Audit Approach of using the audit material that attempt to
enhance team involvement:
Underlying every innovation process is a
need for innovation capacity, capabilities and • Selecting an innovation steering group (IS
competencies; and the ability to handle the group) – a group of employees representing
innovation, skills, training and knowledge all levels of the company, preferably
supporting the underlying aspects in an orga- without the participation of top manage-
nization wishing to be innovative. The goal ment (support from management is,
is to strengthen these underlying elements however, mandatory).
through a learning process. The idea of the • Educating and training the IS group in
new audit approach is to achieve/improve innovation.
participation and involvement of as many • The IS group has to choose the areas of the
employees as possible; it should not be a audit on which they wish to concentrate.
management-driven project, but one approved • The IS group is responsible for the process,
and promoted by management using the back- implementation, setting milestones, plan-
ground of a systemic, holistic approach. ning events, etc.

© 2009 The Author


Volume 18 Number 1 2009 Journal compilation © 2009 Blackwell Publishing
14678691, 2009, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/j.1467-8691.2009.00511.x by Readcube (Labtiva Inc.), Wiley Online Library on [22/10/2022]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
HOW TO USE AN INNOVATION AUDIT AS A LEARNING TOOL 53

• Ensuring that all employees remain as tracts. The company has mainly been innova-
involved as possible in the work of the IS tive on marked issues, and has relied on their
group. suppliers for product innovations. On the one
• Making use of the textual information in the hand, it is a company where change is known
audit, most of the elements being backed by to happen; on the other, it is a company where
explanations, examples, etc. customer and employees’ surveys give the
• Creating a learning process with a long following ranking: ‘trustworthy, stable, but
duration initiated in a learning lab (Argyris, somewhat stagnating’. One of the explanations
2004) and then spreading this learning for the last comment might be that the changes
throughout the organization. have been made slowly over several years. It is
often the norm to expect innovation to come
from the R&D department, but this company
Layer 5. Type of Feedback and Results does not have such a department, and top
The Traditional Audit Approach management, rather than employees, has
driven the new initiatives.
The feedback was given to the companies by
the facilitators as a presentation to a broad-
based group of those involved and covering Action Research
the three steps described in layer 4. The An action research study is a study on interac-
issues revealed were then debated at the tion of the participants and their environment.
review meeting, at which responsibilities were One of the roles of the researcher is to bring
assigned for their implementation. methods, tools and inspiration to initiate a
process and to help sustain it for a certain
The New Audit Approach amount of time. Another role of the researcher
is to reflect upon what happens in the project,
The result for the company of the audit process and to use these reflections to improve
is a group of employees trained to some the process further. New knowledge is then
degree in innovation, who have selected a list created in the action between the researcher
of projects arising from interaction between and the participants, with no parts being
the audit material and the rest of the employ- dispensable (Argyris, 1993; Dawson, 1997;
ees through interviews, focus groups, ques- Greenwood & Levin, 1998; Gummesson, 2000;
tionnaires, open-space technology meetings, Reason & Bradbury, 2000; Coughlan &
etc. This differs in an important way from tra- Coghlan, 2002). The action research concept
ditional audits, in which the feedback is a list used in this case study has given the
of suggested improvements; rather, the selec- researcher the opportunity to observe, follow
tion and initiation of the projects are integral and participate within the company for two
parts of this new audit approach. and a half years.
The background to the development of the
new type of audit approach has been described
in the previous section, and the new audit Data Collection
approach has been compared to a traditional Data was collected in different ways and trian-
one in the five layers presented above. The gulations were done where possible. Work
next section describes an action research diaries have been made concurrently by use of
project in a company testing the new audit either notebook or tape-recorder. The material
approach, followed by a discussion of the stemmed from company documents; seven
results. semi-structured and 15 non-structured inter-
views; drawing sessions; six video-interviews;
participation in four banquets; 12 workshop
Testing the Audit in an SME days; Open Space Technology meetings with
all employees; staff meetings and a large
To validate the new auditing approach, testing amount of ‘small talk’ discussions with
was undertaken in a Danish SME over a period employees and managers. The article has sub-
of two and a half years. The company, which sequently been reviewed and accepted by the
is over 100 years old, is a trade and service company.
company with 75 employees and current To investigate the impact further on the use
annual turnover of approximately €30 million. of the audit approach and the learning process,
The company has shifted over the past ten two drawing sessions inspired by Morgan
years from being mainly a raw material sup- (2006) were used to study the employees’ per-
plier, to selling and servicing products to ception of innovation and were combined with
which they can add value with consultancy, the data collection methods mentioned above.
installation services and ongoing service con- The drawings were not used to give an exact

© 2009 The Author


Journal compilation © 2009 Blackwell Publishing Volume 18 Number 1 2009
14678691, 2009, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/j.1467-8691.2009.00511.x by Readcube (Labtiva Inc.), Wiley Online Library on [22/10/2022]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
54 CREATIVITY AND INNOVATION MANAGEMENT

measurement at one point in time but as a need for improvements in the company. The IS
comparative tool over time. This was done to group participants had to work with such
reveal elements and opinions of issues which methods as interviewing, problem solving ses-
are hard to measure: degree of involvement; sions, Open Space Technology meetings, cre-
employee participation; understanding and ativity tools and idea management, etc.
learning in regard to innovation. The case The main effect of the learning process for
study demonstrates that the drawing and the participants was expressed in their daily
metaphor method actually creates opportuni- actions. They had become active political
ties for important discussions and thoughts actors, being active in the change process.
that are useful in innovation matters when They only occasionally taught their colleagues,
comparing circumstances within the same but their impact was observed by all the man-
company over a period of time. agers, and by being picked from different
departments and geographical locations, they
slowly influenced their colleagues into accep-
The Project tance of several new initiatives, and eased the
The IS group participated in a learning lab change in their organizational structure. The
(Argyris, 2004) between November 2005 and legitimacy the participants brought with them,
May 2007 consisting of four one-day meetings, when convincing others to try new things, was
three two-day seminars, and various shorter amazing, not because they were able to
meetings. The IS group itself also arranged educate them, but merely from being involved,
several working group meetings. The audit asking questions and having received input
was used in different stages: as a learning tool from other employees through Open Space
from which to initiate discussions and to select Technology meetings, surveys, video inter-
those areas that needed improvement. views, etc.
On the first day-long meeting, several data-
collection projects were initiated (i.e., surveys,
video interviews and Open Space Technology Results of the Project
meetings), inspired by elements of the audit. The intention of this audit was not to produce
At the seminar that followed, participants a certain number of new products; instead, the
defined the first projects to be implemented aim was to create the involvement and learn-
with background in the data collection and the ing required for high-involvement innovation.
innovation audit. The participants’ experiences The IS group defined six projects upon
are illustrated by the following representative which to work: knowledge sharing, market-
quotations: ing, service competence, attitude, idea-
By looking at the audit I gained a more management, and rewards and recognition.
accurate picture of the extent of our task. The projects addressing these areas were mod-
Now I have acquired some clarity – which elled using knowledge from previous investi-
actually is a bit scary – that the task is so big, gations as well as suggestions and examples
with so many possibilities and places to from the audit material, and were imple-
start – this can go on for ever. mented in the company in the following
This has been a really great learning months. All projects were directed by the
process, including what we saw on the seven IS group participants, only one of whom
video – that we are so bad and must learn was from the management group. These
from our own mistakes – it surprised me – projects have generally been received quite
but we just have to do something about it. well and have instigated many minor initia-
tives. Top management was quite satisfied
with the results, as were the employees gener-
Learning as an Integrated Process ally. Some employees have, from time to time,
commented on the initiatives more negatively,
Owing to the nature of high-involvement
but generally only when they could not per-
innovation, learning is a very important part of
ceive their origins or rationale. The mood in
the new innovation audit approach. The learn-
the company was formerly rather defensive;
ing involved arises from several aspects of the
now it is more accepting and open to com-
audit process. When the IS group was selecting
ments where a need for improvement has been
areas of interest from the audit, they needed
identified. One participant in the service com-
fundamental knowledge of innovation. Train-
petence group observed that:
ing in this area was undertaken with a facilita-
tor, who helped the group to work through the There are more employees speaking up
accompanying material in the audit in the now; it might sound like grumbling, but it
selection process. The learning for the group is just because we aren’t used to people
expanded when the group investigated the putting forward suggestions.

© 2009 The Author


Volume 18 Number 1 2009 Journal compilation © 2009 Blackwell Publishing
14678691, 2009, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/j.1467-8691.2009.00511.x by Readcube (Labtiva Inc.), Wiley Online Library on [22/10/2022]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
HOW TO USE AN INNOVATION AUDIT AS A LEARNING TOOL 55

During project implementation, three groups the innovation process that was not present in
participated in the learning process and in 2005. There was much more energy, involve-
project selection and implementation. The first ment and enthusiasm in the subsequent dis-
group to be involved was the management cussion, whereas in 2005 the concern was
group, which evaluated and updated the strat- focused on how difficult, or even impossible, it
egy. The second was the IS group, whose main was to get ideas through. The main concern in
focus was enhancing high-involvement inno- 2007 was on concrete issues such as the need of
vation, while the third group looked into one an innovation project manager, more resources
of the six selected projects, namely, how to available to managers helping with ideas and
strengthen service competence. By involving more courage in trying new things among
the rest of the employees, most projects employees themselves. In 2005 the discussion
enjoyed broad-based implementation from the ended with the words: ‘It is very good that we
beginning. This gave legitimacy to group talk about this today, but the ideas are still
members, when answering the question ‘Why being prevented’. The drawing session in 2007
should we undertake this new project?’ with ended with the six participants making sug-
‘Because you asked for it’. gestions to solve some of the obstacles dis-
When the audit material was introduced for cussed, and engaging in solving the problems.
the participants it was expected that there were
going to be long discussions on selecting the
different subjects, but within three hours the Discussion
participants had selected the main areas with
which it was relevant for them to start. They An audit is often used in the process of bench-
were all very determined in the selection marking against other companies, to find areas
process and needed only a short time to select where improvement projects can later be initi-
the most important areas. This enforced the ated. The Oslo Manual (OECD-EU, 2005) and
author’s theory that most of the time you do traditional audits deliberately examine the
not need an audit report to tell you where you background and setting of the questions – an
need to improve – what you need is motivated obvious step when the goal is benchmarking.
employees and managers to make the changes In this paper, however, the audit is regarded as
and enough power to ensure it happens. a process in which employee involvement and
The participants had each selected different implementing employee-selected improve-
areas to investigate from the audit material. ment projects are its main goals. In the case
The combination of having support from an study, the employees undertook the fitting
innovation model, and being motivated by per- and refining of the projects by investigating
sonally having selected the most interesting the organization; the audit provided the inspi-
subject gave the participants a strong starting ration for this, and precise answers were
position towards being political actors and unnecessary.
entrepreneurs (Buchanan & Badham, 1999). Most early-developed audits and product
If the audit material had been used as a innovation audits have their basis in tech-
traditional audit the personal motivation of nologically oriented innovation (Burgelman
working with exactly the subject you found et al., 1995; Chiesa et al., 1996; Cooper et al.,
most interesting could be missing. The expert 2004); some audits developed later include
power found by the participants through the service and organizational innovation (OECD-
use of this facilitated innovation audit might EU, 2005), while some specifically focus on
not have been the same through a normal service innovation (Ozyilmaz, 2001). Such
innovation audit report. There is a lot of insti- audits are useful if the main purpose is to
tutional power (Pfeffer, 1981) in an external pinpoint improvement projects, after which
report showing improvement areas, but there a management group can choose which to
is probably even more in the personal motiva- implement. However, if the main focus is
tion and expert power found in the process of high-involvement innovation, many human
working with, and choosing, subjects yourself. aspects must be taken into consideration. It
Comparing the two drawing sessions that might be that a combination of a traditional
were held at the beginning and at the end of audit and the proposed new way of using the
the project it was found that the drawings from audit could work in tandem; however, in a
2005 all showed a negative view on how ideas service company such as the one examined in
were treated. The focus was mainly on how this case study, the need for technological
difficult it was to promote new ideas into innovation is much less than the need for
implementation. In 2007 there are still frustra- high-involvement innovation. Besides being a
tions but now they are concentrated around service company, this SME was regarded as
lack of steering and progress. The participants representative of most other companies in
used explanations that showed knowledge of Denmark where the majority of companies fall

© 2009 The Author


Journal compilation © 2009 Blackwell Publishing Volume 18 Number 1 2009
14678691, 2009, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/j.1467-8691.2009.00511.x by Readcube (Labtiva Inc.), Wiley Online Library on [22/10/2022]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
56 CREATIVITY AND INNOVATION MANAGEMENT

into the SME size bracket. The results could the project selection and implementation
probably also be found in larger companies , as phases. With this criticism in mind, this article
they are often grouped into smaller divisions. describes a new way of using an innovation
As for the disadvantages of such a new audit audit which was tested in an action research
approach, one of the main complaints would project within a service company. The employ-
probably be their greater use of resources; ees used the audit material both for inspiration
however, the output of this greater resource and as a learning tool, choosing for themselves
use will be an involvement build-up through the questions from the audit on which to work.
the employees’ learning processes (Bessant, Concurrently, they held discussions with other
2003), which means a greater chance for colleagues and undertook feasibility studies
general acceptance of new projects within the before selecting projects for implementation.
organization. Six of the seven participants in the steering
A traditional audit approach might have group were not from the management group,
been able to identify the same improvement which helped to legitimize the audit process to
areas; it might not, however, have been able to their colleagues. The audit process included
ensure the enthusiasm and participation of not only a measurement phase, but also selec-
group members or to build legitimacy for their tion and implementation phases.
acts – some of the building blocks of high- The projects undertaken in the case study by
involvement innovation (Bessant, 2003). A tra- the audit participants resulted in a new orga-
ditional innovation audit might well be suited nizational structure, efforts to change habits
to improving product development and tech- and routines, improved communication and
nologically oriented processes, but to improve several other projects. The development of
high-involvement innovation abilities, the new new service products has been started based
type of audit approach seems to have an on ideas collected by the newly established
advantage because of its broad-spectrum activ- idea-management system.
ity and participation. By concentrating on learning as a way to
It was concluded that the audit material in improve involvement in innovation, there is a
itself was not as important as expected; the risk that one might forget to examine the bar-
important issue was the expert power and riers that could exist and might be much stron-
motivation that the participants gained from ger than the learning effect, possibly hindering
using the material. This supports the statement involvement in the long term. Such barriers
that the material of the audit is not as impor- could include political, power-oriented and
tant as the learning process that is established. psychological issues arising from selecting
some employees, and not others, to participate
in the steering group. These issues are not
Conclusion covered in this paper, but will be treated in a
future article.
This article proposes a new perspective on
innovation audits, building on a criticism of
traditional ways of doing them. It is inspired References
by a review of the innovation audit literature
and theory, covering topics such as high- Adler, S., McDonald, W. and MacDonald, F. (1992)
involvement innovation (Bessant 2003), learn- Strategic Management of Technical Functions.
ing theory and knowledge management Sloan Management Review, 33, 19.
(Nonaka & Takeuchi, 1995; Argyris & Schön, Ahmed, P.K. (1998) Benchmarking Innovation Best
Practice. Benchmarking: An International Journal, 5,
1996). 45–58.
The basis of this new audit approach is high- Argyris, C. (1977) Double Loop Learning in Orga-
involvement innovation against the backdrop nizations. Harvard Business Review, 55, 115–25.
of the many existing types of NPD auditing. Argyris, C. (1993) Knowledge for Action – A Guide to
This context has given rise to a new audit Overcoming Barriers to Organizational Change.
approach based on participation and learning Jossey-Bass, San Francisco, CA.
and with a feedback mechanism that differs Argyris, C. (2004) Reasons and Rationalizations; The
completely from a report: a group of motivated Limits to Organizational Knowledge. Oxford Uni-
employees who, themselves, select and drive versity Press, Oxford.
the improvement projects. Argyris, C. and Schön, D.A. (1996) Organizational
Learning II – Theory, Method, and Practice.
Most existing audit types that have been Addison-Wesley, Reading, MA.
tested cease making observations shortly after Bessant, J. (2003) High-Involvement Innovation, Build-
delivering the report, meaning that there are ing and Sustaining Competitive Advantage Through
very few data from the implementation phase. Continuous Change. Wiley, Chichester.
If the main goal is to enhance a company’s Bessant, J. and Caffyn, S. (1997) High-Involvement
innovation ability, greater focus is needed on Innovation Through Continuous Improvement.

© 2009 The Author


Volume 18 Number 1 2009 Journal compilation © 2009 Blackwell Publishing
14678691, 2009, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/j.1467-8691.2009.00511.x by Readcube (Labtiva Inc.), Wiley Online Library on [22/10/2022]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
HOW TO USE AN INNOVATION AUDIT AS A LEARNING TOOL 57

International Journal of Technology Management, 14, Francis, D.L. (2000) Assessing and Improving Inno-
7–28. vation Capability in Organisations. PhD Thesis,
Boer, H. and Bessant, J. (2002) Organising of Continu- The University of Brighton.
ous Innovation. Aalborg University, DK and Cran- Francis, D.L. and CENTRIM (2004) New Enabling
field University, UK. Services to Support Innovation in New and Emerging
Buchanan, D. and Badham, R. (1999) Power, Politics, Firms – Guide to the Innovation Health-Check.
and Organizational Change: Winning the Turf Game. Freeman, C. (1983) The Economics of Industrial Inno-
Sage, London. vation. The MIT Press, Cambridge, MA.
Buhl, H. (2000) Hvor Vildt Kan det Blive? – Gardiner, G.S. and Gregory, M.J. (1996) An Audit-
Forankring af Participation Belyst Gennem Based Approach to the Analysis, Redesign and
Kommunikativ Praksis i Arbejdslivet. PhD Thesis, Continuing Assessment of a New Product Intro-
Technical University of Denmark, Lyngby. duction System. Integrated Manufacturing Systems,
Burgelman, R.A., Maidique, M.A. and Wheel- 7, 52–59.
wright, S.C. (1995) Strategic Management of Tech- Gertsen, F. (2001) How Continuous Improvement
nology and Innovation, 2nd edition. McGraw-Hill, Evolves as Companies Gain Experience. Interna-
New York. tional Journal of Technology Management, 22, 303–
Caffyn, S. (1999) Development of a Continuous 26.
Improvement Self-Assessment Tool. International Gieskes, J.F.B., Boer, H., Baudet, F.C.M. and Seferis,
Journal of Operations and Production Management, K. (1999) CI and Performance: a CUTE Approach.
19, 1138–53. International Journal of Operations and Production
Center for Ledelse (2005) The Seven Circles of Management, 19, 1120–37.
Innovation – An Innovation Management Model. Greenwood, D. and Levin, M. (1998) Introduction to
[WWW document]. URL http://www. Action Research. Sage, Thousand Oaks, CA.
innovationcup.dk. Gummesson, E. (2000) Qualitative Methods in Man-
CENTRIM (2000) Handbook of Continuous Improve- agement Research. Sage, Thousand Oaks, CA.
ment Enablers for Practitioners of New Product Morgan, G. (2006) Images of Organization. Sage Pub-
Development. CENTRIM, University of Brighton, lications, Toronto.
Brighton. Nonaka, I. and Takeuchi, H. (1995) The Knowledge-
Chesbrough, H. (2004) Managing Open Innovation. Creating Company. Oxford University Press, New
Research Technology Management, 47, 23–26. York.
Chiesa, V., Coughlan, P. and Voss, C.A. (1996) Devel- OECD-EU (2005) Oslo Manual – Guidelines for
opment of a Technical Innovation Audit. Journal of Collecting and Interpreting Innovation Data, 3rd
Product Innovation Management, 13, 105–36. edition, OECD, Paris.
Clark, K.B. and Fujimoto, T. (1991) Product Develop- O’Reilly, C.A. and Tushman, M.L. (2004) The Ambi-
ment Performance: Strategy, Organization, and Man- dextrous Organization. Harvard Business Review,
agement in the World Auto Industry. Harvard 82, 74–81.
Business School Press, Cambridge, MA. Ozyilmaz, A. (2001) Service Innovation Audit and
Clausen, C. and Kamp, A. (2001) Forandringer i the Role of Information Technology (IT) in
Arbejdslivet – Mellem Læring og Politik. Service Innovation. PhD Thesis, Rensselaer Poly-
Tidsskrift for arbejdsliv, 3, 73–94. technic Institute.
Cobbenhagen, J. (2000) Successful Innovation, Ozyilmaz, A. and Berg, D. (2004) Auditing Entre-
Towards a New Theory for the Management of Small preneurial Service Innovations. International
and Medium-Sized Enterprises. Edward Elgar Pub- Journal of Services, Technology and Management, 5,
lishing, Cheltenham. 394–429.
Cooper, R.G., Edgett, S.J. and Kleinschmidt, E.J. Pfeffer, J. (1981) Power in Organizations. Harper
(2004) Bench Marking Best NPD Practices – I. Business, Stanford, CA.
Research Technology Management, 47, 31–43. Radnor, Z.J. and Noke, H. (2002) Innovation
Cormican, K. and O’Sullivan, D. (2004) Auditing Compass: A Self-Audit Tool for the New Product
Best Practice for Effective Product Innovation Development Process. Creativity and Innovation
Management. Technovation, 24, 819–29. Management, 11, 122–32.
Coughlan, P. and Coghlan, D. (2002) Action Reason, P. and Bradbury, H. (2000) The Handbook of
Research for Operations Management. Interna- Action Research: Participative Inquiry and Practice.
tional Journal of Operations and Production Manage- Sage, London.
ment, 22, 220–40. Rickards, T. and Bessant, J. (1980) The Creativity
Coughlan, P., Harbison, A., Dromgoole, T. and Duff, Audit: Introduction of a New Research Measure
D. (2001) Continuous Improvement Through Col- During Programmes for Facilitating Organiza-
laborative Action Learning. International Journal of tional Change. R&D Management, 10, 67–75.
Technology Management, 22, 285–302. Roberts, E.B. (1988) What We’ve Learned: Managing
Dawson, P. (1997) In at the Deep End: Conducting Invention and Innovation. Research Technology
Processual Research on Organisational Change. Management, 31, 11–29.
Scandinavian Journal of Management, 13, 389–405. Rothwell, R. (1994) Towards the Fifth-Generation
de Bono, E. (1970) Lateral Thinking, A Textbook of Innovation Process. International Marketing
Creativity. Penguin Books, Harmondsworth. Review, 11, 7–31.
de Bono, E. (1995) Serious Creativity. Journal for Roussel, P.A., Saad, K.N. and Erickson, T.J. (1991)
Quality and Participation, 18, 12. Third Generation R&D – Managing the Link to Cor-
Dooley, L. (2000) Systems Innovation Management. porate Strategy. Harvard Business School Press,
PhD Thesis, National University of Ireland. Boston, MA.

© 2009 The Author


Journal compilation © 2009 Blackwell Publishing Volume 18 Number 1 2009
14678691, 2009, 1, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/j.1467-8691.2009.00511.x by Readcube (Labtiva Inc.), Wiley Online Library on [22/10/2022]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
58 CREATIVITY AND INNOVATION MANAGEMENT

Schuring, R.W., Harbers, C., Kruiswijk, M., von Stamm, B. (2003) Innovation audit tool, London
Rijnders, S. and Boer, H. (2003) The Problem of Business School. [WWW document]. URL
Using Hierarchy for Implementing Organisa- http://www.innovationwave.com [accessed on 4
tional Innovation. International Journal of Technol- March 2004].
ogy Management, 26, 903–17. Voss, C.A. (1988) Implementation: A Key Issue in
Senge, P.M. (2006) The Fifth Discipline, The Art and Manufacturing Technology: The Need for a Field
Practice of The Learning Organisation. Random of Study. Research Policy, 17, 55–63.
House, Business Books, New York. Yam, R.C.M., Guan, J.C., Pun, K.F. and Tang, E.P.Y.
Tang, H.K. (1999) An Inventory of Organizational (2004) An Audit of Technological Innovation
Innovativeness. Technovation, 19, 41–51. Capabilities in Chinese Firms: Some Empirical
Tidd, J. and Hull, F.M. (2006) Managing Service Findings in Beijing, China. Research Policy, 33,
Innovation: The Need for Selectivity Rather than 1123–40.
‘Best Practice’. New Technology, Work and Employ-
ment, 21, 139–61.
Tidd, J., Bessant, J. and Pavitt, K. (2005) Managing
Innovation – Integrating Technological, Market and
Organizational Change. John Wiley & Sons, New Erik W. Hallgren (Erik@w-hallgren.dk) has
York. a PhD from DTU Management, the Techni-
van der Panne, G., van der Beers, C. and cal University of Denmark. He has a
Kleinknecht, A. (2003) Success and Failure of BSc(Eng) and a Masters in Management of
Innovation: A Literature Review. International Technology. The subject of his PhD thesis
Journal of Innovation Management, 7, 309–38. was learning and innovation in SMEs with
van der Wiele, A., Williams, A.R.T., Dale, B.G., particular attention to participation and
Carter, G., Kolb, F., Luzon, D.M., Schmidt, A. and involvement by employees. He has 15 years
Wallace, M. (1996) Self-Assessment: A Study of of experience in the electronics industry as
Progress in Europe’s Leading Organizations in both R&D manager and researcher, includ-
Quality Management Practices. International ing receiving two patents, with companies
Journal of Quality and Reliability Management, 13, such as Intel Denmark, Vitess Semiconduc-
84–104. tor, among others.
von Hippel, E. (2005) Democratizing Innovation. The
MIT Press, Cambridge, MA.

© 2009 The Author


Volume 18 Number 1 2009 Journal compilation © 2009 Blackwell Publishing

You might also like