You are on page 1of 39

59

Chapter 3
Planning for Knowledge
Management:
Conducting a Knowledge Assessment

Cynthia Shamel
Shamel Information Services, USA

ABSTRACT
As data, information, and knowledge proliferate, professionals continue to grapple with the need to get
their arms (or head) around it all. Needs analysis, information audits, and knowledge audits represent
a range of processes intended to aid in understanding what an organization knows and how the workers
can best access the knowledge. The chapter examines the knowledge assessment process with practical
examples based on project experience. Drawing on case reports from the literature and studies undertaken
by the author, the chapter addresses various methodologies, possible outcomes, typical challenges, and
occasional pitfalls. The author’s experience sheds light on techniques and strategies leading to strategic
recommendations and successful project results.

INTRODUCTION: TAKE STOCK the absence of an audit or in the absence of


understanding the role of information in the
Knowledge management (KM) begins with enterprise.
knowing what you know and do not know - This chapter looks at the knowledge assess-
and understanding the consequences. Experts ment as a key component of the knowledge
agree that a successful knowledge manage- management process, beginning with what to
ment initiative will begin with a baseline call it and ending with a discussion of trends
of insight into an organization’s current and future directions. Using case studies
knowledge related practices, and some will and highlighting specific tips and examples
go so far as to say that KM initiatives fail in through the Theory in Practice feature, the
chapter covers background and history, jus-
DOI: 10.4018/978-1-4666-5186-9.ch003

Copyright © 2014, IGI Global. Copying or distributing in print or electronic forms without written permission of IGI Global is prohibited.
Planning for Knowledge Management

tification and benefits, structure and steps, knowledge (generally found in the heads of
and future trends. knowledge workers) and explicit knowledge
First things first: What do we call the (found in reports, databases, books, and other
process? The literature includes at least the objects). Gaps analysis, needs assessment,
following terms and probably more: knowl- and library services studies represent subsets
edge audit, knowledge assessment, informa- or portions of a larger audit project. Which
tion audit, gaps analysis, needs assessment, terms to use will depend on two questions: 1)
library services study, information services Where is the organization in the KM process?
study, knowledge resource inventory. While and 2) What language will resonate within the
these names are often used interchangeably, organization’s culture?
they are not synonymous. Rather, they repre- For the purposes of this chapter, the broad-
sent a continuum of processes in the attempt est and all encompassing term is knowledge
to understand how knowledge workers get, assessment. More specific terms such as needs
store, and share information and knowledge. analysis, information audit, or knowledge audit
Just as data becomes information that then are used when appropriate.
becomes knowledge, understanding the pro- Where Is the Organization in the KM
cess and how it impacts workers depends on Process? In a paper presented at the Global
needs analysis, information analysis (audit), 2000 Worldwide Conference on Special Li-
and knowledge assessment (audit). A needs brarianship, Susan Henczel (2000) suggests
analysis tends to focus on what knowledge that the needs analysis, information audit, and
workers require in order to do their jobs. knowledge audit help move an organization
An information audit will examine how in- from information management to knowledge
formation assets are used, how they move, management. Figure 1 shows where each
and how they support organizational goals. of these projects fits into the KM process.
A knowledge audit includes analysis of tacit Henczel expresses a distinction between these

Figure 1. Knowledge assessment and the KM process ©Susan Henczel (used with permission)

60
Planning for Knowledge Management

terms and shows where the process fits into audit facilitates an integrated and interactive
an overall knowledge management initiative. approach to knowledge management, includ-
One might view the continuum as a pro- ing the means to develop a strategic response
gression from data to knowledge. What sort to managing tacit and explicit knowledge as
of data does an organization need to generate well as programs and services (personal com-
or acquire in order have necessary information munication July 12, 2013).
that can be developed into the kind of tacit or As far as definitions go, Ulla de Stricker
explicit knowledge helping the organization may have taken the angst out of the definition
meet its strategic goals? by simply stating that the audit is a process to
Henczel makes the following distinction discover “how knowledge workers go about
between an information audit and a knowl- getting, storing, and sharing information and
edge audit: knowledge and with what results” (personal
communication March 27, 2013).
The information audit finds out what informa- What language will resonate? Deciding
tion resources and services people need to do what terms to use or how to name the process
their jobs, as well as how those resources and is more than a matter of formal definitions,
services are actually used. An information theory, and conventional understanding. What
audit enables the mapping of information to call an actual project or process can depend
flows and identifies bottlenecks, gaps, and on specific sensitivities within the enterprise,
duplications. and project leaders should always use lan-
guage meaningful to those participating in
The knowledge audit identifies an organiza- the process. An information audit carried out
tion’s knowledge assets and how and by whom within the Australian Securities and Invest-
they are produced. If an information audit ments Commission was called “information
has already been conducted, a knowledge discovery” because that term “was seen as be-
audit will also allow assignment of a level of ing ‘a more friendly term than Audit’” (Orna,
strategic significance or importance to those 1999, p. 203). When a client requests a library
knowledge assets. services study and then goes on to describe, to
a T, what an information professional would
These days most definitions of the knowl- call an information audit, wait before offer-
edge audit would state that the study addresses ing a correction. Does it really matter? If the
tacit as well as explicit knowledge. Since term “library services study” has meaning
Henczel wrote in 2000, the concepts have for the client and it does not misrepresent
continued to evolve. Dale Stanley and Guy St. the project at hand, then go along and call
Clair, in teaching the knowledge audit process, the project a library services study. One can
distinguish between the needs assessment, the always provide background and definitions in
information audit, and the knowledge audit. the final report, if necessary, but it is helpful
The needs assessment is reactive and gives to use language with meaning for the people
the study team information about what work- involved (see Box 1).
ers require to do their jobs. The information Definitions, scope, steps, and methods for
audit process is proactive, identifying gaps any knowledge assessment project will depend
and developing an understanding of how upon the goals and objectives of the specific
knowledge assets come into the organiza- study. Whatever it is called, the process gen-
tion, move, and are shared. The knowledge erally seeks to inform decision making

61
Planning for Knowledge Management

Box 1. Theory in practice: What to call the project

Experts differ on whether to call an audit an audit. Those opposed to using the term suggest that clients are put off by the
financial connotations of the word because they tend to associate it with restriction or change.

In the case of a study completed by the editor of this book and the author of this chapter for a global company, the client
was very specific that the term audit not be used. The preferred project name was Information/Knowledge Resources
Study. This name held meaning for the knowledge workers in the enterprise and did not convey any negative implications.

On the other hand, several years ago this chapter author recommended an information audit to a medical diagnostics
company. The project champion and decision maker was none other than the Chief Financial Officer who loved the term
‘audit’, fully embraced its connotations, and approved the project with the suggested budget and timetable.

within an organization. The next section ex- to “Information Challenges.” In it he points


amines some of the history and background out that technology alone does not provide
behind the knowledge assessment, the ques- the information executives need to do their
tions the study tries to answer, and the deci- jobs. “Enterprises and individuals will have
sions it seeks to inform. to learn what information they need and how
to get it. THEY WILL HAVE TO LEARN
TO ORGANIZE INFORMATION AS THEIR
BACKGROUND: UNDERSTAND KEY RESOURCE” (p. 110). Drucker goes
THE CONTEXT on to assert that most knowledge workers and
executives have not made much of an effort
Information audits and their kindred have to decide what information they need, much
become an important tool for knowledge less how to organize it. If today’s businesses
managers and information professionals need further convincing about the value of
throughout the world. Australia, the United “knowing what you know” perhaps Drucker’s
Kingdom, the United States, South Africa, and view on knowledge worker productivity will
China in particular have produced numerous seal the deal. “The most valuable asset of a
case studies in conducting information audits. 21st-Century institution, whether business or
Librarians and information professionals are nonbusiness, will be its knowledge workers
often, but not always, the instigators of these and their productivity” (p. 135).
studies. Research scientists, elected officials, While Drucker makes the global, sweeping
and corporate boards also point out the need case for the information or knowledge audit,
to better understand the holdings and use of there are at least two nitty gritty forces at
information and knowledge assets in an organi- work to justify such initiatives. Quoting KM
zation. Leaders generally seek to provide their consultant Nigel Oxbrow, Library Journal
knowledge workers with the resources they noted in the year 2000 that the “two main
need to do their jobs and meet organizational drivers for information audits … are intranets
objectives, but the leaders also desire to know that don’t deliver benefit … and knowledge
the most efficient and cost effective means. management initiatives, where the KM team is
Peter Drucker (1999), well known business trying to get a handle on information available
management guru, addressed the urgency and from both inside and outside the organization,
importance of information to the knowledge and on where and when that information is
worker in Management Challenges for the needed” (DiMattia & Blumenstein, 2000, p.
21st Century. He devotes an entire chapter 48). Practically speaking, knowledge work-

62
Planning for Knowledge Management

ers and executives are motivated for a wide In the abstract for a 1996 article entitled
range of reasons and are in a quest to address “The Knowledge Audit” in the journal Stra-
a multitude of questions with the intention of tegic Direction, it is stated that “[a]n audit
delivering cost effective information solutions should be conducted to assess and value an
to workers across the enterprise. organization’s knowledge base and learning
The next section examines the history skills.” Here, the purpose of the audit is to
of knowledge assessments and provides ex- assess whether the organization’s culture
amples of the motives behind them. encourages learning.

Early Use of the Term


HISTORY OF THE KNOWLEDGE ‘Information Audit’
ASSESSMENT PROCESS
The term “information audit” in the Factiva
In the Dow Jones news database Factiva, the news database appears first in Computing
first mention of a “knowledge audit” appears magazine on September 3, 1987. Officials
in the Portland [Maine] Press Herald on June in a European country ordered each govern-
18, 1996. A writer for the paper interviewed ment department to conduct an “information
director Alan King from the Center for Energy audit” to identify valuable information that
Information. Regarding the knowledge audit, could be offered for sale to the private sector.
King says (p. 3C): A broader search of the library and informa-
tion literature sees the information audit term
It’s a term we coined, but it’s a specific func- in use well before 1987. The Bulletin of the
tion. We make a company step back and look American Society for Information Science
at how information is used in an organization published R.H. Riley’s two page article “The
from an individual level. What information Information Audit” in 1975. In 1979, Infor-
do you need to do your job? Where does that mation Manager published an article by A.V.
information come from, what information do Quinn titled “The Information Audit: A New
you create, and where does it go? Tool for the Information Manager.” By 1999
information audits were “being done … in a
King may not have heard of the concept wide range of businesses and organizations
of a knowledge audit before his company in the UK, from pharmaceutical firms, banks,
“coined the term,” however there are earlier and the health service, to charities and cultural
mentions in the published literature. At about organizations such as museums” (Orna, 1999,
the same time (June 23, 1996), a Mr. Denham p. 69). At the same time the United States
Grey posted this thought on the KM Forum: library and information literature reflected
a lively discussion of the concept includ-
I have noticed an increase in “knowledge ing “The Corporate Information Audit” in
artifacts” and their use in decision streams Library Management Quarterly, 1991; “The
within organizations. This trend is likely to Information Audit” in Information Advisor,
grow as connectivity increases and standards 1995; and “Information Audits: What Do We
for “data” exchange improve. It is part of my Know and When Do We Know It?” in Library
knowledge audit process to enquire, detect, Management Briefings, 1997.
rank and evaluate K artifacts which are an In early 2000, Paul Burden produced a
important knowledge object. bibliography of knowledge management

63
Planning for Knowledge Management

publications used by the Center for Knowl- can contribute to strategic planning, suggest-
edge Management at Dominican University. ing it is “a way for an organization to not only
His search of 34 business, education, and see where it is in terms of its Knowledge
information science databases resulted in a Management program, but also assist in plan-
list of 86 articles on knowledge mapping and ning its future development” (p. 69).
information audits with a strong emphasis
on mapping over auditing. Research for this
chapter produced a bibliography of over 100 QUESTIONS TO ANSWER:
references focused on the knowledge or in- WHAT DRIVES AN AUDIT?
formation audit, with well over half (58) of
them published in 2000-2011. A search of Knowledge workers generally launch an in-
60 multidisciplinary databases, conducted in formation audit to solve a problem or inform
early 2013, produced the results in the chart a project or process. Sometimes the initiator
shown in Figure 2. The first reference comes is the library or information center. Workers
from 1976, and the peak of 172 references in other departments often recognize the need
occurred in 2007. for an assessment of some kind. Interested
As more and more enterprises came to parties include research and development,
realize that effective knowledge management legal, finance, and information technology.
depends on a clear understanding of current Government departments are often interested
conditions and practices, the audit gained because they wish to demonstrate prudence
traction as an important component of knowl- and excellence in KM. This author has worked
edge management planning. As Paul Burden on audits initiated by workers in business
said in 2000, “If the Knowledge Map/Infor- development, customer insights, and strategic
mation Audit is not done prior to any com- marketing. A recent request for assistance
puter, network, or personnel changes, then all came from medical research scientists in a
of the effort, resources, and time will be branch of the United States military. It may
wasted.” Burden further notes how an audit well represent a shift “up the food chain” as

Figure 2. Chart showing frequency of mentions of “Information Audit” or “Knowledge Audit” in the
published literature

64
Planning for Knowledge Management

organizational leaders call for better knowl- • How does knowledge flow throughout
edge management strategies and tools. the organization?
What drives an audit? What prompts the • What blockages are there to that flow
knowledge worker to decide it is time to take (i.e., to what extent do people, process-
stock of the situation and make plans to move es, and technology currently support
forward? We already know from Oxbrow and or hamper the effective flow of knowl-
DiMattia that audits will be prompted by in- edge)? (p. 366).
tranets that do not deliver benefit, the desire
to launch knowledge management initiatives, Leung’s list does a good job of covering just
and the need to get a handle on information about any scenario that might constitute the
assets. Based on over thirteen years of expe- need for an information or knowledge audit.
rience with information audits in a library The goals and objectives of most audits will
or information center, Chris Dobson (2002) fall under the scope of one of these questions.
wrote that broader project goals can prompt It is very important to clarify exactly what
an audit and will vary depending upon the questions the audit intends to answer and what
specific needs of the organization. She offers objectives the project will aim at accomplish-
this elaboration (p. 32): ing. Such information will support the business
case for conducting the audit and inform the
If you’re setting up a new library, you want design and methodology for the audit itself. In
to pinpoint needed resources, discover gate- The Information Audit, Susan Henczel (2001)
keepers (those people who can answer nearly elaborates on the various strategic objectives
any question from their personal knowledge of the information audit. Among others she
or individual library), and find out how the points to the following (p. 27):
organization will use information once you
provide it. For existing information services, • To ensure that information resources
you should focus on awareness, relevance, us- and services support organizational
ability, and unmet needs. If you’re developing goals
a knowledge management system, you’ll need • To identify the needs of key informa-
additional data on how information moves tion users in the organization
within the organization. • To map information flows within the
organization and between the organiza-
More recently, Zeno C.S. Leung et al. tion and its external environment
(2010) in the Department of Applied Social • To identify gaps and duplications or
Sciences at Hong Kong Polytechnic University areas of over-provision of information
stated (p. 366). A typical knowledge audit resources
usually attempts to answer the following • To identify the important information
questions: resources used by the organization

• What are the organization’s knowledge Any number of organizational realities can
needs? spur the launch of a knowledge assessment.
• What knowledge assets or resources We do know that the advent of technology put
does it have and where are they? a greater urgency on understanding informa-
• What gaps exist in its knowledge? tion assets. In 1988 Peter Drucker pointed out

65
Planning for Knowledge Management

“as advanced technology becomes more and that impacts productivity. The need to reduce
more prevalent, we have to engage in analysis costs, enhance findability of information,
and diagnosis - that is, in ‘information’- even manage information overload, avoid reinvent-
more intensively or risk being swamped by ing the wheel, or ‘know what we know’ have
the data we generate” (p. 3). The driver for each been justification to launch a knowledge
the audit will inform the methodology and assessment. Having a handle on reality can
the scope of the project (see Box 2). help the enterprise avoid decisions that damage
the flow of knowledge. This happened to the
Chrysler Corporation in the 1980s when re-
WHY CONDUCT A KNOWLEDGE organization disrupted the engineers’ network
ASSESSMENT? for sharing tacit knowledge. Design defects
ensued, thus damaging product quality and
In the end, what turn of events will prompt an reputation (Cohen, p. 78).
organization to take on a project that tends to Goals for a knowledge assessment will
rock the boat and challenge the status quo? vary, but benefits are assured and can include
Outcomes can require the proverbial turning (Servin & De Brun, 2005, p. 22):
of the ship, which may not be easy when the
ship is large and has momentum. Experience • Helping the organization clearly iden-
indicates that the captain or one of the other tify what knowledge is needed to sup-
officers of the ship has identified a situation port overall organizational goals and
that puts the organization at risk or a problem individual and team activities.

Box 2. Theory in practice: What prompts an audit?

Experience with several audit projects demonstrates how the motivators behind the audit and the problem being addressed
can inform the scope of the project.

Scenario 1: A pharmaceutical company librarian expressed concern that knowledge workers on the commercial side of
the business (not the scientists) might not have all the resources they need. The librarian suggested they might want access
to such resources as Harvard Business Review and Datamonitor. Resulting project: Conduct a needs assessment using a
series of 20 interviews to identify gaps and determine what resources the team actually needed.

Scenario 2: A geographically dispersed company planned to launch a knowledge sharing initiative and wished to identify
resources and knowledge throughout the organization that would be appropriate to share across locations. Resulting
project: Conduct an information audit through numerous interviews and collect data from the procurement process to
identify information assets suitable for sharing.

Scenario 3: Business development staff in a mid-size firm had orders from the Board of Directors to get a better handle
on the competition. The initial vision was to create a competitor intelligence database. The directive from the Board
brought to light the larger challenge: No one was responsible for overseeing the knowledge assets of the enterprise in
terms of acquisition, creation, storage, or sharing. Information silos prevailed, and home grown solutions were common.
Resulting project: Conduct a knowledge audit to fully understand where information came from, how it was shared,
how much it cost, and what barriers were limiting the flow. The project included a survey of all 700+ employees and
interviews with 30 stakeholders to identify nodes of information, gaps, and opportunities to improve processes.

In all three cases, significant additional value was derived from the fact that the audit uncovered much more information
than was at first anticipated. For example, in Scenario 2 it became apparent that improvements in the organizations’
mechanisms for sharing knowledge among employees were called for.

66
Planning for Knowledge Management

• Giving tangible evidence of the extent the process include goals, objectives, budget,
to which knowledge is being effectively enterprise size, available time, and human re-
managed and indicating where im- sources. This section of the chapter examines
provements are needed. the leadership team, the working environment,
• Providing an evidence-based account and some of the soft skills required for suc-
of the knowledge in an organization cess. Then, an overview of basic structure and
and a tracking how that knowledge steps to follow is illustrated by specific cases
moves around in, and is used by, the and standard methodologies. Subsequent
organization. sections discuss how to collect information,
• Presenting a map of what knowledge what to measure, how to perform analysis and
exists where in the organization, re- evaluation of findings, and how to deliver or
vealing gaps and duplication. communicate findings.
• Identifying pockets of knowledge that
are not currently being used to good Begin at the Beginning
advantage and therefore offer untapped
potential. A successful knowledge assessment requires
• Providing a map of knowledge and that certain foundations be in place. They
communication flows and networks, re- include skilled leadership, a clear mandate
vealing examples of good practice and with time and budget, and support from top
blockages and barriers to good practice. management. While the number of people
• Presenting an inventory of knowl- with firsthand experience in conducting the
edge assets, allowing them to become information audit may be limited, there are
more visible and therefore more mea- definite characteristics to consider in assem-
surable and accountable, and giving a bling the team.
clearer understanding of the contribu-
tion of knowledge to organizational Define the Leadership Team
performance.
• Supplying vital information for the An assessment or audit team needs skilled
development of effective knowledge leadership. Ideally the leader has experience
management programs and initiatives or training in the process (or access to the
that are directly relevant to the organi- appropriate expertise). Each member of the
zation’s specific knowledge needs and team needs time to dedicate to the project.
current situation. How much time will vary, but it would be
realistic to allow for a 50% time commitment
spread over 30 to 120 days. A comprehensive
LET THE ASSESSMENT BEGIN: knowledge audit with extensive interviews
CARRYING OUT THE PROCESS and knowledge mapping in a large corpora-
tion can take as much as a year or more, and
Over and over again the literature states the project team needs to be available and
there is no one set method for conducting an supported throughout.
information audit or knowledge assessment. In addition to time, team members need
Indeed, experience indicates the tools to apply impartiality and honesty to obtain a thorough
or the approach to take must be aligned with view of the good and the bad of informa-
the situation at hand. Variables influencing tion and knowledge within the organization.

67
Planning for Knowledge Management

Participants need to trust the integrity of the Equally well respected audit professionals
team in order to feel comfortable sharing their assert the benefits of bringing in an outside
views with confidence. The team also requires consultant. The benefits outweigh perceived
a good measure of “people” skills to assure ef- costs, assuring impartiality, expertise, and the
fective listening, political sensitivity to issues depth of an outside opinion. In this author’s
within the organization, tact, and flexibility. experience, knowledge workers speak more
Other soft skills suitable to the task include freely to an outsider than they do to their own
good communication and time management. colleagues, suggesting the possibility that
Internal or External Expertise? Given that findings may be more valid when obtained
there is no one accepted methodology for by an outsider (see Box 3).
conducting a knowledge assessment, it should
come as no surprise that experts do not agree Address the Actual Work Environment
on whether the audit should be conducted by
insiders or outsiders to the organization. Eliza- The actual working environment can directly
beth Orna, information audit expert writing impact the ability of the team to gather the
in 1999, is unequivocal. The process “should necessary information and assess the oppor-
be managed and controlled from inside the tunities for the organization. The three most
organization, and carried through by people important variables affecting this aspect of
who work there.” She holds this view largely the project include management support (as
because she places high value on the “knowl- part of corporate culture) and budget.
edge … people have of their own organization”
(Orna, 1999, p. 79). The information audit
team assembled at Miller Brewing Company Table 1. Miller Brewing’s list of pros and cons
reached the same conclusion (Table 1). Its for hiring a consultant
members examined the options of hiring an
Pros Cons
external consultant or having the team itself
• Lacking bias • Time to bring
conduct the audit. After looking at the pros • Outside experience from similar consultant up to speed
and cons of a consultant, they decided that an projects • High cost
• Credibility of recommendations
internal team would perform the audit.

Box 3. Theory in practice: The case for an outside consultant

A mid-size pharmaceutical company’s librarian required an objective assessment of her services and the resources
provided to her internal clients. She was well liked throughout the company and had good working relationships with
colleagues in numerous departments. When the library staff sought information to evaluate resources and services, she
wisely contacted a consultant to conduct the assessment. When the librarian is well liked and appreciated, constituents
sometimes hold back on criticism or complaints for fear of hurting feelings or damaging relationships. An outsider can
offer anonymity and encourage participants to share honest views of existing services and projected needs.

A small biomedical company brought in an outside consultant largely because no one internally had an understanding
of the knowledge assessment process. In fact, at the outset it was not even realized that such a process was possible. The
managers knew only that they needed help with information management. The consultant was able to suggest an audit as a
tool to provide a strategy for addressing the information management challenges.

A large global corporation hired a consultant to conduct an information audit largely because the internal staff did not
have adequate time to dedicate to the process. The company provided active project input, but the outside consultants
conducted the work and compiled the results with significant value-add recommendations.

68
Planning for Knowledge Management

Support from upper management is essen- support the project’s business case. This in-
tial to the success of a knowledge assessment formation may influence the decision to recruit
project. The process requires timely, open, internal or external expertise. While a tar-
and honest responses from workers across the geted needs assessment is possible with a
organization, and in general these individu- budget as small as $10,000, budgets ranging
als need to know that management endorses from $30,000 to $150,000 are more typical.
their participation, gives them permission to Factors influencing cost include the size of
use their time on the initiative, expects them the organization, the number of people to be
to deliver honest and professional answers to interviewed and/or the number of focus groups
the questions asked, and will not recriminate to be held, the depth of analysis required, and
or punish negative findings in any way. When the scope of recommendations.
a project launches, a letter from management
stating these expectations contributes signifi- Process Overview
cantly to the smooth initiation and completion
of information gathering and sets the stage With the consistency of a spiritual mantra, the
for later implementation of recommendations KM literature asserts and agrees that there is no
(see Box 4). one accepted methodology for performing an
A wise project planner wants to know in information or knowledge audit. Nevertheless
advance the expected costs for any project. knowledge assessments do get done efficiently
Management needs to understand project costs and effectively by working through a few core
and anticipated benefits in order to build or steps that have proven effective over time.

Box 4. Theory in practice: Sample letter from management to announce the project

Dear Colleagues,

In our corporate effort to advance goals in knowledge management and to continue developing knowledge sharing across
the organization, I invite you to participate in an exciting new initiative we believe will deliver considerable value for all
business teams.

The Knowledge Center and Corporate Library has launched a Knowledge Assessment Study, headed by Jane Infopro
on the KM Team. Working with Brilliant Consultants Inc., we will identify new, cost effective ways to deliver new
knowledge and share existing knowledge across the enterprise.

Experts from Brilliant Consultants will contact you soon to schedule a 30-minute interview in order to discuss your
information management practices and the resources you consult in the course of your work. All responses will be kept
anonymous with results aggregated to protect confidentiality.

This project has the full support of the Board of Directors. When the consultants contact you, we ask that you:

     1. Make time in your schedules to meet with them whether on the telephone or in person to provide input from
your team, and
     2. Provide honest input to the project in order to best inform findings and recommendations.

Your assistance in this strategic initiative is greatly appreciated.

Sincerely,
Joan Honcho
Chief Executive Officer

69
Planning for Knowledge Management

The key to success is flexibility appropriate chapters on challenges and culture), the orga-
to the situation at hand. In spite of the lack of nizational culture could inhibit open participa-
a universal approach, experience has shown tion in a knowledge assessment project. Some
that a few key steps provide a fairly universal organizations have insurmountable barriers to
structure to the process: knowledge sharing. Examples include secu-
rity clearances in governmental departments,
1. Planning, proprietary financial information in publicly
2. Information Gathering, owned companies, and restrictions imposed
3. Analysis, by intellectual property rights. Acknowledg-
4. Recommendations, ing such conditions in advance helps project
5. Reporting, and managers plan a process that works within
6. Implementation. these realities rather than ignoring them.
In the course of a knowledge assessment
Working with and through these six steps, project, knowledge workers will be asked to
the audit team can customize the details to fit cooperate in answering surveys, participating
the project goals and the organizational reali- in interviews, or compiling and sharing lists
ties including the budget. If the budget cannot of information assets. The project design and
expand to meet all the project objectives, then methodology must take all these variables into
the project must adapt to fit within the budget. account in order to assure success (see Box 5).
It means setting priorities, attending to the Not all recommended methods or steps
most important concerns first, and working address the concept of implementation. Per-
as cost effectively as possible. haps it is assumed that recommendations
A productive audit process aligns closely flowing from the study will in fact become
with organizational goals and objectives. reality. In any case, carefully developed rec-
The true value of an information audit lies ommendations and clearly communicated
in maximizing the impact from information reporting should lead to a plan for implemen-
and knowledge resources on advancing the tation. Finally, closing the loop on the assess-
goals of the enterprise. A productive audit ment process is the notion to “repeat.” Knowl-
requires sensitivity to organizational culture, edge auditing should be a cyclical process
taking into account attitudes toward sharing repeated at intervals to reinforce awareness
and managers’ support for knowledge manage- and ensure the organization stays on track.
ment. Where information hoarding, silos, and Experts in knowledge auditing have pub-
‘knowledge is power’ attitudes prevail (see the lished their own variations on project structure,

Box 5. Theory in practice: Management support

Management support can make all the difference in terms of knowledge worker participation in an information audit. In
one project I inquired about the culture from the point of view of assuring maximum participation in an all-employee
survey, suggesting that some kind of incentive to encourage participation might be appropriate. The executive assured me
not to worry. In the end there was a 90+% response to the online survey. Here’s why: The CEO instructed employees to
respond to the survey.

It turns out the company had a strong CEO from whom employees were accustomed to receiving instructions to which
they were expected to respond. This particular instruction was no different from others. The CEO says “do X,” and so it
was done.

70
Planning for Knowledge Management

with the number of steps ranging from three A Practical Guide. It has become one of the
to ten. Huan Vo-Tran (2011) at RMIT Uni- best known methods for the information audit.
versity in Melbourne, Australia summarized Henzcel’s Seven Stages are:
10 information audit methodologies described
in the published literature between 1987 and Stage One: Planning
2004 (p. 273). Some of the methodologies Stage Two: Data Collection
outlined leave much to the imagination. For Stage Three: Data Analysis
instance, the three step process says simply, Stage Four: Data Evaluation
Stage Five: Communicating Recommenda-
1. “Initial audit (inventory), tions
2. Collecting the data, and Stage Six: Implementing Recommendations
3. Data analysis.” Stage Seven: The Information Audit as a
continuum pointing back to the ongoing
Elizabeth Orna’s (1999) process, described process of matching services with needs
in Practical Information Policies, offers a
more detailed view containing 10 steps, nota- Henzcel asserts that this is not a highly
bly ending with Step 10: Repeat the auditing structured or controlled process but rather
cycle (p. 75). a flexible one able to bend to meet varying
In 2001, scholars from The Robert Gor- conditions and constraints. In 2006, the South
don University’s Aberdeen Business School African Journal of Libraries and Informa-
Centre for Knowledge Management described tion Science published a test of the viability
a knowledge management initiative to which of this seven step approach. Authors Lufuno
they provided assistance. The project ad- Raliphada and Deonie Botha found that Hen-
dressed the tacit and explicit knowledge held zcel’s method “could be effectively used as
by a 20 person team in the tax department of an information management activity within
a large oil company. It was quite ambitious, a medium sized public organization.” They
leading to a detailed knowledge management further concluded that flexibility and cost
strategy and a plan for implementation. The effectiveness are the two biggest advantages
team applied an eight-phase approach (Bur- of this method. They also point out that the
nett, Illingworth, & Webster, 2004, p. 27): process is cumbersome, particularly in that the
planning stage includes activities that need to
Preliminary Phase: Setting the Scene be repeated later (p. 249).
Phase 1: Learning Day Henzcel’s approach has gained some trac-
Phase 2: Measurement Criteria tion over the years as its application gets tested
Phase 3: Audit Interviews and reported. In addition to Raliphada’s evalu-
Phase 4: Development of Knowledge Map ation of the effectiveness of Henzcel’s seven
Phase 5: Feedback Event steps, Vo-Tran opted for Henzcel’s method to
Phase 6: Implementation Plan Development study creation, processing, and dissemination
Phase 7: Implementation of information in a mid-sized architecture firm.
He chose the method after careful examination
At about the same time Burnett was work- of nine approaches examined in the literature
ing with the oil company tax team, Susan between 1987 and 2008. Vo-Tran chose this
Henczel (2001) published her information methodology (p. 275) because it …
audit methodology in The Information Audit:

71
Planning for Knowledge Management

1. Leverages the strengths of earlier works Briefly stated, the stages involve determin-
2. Focuses on a strategic direction for the ing the answers to the following questions:
organization
3. Includes a continuum or cyclical process 1. What are we attempting to find out?
4. Incorporates information technology into 2. How much time do we have, and who is
its overall process doing the investigation?
5. Considers management and operational 3. What methods will be most suitable for
aspects with the submission of a busi- collecting information about information
ness case in the planning stage before assets, practices, and services?
proceeding 4. How can we ensure everyone understands
clearly what is going on and why?
Thus, the published literature appears to 5. How can we gain and sustain manage-
support acceptance of Henczel’s approach to ment support?
conducting the information audit. Neverthe-
less, the fact remains that each project will have Establish Objectives
important individual characteristics calling for
a customized approach. The following sections The organization’s leaders must clearly under-
take a closer look at the key steps generally stand, and the project’s leaders must clearly
making up each project, including examples define, what the project will accomplish and
from project experience. how the findings will inform organizational
decision making. What problems or oppor-
Planning tunities will the project address? Definition
of project objectives affects the rest of the
The five Ps of project execution apply: Prior process and can influence budget, timeline,
planning prevents poor performance. In the methodology, and findings. Objectives are
case of a knowledge assessment, regardless of not “things we will do during this audit.”
scope, prior planning can assure useful results, Objectives point to a larger organizational
adequate time and budget, smooth execution, need that can be addressed through the find-
cooperative and engaged participants, and ings of the audit. The objectives of the study
project support throughout the organization. will influence the methodology, the buy-in
Thus, the key actions in preparing to launch from management and executives, the likely
a knowledge assessment include: participants, the plan for communication, and
the scope of the recommendations. Objectives
1. Establish objectives for undertaking an audit vary and may include:
2. Define the scope and resource allocation
3. Choose a methodology for data collection • Identifying content for a Web site or
4. Develop a communication strategy intranet
5. Enlist management support • Determining the first steps in a larger
KM initiative
These steps are common and fundamental • Supporting information services or in-
to good project planning, and they are spelled formation technology activities
out in great detail by Susan Henczel in The • Addressing an identified problem in
Information Audit: A Practical Guide. sharing or learning

72
Planning for Knowledge Management

• Aligning knowledge resources with or- leaders thought to address is not the key issue
ganizational goals and objectives after all. Flexibility in listening and learning
• Discovering opportunities for cost may point the team toward even more pro-
savings ductive approaches to addressing knowledge
• Establishing a benchmark for future management within the organization than
reference those originally set out as expected outcomes
• Improving service efficiency and (see Box 6).
effectiveness
• Retaining or identifying sources of or- Define the Scope and Resource
ganizational knowledge to prevent loss Allocation
of expertise
Project planning must address the actual scope
Objectives must be developed within and of the project. Careful definition of scope and
adapted to the framework of the organization. resources keeps the project on track and on
Such an understanding provides the necessary time while delivering actionable information.
foundation for defining reasonable and reach- There are at least four ways to scope the project,
able objectives. Fundamental organizational depending upon the objectives being addressed:
characteristics such as internal politics, struc-
ture, culture, and communication practices 1. Limit activity to a specific department
help define the possibilities and options for or departments rather than including the
knowledge management. For example, inter- entire organization.
nal politics sometimes make it difficult to get 2. Use the organizational chart to define a
full participation from relevant departments. certain demographic such as high level
Understanding the structure, often seen in managers or key information users for
the organizational chart, helps identify where participation in the study.
knowledge resources may lie and who should, 3. Limit the scope based on geography, so
or should not, participate in the study. Culture that only one site or city or country or
influences most objectives but particularly region participates in the audit.
knowledge sharing. If the study team knows 4. Focus on a specific problem or question
at the outset that knowledge workers have a for all affected departments to address.
history of guarding information or holding it
close to vest, it may or may not be appropriate The scope clearly influences the time, staff,
to set “improved information flow throughout and budget necessary to meet project objec-
the company” as one of the objectives. Culture tives. In deciding how much time to allow for
not only relates to sharing but can reflect an project completion, planners must decide who
overall attitude toward information. Internal will conduct the assessment (internal staff or
cultural barriers need not derail a knowledge external consultants), how many people can
management project, but they cannot be de- commit to working on the project, and how the
nied or ignored. expense affects spending on other enterprise
The best laid plans of mice and men do at projects and priorities. In many cases, these
times go astray. The findings of a knowledge three variables will shift in relation to each
assessment project may reveal the need to ad- other, leading to a need to balance and weigh
just objectives. In other words, the results of them at the outset and as the project moves
the audit could indicate that the issue project forward (see Box 7).

73
Planning for Knowledge Management

Box 6. Theory in practice: Responding to unexpected realities

Every project begins appropriately with carefully defined objectives. Planners ask themselves “what do we hope will
come out of the study and what will we do with the findings?” Experience indicates that audit findings may uncover
unexpected realities and thus impact goals as the project unfolds.

Example 1
Problem to Address: The business development team needs a better way to manage information related to other
companies in the industry: “If only we could gather up the resources housed across the company into one database, we
would save time and effort and have better intelligence.”
Project Findings: The lack of information management was pervasive. Every department had the same notion that
“information resources exist somewhere - they just need to be corralled and organized.”
Recommendation: A technology solution (database) was not the answer. In this case, the information audit revealed the
need for an information professional empowered to centralize information and knowledge management and provide cost
effective services across the entire organization.

Example 2
Problem to Address: We have a fabulous new intranet site. The assessment project will identify resources from across the
company that can be added to it for all to share.
Project Findings: Most of the content housed in various departments was not suitable for broad sharing in an enterprise
wide search site. The resources already on the site, as defined by the knowledge management team, were well chosen and
perhaps sufficient. The larger issue uncovered by the study was the inability of knowledge workers to identify “who does
and knows what” within the company.
Recommendation: Develop an employee or expertise directory to facilitate and otherwise support networking and
connections between various departments and teams across the enterprise.

Box 7. Theory in practice: Dealing with an expanded scope

One large knowledge audit was based on a plan for time, participants, and budget that assumed a maximum of 50
interviews with knowledge workers on five continents. As a result of the commonly encountered “you might like to
interview as well our colleagues in X office,” the actual number of interviews was closer to 70.

Neither the size of the project team nor the budget could increase. As a result, the timeline bore the brunt of the change,
stretching out to accommodate the extra interviews.

Choose a Methodology for Data analysis if the team does not have access to
Collection or expertise in software typically used for that
kind of crunching. Rather, the method should
In the planning phase, the assessment leader- fit available resources while still providing
ship team must outline a method to collect and the information necessary to meet project
analyze data and formulate recommendations. objectives.
The options for information gathering are
discussed in more detail later in this chapter. Develop a Communication Strategy
The method must align with available tools
and resources. For instance, there is no point Open communication before, during, and
in deciding to hold focus groups if the study after the study contributes significantly to the
team lacks money to pull groups together success of the project. Careful consideration
or skills to manage the groups. Similarly, of communications during the planning stage
the method should not rely on complex data can help assure a high level of participation

74
Planning for Knowledge Management

and useful input. Knowledge workers are busy signage. Of equal importance is the messen-
meeting their own goals and objectives as they ger. Should the message come from the study
manage the priorities and concerns of their team, management, the board, or someone
departments and teams. A project as encom- else? As mentioned earlier, in one case an
passing as a knowledge or information audit email from the company’s Chief Executive
can come across at best as a distraction or at Officer proved sufficient to encourage worker
worst as a threat. The project team needs to plan participation and establish project priorities
for messaging content and communication across the organization. Choosing the most
channels to employ throughout the process. appropriate messenger can help ensure the
Effective messaging communicates the message gets heard.
benefits of the audit so that knowledge work-
ers understand how the project outcome will Enlist Management Support
improve their own situations. It helps manage
expectations by defining how much input time Finally, if the project team does not already
is requested, when to expect the output or have management support in launching or
results of the study, and what kind of changes commissioning a knowledge assessment, then
could result. Messaging after project comple- it must establish support during the planning
tion should include a summary of shareable period (see Box 8). Without support from the
findings and possible next steps. top, the project is likely to suffer from lack of
Knowledge assessments sometimes raise funding, lack of participation, lack of access
fears among workers that some kind of change to necessary tools, or - worst of all - lack of
is afoot that could result in more work, fewer implementation of project recommendations.
resources, less access to necessary informa- The knowledge assessment team needs to
tion, or even personnel shifts. Employees do assure managers that it understands how the
not welcome projects they fear might lead to project will advance organizational goals.
layoffs or staff reductions. In this case, the Should the team need to construct a business
messaging must address goals and outcomes case in order to bring top management on
focusing on the anticipated benefits of the board, Elizabeth Orna offers the key points
process. managers need to understand and support
Communication channels vary, but project (1999, pp. 76-77):
leaders should engage all appropriate means to
convey the message to the affected knowledge • The objectives of the audit, both imme-
workers before, during, and after the audit. diate and longer-term
Typical options include a newsletter article, • The long term benefits to be expected,
an email blast, individual direct emails, an in terms of achieving key business
intranet newsfeed, employee meetings, and objectives

Box 8. Theory in practice: The need for an internal champion

During the planning stages of one information audit the internal champion, who in this case was the Executive Vice
President of Human Resources, abruptly left the company. Project leaders knew the initiative could not go forward
without executive level support. Fortunately the Chief Financial Officer, recognizing an opportunity to evaluate spending
on information resources, quickly picked up the mantle and carried the project forward. Only a week or two was lost in the
timeline, with no significant impact on project outcome.

75
Planning for Knowledge Management

• The scope proposed: is the audit to • Do not try to cover too much. For ex-
cover the whole organization, or parts ample, avoid the temptation or outside
of it, or particular activities or process- pressure “to take advantage of this op-
es? Is it to start with one or more pilot portunity” by adding “just one more
projects? question” to a survey.
• The phases proposed: the audit plan • Test and validate every questionnaire
should be based on realistic steps, with or survey to be sure responders under-
stopping points for evaluation and deci- stand the questions so that they are able
sion making to deliver the useful answers you seek.
• The benefits from each phase: what the
organization can expect to gain from Information gathering requires project
each step planners to consider which tools to use, from
• The timescale, expressed both in per- whom to collect data, and what questions to
son days and the total elapsed time to ask. While there is no one “correct” method,
completion there is ample history and experience to draw
• The deliverables, for example [progress from in making informed choices.
reports and presentations at the end of
the each phase] Data Collection Tools
• The resources required.
Most knowledge assessments rely on surveys,
Information Gathering interviews, and focus groups to gather the
bulk of necessary information. However, these
A knowledge assessment invariably involves are not the only options for the project team.
the collection of information. What informa- There are at least six data collection methods.
tion to collect and how to collect it unfolds Analysis of Existing Documents and
within the development of a method and re- Databases: Taking time to understand what
fers back to objectives, scope, and resources. resources and content are already at the dis-
Within this context, methods for data col- posal of knowledge workers can save time
lection vary to include analysis of existing in the long run. Knowing what information
documents and databases, observation of the enterprise creates and uses can influence
behavior, monitoring actual resource usage, what questions to ask in the surveys or inter-
questionnaires, interviews, and focus groups. views. It is also useful to inquire with finance
Each approach has its own benefits and chal- or procurement within the organization to
lenges. Many projects involve a combination learn how information assets are purchased
of collection techniques in order to meet the and categorized. It can be informative - and
designated objectives. In maximizing the sometimes surprising - to see what is not
opportunity for success, one must keep the known about spending or cannot be known
following points in mind: due to lack of proper tracking.
Observation: This technique reveals bar-
• Keep data collection in line with proj- riers or stumbling blocks in the flow of in-
ect goals and resources. Chose only formation or in the execution of technology
those methods you have the staff and solutions. Watching users search the intranet
the budget to execute well. or interact with document management tools

76
Planning for Knowledge Management

uncovers users’ search techniques and assump- answered within 20 minutes. Survey testing
tions about findability. Of course watchers is non-negotiable. It is inevitable that while
should obtain permission from those being all the questions and expected answers may
watched. seem clear to the survey designer, something
Monitoring Actual Usage: In the days be- will be unclear or be misunderstood by the
fore electronic and digital assets, monitoring responders. Testing, rewriting, and retesting
usage might have been done by noting how will assure maximum usability of the data
often a book got checked out or what reference ultimately collected.
materials were left behind on library tables. A good response rate for a widely distrib-
Now, statistics available through database uted survey should exceed 70%. One would
or online subscription vendors and through hope for at least 50% for validity, but with the
Website monitoring tools such as Google right incentives 90% is not out of the ques-
Analytics shed light on what resources get tion. Incentives could be tangible or monetary
visited how often. rewards or a request or mandate from manage-
Questionnaires: Administering a question- ment. Effective incentives vary depending on
naire is easier than ever with online survey organizational culture and expectations.
tools (commercial or free). The fee-based Interviews: It is hard to envision a knowl-
tools offer more powerful survey and analyt- edge assessment process that does not include
ics features, but for a wide range of projects interviews. They enable a two way flow of
the free versions work well. Questionnaires information not readily achieved through
are particularly useful to collect factual data other methods. Open ended questions and the
such as lists of “go-to” resources or databases, follow up questions flowing from them can
personal subscriptions, or data sources. Ques- lead to discoveries and insights not otherwise
tionnaires offer many advantages in that they revealed. Interviews are generally held one-
can be administered to relatively large groups on-one, however they may involve two or
of people, deliver information in a short pe- three people who work closely together and
riod of time, reach geographically dispersed have similar needs or challenges. Benefits
groups, and offer anonymity or confidentiality. of interviews include the ability to probe for
Successful surveys are short with clear and more detail or further explanations as appro-
unambiguous questions. They may include priate, the opportunity to explore information
open ended questions (the answer cannot be flows and barriers, the opportunity to build or
yes or no), multiple choice questions, or rating strengthen relationships with key knowledge
scales. The following open ended question workers, and participation from all relevant
is recommended for every questionnaire and groups within the organization.
is generally offered as the last question: “Is Interviews are time and labor intensive, and
there anything else you want us to know for interviewers require training and experience.
the purposes of the study?” It gives responders Fortunately interviews need not occur face to
the opportunity to offer information the project face. Telephone calls, online video chats, or
planners could not have anticipated and often Webinar software enable affordable 30-60
leads to surprising insights. Most knowledge minute conversations across time zones. As
workers cannot or will not take more than with the questionnaire, interview questions
20 minutes or so to respond to a survey. should be tested and practiced by the inter-
Twenty to 25 questions could be considered a viewers. In most cases, training or practice
maximum, as long as on balance they can be for simple interviews can be accomplished

77
Planning for Knowledge Management

with observation and two or three practice the analysis to say something like “of x indi-
sessions. A typical interview begins with a viduals interviewed, y consider ease of use to
welcome message and “thanks for taking time be the most important feature of a corporate
to speak with me.” Most interviewees appreci- intranet.” The semi-structured interview
ate receiving in advance the set of questions begins with a prepared list of questions or
to be used and an overview of the purpose of topics to use in eliciting information, but can
the knowledge assessment project, an indica- also include more open ended questions and
tion how the results might be used, and an enable an experienced interviewer to follow
estimate when the results will be available. up on selected points or responses. The un-
In addition, they typically request a project structured interview is informal, beginning
recap as the interview begins. It is useful to with a general explanation of the topic or
manage expectations by explaining how the information of interest. It requires a skilled
interview will be conducted and reaffirming and experienced interviewer to draw out the
how much time it will take. After the scripted salient points.
or preplanned questions are asked, the final Focus Groups: A focus group amounts to
open ended question “is there anything else collective interviewing. A moderator leads
we need to know?” provides an opportunity six to ten people in addressing typically five
for interviewees to volunteer detail not already questions or topics. When conducted in ad-
covered. It is useful to ask permission to get vance of a series of interviews, focus group
back in touch should the interviewer require findings feed the formation of questionnaires
clarification or further information. In turn, the or interview questions. When held after
interviewer can provide appropriate contact distributing a questionnaire or conducting
information should the knowledge worker one-on-one interviews, the focus group af-
have any questions or further insights to offer fords an opportunity to expand on or clear up
after the interview. individual findings. Group discussions often
Whether to tape the interview remains bring out information that might otherwise
an open question. Some information audi- go undetected (see Box 9). While some assert
tors consider it mandatory while others say that participants are more forthcoming in a
that recording inhibits the conversation and group than they might be as individuals, that
encumbers the process. At a minimum, the is not always the case. Some might hold back
interviewer must take notes, and experience for fear of what others think of their ideas. It
indicates that an immediate review following helps if all participants are at the same level
the end of the interview provides the op- within the organization. Mixing supervisors
portunity to correct and clarify the notes for and subordinates in the same group can stifle
future reference. sharing. Focus group sessions last 45-90 min-
In planning the interview, consider which utes, and as the name suggests, the discussion
type will best suit the project at hand. There moves from a general view to a more focused
are at least three types of interviews: struc- discussion of the questions at hand. Topics to
tured, semi-structured, and unstructured. cover are typically sent out in advance so that
The structured interview has a preset list of participants can give some thought to their
questions with each question asked in the opinion or answers.
same order during each interview. This ap- Moderating a focus group takes a fair
proach requires minimal interviewing skills. amount of practice and training. The mod-
It also delivers quantifiable results, enabling erator, sometimes called the facilitator, must

78
Planning for Knowledge Management

Box 9. Theory in practice: Surprising findings from a focus group

Information professional Chris Dobson (2002) discovered the ‘two click rule’ in a focus group. The topic revolved around
the value of a biweekly newsletter distributed electronically by the company librarian. In the course of the discussion, a
consensus emerged. If the notifying email included a link to the newsletter, recipients would click on the link and read the
newsletter. If the notification required the recipient to go first to the library intranet site and then click on the newsletter,
they probably would not bother.

Dobson uses the finding as an example of the kind of information that would only come out during a focus group (p. 35).

maintain objectivity and see that the study fied and selected? Often the internal project
objectives are met. In addition, the moderator sponsors can point to the teams, departments,
needs to listen carefully, guide the discussion, and users best able to inform a knowledge
and ensure that everyone has a chance to assessment. In one audit, conducted for a
participate. The successful focus group takes company with 3,500 employees, the project
place in a relaxed atmosphere with a free flow team relied on executive management to select
of ideas and conversation. participants. The project sponsor requested
each of the 80 senior leaders in the company to
Project Participants appoint someone from their team to make time
for an interview. DiMattia and Blumenstein
Whether the study team elects to use question- (2000) cites the example of a Westinghouse
naires, one-on-one interviews, focus groups, or information audit with a pool of 22,000 em-
a combination of these methods, it is impor- ployees on which to draw. Recognizing that
tant to decide what constitutes a meaningful she could not include everyone, she needed
sample size and who needs to have a voice. to establish criteria defining who should to
Sample size varies depending upon meth- include (p. 50). In this case the corporate
odology and project goals. In theory, with a librarian identified her customers (and likely
questionnaire or online survey, every knowl- candidates for a survey) by culling two years
edge worker in the enterprise could participate. of research questions to see who asked them
Automated online survey and analysis tools and by examining circulation records for busi-
make it possible to collect and analyze large ness books to see who had checked them out.
quantities of input. Of course, the possibility Selection of participants can influence
does not imply suitability. It may be best to the findings, the recommendations, and the
decide which sections of the company have ultimate implementation of any changes
relevant information or knowledge needs and coming out of the audit. Study participants
practices and then target these groups. That often become advocates for the outcome and
being said, inclusion has its benefits as it can take part in the implementation process. One
help increase interest and buy-in while some- criterion to apply in selecting participants is
times uncovering unexpected information. to seek out the gatekeepers or information
Organizational culture and available resources gurus. Experience indicates that most organi-
(staff and budget) help guide the decision. zations have individuals with strong interest
In the case of interviews and focus groups, in information management or significant
sample size must accommodate all affected knowledge of information needs. For example,
constituencies in order to assure valid out- such individuals may have initiated a local
comes. How are appropriate candidates identi- knowledge management solution of their

79
Planning for Knowledge Management

own (such as a portal or share site). Within a 1. Information resources currently used
team or department, workers will often turn (content and ‘containers’)
first to the gatekeeper or guru for information 2. Guardians and stakeholders
solutions before turning to IT or the library 3. Information flow and interactions
(if there is one). In the case of focus groups, 4. Technology and systems to support the
it is helpful to invite members from the same use of information
department, project team, or job classification. 5. How the cost effectiveness of information
Having something in common helps assure is assessed
a reasonable level of interest and discussion
from them. Finally, as mentioned earlier, it is Orna details what one might want to know
best to avoid mixing supervisors and subor- about each of these general areas, pointing out
dinates (see Box 10). that knowing what information or knowledge
resources the organization owns or has access
Questions to Ask to, and knowing where they reside, is funda-
mental to any knowledge assessment project. It
Consistent with the understanding that there is the beginning of ‘knowing what we know’.
is no one “correct” method for conducting a Identifying and understanding the practices
knowledge assessment or information audit, of guardians and stakeholders provides valu-
it should come as no surprise that there is no able input to creating a knowledge map and to
one set list of questions to ask. Whether you identifying nodes or collections of informa-
opt for a survey, individual interviews, or fo- tion. Inevitably within a business unit or an
cus groups, the questions to ask will depend enterprise, individuals take an interest and
entirely on the objectives of the project. In rise to the occasion as local unofficial gurus
any case, ensure the questions relate directly of information management. Individuals gain
to the project. Unrelated questions lead to a reputation as the go-to person or the first
fatigue and lack of interest among those be- line of defense in pointing to locally held
ing interviewed and serve as a distraction for information assets. Identifying these people
those analyzing and evaluating the findings. and collecting information on what they
Typically, in a comprehensive knowledge know reveals a great deal about information
study, the team wants to know about the fol- creation, acquisition, storage, and flow within
lowing broad areas (Orna, 1999, p. 84): the organization.

Box 10. Theory in practice: Survey or interviews?

Not all knowledge assessments require a survey and interviews, but some do. In one case the company was small enough
to permit a survey of all employees plus a round of one-on-one interviews. The questionnaire sought to determine overall
corporate practices for finding information and to build an inventory of sources used. It was crafted and tested online
using the paid version of SurveyMonkey, and the corporate CEO ultimately distributed the link to all employees. The
response rate was very high and resulted in data that could be used to recommend corporate journal subscriptions and
document delivery options.

The subsequent interviews delved into departmental knowledge management practices and challenges. Interview findings
uncovered internal knowledge management champions and produced a better understanding of corporate culture revealing
an overreliance on email and a general feeling of information overload. One surprising finding revealed a competitive
intelligence risk. When she could not find useful information within her own company, one knowledge worker relied on a
former colleague (who happened to be at a competing company) to supply certain types of search results for her.

80
Planning for Knowledge Management

Questions about information flow focus The questions asked and the level of detail
on identifying internal and external sources: expected from responders must align with each
Who brings information into the company, individual’s position in the organization and the
how is it shared, and what barriers inhibit the amount of time allotted. Questions that can be
flow? Technology and systems should sup- answered ‘off the top of the head’ generally
port this flow, facilitating access to necessary receive much more participation than questions
resources. Thus, questions about technology requiring extensive digging into spending re-
address usability, appropriateness, and com- cords or time sheets. Henczel outlines a process
patibility with other systems. wherein the interviewee is asked to list the
Finally, most knowledge assessment stud- tasks performed and the information required
ies do well to determine a baseline of expendi- to complete each task. Then, he or she is asked
tures and perceived value in order to address to describe where the information comes from
perceptions of cost effectiveness. Ideally the and how important it is to the task it supports
questions related to costs shed light on actual (on a scale of 1 to 5). Henczel’s questionnaire
expenditures by a given business unit or by also asks for a listing of information or reports
the entire organization. Surprisingly, many created by the business unit for other sections
companies do not know what they spend of the organization. Finally, the questionnaire
to acquire external information or create asks responders to rate the importance of vari-
reports internally. The accounting systems ous characteristics when choosing or using a
lack adequate categorization to easily identify particular information resource. These char-
information related spending. For example, a acteristics include availability, accuracy, cost,
subscription to a database or market research currency, and delivery method (p. 96).
service might be labeled “consulting” in one Such insight provides important input rating
business unit, “research” in another, and “mis- the value of resources and to mapping infor-
cellaneous” in a third. Thus, the first round in mation flow, but providing this level of detail
the knowledge assessment may simply bring to is time consuming. Analyzing the findings is
light such opportunities to improve or clarify also time-consuming. Since this level of detail
recordkeeping. Once it is clear, for example, is not necessarily needed from each and every
that seven departments are each spending responder, questionnaires might be tailored or
an average of $50,000 per year for the same customized for responders within a department
type of information content, the study recom- or business unit (see Box 11 and Box 12).
mendations may suggest negotiating a more
cost-effective enterprise wide subscription.
Henczel (2000, p. 220) approaches the ANALYSIS AND EVALUATION
categorization of topics for questions more
broadly, suggesting that it is usual to collect Once the input has been collected, by whatever
three types of data: means, the next steps involve data analysis and
evaluation. Strictly speaking, analysis means
1. Data relating to information required to separating the data into its constituent parts
perform tasks and activities for study while evaluation means examining,
2. Data relating to the ‘level of criticality’ judging, or appraising it. In the case of an
of information resources, tasks, and assessment project, the team needs to derive
activities knowledge from the collected input in order
3. Data relating to information transfer to offer recommendations. The first step in

81
Planning for Knowledge Management

Box 11. Theory in practice: Employee questionnaire in a medium sized firm

The Information Sources survey is designed to help us learn more about the information you need to do your job. It will
help identify gaps and opportunities in the information services available to you.

Thank you very much for taking time to complete this survey. Your participation is appreciated and should require less
than 15 minutes. All answers will be kept confidential. Information will be aggregated for the purposes of the study
report.

     1. In what department do you work?


     2. What is your job title?
     3. As part of your job, do you ever need information from journals, databases, libraries, market research, news, or other
outside sources? (If the answer is no, you can end the survey here.)
     4. Please list the professional or trade associations you belong to (paid for by the company).
     5. What newspapers, journals, newsletters, or magazines do you subscribe to (not including those coming with
memberships you describe in your answer to Question 4)?
     6. If you have budgetary responsibility, please offer an estimate of how much your department spends each year to
obtain information from outside the company (subscriptions, photocopies, reports, etc.).
     7. Which databases, subscriptions or fee-based search services on the below list do you use?
     8. How many times each week do you search for work related information on the Internet?
     9. How many times each week do you ask colleagues within the company for work-related information?
Check all that apply for questions 10-20:
     10. When you need work-related information, how do you look for it?
     11. What kind of information do you need?
     12. Where do you generally look for information on competitors?
     13. Where do you look for patent information?
     14. What databases do you search for scientific/technical/medical literature?
     15. How do you get general business news?
     16. How do you get market research information?
     17. How do you get industry news?
     18. Where do you look for safety/regulatory/quality information?
     19. Where do you look for information on management or human resources topics?
     20. What else do we need to know about the information you need and how you go about getting it?

We are grateful for your input! Thank you for taking time to participate in the survey.

analysis is to organize the data in such a way Analysis


as to understand it at a higher level. Doing so
leads to information that can be evaluated to Techniques used for analysis depend upon the
draw meaning in the context of project objec- kind of data collected and the resources avail-
tives and organizational goals and objectives. able to the project team. Generally speaking,
Here is where the rubber meets the road, so the approach fits into one of three categories
to speak, as the information experts begin to or types:
see the patterns and practices in the organiza-
tion’s information management. The analysis 1. General analysis,
phase begins to reveal gaps, duplications, 2. Strategic analysis, or
usage anomalies, over-provision or under- 3. Flows analysis.
provision, information flows or barriers, use
of inappropriate or sub-standard resources, A general analysis stems from open ended
and cultural themes. All of it feeds into the survey and interview questions. It requires the
development of recommendations. analyst to digest large volumes of text look-

82
Planning for Knowledge Management

Box 12. Theory in practice: Interview questions from two audits

In each of two studies, the interviews were conducted in a relaxed conversational style by experienced interviewers.
In neither case did the team try to collect data that could lead to quantifiable assessments. Rather it sought to elicit
information useful in understanding the knowledge culture, identifying knowledge guardians or gurus, learning about gaps
or missing pieces, and understanding how knowledge flows (or does not flow) within the organization.

All interviews begin with an explanation or recap of the project and process and end with a special thank you to the
interviewee for taking time to participate and share.

Interview questions for interviewees identified as key “knowledge consumers”:


Project Objective: To identify what we know and to identify means to track what we know.
     1. What is your primary job responsibility?
     2. What are the projects you spend most of your time on?
     3. What kind of information do you use in your normal work processes?
     4. How do you usually obtain that information?
     5. What Internet sites are particularly useful to you?
     6. What information do you wish you had that you cannot easily obtain?
     7. What reports or other information do you generate?
     8. Who receives the information?
     9. What reports do you receive from others in the organization?
     10. Are they useful?
     11. Do they come to you proactively, or do you need to go asking for them?
     12. What other comments could you make about your access to information?

Interview questions for interviewees designated by top management:


Project Objective: To identify business teams’ information related practices and discover whether “information silos”
present a barrier to exchange among teams.
     1. For the sake of context, could you describe in general terms the work your department performs and illustrate by
describing typical work products? To support the work, what external and internal resources do you consult?
     2. What challenges do you perceive with respect to using those resources? (Typical comments include timeliness, user
friendliness, cost, and finding time to examine the resource.)
     3. How do you stay current with relevant new developments or competitive information?
     4. How does your unit share knowledge internally and with other departments?
     5. Does any type of “expertise directory” exist to identify the experience of colleagues? If not, would you value such a
resource?
     6. What other comments could you offer regarding access to and use of information in your team?

ing for themes or common threads related to the collected notes from dozens of interviews
pain points, enterprise knowledge/information were pasted into Wordle. The resulting word
culture, workarounds, and awareness (or lack cloud reflects a concern for people, teams,
thereof) regarding available resources. De- resources, needs, sharing, and of course in-
pending on the number of interviews, it can formation and data.
be helpful to create a spreadsheet reflecting In analyzing content from interviews, the
interviewee name and department down one simple “Find” command in word processing
axis and key concepts on the other to create software is helpful in guiding the analyst to
a visual impression showing how many times important concepts within large quantities of
a matter was raised and who raised it. Word text: For instance, the number of times the
clouds, in which word size indicates preva- word “barrier” occurs is a finding in itself.
lence, give a general view of key concerns or Strategic analysis works from quantifi-
often repeated concepts. To create Figure 3, able data collected through surveys or highly

83
Planning for Knowledge Management

Figure 3. Word cloud based on interview notes

structured and standardized interviews. Sur- tional step of inputting answers into a database
vey questions shed light on perceived value system - a step that may require coding and
of resources, spending, go-to sources and tagging so that the system can be queried
search strategies, as well as general classes to generate customized reports. When the
of information sought. For example, ratings data provides details on specific information
reveal how important something is to the resources, a database can generate reports
knowledge worker and can be used to prioritize (Henczel, 2000, p. 221)such as:
new products or services:
• The tasks supported by each informa-
Do you consider article delivery service as tion resource
_____ must have • The importance of each information re-
_____ nice to have or source to the tasks it supports
_____ not needed? • The information resources that support
Please rate the following subscription ser- each organizational objective
vices as • The tasks for which the ‘ideal’ resourc-
_____ must have es are not provided
_____ nice to have or • Duplications of resources
_____ not needed
Very large studies sometimes require sta-
Using an online survey tool such as Sur- tistical analysis using specialized software,
veyMonkey facilitates distribution, collection, however experience indicates that projects of
and analysis of data. A thoughtfully generated such huge size are rather rare (see Box 13).
and carefully tested online questionnaire Outputs from the strategic analysis of data
can save a great deal of time by automating frequently include tables, graphs, or SWOT
the analysis while delivering insights not (strengths, weaknesses, opportunity, and
otherwise discoverable. Strategic analysis of threats) charts. Spreadsheet software such as
interview data sometimes requires the addi- Excel facilitates creation of tables, particu-

84
Planning for Knowledge Management

Box 13. Theory in practice: Resource lists submitted via spreadsheets

One knowledge audit requested participants to submit spreadsheets listing information assets used by the knowledge
worker (those assets obtained externally and those generated internally). Spreadsheets came in from several dozen
participants. Seeing no way to automate the process, the audit team manually created an aggregated spreadsheet showing
all assets and who submitted them. It was a labor intensive task, but the end result proved very useful because the audit
team could produce charts and graphs showing overlaps, frequently used resources, and frequent users. Charts identified
the top ten resources mentioned, the departments using the largest number of resources, and the individuals who were
intense users of information assets.

larly pivot tables, to show who uses particular • Where information originates
resources, which departments rely on specific • What reports, content, or knowledge
resources, and who are heavy information get created as a result
consumers. Pie charts and bar graphs help • Where the information is stored
analysts see, for example, how the use of re- • Who else gets it once it has been created
sources varies across the organization. Analyz-
ing the strengths, weaknesses, opportunities, A knowledge map can also show how a
and threats and listing them in the classic four given document moves into, through, or out
square grid works well when studying pro- of the organization.
cesses or systems used to manage information Social network maps have become a useful
assets. For example, the Australian Securities tool in understanding the flow of tacit knowl-
and Investments Commission applied a SWOT edge. They represent the connections between
analysis to the data from 80 interviews, parsing knowledge workers showing who knows whom
out the comments as a strength, weakness, and how knowledge flows as a result of a
opportunity, or threat to give analysts a struc- specific work process (customer complaint or
tured list from which to work in evaluating the social worker case management for instance).
findings and responding with recommendations Finally, marking up an organizational chart
(Orna, 1999, p. 206). with data from interviews or surveys can reveal
Flows analysis comes out of surveys, gatekeepers and silos of information.
interviews, observation, and examination of Today’s digital environments offer an
existing documents and databases. This pro- abundance of tools to create flow charts,
cess shows how knowledge moves into, out of, organizational charts, mind maps, and social
and around an organization. Not every project networking diagrams. In order to appreciate
requires flows analysis, however the exer- the value of these images, it helps to look at
cise works well to reveal barriers, silos, and some examples. In “Knowledge Auditing and
gatekeepers. Flows analysis is often referred Mapping: A Pragmatic Approach,” Burnett et
to as knowledge mapping, since diagrams of al. (2004, pp. 32-33) includes two knowledge
various kinds are generally used to organize maps from the tax department of an oil com-
the data and to display findings. A knowledge pany. They illustrate document formats such
map might show how an individual worker as notes, books, papers, or online along with
uses information illustrating the following: content including cases, statutes, and courses.
The map shows what is stored where, with stor-
• What documents, databases, or tacit age places listed as “tacit, H:Drive, Database,
knowledge feed into the work S:Drive, and Hardcopy Files.” In “Assessing

85
Planning for Knowledge Management

Knowledge Assets: Knowledge Audit of a Evaluation


Social Service Organization in Hong Kong,”
Leung et al. (2010, p. 375) offers a detailed Once the data has been adequately analyzed
map for an individual social worker showing with appropriate themes identified and visu-
what kind of information flows to and from als created, it is time to “figure out what it
this worker, identifying format and content. all means.” How do the findings align with
Rather than focusing on an individual, Chan the objectives of the study and the realities of
(2011, p. 109) illustrates a process in a map the entity being assessed? The project team
detailing the customer complaint process. can now begin matching what is (as shown
The diagram details the customer complaint in the data analysis) with what should be (as
process showing how documents flow within defined by organizational goals).
a battery manufacturing plant. The study team should have enough or-
Some cloud based or online social network- ganizational knowledge to interpret themes,
ing sources provide analysis tools that facilitate analyze gaps and duplications, and attach
knowledge mapping. LinkedIn offers a good meaning to the movement of information.
example. Through LinkedIn Labs it is possible Do the findings support the hypothesis or
to create a map visualizing an individual’s assumptions developed at the beginning of
connections. The map is interactive, making the study? Are there any surprises or anoma-
it possible to hover over any individual’s node lies? Themes generally reveal weaknesses
and see what connections track back to him or or strengths in knowledge management that
her. Clicking on any name reveals his or her can be converted to opportunities. Common
profile along with a list of shared connections weaknesses include:
(see for example Figure 4).

Figure 4. Author’s LinkedIn network as portrayed by LinkedIn Labs (http://inmaps.linkedinlabs.com/)

86
Planning for Knowledge Management

• Lack of necessary resources or use of lowing questions will help the team put the
sub-standard resources to “do the job” findings into a workable context.
• Lack of knowledge regarding resources How do the findings measure up against
created by or available to other workers organizational goals and objectives? In or-
or departments der to put weight or priority on the findings,
• Not knowing who to ask when help is compare them against organizational goals. In
needed working on a biotechnology company audit,
• Inability to adequately store and track the consultant noted that the company placed
essential information objects (reports, a high priority on ethical and legal use of its
documents, slide decks) own intellectual property, even including this
• General fear of sharing (if I give infor- concept in the company’s values statement and
mation away, I will lose power or con- in new employee training. At the same time,
trol in some way) existing company practices uncovered during
• Misunderstanding as to what kind of the audit process put the company at risk for
information others need to do their jobs copyright violations (using the intellectual
• General sense of information overload property of others). The discrepancy and the
and inability to prioritize incoming resulting risks led project leaders to place
information high priority on recommendations related to
• Awareness that there may be duplica- copyright compliance.
tion of effort or spending with no in- Does the organization have the political
stitutionalized means to address this will to address the problem? Executive and
concern management support, even to the point of
mandates, is generally required to assure some
Common strengths sometimes reflect level of commitment to corrective action. If
weaknesses. These include: for any reason there appears to be a lack of
support, it may be prudent to take a pass on
• Willingness to share - if only we a given problem, at least for the time being.
knew who needed our information or For example, in the case of a company put-
knowledge ting a very high priority on learning from past
• Desire to organize content given the mistakes, it is significant to find (1) there is no
right tools and resources way of sharing prior learnings and (2) there are
• Desire to manage costs by avoiding cultural barriers to admitting failure. Turning
duplication and improving vendor around such a corporate culture could be an
negotiations insurmountable challenge if leadership is not
• Appreciation of the value of centralized willing or able to rally in support of necessary
knowledge management changes (see Box 14).
• Recognition that knowledge manage- Do the potential benefits of addressing the
ment processes can save time and help problem outweigh the risks? Every change,
everyone do a better job even if it is for the best, creates ripple effects
throughout the organization. Responsibilities
In evaluating study findings, the team must move between individuals and departments.
take corporate culture or organizational reali- Processes change, requiring learning curves
ties into account in order to derive meaning and time adjustments. Priorities adjust so that
from the findings. Consideration of the fol- what used to be of little interest suddenly be-

87
Planning for Knowledge Management

Box 14. Theory in practice: Providing incentives to action

Sometimes corrective action requires a mandate from management or some kind of appropriate incentives. In a recent
project where recommendations required a corporate shift in the culture of sharing and tracking project success, the
consultants recommended steps be added to employees’ key performance indicators that require certain knowledge
management practices to be followed. An evaluation of adherence to these practices was added to the annual review
process.

In another case, where new initiatives for knowledge sharing were put in place, the team included gamification incentives.
Knowledge workers obtained points, badges, and recognition through designated sharing activities.
Whether to use the carrot or the stick or a combination depends on the situation.

comes a primary concern. Finally, budgets RECOMMENDATIONS


must adapt to all these changes. It helps if the
benefits are clear to all concerned. In the case While the analysis stage reveals what the data
of the company inadvertently putting itself at can tell us and the evaluation stage looks at
risk for copyright infringement, the costs of what it means, developing recommendations
bringing company practices into compliance answers the question “what do we do about
appeared high. However, the audit revealed it?” The recommendations must be grounded
that potential costs in terms of fines or penal- in industry best practices and must address
ties were much higher - quite apart from the the study objectives. The recommendations
damage to corporate reputation. (As an aside, must be feasible within the context of the
the intangible benefits achieved when workers enterprise. It is important to find the balance
feel good about their ethical business prac- between the ideal or best practice and the
tices are hard to measure but real nonetheless.) solutions appropriate to a given situation. The
Are there sufficient resources to address recommendations must in addition include
the problem? Financial and human resources an implementation plan.
are often required to address knowledge man- Incorporate industry best practices.
agement problems. While financial savings Knowledge management tactics take many
may in some cases result, it is prudent not to forms including technical and human solutions
count on any. Costs may be simple additions ranging from the installation of a platform such
such as new journal subscriptions or a new as Microsoft SharePoint to employing a trained
hire, or they may involve more complex staff librarian or information professional. Tactics
realignments. Making sense of findings and vary in scope from adding document delivery
evaluating possible solutions must take into service for one-off articles to negotiating a site
account the availability of staff or finances. license with a multidisciplinary database ven-
The study team should weigh organizational dor for hundreds of magazines and journals.
goals and priorities against the problems Solutions recommended by the audit team
identified. Experience has shown that when should reflect industry best practices. Time
the need is great enough, a strong case can has taught that a complex technology platform
be made for a significant extra expense even for knowledge management does not always
when budgetary restrictions would have represent the best solution (although there was
argued against it. It is the role of the study a time when technology was thought to be the
team to find the balance between corporate answer). Documenting how recommendations
objectives and study findings. are in line with industry standards may be in

88
Planning for Knowledge Management

order - for example, through a search of the recommended that the enterprise develop
literature or interviews with noted experts. a meaningful list - in cooperation with the
Address study objectives. In addition to procurement department - of codes and sys-
reflecting industry best practices, the recom- tematically implement the use of those codes
mendations should closely align with study to facilitate future tracking of expenditures.
objectives. Be sure that the recommendations The process found that in order to meet the
speak to the drivers of the study - but in addi- study objective in the future, certain interim
tion take advantage if the findings open doors changes to current practices and systems must
to unexpected opportunities. be put in place.
In one project focused on cost savings, the Make sure recommendations are feasible.
audit team polled key constituents to learn In an ideal world an enterprise would have all
what information assets they were bringing of the political will, financing, and staffing
into the organization, including subscriptions, required to implement all recommendations
market research reports, custom research, arising from the audit. This virtually never
online databases, print reference materials, happens, so recommendations must be tailored
and one-off purchases of journal articles. or prioritized to fit the realities of the situation
The team also contacted procurement for data at hand. Even with ample financial and human
showing the purchase of such materials. The resources in place, a knowledgeable project
team assumed that with input from the various team may conclude that a recommended solu-
business units supplemented by data from the tion simply “will not fly” in the organization
purchasing department, it would be possible right now. In that case, the alternative might
to identify users, redundancies, and opportu- be a phased approach with recommendations
nities to reduce costs. Findings revealed that offering a step-by-step means of getting from
many participants could not say what their the status quo to an improved situation (see
department purchased or how much they Box 15).
spent because of inadequate recordkeeping. Include a plan: While a list of recommen-
Procurement could not produce useful lists dations addressing study objectives might
of purchases because of inadequate coding seem like a reasonable conclusion for the
or tagging of knowledge and information as- knowledge audit, there is another question to
sets. In this case, the knowledge audit team answer. How does the organization get from

Box 15. Theory in practice: Delivering feasible recommendations

The knowledge audit at a start-up company revealed that research scientists did not have copyright compliant access to the
scientific literature they needed in order to advance the research goals of the organization. The audit team identified the
need for a searchable, full-text database of the scientific literature to deliver articles in a timely way without concern for
copyright infringement.

Management had not budgeted for the expense and was not willing to allocate the necessary funding from other sources.
Recognizing the limitations, the audit team nevertheless recommended a Phase I training in a well respected public-access
scientific literature resource and contracting with a document delivery service. This gave the research scientists improved
understanding of the free literature search option and copyright compliant access to the full text of identified articles while
postponing the expense of a database subscription.

Phase II of the recommendation, however, called for a site license for commercial databases in order to provide for access
to a broader range of literature and for immediate downloads of articles.

89
Planning for Knowledge Management

the current situation to the improved situation them why the study was initiated in the first
pointed to by the recommendations? A plan place and what kind of management support is
prioritizes the recommendations, identifies behind it. Be mindful of individual preferences
responsible parties to carry out the work, and for communication and do not be surprised if
creates a timeline for getting things done. the results of six months of research, evalu-
Three years is generally a workable timeframe ation, and study must be boiled down into
for planning purposes. Few institutions are five slides for executive consumption. Get
nimble enough to make significant changes to the point immediately in the presentation,
in a shorter period. The easy fixes or “quick and only provide background and supporting
wins” in the first year help establish credibil- evidence as needed.
ity and demonstrate effectiveness early on, In an oral presentation plan, five slides
thus establishing the foundation for moving could address the following topics:
on to the harder or more complex tasks pri-
oritized into years two and three. 1. The situation the project was meant to
address (threats, risks, opportunities)
Reporting 2. What the study found (good news and
bad)
Most knowledge audits produce a written 3. What we recommend be done about it
report for the record. The written report in- (and it is eminently doable)
cludes an executive summary (less is more 4. Steps for getting it done (including quick
when it comes to getting the attention of wins)
busy executives), sections on methodology, 5. Action required to get started
findings, recommendations, and an imple-
mentation plan. It is helpful to BLUF (put the Finally, in writing or presenting, consider
Bottom Line Up Front). No reader, no matter language carefully. First and foremost, avoid
how dedicated, wants to plow through page jargon and acronyms. Every industry has its
after page of background, justification, and shorthand language. Information profession-
project details to figure out where the initia- als talking to other information professionals
tive is going. will understand what it means to put in place
Ideally the audit team has offered interim an LAS or ILS, but no one else will. (An
progress reports to stakeholders or decision LAS is a library automation system, an ILS
makers along the way in writing or through is an integrated library system - both involve
presentations. Doing so helps identify red flags cataloguing, circulation, authority control, and
or pitfalls that could derail the process if left serials management capabilities.) Sometimes
unaddressed. Interim reporting also sheds light even spelling out the acronym is not helpful.
on the viability of possible recommendations Instead use unambiguous, natural language
under consideration. that is clear to most readers and listeners.
Reporting often involves something of One must also consider the context. In most
a sales pitch in order to obtain executive or cases it is clear to use the term ‘information
decision maker buy-in to the study recom- properties’ to refer to reports, documents, slide
mendations. It is essential to position the decks, or books. However, in one knowledge
recommendations so that decision makers can audit conducted for a travel company, the
easily see the benefits of implementation and concept of ‘information properties’ confused
the risks of retaining the status quo. Remind the listeners. In their world, ‘property’ means

90
Planning for Knowledge Management

only one thing - a hotel. The term was aban- now make a distinction between the needs
doned early on and substituted with “asset” assessment, the information audit, and the
or the actual word such as database, research knowledge audit. They acknowledge that no
report, or book. single approach serves all purposes and that
an audit may be led by an internal team or
Implementation external consultants or by a combination.
Further, the experts understand the differ-
The last step in the first iteration of a knowl- ence between explicit knowledge and tacit
edge assessment process is implementation. knowledge and see clearly that technology
Putting the recommendations into place has a role but cannot serve alone to solve the
requires a certain amount of finesse, tact, challenges of knowledge management.
and people skills. Change management is a The knowledge or information audit
discipline all to itself. Suffice it to say here continues to gain traction as a means toward
that missteps in implementation could lead to meaningful knowledge management. In-
a missed opportunity within the organization. formation professionals commonly include
Stakeholders might give the team a chance at sessions on information/knowledge audits at
achieving change, but if it is not well done, industry conferences and write about their
the team may not get a second chance. This experiences in the professional literature. For
is particularly true of technical solutions such instance, the 2013 SLA conference (attended
as intranets, portals, or sharing platforms. As by specialized librarians) included a full day
enterprise content manager Jüris Kelley puts it, workshop on the knowledge audit. In 1997
“many end-users will give you one chance to Sue Henczel said there are “very few people
show them why they should spend their time with firsthand experience in conducting
using your system” and the “quickest way to complete information audits” (DiMattia &
achieve collaboration failure is to launch a new Blumenstein, 2000, p. 48). That is less true
system that is a dud” (Kelley, 2005, p. 30). in 2013. Consultancies have emerged to pro-
As indicated above, the entire knowledge vide audit services to clients of all sizes in all
assessment process is iterative. Once a project industries. The literature abounds with case
is complete, it is time to begin planning for an studies of assessments conducted by internal
update. As the organization implements the staff. LinkedIn includes information audit
recommendations of an audit, time passes, among its list of skills.
and priorities change so that a study update In the literature search for mentions of
becomes necessary. Most organizations ben- ‘information audit’ or ‘knowledge audit’
efit from a plan evaluation after 18-36 months. conducted in April 2013, the total number
Such a cycle keeps the recommendations fresh of references found remained under 10 per
and relevant and facilitates the adaptation to year until 1990. At that point the references
changing conditions (see Box 16). began a steady climb through the 1990s until
2007 when it peaked and began to taper off.
In 1993 Pat Alderson at Travelers Com-
CONCLUSION AND FUTURE panies wrote in Best’s Review that “the ‘new‘
TRENDS: NOW WHAT? information professional” will be an infor-
mation consultant, auditing the company’s
Over the last 15-20 years, information and information needs, supplying resources and
knowledge auditing has evolved. Practitioners measuring how well data needs are met” (p.

91
Planning for Knowledge Management

Box 16. Theory in practice: A client speaks

The knowledge manager in an international company with extensive emphasis on business intelligence was leading
a project to develop an intranet based “Information Central” providing access to a range of commercial resources.
To support the specific design and rollout of the Information Central, the knowledge manager made the business case
to superiors that it would be valuable not only to focus on it, but to understand in a broader perspective the current
practices on the part of knowledge workers. As a result, a comprehensive knowledge audit was undertaken in an effort to
understand precisely (1) how the business teams around the world were currently going about finding data and market
intelligence and (2) whether there were adequate mechanisms for communicating lessons learned and insights gained
from one team to other teams. The following represents the knowledge manager’s observations regarding the knowledge
audit process and the value derived from it:

I have been championing knowledge management and world class market intelligence for over a decade at my company.
One thing missing for all those years was true executive support and buy-in. The support received usually stalled at the
Vice President level as the VPs appeared not to be in a position to gain support from their superiors.

Through some management changes and new voices coming into the company, that all changed suddenly. My team
received budget to hire an outside consultancy to help conduct a professional knowledge study. We began the RFP process
and requested proposals from several respected consultants. We were looking for a solid track record and for assurance
that the engagement would deliver value.

We were pleased to see two consultants, each with a stellar reputation, teaming up to create a proposal uniquely suited to
our requirements. Their combined experience perfectly complemented the complex environment typical of my company.

The anticipated “perfect match” proved true as the consulting team began work. Following an initial two day in-person
meeting to learn more about our company, the consultants suggested and we agreed that interviews with representative
knowledge workers would be the best method by which to gather insight into their information related practices and
challenges. I learned a great deal from observing the consultants as they went about crafting the investigative phase of the
project and …

• Developed questions to ask the interviewees


• Created an invitation for senior leaders to send to individuals they nominated to be interviewed - the invitation was sent
out by the Senior Vice President sponsoring the audit to ensure the project was taken seriously
• Wrote a meeting invitation and sent it to the nominated interviewees along with a preformatted template to complete
with information about the resources they currently buy and/or use
• Tracked responses and set up the interviews
• Conducting the 1-4 person interviews (in which I, on the consultants’ advice, did not participate in the interest of
confidentiality and freedom to speak)
• Sent out thank you notes to the participants

Throughout the interview process, we discovered that the participants were enthusiastic and more than willing to give
of their time. Very few individuals turned out to be unavailable at the scheduled time. The participants were especially
pleased that the study was taking place - in other words, that KM was going to get serious attention - and expressed their
hopes that it was the first step in enabling change to take place within the organization.

For one month after the interviews were completed, the consultants compiled their findings and created two reports:
Recommendations for KM policy at my company and recommendations for our Information Central. Key among the
recommendations - and something I would never have thought of - was the formation of a Knowledge Advisory Board
consisting of prominent stakeholders. A summary report was in addition created for the participants in order to ensure
they had a sense of the direction recommended for the company.

continued on following page

92
Planning for Knowledge Management

Box 16. Continued


A final in-person, two-day meeting took place at my company to give me an opportunity to showcase in front of my boss
the exciting opportunities uncovered by the findings. We reviewed the reports and then began discussing in detail how
to implement the recommendations. Having learned so much from the study about the “cost of not knowing,” gaps and
barriers to knowledge sharing, and internal and external resources being used, we were now in a position to make well
informed decisions in leveraging the opportunity to impact the organization positively. The opportunities we saw were
quick wins as well as wins for the longer term.

Our discussions produced a three-year roadmap tailored to our organizational culture’s focus on planning. It encompassed
four pillars: Business Process, Procurement, the Information Central, and Personnel. Emphasizing action in year 1 for
immediate progress (the quick wins), the roadmap provided for gradual increases in KM personnel resources and for
evolving assessments of priorities to ensure the planned actions could be taken in years 2 and 3.

Shortly thereafter, a presentation was created for the sponsoring Senior Vice President. He was pleased with the clarity
of vision in the recommendations and in the roadmap and speedily authorized the distribution of the summary report to
interview participants.

Because of the study, we now have relevant validation points when initiating activities on the knowledge management
front. My team and I have in a few months accomplished a great deal:

• My team selected the members for and set up a Knowledge Advisory Board. We chose 10 champions of knowledge
sharing whose credentials were confirmed in the study. The Board has advised our team on the various activities we
have been undertaking. The members have been leaders in getting their team members to attend training events
sponsored by the knowledge management team.
• I sought out a company to build an expertise directory enabling employees to identify who knows what - not just based
on what people do here at my company, but on previous experience and expertise. During recent training sessions, I
have seen people in the audience perk up with smiles and even applaud when they heard the directory was being created.
• Our Information Central user base has grown by 600%.
• We are having conversations with many teams to start cultivating their content for addition to the Information Central.
• We are discussing with global human resources opportunities to integrate knowledge sharing into the onboarding
process of new colleagues to the company.
• We created a new brand, logo, and tagline for our Information Central.
• We developed better relationships with Procurement so as to get better value from our market intelligence resources.
• We are reviewing licenses for content to determine whether they are the “right size.”
• To generate maximum awareness in the company, we have planned a “relaunch” of the Information Central with
enhanced searching capabilities and a new brand identity.
• Training opportunities have been set up so that employees may learn how to use the Information Central via in-person
trainings in one-on-one sessions or through international Webinars.
• We created a monthly newsletter to “shout about” what we are planning and what we are doing; it is the perfect
communication vehicle for speaking about market intelligence resources and how they are impacting the business.
• A Knowledge Management analyst was hired to be responsible for curating the content for the Information Central.

These are just some of the exciting opportunities my company is now pursuing as a result of undertaking the study.

The value derived from the systematic work of the consultants and from their deep insight is priceless. In no way could
a study have been performed internally to make such useful discoveries; the consultants knew just what to probe for,
and they knew just what the findings meant for my company. I cannot overstate how their experience and expertise has
advanced knowledge management and sharing across my company in such a short time: The return on investment has
been immense and obvious.

93
Planning for Knowledge Management

54). The prediction has panned out to some The information audit reflects a more proac-
degree and has spread to other disciplines as tive approach looking more broadly at “how
knowledge workers recognize the need for good are the resources you have and what is
balanced knowledge management. In a broader missing?” The knowledge audit takes a more
sense, the auditing activity has become part integrated, holistic approach, still asking about
of the professional skill set for a number of needs and opportunities but seeking to further
knowledge workers. Peter Griffiths (2010) understand how knowledge is used, identifying
specifically sees the opportunity to incorporate opportunities to affect culture. The assessment
financial audit practices with the information tool now includes analysis of tacit knowledge
professional’s traditional audit approach and such as social networks and expertise. Stanley
goes on to make a distinction between the notes that “a good knowledge audit leads to a
various professions’ views toward the process. strategy that falls between the audit process
He mentions the following: an information and a mere technological (intranet or portal
scientist’s approach, an accountant’s ap- or collaboration) solution.”
proach, an internal auditor’s view, a record As tacit and explicit knowledge increases
manager’s view, the information security view, in volume and complexity, the need for value-
the competitive intelligence view, the IT and added knowledge management, grounded in a
systems view, and the knowledge management knowledge assessment, will continue to grow.
view. He concludes that the audit is a work in As the methods for assessing and managing
progress with changing roles for the various explicit knowledge become fairly well and
professional groups that include information widely understood, attention will expand to
auditing among their tools (p. 222). more intentionally include tacit knowledge.
The international association of special- At least two pointers support this view: A
ized librarians (SLA) in 2006 formed the recent knowledge assessment project initially
Knowledge Management Division for infor- focused entirely on explicit knowledge assets
mation professionals interested in this area of identified as a key gap the need to track and find
expertise. In 2008 the association added the individuals having specific knowledge and
Knowledge Management Certificate Program experience. This challenge was not identified
to its professional development curriculum in advance by the internal team but became
in recognition of the growing need for and very clear early in the project. Further, a solo
the growing interest in providing strategic librarian within a large United States govern-
knowledge management services in organiza- ment department pointed out recently the rate
tions. Knowledge management consultants at which tacit knowledge was being lost as
Dale Stanley and Guy St. Clair conduct the older workers from the Baby Boom genera-
series of workshops that leads to the SLA KM tion retired. Her organization recognizes the
Certificate. Mr. Stanley (personal communica- need to put a process in place to capture tacit
tion, July 12, 2013) recently shared his view knowledge. These two examples are anecdotal,
of trends in the development of knowledge but they point toward a direction for knowledge
assessment tools including the needs assess- assessment in the future.
ment, the information audit, and the knowledge The knowledge assessment continues to
audit. He notes that the needs assessment serve as the foundation for successful knowl-
represents a reactive approach to knowledge edge management and is a growing discipline
management wherein the information profes- for information professionals.
sional asks “what do you need to do your job?”

94
Planning for Knowledge Management

REFERENCES Drucker, P. F. (1999). Management challenges


for the 21st century. New York: HarperCollins.
Alderson, P. (1993). Managing the costs of on-
line information. In Best’s review-Property- Grey, D. (1996, June 23). KM forum discus-
casualty insurance ed. Academic Press. sion archives – The early days. Retrieved
from http://www.km-forum.org/t000015.htm
Anonymous,. (1987). In the online informa-
tion sector Europe is striving for unity in face of Griffiths, P. (2010). Where next for information
US and Japanese competition. Computing, 21. audit? Business Information Review, 27(4),
216–224. doi:10.1177/0266382110388221
Anonymous. (1996). The knowledge audit.
Strategic Direction, (119), 12-15. Henczel, S. (2000). The information audit
as a first step towards effective knowledge
Bates, M.E. (1997). Information audits: What management: An opportunity for the special
do we know and when do we know it?. Library librarian. INSPEL, 34, 210–226.
Management Briefings, 1-7.
Henczel, S. (2001). The information audit: A
Berkman, R. (1995). The information audit: practical guide. Munich, Germany: K G Saur.
methods for managing information The In- doi:10.1515/9783110974645
formation Advisor, 7, 2.
Kelley, J. (2005). Sustaining collaboration
Burden, P. R. (2000). Knowledge manage- and information sharing. AIIM E-DOC, 19(3),
ment: The bibliography. Medford, NJ: Infor- 30–32.
mation Today.
LaRosa, S. M. (1991). The corporate informa-
Burnett, S., Illingworth, L., & Webster, L. tion audit. Library Management Quarterly,
(2004). Knowledge auditing and mapping: A 14(2), 7–9.
pragmatic approach. Knowledge and Process
Management, 11(1), 25–37. doi:10.1002/ Leung, Z. C. S., Cheung, C. F., Chu, K. F.,
kpm.194 Chan, Y. C., Lee, W. B., & Wong, R. Y. W.
(2010). Assessing knowledge assets: Knowl-
Cohen, D., & Prusak, L. (2001). In good com- edge audit of a social service organization in
pany: How social capital makes organizations Hong Kong. Administration in Social Work,
work. Boston, MA: Harvard Business School 34, 361–383. doi:10.1080/03643107.2010.
Press. doi:10.1145/358974.358979 512843
DiMattia, S. S., & Blumenstein, L. (2000). Orna, E. (1999). Practical information poli-
In search of the information audit: Essential cies: How to manage information flow in orga-
tool or cumbersome process? Library Jour- nizations. Aldershot, UK: Gower Publishing.
nal, 48–50.
Quinn, A. V. (1979). The information audit:
Dobson, C. (2002). Beyond the information a new tool for the information manager. In-
audit: Checking the health of an organization’s formation Manager, 1, 18–19.
information system. Searcher, 10(7), 32.
Riley, R. H. (1975). The information audit.
Drucker, P. F. (1988). The coming of the new Bulletin of the American Society for Informa-
organization. In Harvard business review on tion Science, 2(5), 24–25.
knowledge management (pp. 1–19). Boston:
Harvard Business School Press.

95
Planning for Knowledge Management

Servin, G., & De Brun, C. (2005). ABC of Liebowitz, J., Rubenstein-Montano, B.,
knowledge management. National Health McCaw, D., Buchwalter, J., Browning, C.,
Services. Retrieved from http://www.fao. Newman, B., & Rebeck, K. (2000). The
org/fileadmin/user_upload/knowledge/docs/ knowledge audit. Knowledge and Process
ABC_of_KM.pdf Management, 7(1), 3–10. doi:10.1002/
(SICI)1099-1441(200001/03)7:1<3::AID-
Turkel, T. (1996). CEI’s exports cover the
KPM72>3.0.CO;2-0
globe. Portland Press Herald, p. 3C.
Lubbe, W. F., & Boon, J. A. (1992). Infor-
Vo-Tran, H. (2011). Adding action to the infor-
mation audit at a university. South African
mation audit. Electronic Journal of Information
Journal of Library & Information Science,
Systems, 14(2), 271–281.
60, 214–223.
Perez-Soltero, A., Barcelo-Valenzuela, M., &
ADDITIONAL READING Sanchez-Schmitz, G. (n.d.) Design of an ontol-
ogy as a support to the knowledge audit pro-
Botha, H., & Boon, J. A. (2003). The in- cess in organisations Journal of Information
formation audit: Principles and Guidelines. & Knowledge Management 08(2), 147-158.
Libri: International Journal of Libraries &
Information Services, 53(1), 23. doi:10.1515/ Raliphada, L., & Botha, D. (2006). Testing
LIBR.2003.23 the viability of Henczel’s information audit
methodology in practice. South African Jour-
Buchanan, S., & Gibb, F. (1998). The informa- nal of Library & Information Science, 72(3),
tion audit: An integrated strategic approach. 242–250.
International Journal of Information Man-
agement, 18(1), 29–47. doi:10.1016/S0268- Ravishankar, M. N. (2008). Rewarding end-
4012(97)00038-8 users for participating in organizational KM: A
case study. Journal of Organizational and End
Buchanan, S., & Gibb, F. (2008). The in- User Computing, 20(1), 35–49. doi:10.4018/
formation audit: Methodology selection. joeuc.2008010103
International Journal of Information Man-
agement, 28(1), 3–11. doi:10.1016/j.ijin- Robertson, G. (1994). The information audit:
fomgt.2007.10.002 A broader perspective. Managing Informa-
tion, 1(5), 34–36.
Dietrick, B. (1997). The art of knowledge
mapping: Where to begin. Information Advi- Sharma, R. S., Foo, S., & Morales-Arroyo,
sor 9(12). M. (2008). Developing corporate taxonomies
for knowledge auditability: A framework
Griffiths, P. (2005). Performing an informa- for good practice. Knowledge Organization,
tion audit. Records Management Society 35(1), 30–46.
Bulletin (126), 19-21.
Soy, C., & Bustelo, C. (2009). A practical ap-
Kilzer, R. (n.d.). Information audit: Keys for proach to information audit: Case study – La
understanding the academic library. Technical Caixa Bank, Barcelona. Managing Informa-
Services Quarterly, 29(3), 200–206. doi:10.1 tion 16(6), 41-46.
080/07317131.2012.681284

96
Planning for Knowledge Management

St. Clair, G. (1996). The information audit: A Information Audit: A process for iden-
powerful tool for special librarians. SpeciaL- tifying how information assets are acquired
ist, 19(2), 9. or produced within an organization and how
workers store, share, and use them.
Stevens, L. (2000). Knowing what your
Knowledge Audit: An evaluation tool used
company knows. Knowledge Management
to understand both the tacit and explicit knowl-
(3), 38-42.
edge assets within an organization and their
Tsoukas, H. (2003). Do we really understand role in advancing the organization’s goals.
tacit knowledge? The Blackwell Handbook Knowledge Map: An image or diagram
of Organizational Learning and Knowledge illustrating how knowledge comes into and
Management. M. Easterby-Smith and M.A. moves within an organization. It may identify
Lyles (Eds.) Maulden, MA, Blackwell. knowledge assets, gatekeepers, and connec-
tion nodes.
Webb, S. (1994). The information audit. Informa-
Needs Analysis: A process to identify the
tion Management Report, 9-11.
information and services workers require in
order to do their jobs.
Structured Interviews: All participants
KEY TERMS AND DEFINITIONS
respond to the same list of predefined ques-
Explicit Knowledge: Knowledge found in tions.
tangible assets such as books, reports, slide- Tacit Knowledge: Knowledge acquired
decks, databases, and documents (hard copy through experience that is not easily codified
or digital). for sharing.
Focus Group: A preselected group of Unstructured Interviews: Participants
individuals participate in a discussion led by respond to questions that emerge from the
a moderator or facilitator, with the conversa- discussion and that may vary from one par-
tion generally moving from general to more ticipant to the next.
specific topics.

97

You might also like