Professional Documents
Culture Documents
ASSURANCE
PROJECT
QA MONOGRAPH
Center for Human Services • 7200 Wisconsin Avenue, Suite 600 • Bethesda, MD 20814-4811 • USA • www.qaproject.org
The Quality Assurance (QA) Project is funded by the U.S. Agency for International Development
(USAID), under Contract Number HRN-C-00-96-90013. The QA Project serves countries eligible for
USAID assistance, USAID Missions and Bureaus, and other agencies and nongovernmental organiza-
tions that cooperate with USAID. The QA Project team consists of prime contractor Center for Human
Services; Joint Commission Resources, Inc.; and Johns Hopkins University (including the School of
Hygiene and Public Health [JHSPH], the Center for Communication Programs [CCP], and the Johns
Hopkins Program for International Education in Reproductive Health [JHPIEGO]). The QA Project
provides comprehensive, leading-edge technical expertise in the design, management, and implemen-
tation of quality assurance programs in developing countries. Center for Human Services, the nonprofit
affiliate of University Research Co., LLC, provides technical assistance and research for the design,
management, improvement, and monitoring of health systems and service delivery in over 30 countries.
Sustaining Quality
of Healthcare:
Institutionalization
of Quality Assurance
Lynne Miller Franco, Diana R. Silimperi,
Tisna Veldhuyzen van Zanten, Catherine MacAulay,
Karen Askov, Bruno Bouchet, and Lani Marquez
September 2002
iv ◆ Sustaining Quality of Healthcare: Institutionalization of Quality Assurance
Table of Contents
6 Epilogue ...................................................................................................... 49
References .............................................................................................................. 51
Figure 2.2 Quality Assurance Triangle ....................................... 11 Box 5.7 Promoting the National Crusade for
Health Quality in Mexico .......................................... 43
Figure 2.3 Four Steps to Quality Improvement ......................... 12
Box 5.8 Rewarding Quality in Malaysia ................................. 45
Figure 3.1 Essential Elements for the
Institutionalization of QA .......................................... 13 Tables
Figure 3.2 Institutionalization of Quality Assurance ................ 14 Table 4.1 Institutionalization Phase Characteristics,
Strategies, and Indications of Readiness
Figure 4.1 The Phases of Institutionalizing to Progress ................................................................. 26
Quality Assurance ..................................................... 25
Table 5.1 Evolution of QA Essential Elements through
Boxes the Phases of Institutionalization ........................... 30
Box 3.1 Quality Policy in Mexico ............................................ 15 Table 5.2 Illustrative Example of an Organization’s
Box 3.2 Key Leadership Responsibilities for QA Institutionalization Status .................................. 32
Successful QA Implementation ............................... 16 Table 5.3 Possible Activities to Develop the
Box 3.3 A Change in Values in Russia .................................. 16 Essential Element Policy and
Move to the Next Phase/State ................................ 33
Box 3.4 A Change in Staff Attitudes in South Africa............ 17
Table 5.4 Possible Activities to Develop the
Box 3.5 Core Values that QA Project Experience Has Essential Element Leadership and
Shown to Be Critical for Institutionalizing QA ......... 18 Move to the Next Phase/State ................................ 34
Box 3.6 Evolution of the QA Oversight Structure Table 5.5 Possible Activities to Develop the
in Malawi ................................................................... 19 Essential Element Core Values and
Box 3.7 Key Roles and Responsibilities Move to the Next Phase/State ................................ 37
for a QA Structure ..................................................... 20 Table 5.6 Possible Activities to Develop the
Box 3.8 Capacity Building in Tahoua, Niger ......................... 21 Essential Element Resources for QA
and Move to the Next Phase/State ......................... 38
Box 3.9 The Three Types of QA Capacity Building ............... 21
Table 5.7 Possible Activities to Develop the
Box 3.10 Sharing Data on Compliance with Essential Element QA Structure and
Standards in Ecuador ............................................... 22 Move to the Next Phase/State ................................ 40
Box 3.11 Facilitating Information Flow and Table 5.8 Possible Activities to Develop the
Sharing of Lessons in Chile ..................................... 22 Essential Element Capacity Building and
Box 3.12 Rewarding High Levels of Quality Move to the Next Phase/State ................................ 42
and Coverage in Ecuador ......................................... 23 Table 5.9 Possible Activities to Develop the
Box 5.1 Evolution of Quality Policies in Malaysia ................ 32 Essential Element Information and
Communication and Move to the
Box 5.2 Top-Level Leadership Support for QA in Chile ........ 34 Next Phase/State ..................................................... 44
Box 5.3 Corporate Culture Building in Malaysia .................. 36 Table 5.10 Possible Activities to Develop the
Box 5.4 Sustaining the Funding Base for Essential Element Rewarding Quality and
QA Activities in Chile ................................................. 38 Move to the Next Phase/State ................................ 45
Box 5.5 Structures to Support and Implement QA Table 5.11 Analysis of Each Essential Element in
in Malaysia ................................................................ 39 Zambia’s Quality Assurance Program ..................... 47
CBOH Central Board of Health This monograph has benefited tremendously from the
collective work and thinking of the staff of the Quality
COHSASA Council for Health Service
Assurance Project, health workers and managers in many
Accreditation of Southern Africa
developing countries, and James Heiby of the U.S. Agency
MOH Ministry of Health for International Development. The authors want to recog-
nize their contributions, without which this monograph
NGO Nongovernmental organization could not have been written. We also want to express our
QA Quality assurance appreciation to Beth Goodrich for her skillful editing of the
final manuscript.
QD Defining quality
Recommended citation: Franco, L.M., D.R. Silimperi, T.
QI Improving quality Veldhuyzen van Zanten, C. MacAulay, K. Askov, B. Bouchet,
and L. Marquez. 2002. Sustaining Quality of Healthcare:
QM Measuring quality
Institutionalization of Quality Assurance. QA Monograph
USAID United States Agency for Series 2(1). Bethesda, MD: Published for the U.S. Agency
International Development for International Development (USAID) by the Quality
Assurance Project.
I
MPROVING quality has become a unifying theme across Ministries of Health and other health organizations in their
health programs and countries. Awareness of the quest for sustainable quality of care. It both describes the
importance of improving healthcare quality is seen in components necessary to inculcate a culture of quality
the rapid spread of evidence-based guidelines, growing and provides practical information on how to facilitate the
attention to patient safety and reducing medical errors, process necessary to reach this goal. A framework of eight
and attempts to reduce waste and inefficiency, to ensure essential elements and a phased process for institutional-
that scare resources for healthcare are used to derive their ization of QA outline the critical aspects and a road map
full impact. for creating a lasting program to improve the quality of
healthcare. The institutionalization framework draws
Around the world, impressive efforts are underway in
heavily on management literature and organizational
public and private organizations to improve the quality of
change models, as well as QA program experiences in
healthcare, based on a systematic approach to ensuring
diverse countries.
that the details of healthcare are done right—an approach
called quality assurance. The tools of quality assurance
(QA) and quality management, born in manufacturing,
have been successfully applied in healthcare in both
The Core Activities of Quality Assurance
developed and less developed countries, and there is At the heart of any effort to institutionalize the delivery of
growing acceptance that QA can improve program and quality healthcare are three core QA activities: defining
health worker performance. quality, measuring quality, and improving quality. These
In developing country health systems, the need for higher core activities are developed, scaled up, and made integral
quality care and health services that are responsive to parts of an organization’s functioning through institutional-
clients is acute. QA activities have been successfully estab- ization. Defining quality means developing expectations
lished in many developing country settings, but often falter or standards of quality, as well as designing systems to
in scaling up or sustaining their achievements. As more produce quality care. Measuring quality consists of docu-
national ministries and other health organizations gain menting the current level of performance or compliance
experience in applying QA approaches, demand has grown with expected standards, including patient satisfaction.
for guidance on the elements and processes that sustain Improving quality is the application of quality improvement
the quality of healthcare. methods and tools to close the gap between current and
expected levels of quality by understanding and address-
ing system deficiencies (as well as enhancing strengths) in
order to improve healthcare processes. These three sets of
The Objectives of This Monograph activities work synergistically to ensure quality care as an
This monograph presents a conceptual framework to help outcome of the system. Together they encompass the range
healthcare systems and organizations analyze, plan, build, of mutually supportive QA methodologies and techniques.
and sustain efforts to produce quality healthcare. The No core activity alone is sufficient to
framework synthesizes more than ten years of QA Project improve and maintain quality; it is the interaction and
experience assisting in the design and implementation synergy of all three that sustains high quality healthcare.
of QA activities and programs in over 25 countries. That
experience has shown that the key institutionalization
question is often not so much a technical one—how to A Conceptual Model of QA Institutionalization
“do” QA activities—but rather, how to establish a culture of
quality within the organization and make QA an integral, Many factors affect a health organization’s ability to
sustainable part of the health system. institutionalize QA and a culture of quality, but we have
identified eight elements as essential for implementing
As with any kind of organizational change, the road to and sustaining the core QA activities. The first four ele-
institutionalizing QA can be long and complex. This ments constitute the internal environment conducive to
monograph was written to provide practical information to initiating, expanding, and sustaining QA within the organi-
Maturity
QA is formally,
philosophically
integrated into the
ation structure and function
Consolid of the organization
Ex pansion or health system
tial
Pre-existing Experien
ss
Awarene
organization has
no formal or
deliberate QA
QA Project 2001
H
EALTH systems worldwide are recognizing the need work incorporates more than ten years of QA Project expe-
to improve quality. Such systems are increasingly rience assisting in the design and implementation of QA in
adopting evidence-based guidelines, giving atten- over 25 developing country health systems. Other publica-
tion to reducing medical errors, and safeguarding patient tions by the QA Project provide more general overviews of
safety. Concern with quality is also expressed in efforts quality assurance in healthcare and technical guides to
to reduce waste and inefficiency, to ensure that scare re- major QA interventions (Massoud et al. 2001; Bouchet
sources for healthcare are used to derive their full impact. Undated; Rooney and van Ostenberg 1999; Ashton 2001a).
Most QA Project publications are available from the
Why is quality of healthcare important?
website and mailing address on the cover.
Simply stated, healthcare organizations can’t afford not to
be concerned with quality and efficiency. Quality of care is
not a luxury that only wealthy countries can afford; it is an 1.1 What Is Institutionalization of
imperative for healthcare organizations worldwide. Com-
plex health problems that know no national boundaries,
Quality Assurance?
such as HIV/AIDS and antibiotic-resistant tuberculosis, The QA Project defines quality assurance as all activities
demand careful attention to well-designed processes of that contribute to defining, designing, assessing, monitor-
care, based on clinical evidence of effectiveness. The very ing, and improving the quality of healthcare. While
limited resources available for publicly funded health adequate drug distribution, financing, human resources
services in many low-income countries demand that those planning and allocation, and technical and professional
resources be channeled into effective processes of care training systems contribute to and are necessary for qual-
and that wasteful or ineffective practices be eliminated. ity care, quality assurance ensures that all processes work
effectively and synchronously to achieve quality
Impressive efforts are underway to improve the quality of
healthcare.
healthcare being offered to people around the world,
based on a systematic approach to ensuring that the Our understanding of QA and its use to improve the qual-
details of healthcare are done right––an approach called ity of healthcare in developing countries has grown sub-
quality assurance. While the principles and methods of stantially over the last ten years. One lesson was learning
quality assurance are widely embraced, we know that that having the capacity to carry out technical quality
re-orienting and reorganizing entire healthcare systems so assurance activities does not ensure that QA is institution-
that they can consistently offer quality care to all clients alized within an organization or that QA functions are
remains a challenge for many countries, especially in the sustained over the long term. The critical question now is
developing world. Quality assurance (QA) activities have not so much a technical one, how to “do” QA activities, but
been successfully established in lower and middle-income rather how to establish and maintain QA as an integral,
countries, but often face significant hurdles in scaling up sustainable part of a health system or organization, woven
or sustaining their achievements. As more countries gain into the fabric of daily activities and routine. The process of
experience in applying the methodologies that lead to achieving this state is what we term “institutionalization.”
quality healthcare, demand has grown for guidance on the
totality of the elements and inputs needed to sustain QA. Institutionalization is the process through which a set of
activities, structures, and values becomes an integral and
This monograph presents both a conceptual framework sustainable part of an organization. Institutionalization
and a road map to help organizations create the capacity means that people know what needs to happen to provide
to plan, build, and sustain efforts to produce quality quality care, they have the skills to make it happen, and
healthcare. We use the term framework to refer to (a) the they are committed to making it happen over time within
essential elements an organization must have to institution- the available resources. This notion encompasses a
alize QA and (b) the phases an organization must pass broader set of dimensions than financial sustainability
through to reach mature institutionalization. The frame- alone.
1
Organizational culture can be defined as the shared and behavioral expectations that characterize a corporate (or organizational) identity
(Grindle 1997).
2
In collaboration with the Pan American Health Organization (PAHO), the QA Project is developing a framework describing the interface
between quality assurance and health sector reform. Publication is planned for fall 2002.
Interpersonal relations refers to effective listening Quality of care refers to the degree to which these nine
and communication between provider and client; it is dimensions of quality are present in the healthcare deliv-
based on the development of trust, respect, confidentiality, ered to a client.
and responsiveness to client concerns.
3
The quality management literature often includes leadership as a fifth principle of quality. We include leadership in our framework for
institutionalization.
4
More discussion of the uses and formats of standards in healthcare may be found in Ashton 2001b; more on regulatory approaches is in
Rooney and van Ostenberg 1999.
5
A systematic approach to measuring the quality of primary and in-patient care is described in Bouchet Undated and Ashton 2001a,
respectively.
6
A thorough presentation of approaches to improving quality is in Massoud et al. 2001.
1.
Identify
2.
Analyze
3.
Develop
Plan
4.
Act Test and Do
Implement
Study
B
EARING in mind that (a) our goal in implementing Figure 3.1 Essential Elements for the
quality assurance is to improve the quality of Institutionalization of QA
healthcare; (b) QA and improved quality of care
require not only a technical approach of tools and meth-
Essential Elements for the
ods but also a change in attitude; and (c) QA is institution-
alized when it is formally and philosophically integrated
Institutionalization of QA
into the structure, functioning, and culture of an organiza- Internal enabling
tion, we can examine institutionalization more clearly to environment:
identify its “essential elements.” These elements have been
identified by the QA Project through its international expe- Policy
rience in supporting QA activities and programs and from Leadership
quality management literature (Baldrige National Quality
Core values
Program 2001; Tenner and DeToro 1992; Marszalek-Gaucher
and Coffey 1990; Brown 1995; Powell 1995; Shortell et al. Resources
1995, among others).
Organizing for quality:
Structure
3.1 Overview of the Model
Support functions:
Many factors affect a health organization’s ability to
institutionalize a change in the way work is approached,
Capacity building
especially the key, or essential, elements listed in Figure 3.1. Information and communication
We group them in three categories: internal enabling envi- Rewarding quality
ronment, organizing for quality, and support functions.
These categories are briefly described in the next few QA Project 2000
paragraphs; then we describe the role each essential ele-
ment plays in institutionalization and how each functions
in a mature organization that can sustain QA. equated with an organization chart or reporting relation-
ships. Instead, it refers to the mapping out of responsibili-
The internal enabling environment: An internal envi-
ties and accountability for QA in the organization,
ronment conducive to initiating, expanding, and sustaining
including oversight, coordination, and implementation of
QA is necessary to institutionalize QA. Such a supportive/
QA activities.
facilitative environment is comprised of: (a) policies that
support, guide, and reinforce QA; (b) leadership that sets Support functions: Several essential elements are needed
priorities, promotes learning, and cares about its staff; (c) to support sustained implementation of QA and improved
core organizational values that emphasize respect, quality, quality of care. Three critical support functions are:
and continued improvement; and (d) adequate resources (a) capacity building in QA, such as training, supervision,
allocated for the implementation of QA activities. The full and coaching for healthcare providers and managers;
impact of the internal enabling environment is achieved (b) information and communication for the purposes of
only through the synergy created among all four of these sharing, learning, and advocating for quality; and
elements. (c) rewarding and recognizing individual and team efforts
to improve quality.
Organizing for quality: Institutionalization requires a
clear delineation of roles, responsibilities, and accountabil- These three categories are represented in Figure 3.2 as a
ity for the implementation of QA activities. We refer to this series of overlapping concentric circles that work together.
organization for implementing QA as the essential element, At the center is quality healthcare, the desired outcome of
structure. However, in this context structure should not be QA. Surrounding the center is the triangle of core QA tech-
Inf mmu
Co
orm nic
ildi ty
ng
Bu paci
The QA Project provided long-term technical assis- Providing basic QA expertise: Institutionalization of
tance to the Department of Health of Tahoua, Niger, QA requires that health providers and managers
to institutionalize QA in the decentralized manage- receive initial and continuing knowledge and skill
ment of health services in the region. Training and development in QA techniques and methods. As
on-site coaching were the central strategies used to appropriate, the ability to manage QA activities might
enable health workers at the regional, district, and also be included. Developing basic QA expertise
facility levels to apply QA concepts and methods. should ultimately be integrated into the pre-service
and in-service training systems. Training activities
The Tahoua QA project first trained health workers
can be on- or off-site, in the context of the job, or
who had been selected for the regional and district-
using distance learning. Staff needs will change over
level quality improvement teams in each of the
time, so training should be tailored to evolving QA
region’s seven districts. Training gave participants a
responsibilities and related learning needs. QA
framework and skills to systematically solve quality-
Project experience has shown that training is most
related problems using methods adapted to local
effective when it is “just in time”—i.e., when staff and
conditions. During the training workshops, partici-
providers need the information.
pants chose a problem, drafted a definition state-
ment, and began preliminary problem analysis before Ongoing coaching and mentoring: Coaching and
leaving training. mentoring provide ongoing technical and motiva-
tional support to facilitate the behavior changes
The QA Project’s resident advisor gave the teams
needed to undertake and sustain QA activities in
support, visiting each team regularly to motivate
the routine working environment, while simulta-
team members and help them apply the QA method-
neously encouraging the development of a “culture
ology. This follow-up support was found to be critical
of quality.” The term “coach” refers to an individual
to teams’ ability to move through the problem-solving
who is well versed in QA techniques and principles
cycle, since QA required very different attitudes and
and can provide on-the-job technical support to staff
skills than what Tahoua health workers were accus-
implementing QA activities. In contrast, a “mentor” is
tomed to. Members of the district management
someone who acts as a guide or advisor. A mentor
teams and supervisors were also trained in coaching
does not need to be a QA expert, but must be able
and team-building skills to enable them to train and
to know when additional intervention or expertise
support facility-level quality improvement teams.
would be useful and facilitate connection with an
Source: QA Project Undated appropriate resource person.
Supervision: Staff also need day-to-day support and
correction as they undertake QA activities. Achieving
supportive supervision of QA requires enhancing the
Ensuring the timely flow of information is critical to effec- supervisor’s facilitative role; assuring that supervi-
tive implementation of QA and thus to improvements in sors have a foundation of QA expertise; and teaching
the quality of care. Formal mechanisms to assure the com- supervisors how to observe, assess a situation, and
munication of new standards, policies, and improvement give constructive and immediate feedback for
efforts increase the likelihood of acceptance and compli- improvement.
ance with these QA activities. Communication reinforces
the notion that QA is everyone’s business, that successes
should be publicized, and that lessons should be shared
even when things do not go as planned. Sharing what has been achieved and how it was done,
Successful information and communication support for with the organization’s staff, the community it serves, and
QA includes: others who might learn from it and become motivated by it
to improve their own services (see Box 3.11).
Recording improvements and changes, using both data to
demonstrate results that have been achieved and stories Using the results for advocating policy changes and
about how these results were achieved (see example in resources: when activities are well documented with sup-
Box 3.10). porting data, it is easier to convince decision makers.
As part of a QA intervention to improve compliance The national quality unit in Chile’s Ministry of Health
with maternal and child care standards in hospitals (MOH) has played the lead role in coordinating the
in Ecuador, data on monthly compliance with the dissemination of information on QA interventions and
standards are posted in each hospital’s public areas results from quality improvement activities carried
for staff and clients to see. Monthly staff discussions out in the Health Services. Approaches used include:
of the trends in compliance with standards have
National “Quality in Healthcare Month”: Since
generated collective self-supervision, creating the
1994, the MOH has designate October “Quality in
opportunity to discuss causes for problems and
Healthcare Month” to stimulate health professionals
potential interventions and heightening awareness
throughout the country to come together to share
among staff of their role in quality improvement.
successes and promote quality through special
Hermida and Robalino. Forthcoming events.
Bi-monthly newsletter: In the first three years of the
program, the quality unit published and distributed
When QA is institutionalized, the organization has been throughout the country a newsletter reporting on
transformed into a learning environment. Yet, without advances by local quality improvement projects,
access to information, it is difficult to learn, so gathering training activities, and formation of quality commit-
and communicating information are essential support tees. The newsletter ceased publication in 1995
functions. because circulation had become too large and funds
ceased. Instead, the central team now contributes
QA information to bulletins published by the health
3.4.3 Rewarding Quality Work regions.
In addition to having the capacity to do QA and having
National Resource Center: The quality unit houses a
information available about what can be achieved, staff
resource center on QA methods and experiences. The
also need to see that their QA efforts are important to the
materials are available to quality monitors and teams
organizational leadership and the communities served.
throughout the country and to self-organized QA
Providing individual, group, or organizational recognition
study groups.
or rewards can reinforce interest in QA endeavors and help
to align staff values with organizational values relating to National Quality Assurance Conference: Since
quality. 1995, the MOH has sponsored an annual conference
featuring presentations of quality improvement
Every organization has implicit, if not explicit, incentives projects, regional quality plans, and technical
that influence staff behavior. Institutionalization requires discussions of QA issues. The average attendance
developing mechanisms to stimulate and reward workers is 250 participants, drawn from the health services,
for striving to provide quality services. Incentives can universities, and the private sector.
be material—such as in Zambia, where some districts
rewarded their best staff with bicycles or sewing Gnecco et al. 1999
machines—or non-material—such as public recognition
of staff. In Costa Rica and Niger, the best QA teams were
selected to attend a conference, thus serving the dual
purpose of rewarding staff while continuing their skill ties, and honoring individuals and teams with symbolic
development. These practices boost employee self-esteem awards. Quality improvement efforts, commitment to QA
and encourage continual efforts. goals, or quality work can also be recognized in the regular
performance appraisal system.
There are many ways to recognize and reward individuals
and teams for QA efforts that do not necessarily require Rewarding quality work can also be done through higher
additional resources: featuring the work of quality improve- level interventions, such as changes in financing systems
ment teams in meetings or newsletters, publicly recogniz- or in civil service human resource management policies
ing an “employee of the month” for outstanding client (see example in Box 3.12).
focus, posting displays on QA efforts in healthcare facili-
QA Project 2001
Consolidation Organization simultaneously Identify missing essential elements or Full implementation of a balanced set
strengthens and anchors existing lagging QA activities and take corrective of QA activities, integrated into routine
QA activities into routine action. responsibilities throughout the
operations, while addressing organization
lagging or missing activities. Enhance coordination of QA strategy and
activities.
Support establishment of a learning
environment.
The following sections describe in more detail the state of 4.4 The Awareness Phase
pre-awareness, the four transitional phases, and the ulti-
mate state or goal, maturity. For each phase, possible strate- The awareness phase is the first step on the road to institu-
gies and indications of readiness to move on to the next tionalizing QA. Influential individuals (especially key
phase are presented. decision makers) become conscious of the need to im-
prove the quality of care and of the possibility of doing
something deliberate and systematic about it. The impetus
4.3 Pre-Awareness for this awareness could come from personal experience
with quality problems, an isolated QA success during pre-
As the term suggests,“pre-awareness” is not a phase of QA awareness, discussions with key stakeholders, participation
institutionalization; rather, it is the organization’s pre-exist- in training or conferences, complaints and pressure from
ing state before it begins to implement any formalized or communities or clients, or other sources. During this phase,
deliberate QA efforts. Isolated attempts to improve quality senior managers, policy makers, and key stakeholders
occur commonly in this state: it is hard to imagine a health (including providers) gain knowledge of and interest in
organization where no one has made any attempts to im- QA, while becoming increasingly dissatisfied with the
prove the quality of care (e.g., a district health officer’s current care.
attempts to improve the quality of care by sending staff for
in-service training). Pre-awareness is characterized by Strategies for building organizational awareness of QA aim
activities that are sporadic, individual, and informal, rather to increase exposure to perceived needs for better quality
than part of a deliberate, formal QA program. Isolated QA of care and to extend familiarity with quality assurance
successes often become known, building momentum approaches. Examples include but are not limited to:
within an organization to consider QA; thus, the organiza-
tion enters the awareness phase.
T
HE institutionalization of QA is a complex process, move the whole organization closer to QA institutionaliza-
as is institutionalizing any change in how an tion. These strategies should not be seen as prescriptive;
organization operates. The eight essential ele- they are illustrative and meant to encourage new ideas.
ments of QA all contribute to an organization’s ability to The abundance of information is meant to serve as a
institutionalize QA, yet the degree of development of each comprehensive reference, rather than as a “how-to” manual;
essential element will vary within an organization and will readers may find it useful to refer to the specific phases
vary over time. Each element must go through the same and essential elements that are most relevant to them at
series of transitional phases as QA institutionalization the moment, based on a self-assessment using Table 5.1.
itself: it is unlikely that an organization embarking on QA
will develop all the policies, leadership, values, structure,
and support functions all at once. This section discusses 5.1 Policy
how each element can progress from its current status to
maturity, to fully contribute to the organization’s overall Organizations have internally set policies at every level to
efforts to institutionalize QA. Just as the aggregate view guide organizational efforts. QA policies provide a frame-
provides guidance for overall planning and assessment, work and goals for the development of QA efforts within
looking at each element individually provides concrete an organization. They define the organization’s QA
ideas on how to facilitate its development. mandate and guide the setting of objectives, allocation of
resources, and implementation of activities to ensure
Table 5.1 describes, for each element, the conditions that quality healthcare.
signal an organization’s readiness to move on to the next
phase of institutionalization. Organizations can use this While the essential element policy can lend vital direction
table to help gauge where they are in the continuum for to an organization’s QA efforts, the development of policy
each element with respect to each phase of QA develop- statements about QA are not necessarily effective in initiat-
ment and identify where QA institutionalization efforts ing QA activities in a country. Policy statements alone,
should focus next. without supportive structures and staff empowered and
motivated to undertake QA, are not sufficient to make
Table 5.2 provides an illustration of how the status of each quality assurance happen. Similarly, efforts to legislate or
essential element might look for a hypothetical organiza- decree quality, without creating the conditions to under-
tion. The shading in each cell shows, at a particular point take and sustain QA activities, are doomed. Consequently,
in time, the phase that the hypothetical organization has the development of explicit national QA policies, as illus-
reached in the institutionalization process for that essential trated in the case of Malaysia in Box 5.1, often occurs years
element. Looking at the progress of each element relative after major QA efforts are underway, thus allowing the
to the others would enable the organization to understand organization to develop policies based on its own
the extent to which its QA development is balanced and experience.
complete. In this example, it would be appropriate for the
organization to now focus relatively greater efforts on de- It is also important to keep in mind that every healthcare
veloping the essential element of rewarding quality as its system/organization operates in a larger national policy
highest priority and then to strengthen policies, core val- environment that may influence organizational QA efforts
ues, and information and communication. With time, the but over which the organization may have little influence.
organization should reassess the strength of each element, For example, national health policies may constrain what a
revise the table, and act to strengthen the weakest ele- regional health office can do to implement QA. Alterna-
ments. tively, the larger policy environment can facilitate the de-
velopment of QA policies. Such facilitation occurred in
The next few pages discuss each essential element indi- Chile in 1989 when its newly elected democratic govern-
vidually, describing its role in facilitating the institutional- ment made improving the population’s health status a top
ization of QA and how each element develops on the road priority in its social policies. This emphasis gave rise to the
to maturity. A table suggests possible activities that an orga- Ministry of Health’s quality improvement initiative in 1991
nization might undertake to develop each element and (Gnecco et al. 1999).
Expansion Policies that support QA A critical mass exists of Staff can articulate Realistic budgets for QA
capacity building are operational and senior organizational core values. activities are developed
developed. managers who display based on awareness of the
leadership qualities. Core values guide program true costs of doing QA.
Policies exist that encourage development and strategic
measurement and Organizational, unit, and decisions. Decision makers
continuous improvement. individual worker goals are demonstrate a willingness
aligned. to consistently allocate
adequate resources for QA.
Consolidation Policies supporting Operational and senior Staff and leaders’ daily Sufficient resources are
measurement and managers feel accountable performance reflects core allocated to support ongoing
continuous improvement for quality, provide values. quality initiatives.
have been written and fully leadership to QA activities,
communicated. and advocate for QA. Rewards and programs are in Estimated QA resource
place to support core values. needs are incorporated into
Resources are available and The organization annual operating budgets.
core values are aligned with demonstrates a sustained
policies. commitment of resources
for QA.
Maturity Organizational policies QA is supported throughout Explicit core values are QA resource needs are
identify quality as an explicit the organization at all levels. reinforced by policies, routinely identified,
goal and QA as an important rewards, and leadership quantified, and incorporated
mechanism for reaching that Staff feel ownership of styles. into annual operating
goal. results and empowered to budgets.
make improvements in Managers use core values to
Organizational policies are collaboration with others. guide program development Resources for QA are
fully communicated and and their own and their consistently made available.
actively used by leaders to staff’s behavior.
set goals and guide
implementation.
Organizational leaders have Key leaders, decision Key stakeholders are The organization’s Awareness
decided to further explore makers, and stakeholders committed to exploring QA. leadership recognizes the
QA. express a need for QA and need to develop mechanisms
are interested in exploring it Information about problems or processes for rewarding
Responsibility is assigned for for their organization. with quality of care and quality work and QA efforts
oversight, technical support, possible approaches to among staff.
and implementation of initial The organization sponsors improve quality is
QA experiences. QA awareness or training disseminated within the
events. organization.
Leaders recognize the The organization has Those experimenting with Managers understand what Experiential
need for clear oversight, supervisors, coaches, and QA regularly document their impedes quality work and
coordination, and leaders with knowledge activities and share this what motivates workers and
accountability for QA and skills to support and information with others, teams to pursue quality.
expansion. expand QA efforts. both inside and outside the
Incentive packages to
organization.
Consensus exists within Consensus exists on motivate quality work are
the organization as to capacity building strategies developed and tested.
appropriate and effective for expansion.
structures for QA expansion.
Responsibility for QA There is a critical mass of Mechanisms and systems Organizational leaders Expansion
activities is formally assigned competent staff to support are established for routine express commitment to
within the organization. ongoing QA efforts. documentation and sharing rewarding quality.
of results and lessons
QA strategies are refined Leaders and managers learned. Incentive packages that
based on an assessment of model QA values and passed testing are in place.
QA “structure.” processes. Documentation information
is continually used for QA Staff are knowledgeable
advocacy. about incentive and
performance management
systems.
All staff can accurately QA content is integrated into Systems for documentation, Staff believe that reward Consolidation
describe their own other training curricula. sharing, and advocacy systems are fair and
responsibilities to contribute operate routinely. meaningful.
to quality of care. A mechanism exists to
sustain a critical mass of Mechanisms exist for
QA expertise within the community input into the
organization. reward/incentive package.
QA is integrated into job QA capacity building is Mechanisms exist for regular Formal or systematic Maturity
descriptions. integrated into pre-service documentation and sharing processes exist for
and continuing education of experiences. recognizing staff and
Roles, responsibilities, and and supported continuously managers who perform
accountability for QA are by coaching, mentoring, Information about high quality work.
clearly delineated and and supervision. improvement areas and
operational. better practices is used for Incentive systems that
decision making at policy reward continuous
and operational levels. improvement are integrated
into the personnel system.
Awareness
Experiential
Expansion
Consolidation
Key policy issues that an organization faces in each phase Awareness: As an organization embarks on QA, a com-
of institutionalization are described below. Table 5.3 has mon first step is to analyze how current organizational
suggestions on activities that an organization may under- policies may help or hinder the delivery of quality
take in each phase to develop the essential element of QA healthcare and the implementation of QA activities. For
policy. example, if policies focus on cost containment without
providing explicit criteria for quality, their implementation
may negatively affect the quality of care. Countries that are
Box 5.1 Evolution of Quality Policies in Malaysia initiating broad health system reforms should review
policies related to financing, decentralization, purchaser-
Malaysia has a well-developed national QA program in provider cost sharing, etc. to determine their potential
the health sector, under the leadership of the Ministry impact on the quality of care and how QA could enhance
of Health. Centralized planning characterizes govern- the reforms’ positive effects and mitigate their negative
ment activities in all sectors. Shortly after Malaysia effects. In addition to looking at current policies, those
became independent in 1955, the country’s first five- interested in pursuing quality will start to identify the key
year development plan (1956–60) was defined and stakeholders in policy discussions on quality and consider
has since been followed by a continuous succession how these stakeholders can be included in policy dialogue
of five-year plans. Although the Ministry launched the and how to increase their awareness of QA’s potential role
program in 1985, objectives related to improving the in improving organizational performance. If the policy
quality of healthcare did not appear in the Health environment is rigid and offers little flexibility for experi-
Sector Plan until ten years later in the Seventh Malay- mentation and innovation within the system, study tours to
sia Plan (1996–2000). With the growth of private organizations or countries with strong QA efforts may
sector delivery systems, privatization, corporatization stimulate favorable conditions for QA demonstration
of public hospitals, and increasing pressure to opti- projects. Although policies are generally created at higher
mize the relationship between health sector expendi- management levels in an organization, the experiential
tures and outcomes, the Ministry now recognizes the phase provides the opportunity to try out different policies
need for legislation to regulate healthcare distribu- for innovation at lower levels in the organization. One
tion, quality, standards, and cost in all agencies indication of readiness to move on to the experiential
operating in the sector. phase of policy is the willingness of decision makers to
allow experimentation outside of existing policies as the
Source: Suleiman and Jegathesan 2000 organization starts to learn about QA, as well as willingness
to use “simple rules.” 1 Such a decision may be prefaced by
1
“Simple rules” refers to using the concept of complexity to work out solutions: where it is difficult to control all aspects of a situation (which
probably accounts for most work situations), it may be best to provide a vision and some basic guidelines, and then simply allow people to try
out things. “Complexity science suggests that we would be better off with minimum specifications and general senses of direction, and then
allow appropriate autonomy for individuals to self-organize and adapt as time goes by” (Plsek 1997).
Box 5.4 Sustaining the Funding Base for Table 5.6 Possible Activities to Develop the
QA Activities in Chile Essential Element Resources for QA and
Move to the Next Phase/State
The MOH of Chile initiated its national quality
assurance program in 1991, supported by a two- Awareness Present examples to stakeholders and policy makers
year grant from USAID. A team of four central level of the costs of poor quality and the potential cost
staff was designated to direct the program, provide savings through reduction of waste or inefficiency, as
QA training, and initiate quality improvement activi- well as QA implementation costs
ties in the health regions and areas. Yet the four Document existing resource allocations for QA
members of the central team realized that they Identify existing policies that support or could be
were too few to provide the level of coaching and used to support resources (human, material, and
training needed to support QA implementation in financial) for QA
the country’s 29 health areas. They soon adopted
Experiential Try out different approaches to measuring the costs
a strategy of stimulating the creation of local and savings of QA activities
quality committees to direct all QA activities and
train local quality monitors to provide hands-on Analyze broad staffing requirements and staff time
needed to implement QA activities
technical support.
Set up an expenditure tracking system for all QA
In 1993, when external funding ceased, the MOH material investments
shifted funding for the central team’s salaries,
travel expenses, and other direct costs to its Expansion Based on results from trial costing methods, expand
regular budget. The MOH decided that all other their implementation
costs of QA training and implementation, including Analyze staffing requirements to implement
training materials, participant travel, and per diem expanded QA activities
expenses, would be borne by the health regions Identify capacity building needed to enable staff to
and areas themselves, out of their decentralized undertake expanded QA
operating budgets. A 1999 study found that the Identify sources for additional staff or expertise
health areas were allocating an amount totaling
US$ 85,000 (around US$ 3,000 per health area) Identify resource needs for new QA activities being
implemented (e.g., adding self-assessment or
to support QA efforts. In addition, over 500 quality monitoring of performance according to standards,
monitors were volunteering technical support. after having developed standards)
In 1996, budget cuts led the MOH to reduce Consolidation Refine the cost-monitoring system for capturing QA
staffing of the central QA team to one full-time expenditures as well as cost savings
professional, who works closely with the heads of Develop annual and long-term human resources
major technical programs and units in the MOH to plans to address staffing requirements to undertake
develop quality standards and monitoring tools that and sustain expanded QA
are implemented throughout the country. Broker partnerships or intersectoral collaborations as
Sources: Gnecco et al. 1999; Legros et al. 2000 additional resources to sustain QA activities
During expansion, the long-term vision of QA roles, respon- Develop consensus on appropriate structures for
expansion
sibilities, and accountability among all staff in the organi-
zation becomes more fully developed. This includes Expansion Outline the structural elements at all levels as part
designing staff performance measures that reflect their QA of the strategic plan for QA implementation
involvement and responsibilities, and orienting staff to Delineate and communicate specific QA roles and
those roles. As time goes on, the effectiveness of the struc- responsibilities for all staff
tures for ensuring ongoing use of information for decision
Outline staff performance measures that include or
making, involving stakeholders, and getting results should reflect involvement in QA
be evaluated. A key indication of readiness for consolida-
tion is the formal assignment of QA activities and responsi- Ensure adequate orientation and capacity building
for new roles and responsibilities at all levels (and for
bilities within the organization. Another indication is oversight, coordination, and implementation)
conducting a formal assessment of the QA structure to
refine QA strategies. Assess the effectiveness of QA structures at all levels
of the organization
Consolidation: As the organization moves towards
Consolidation Refine or modify QA structures in light of
consolidation of structure, people feel increasingly assessments of how well they facilitate achieving
accountable for organizational goals. The need for an array quality care
of individuals solely responsible for QA activities will
Continue to work with staff on change management
diminish, because in this phase, QA is part of daily opera- and communicating their roles and responsibilities
tions, the “way things get done.” However, there will be
continuing need for oversight, coordination, and ensuring Reinforce roles and responsibilities through rewards
and recognition
a learning environment related to QA. The QA structure
undergoes refinements or modifications based on experi- Ensure that QA responsibilities are incorporated into
ence and assessment. During this phase, mechanisms are all job descriptions
fully implemented to ensure that all staff receive training
and orientation to their QA roles, responsibilities, and new
Experiential Establish skill development training for supervisors Expansion: When the organization is ready to expand the
and coaches, including on-the-job mentoring and scope of QA implementation, capacity building is again
evaluation critical by providing and reinforcing QA knowledge and
Introduce self-assessment and monitoring exercises skills to an even broader group of individuals. During
Conduct leadership training expansion, QA capacity building might include training,
on-the-job learning, mentoring, coaching, computer-based
Develop performance indicators and learning, and other forms of learning. For maximal
performance-based evaluation of training
effectiveness, capacity-building activities for QA must be
Test alternative training modalities (e.g., computer- integrated with other organizational capacity-building
based learning, problem-based learning, mentoring) activities. During this phase, QA training and support mate-
Expansion Develop a formal QA capacity-building plan rials must be compiled or revised as necessary. Capacity
must be developed at several levels: staff with QA leader-
Develop a system for tracking staff training in QA and
ongoing, performance-based evaluation of training ship skills that can facilitate the work of QA teams, QA
effectiveness experts who can foster the continuous development of QA
strategies and techniques, and staff with QA coaching and
Develop a formal training program for QA mentors
and coaches that includes on-the-job learning mentoring skills who can provide ongoing support to the
expanding QA implementation. These QA staff are not a
Validate the competence of QA mentors, coaches, small group of exclusive QA experts, but rather a growing
and supervisors
proportion of staff with QA skills. The skills of the expand-
Explore whether computer-based learning could ing pool of QA coaches, mentors, and master trainers
expand access to QA information to private should be validated at this point and the effectiveness of
practitioners and remote staff
QA training evaluated. A key indication of readiness to
Develop and implement a leadership training move on to the next phase is the creation of a critical mass
curriculum of competent staff to support ongoing QA efforts. Another
Consolidation Develop a mechanism for an annual QA capacity- indication is the presence of leaders and managers
building needs assessment, strategic planning of modeling QA values and processes.
specific QA topics, and development of appropriate
training strategies to address each Consolidation: At this phase, capacity-building plans are
integrated into ongoing staff training and development
Refine the performance-based evaluation system
plans. The content and methods of training and other
Refine the process for maintaining a critical number capacity-building efforts are monitored for their effective-
of competent coaches and mentors ness. Competency and performance are evaluated on a
Implement a training strategy to maintain critical regular basis, and the results are used to direct improve-
mass of QA practitioners and champions ment or enhancement of capacity. Diverse approaches to
Innovations to increase productivity and improve Work closely with those developing new organizational
policies to harmonize efforts and develop joint
quality have been documented in Malaysia’s Ministry implementation strategy to reorient the organization
of Health since the 1960s. However, they received toward quality work
no formal recognition until a 1991 government-wide
decree called for the recognition of formal innovation Expansion Work with human resources and policy makers to
incorporate incentives for quality into staff
projects and for the creation of a national innovation performance evaluations
award. Innovations were defined as “new ideas in
all aspects of work to produce quality service and Develop supervisors’ capacity to give feedback and
motivate staff to improve quality
improve productivity as well as to enhance client
satisfaction.” Several health sector innovation Initiate the development of mechanisms to solicit
projects have subsequently won the award. input from communities and clients for the incentive
system
A 1997 evaluation of the national health sector Assess staff satisfaction with incentives and rewards
quality improvement effort found that while the idea for quality
of innovation was widely accepted in the MOH, its
Analyze whether any disincentives to quality work
practice was not uniform throughout the country: endure in the organization and identify strategies to
some states were much more proactive than others. remove them
The evaluation recommended that innovations be
more widely publicized throughout the country to Consolidation Assess whether all parts of the organization and all
stimulate interest and help others to learn from staff are included in the new incentive system
successful improvements. Eliminate any remaining disincentives
Source: Suleiman and Jegathesan 2000 Conduct a formal evaluation of the effectiveness of
incentives and rewards for quality
Leadership Zambia is moving into the expansion phase in terms of accountable for quality, lead QA activities, and have pro-
leadership. Key leaders at all levels have the authority to vided sustained support and resources for QA work, but
expand QA activities, allowing for creative and individual- this is not consistent across the country. To move to the
ized approaches to measuring and improving quality at next level, QA coaches are involving a wider variety of
different levels of the health system. Some districts and senior leaders in QA sensitization, to gain their support
hospitals already have a critical mass of leaders who are and assistance in leading QA efforts.
Core Values “The vision of health reforms is to provide quality, cost- continues to include these values in performance assess-
effective healthcare as close to the family as possible.” ment, supervision, policy development, and strategic
This statement reflects core values held by the Zambian decision making. As they solidify this phase, leaders may
public sector health system, placing it in the experiential consider whether the vision and strategic planning imply
phase. Staff and leaders are acutely aware of barriers other important values; if so, these leaders could make
that limit the achievement of this vision, but the CBOH these additional themes explicit.
Resources Resources to do QA in Zambia are in the expansion capacity building (clinical, QA, health/management infor-
phase. Realistic budgets and other resource documents mation system, etc.), staffing levels, and priorities for
at the facility, district, and province levels identify clinical improvements. As activities mature, the CBOH
human, financial, and material resources needed to looks forward to having more of the country incorporate
provide quality healthcare. In many cases, QA is inte- QA resource needs into routine budgets and anticipates
grated with other activities, so a budget for introducing a having sufficient resources to fund all levels at the
new service, for example, would include resources amounts they have budgeted. Assuring adequate re-
needed for standards setting and communication, imme- sources for national and local level support for the QA
diate post-intervention quality measurement, and longer- program would signal an important step toward
term monitoring. Local budgets define requirements for consolidation.
Organizing for Quality The CBOH is in the consolidation phase vis-à-vis organiz- roles and responsibilities related to quality and QA at all
ing for quality. The assessment concluded that current levels. As job descriptions are being written, responsibility
organizational structures do not support communication for quality is included. In addition, specific responsibility
about quality or effective mentoring and monitoring of statements for province clinical specialists, QA commit-
QA work by the national level. With a new service quality tees, QA coaches, and national trainers are being revised.
specialist taking over the senior technical QA role in
September 2002, an opportunity exists to redefine
Capacity Building The CBOH is in the expansion phase for capacity building, coaching training. QA coaches and national trainers have
moving into consolidation. Formal QA capacity building has been regularly validated with competency-based assess-
occurred or is ongoing in every district and at each level 2 ment by senior QA practitioners. Training materials have
and 3 hospital, and competent coaches are available at been developed for several pre-service and post-basic
most districts and each hospital. Many, but not all, facili- school environments in technical clinical programs and
ties have at least one QA-trained person. Capacity building nursing. Plans have been made to train additional coaches
uses standard materials and qualified trainers. Training and national trainers to address attrition and reassign-
effectiveness has been routinely evaluated by national ment, to ensure a critical mass of QA expertise.
trainers, resulting in changes in technical approaches and
continued on page 48
Rewarding Quality Zambia is at an experiential level in terms of formal reward quality work. At local levels, where QA efforts are
rewards for quality. Job descriptions are not yet developed sustained, people are rewarded for quality in several ways:
for all staff, though job expectations do exist for catego- personal recognition by supervisors, formal awards on
ries of staff. The system has assumed that workers will be Labour Day, recognition of “best ward” or “best nurse,”
of high quality and has not envisioned a role for rewards or ability to use saved funds on priority needs, and personal
punishments based on quality performance. At the advancement due to knowledge of quality and quality
national level, leaders are discussing ways to evaluate and assurance.
T
HE QA Project has now completed ten years of work strates to health decision makers, on an ongoing basis, that
to support lower- and middle-income countries in investments in QA produce results. The development of
implementing QA in national, regional, and local quality indicators and monitoring systems that capture and
healthcare systems. This monograph highlights our under- communicate such results is essential to this end.
standing of what is needed to sustain QA in a healthcare
The QA Project enters its second decade with a clear un-
system or organization over time.
derstanding of the elements of QA institutionalization and
Leadership, both at the facility and the political levels, is a need to learn how to most efficiently support their devel-
perhaps the most critical element in improving and opment and scale-up. While a few countries have moved
sustaining the quality of care and moving forward in insti- rapidly to expand QA to entire districts or provinces, many
tutionalization. In addition, clear policies that link QA to countries become mired in the expansion phase, struggling
the organization’s overall mission and that define the QA with the challenges of scaling up successful pilot or dem-
roles and responsibilities of coaches, trainers, quality com- onstration experiences. We need to learn more about how
mittees, and supervisors must be in place. While our field QA activities in a small number of sites can be efficiently
experience shows that it is possible to implement QA expanded to cover all or most of a healthcare
activities with good results, without overall policies that organization’s operations.
support QA, such activities are rarely, if ever, sustained.
No single approach to scaling up fits all countries and
Leadership, policies, and core values that support QA help
contexts, and we need to increase our understanding of
sustain health worker motivation to persist in delivering
the range of expansion strategies and the different condi-
quality care despite the difficulties they face daily in
tions under which various strategies would work. Focusing
resource-constrained environments.
QA activities on priority health problems is one model that
Building QA capacity at the facility, district, regional, and can be effective in rapidly expanding QA efforts. The selec-
national levels for large-scale implementation is another tion of what to improve determines much of the initial
big challenge, and one that demands further insights in enthusiasm and leadership buy-in to the improvement
how to undertake it with the least investment of resources. effort. It is critical to select important health priorities;
We know that organizations that are serious about quality doing so will make the effort worthwhile and generate
assurance must allocate sufficient resources to develop a support for more improvement. This has the double benefit
cadre of QA experts who can train, coach, and mentor of achieving measurable results to persuade decision mak-
others. Frequent turnover of health personnel calls for ers that QA activities are worthwhile and providing positive
diverse strategies for developing and maintaining QA skills reinforcement to the health providers who undertook the
after initial waves of QA training. Alternatives to traditional QA activity. Replicating successful interventions or expand-
training merit wider application: self-learning, peer ing work to other clinical areas then serves as the vehicle
mentoring, and job aids, as well as mechanisms to reach to spread QA concepts and methods to a larger area or to
would-be healthcare providers during basic education and apply them to other problems.
during service through professional organizations.
Another promising approach for building up and sustain-
While the eight essential elements and the phases for insti- ing QA efforts is creating demand for improved quality of
tutionalization are the central issue of this monograph, it’s care from forces external to the healthcare organization.
important to keep the principles of QA in mind while insti- This external demand for quality may come from clients
tutionalizing QA. For instance, the principle of focusing on and communities (such as the users’ committees or com-
the client, as noted in Section 2, keeps healthcare workers munity health boards) or through the healthcare financing
performing at their best and clients satisfied with the ser- system, as in the approach of tying payment or reimburse-
vices they are receiving. Such performance feeds into a ment to meeting minimum quality standards. Attention to
focus on results that will resonate with health authorities, addressing client needs and expectations can help lay the
who are responsible for improving outcomes for priority groundwork for greater community involvement in and
health problems and efficiency, and for reducing costs. support for QA efforts.
Providing objective evidence of improvement demon-
Partnerships for Health Reform Project. 2000. Glossary of Shortell, S.M., J.L. O’Brien, J.M. Carman, R.W. Foster, E.F.X.
Health Reform Terms for Translators: A Working List for Hughes, H. Boerstler, and E.J. O’Connor. 1995. Assessing
Use by Translators and Health Systems Specialists. the impact of continuous quality improvement/total
Bethesda, MD: Partnerships for Health Reform Project quality management: Concept versus implementation.
in cooperation with the Ministry of Health and Health Services Research 30:377–401.
Population, Egypt.
Shortell, S.M., C.L.Bennett CL, Byck GR. 1998. Assessing the
Plsek, P.E. 1997.“Working Paper: Some Emerging Principles impact of continuous quality improvement on clinical
for Managers of Complex Adaptive Systems (CAS).” practice: What will it take to accelerate programs. The
<www.directedcreativity.com/pages/ Milbank Quarterly 76:593–624.
ComplexityWP.html>. Uploaded to Internet 5 November
Suleiman, A.B., and M. Jegathesan. 2000. Health in
1997.
Malaysia–Achievements and Challenges. Malaysia:
Powell, T.C. 1995. Total quality management as competitive Ministry of Health.
advantage: A review and empirical study. Strategic
Tenner, A.R., and I.J. DeToro. 1992. Total Quality
Management Journal 18:15–37.
Management: Three Steps to Continuous Improvement.
QA (Quality Assurance) Project. Undated.“Niger Country Reading, MA: Addison-Wesley Publishing Company, Inc.
Report: Tahoua Project.” Quality Assurance Methodology
USAID (United States Agency for International Develop-
Refinement Series. Bethesda, MD: Published for the
ment). 2000.“Measuring Institutional Capacity.” USAID/
United States Agency for International Development
CDIE TIPS Number 15. Washington, DC: USAID.
(USAID) by the Quality Assurance Project.
Wagner, C., D.H. DeBakker, and P.P. Groenewegen. 1999. A
Reinke, J.M., L. Malianga, and M. Mchombo. 2001. Malawi:
measuring instrument for evaluation of quality systems.
May 21–June 7. Trip Report.
International Journal of Quality Health Care 11:119–30.
Reinke, J.M. 2002. Zambia: August 4–September 1. Trip
Report.