Professional Documents
Culture Documents
016055
206
https://doi.org/10.1192/apt.bp.116.016055 Published online by Cambridge University Press
Quality improvement for psychiatrists
Bell Telephone Company in the 1920s. Shewhart collection of data to inform change efforts, with
developed statistical methods of understanding a focus on improving patient outcomes and
variation and used these to drive improvements experience in a climate of financial restraint.
in production processes, resulting in improved Emphasising that healthcare is delivered within
reliability of telephone transmission systems. He complex systems, Langley et al (2009) define
asserted that system performance data comprises systems as ‘interdependent group[s] of items,
two types of variation: that which is randomly people, or processes working together toward a
occurring and normal within the system, and that common purpose’ (p. 77). Audit generally involves
which is not randomly occurring and so indicates staff in a discrete part of a system regularly
that there is another cause. To find meaning accessing data within their local context to
within data, they must be understood in context. evaluate ‘what is happening in clinical practice
This ability to analyse information about a against explicit criteria’ (Hill 2006).
system and use it to guide improvements influenced QI recognises that improved performance of
William Edwards Deming, who also studied with ind iv idual parts cannot, on its own, maximise
renowned statisticians Sir Ronald Fisher and Jerzy the effectiveness of the system as a whole
Neyman. Deming famously went on to influence (Langley 2009). It moves beyond clinical audit to
the automotive industry in Japan in the 1950s multidisciplinary scrutiny of a system, emphasises
and is widely credited as the inspiration for the integration, uses open-ended questions and seeks
Japanese post-war economic ‘miracle’. qualitative as well as quantitative data. QI seeks
Deming urged those wishing to make an to bring about better outcomes while either
improvement in any system to take a fourfold reducing expenditure or, if this is not possible,
approach that he named the ‘system of profound ensuring that the best possible value is achieved
knowledge’. This demands simultaneous appre for the investment made (Porter 2010). The
ciation of the system, understanding variation process of improvement itself can bring about
within that system, considering the psychology substantial savings by eliminating unnecessary
and behaviour of the people in the system and activity, reducing costly harms and increasing
taking an epistemological perspective (Deming efficiency. An intervention in a psychiatric in-
2010). Several approaches that arose from this patient unit designed to reduce violence has the
philosophy of using statistical techniques to potential to save money in a number of ways, as
streamline manufacturing process, such as Lean observed by Brown et al (2015), who conducted a
and Six Sigma, have subsequently been applied to financial analysis of their work to reduce physical
healthcare (DelliFraine 2010). violence on three older adults’ wards and observed
a reduction in direct costs of £58 612, balanced
QI and audit in times of financial constraint against the £2000 required to fund environmental
improvements.
Clinical audit has long been seen as an essential
cornerstone of clinical governance. Audit was
introduced in to the National Health Service The Model for Improvement
(NHS) by the government’s white paper Working Developing knowledge of QI principles and method
for Patients (Department of Health 1989). Audit ology requires dedicated study and the opportunity
is the process of setting explicit standards, then to apply learning in an experiential environment.
measuring practice against these standards and There are several different approaches, with
implementing the necessary change to improve their own perspectives for understanding and
patient care, thereby addressing any deviation influencing positive change. By way of an example,
from the standards (Palmer 2002). It has been the Model for Improvement (Fig. 1) provides an
criticised as being overly focused on the process accessible framework to accelerate improvement
of data collection, with inadequate emphasis on efforts, posing three fundamental questions
bringing about the actual improvements (Hillman that are combined with Deming’s structure for
2011). When used to assess practice against iteratively testing changes, the plan–do–study–act
minimum standards, audit becomes an exercise in (PDSA) cycle (Deming 2010).
quality assurance, focused on improving outcomes This model encourages those who would like to
to meet a ‘good enough’ target, in contrast to bring about change to engage with other stake
continuous quality improvement, which seeks holders across the system and systematically
to achieve the ‘best possible’ outcomes through plan changes they believe will be beneficial.
improved healthcare processes (Goldstone 1998). Couched in the plural, the approach emphasises
Clinical audit is not completely distinct from that sustainable change in a complex system
quality improvement; they share the repeated necessitates joint working by people with multiple
Traditional management strategies have devel Services operate from over 100 community and in-
oped to deal with technical problems, and they can patient sites, with over 735 general and specialist
exacerbate problems if implemented with adaptive in-patient beds, 5000 permanent employees and
challenges (Heifetz 1994). QI offers an alternative an annual income exceeding £350 million.
way of dealing with the complex problems we so ELFT’s organisational mission is to provide
often face in healthcare systems, and the potential the highest quality mental health and community
to make changes that lead to ‘improvement beyond care in England. A large-scale QI programme
what has been seen before’ (Langley 2009: p. 16). was launched in February 2014 to help the
Any theory of change or logic model to tackle a organisation achieve this. The QI programme
complex adaptive problem will inevitably involve is designed to support teams to continuously
some technical aspects. QI often includes testing improve care and to change organisational culture
and learning about areas where existing knowledge so as to shift power and decision-making to the
and experience are weak, and facilitates shorter front line. It encourages teams and patients to
testing cycles with accelerated implementation in drive change, collaborating to creatively tackle
technical areas. some of the trust’s most complex quality issues.
Two initial ‘stretch’ goals, clearly communicating
Factors that influence success in QI that maintaining the status quo is not an option,
were set: to reduce harm by 30% every year; and
The context in which QI is used within healthcare
to ensure that every patient receives the right care,
to attempt improvements has been recognised as
in the right place at the right time (Fig. 3). Two
an important determinant of success, and work
years after the QI programme was introduced at
is ongoing to establish which contextual factors
ELFT, improvement efforts have grown in scale
are sufficiently modifiable to warrant investment
and breadth to over 150 active projects across
at different stages of QI (Fulop 2015). Kaplan
all areas of the organisation, including corporate
et al (2011) have explored contextual factors as
services, all clinical services and the Council of
they relate to QI in healthcare using a systematic
Governors (ELFT 2015).
review of the literature and structured input from
a diverse group of QI experts. Having defined
success for a QI project as ‘the implementation
of system and process changes and associated The Model for Understanding Success in Quality
outcome improvements’, they identified 25 factors External environment • Task of strategic importance to the organisation
they believed were likely to influence success and • External motivators
created a conceptual model applicable to QI in • External project sponsorship
healthcare. The resulting Model for Understanding
Organisation QI leadership
Success in Quality (MUSIQ) organises these into •
• Senior leader/project sponsor
several themes: the environment external to the • QI culture
organisation in which QI work is being done; • QI maturity
• Payment structure
the organisation itself; local QI support and • Other factors (organisation type, size, complexity,
capacity; the team working on the project; and formalisation, teaching status and system affiliation)
the microsystem in which the team functions
QI support and capacity QI workforce focus
(Fig. 2). A related MUSIQ tool allows projects to be •
• Resource availability
scored in each domain, highlighting areas where • Data infrastructure
contextual factors may be supporting or failing to
support improvement efforts. QI team • Team leadership
• Team diversity
• Subject matter expert
Case study: East London NHS Foundation • Decision-making process
Trust •
•
Team norms
QI skill
East London NHS Foundation Trust (ELFT) • Physician involvement
• Prior QI experience
is one of the UK’s largest specialist healthcare • Team tenure
providers, delivering mental health services to
a population of 750 000 people in east London Microsystem • QI leadership
and, since April 2015, a further 630 000 people • Motivation
• QI capability
in Bedfordshire and Luton. Other provisions • QI culture
in London include community health services
in Newham, psychological therapy services in FIG 2 Contextual factors and the level of the healthcare system in which they operate, according
Richmond, and children and young people’s to the Model for Understanding Success in Quality (MUSIQ) developed by Kaplan et al
speech and language therapy services in Barnet. (2011). QI, quality improvement.
30
25
UCL
20
No. of Incidents per 1000 OBD
15
12.1
10
7.2
5
LCL
0
06-Jan-14
20-Jan-14
03-Feb-14
17-Feb-14
03-Mar-14
17-Mar-14
31-Mar-14
14-Apr-14
28-Apr-14
12-May-14
26-May-14
09-Jun-14
23-Jun-14
07-Jul-14
21-Jul-14
04-Aug-14
18-Aug-14
01-Sep-14
15-Sep-14
29-Sep-14
13-Oct-14
27-Oct-14
10-Nov-14
24-Nov-14
08-Dec-14
22-Dec-14
05-Jan-15
19-Jan-15
02-Feb-15
16-Feb-15
02-Mar-15
16-Mar-15
30-Mar-15
13-Apr-15
27-Apr-15
11-May-15
25-May-15
08-Jun-15
22-Jun-15
06-Jul-15
20-Jul-15
03-Aug-15
17-Aug-15
31-Aug-15
14-Sep-15
28-Sep-15
12-Oct-15
26-Oct-15
09-Nov-15
23-Nov-15
07-Dec-15
21-Dec-15
04-Jan-16
18-Jan-16
01-Feb-16
15-Feb-16
29-Feb-16
14-Mar-16
28-Mar-16
11-Apr-16
25-Apr-16
Baseline data PDSA data
(before) (after)
FIG 4 Rates of incidents of physical violence across all six in-patient mental health wards in Tower Hamlets. LCL, lower control limit; OBD, occupied bed-day;
PDSA, plan–do–study–act; UCL, upper control limit. Adapted with permission from Taylor-Watt et al (2017).
20
15 UCL
10
No. of Incidents per 1000 OBD
5 2.5
5.8
0 LCL
100
80
UCL
60
35.0
40
20
LCL
0
06-Jan-14
20-Jan-14
03-Feb-14
17-Feb-14
03-Mar-14
17-Mar-14
31-Mar-14
14-Apr-14
28-Apr-14
12-May-14
26-May-14
09-Jun-14
23-Jun-14
07-Jul-14
21-Jul-14
04-Aug-14
18-Aug-14
01-Sep-14
15-Sep-14
29-Sep-14
13-Oct-14
27-Oct-14
10-Nov-14
24-Nov-14
08-Dec-14
22-Dec-14
05-Jan-15
19-Jan-15
02-Feb-15
16-Feb-15
02-Mar-15
16-Mar-15
30-Mar-15
13-Apr-15
27-Apr-15
11-May-15
25-May-15
08-Jun-15
22-Jun-15
06-Jul-15
20-Jul-15
03-Aug-15
17-Aug-15
31-Aug-15
14-Sep-15
28-Sep-15
12-Oct-15
26-Oct-15
09-Nov-15
23-Nov-15
07-Dec-15
21-Dec-15
04-Jan-16
18-Jan-16
01-Feb-16
15-Feb-16
29-Feb-16
14-Mar-16
28-Mar-16
11-Apr-16
25-Apr-16
FIG 5 Rates of incidents of physical violence across in-patient mental health wards in Tower Hamlets: the top chart relates to acute wards and the bottom chart
relates to intensive care wards. LCL, lower control limit; OBD, occupied bed-day; PDSA, plan–do–study–act; UCL, upper control limit. Adapted with permission
from Taylor-Watt et al (2017).
data with new information, primarily qualitative relating to quality improvement and outcomes
MCQ answers
data drawn from interviews, focus groups and addi openly on the website, as well as holding regular
1c 2e 3a 4d 5e
tional surveys. open mornings and an annual QI conference.
The evaluation in 2015 identified three themes
that were felt to help in the implementation of the The future medical workforce
QI programme: positive front-line engagement, QI
Improvement requires a progressive accrual of
team support and strong leadership (ELFT 2015).
knowledge, skills, values and behaviours; any
Conversely, three themes were identified as hin
QI curriculum needs to reflect this. QI learning
dering programme implementation: unclear
in the healthcare workforce needs start as early
expectations regarding the QI programme, lack of
as possible in practitioners’ careers if it is to be
support structures for staff, and communication
embedded in practice. Psychiatrists in training
problems. QI training was identified as both a
should have the opportunity to develop a basic
helping and hindering factor. It was perceived to
understanding and engage in practical experience
be helping because it offered a formal yet creative
of QI during medical school and foundation
programme that provided QI projects a lifeline. It
training. Examples of effective partnerships
was perceived as hindering because there were
between education and health organisations are
issues with accessibility and flexibility of training
emerging, for example, collaboration between City
options at the time, which have subsequently been
University and ELFT, and Stirling University’s
addressed by an expanded range and capacity of
adapted IHI practicum. These education initiatives
learning opportunities.
are supported by mentors, managers and other
clinical staff and provide undergraduate nursing
Learning and sharing students with structured teaching while aligning
To date, the QI programme has focused on four them with practice of QI.
areas: engaging people across the organisation to The Academy of Medical Royal Colleges’
use QI approaches to tackle something that matters (AoMRC’s) Joint Academy Training Forum
to their team; enhancing people’s knowledge and commissioned a ‘task and finish’ group to consider
skills in QI; supporting teams working on QI this issue as it relates to the medical profession.
projects; and ensuring that QI work is embedded The group involved key stakeholders from all four
into ‘business as usual’, including integration UK countries, the aim being to create an increased
into operational structures. QI project teams now capacity across the workforce in order to allow
have access to local support systems – including healthcare teams to have a positive impact on the
connections with sponsors, coaches and local delivery of safe and effective patient care.
learning forums – enabling their work to flourish. The final report, Quality Improvement – Training
Results from the 2015 and 2016 NHS staff for Better Outcomes, recognises that trainees have
surveys are encouraging, with overall staff generally been expected to focus on audit, which
engagement, job satisfaction, perceived ability can be a token exercise in data collection, and
to contribute to improvements at work, clinical makes recommendations designed to align efforts
safety reporting mechanisms, and motivation at to implement QI training as a core component of
work all increasing consistently over the 4 years every doctor’s development (AoMRC 2016a). The
since this approach to improvement began to group’s recommendations (Box 1) are designed
be discussed and developed (NHS 2015). Senior to provide a robust framework for embedding
leaders in ELFT believe that the QI programme improvement methodology as a core competence
is a significant contributor to this improvement. for all doctors.
The recent Care Quality Commission inspection of This learning will be augmented throughout
the trust also noted the impact of the QI approach core and higher training in preparation for senior
on encouraging innovation, improving outcomes leadership of QI work as consultants. Current
and experience for patients, and supporting deeper consultants who are trainers should familiarise
staff engagement. Some fairly unique aspects to themselves with the expectations for students and
the way this programme is being delivered, such trainees at different stages in order to provide
as the emphasis on improvement priorities and appropriate support. This may also involve
change ideas being developed at the edge of the trainers undertaking additional training in order
organisation by front-line teams together with to feel confident in providing such support.
patients, appear to be critical to the engagement The report also suggests that each organisation
and successes noted at this early stage in the in healthcare should have a local leader respon
improvement journey. The trust is committed to sible for quality who would lead efforts to build
transparency and shares a great deal of information capability and capacity. This would need to
DelliFraine JL, Langabeer JR, Nembhard I (2010) Assessing the evidence Hill SL, Small N (2006) Differentiating between research, audit and quality
of Six Sigma and Lean in the healthcare industry. Quality Management improvement: governance implications. Clinical Governance, 11: 98–107.
in Health Care, 19: 211–25.
Hillman T, Roueché A (2011) Quality improvement. BMJ Careers (http://
Deming WE (2010) The New Economics: For Industry, Government, careers.bmj.com/careers/advice/Quality_improvement). Accessed 23
Education (2nd edn). MIT Press. March 2016.
Department of Health (1989) Working for Patients. HMSO. Institute of Medicine (2001) Crossing the Quality Chasm. National
Academies Press.
Department of Health (2012) Transforming Care: A National Response to
Winterbourne View Hospital. Department of Health Review: Final Report. Jones B, Woodhead T (2015) Building the Foundations for Improvement.
Department of Health. The Health Foundation.
Dixon-Woods M, McNicol S, Martin G (2012) Ten challenges in Kaplan HC, Provost LP, Froehle CM, et al (2011) The Model for
improving quality in healthcare: lessons from the Health Foundation’s Understanding Success in Quality (MUSIQ): building a theory of context
programme evaluations and relevant literature. BMJ Quality and Safety, in healthcare quality improvement. BMJ Quality and Safety, 21: 13–20.
21: 876–84. Langley GL, Moen R, Nolan KM, et al (2009) The Improvement Guide
(2nd edn). Jossey-Bass.
Donaldson L (2002) An organisation with a memory. Clinical Medicine,
2: 452–7. Lawton R, Parker D (2002) Barriers to incident reporting in a healthcare
system. Quality and Safety in Health Care, 11: 15–8.
East London NHS Foundation Trust (2015) Improving the Quality of Mental
Health and Community Services. ELFT. NHS (2015) 2015 National NHS Staff Survey. Results from East London
NHS Foundation Trust. NHS.
Fulop N, Robert G (2015) Context for Successful Quality Improvement.
The Health Foundation. Palmer C (2002) Clinical governance: breathing new life into clinical audit.
Advances in Psychiatric Treatment, 8: 470–6.
Francis R (2013) Report of the Mid Staffordshire NHS Foundation Trust
Public Inquiry. TSO (The Stationery Office). Porter ME (2010) What is value in health care? New England Journal of
Medicine, 363: 2477–88.
Goldstone J (1998) The role of quality assurance versus continuous
quality improvement. Journal of Vascular Surgery, 28: 378–80. Reason J (1995) Understanding adverse events: human factors. Quality
and Safety in Health Care, 4: 80–9.
Health and Safety Executive (1999) Reducing Error and Influencing
Behaviour (HSG48). HSG Books. Taylor-Watt J, Cruickshank A, Innes J, et al (2017) Reducing physical
violence and developing a safety culture across wards in East London.
Heifetz R (1994) Leadership without Easy Answers. Harvard University British Journal of Mental Health Nursing, 6(1).
Press.
World Health Organization (2009) Human Factors in Patient Safety:
Heifetz R, Linsky M (2002) Leadership on the Line: Staying Alive. Harvard Review of Topics and Tools. Report for Methods and Measures Working
Business School Publishing. Group of WHO Patient Safety. WHO.
MCQs d QI involves staff in a discrete part of the system d establishing effectiveness using aggregated
Select the single best option for each question stem e clinical audit involves staff in a discrete part of data retrospectively
the system. e making predictions based on real-time data.
1 In the 1920s, methods of understanding
variation to drive improvements in industry
were developed by: 3 In a typical technical challenge: 5 The MUSIQ tool is likely to be least effective
a Jerzy Neyman a skills to tackle the challenge exist within the when used by:
b William Deming system a a QI mentor, working with a project team
c Walter Shewhart b resolution is difficult to define b a project team, identifying their own needs
d Ronald Fisher c further challenges are revealed when solutions c a clinical leader, deciding what QI support is
e Donald Berwick. are attempted needed for an initiative
d attitudes, values and behaviours need to adapt d a non-clinical manager, deciding what support
e those involved in the work develop solutions. needed for a QI initiative
2 Regarding clinical audit and quality
e an organisation, determining their QI capability.
improvement (QI):
a QI and audit rely on repeated collection of 4 The Model for Improvement does not
system performance data involve:
b clinical audit involves making changes to deliver a determining what should be accomplished
improvements b deciding how improvements will be recognised
c QI involves making changes to deliver improvements c generating change ideas that can be tested