Professional Documents
Culture Documents
Effectiveness of Quality Improvement Interventions For
Effectiveness of Quality Improvement Interventions For
Review question/objective: The objective of this review is to find the best available evidence regarding
effectiveness of quality improvement interventions in clinical radiology and the experiences and perspectives of
staff and patients. More specifically, the review questions are:
How effective are the interventions that may improve or affect patient safety and quality in clinical radiology?
What are the experiences and perspectives of staff and patients of patient safety and quality
improvement interventions?
Keywords Diagnostic imaging; health information technology; healthcare professional; medical imaging;
patient safety
JBI Database of Systematic Reviews and Implementation Reports ß 2016 THE JOANNA BRIGGS INSTITUTE 65
adverse drug events23, wrong site, side, patient or improving deficits in patient safety and thus may be
procedure24,25 complications26, falls27 and pressure considered as a proxy for patient safety.49 Safety
sores.28 Patient safety data may be shown through culture has been measured using a number of tools
incidents reported by healthcare professionals such as the Safety Attitudes Questionnaire (SAQ)
and/or patients and carers, coroner’s reports, or Hospital Survey on Patient Safety Culture
medico-legal case files, medical records from private (HSOPSC).49
facility and state-based public hospital. Interventions to improve patient safety in
Awareness of patient safety in radiology has risen radiology have focused on several other areas. For
over the last decade through analysis of inci- example, the implementation of new technologies
dents17,18,29 and by focusing on human factors6 addressing human factors6 and systems deficits,
and nontechnical skills (NTS).30 Human factors including technologies like patient identifi-
are part of the scientific discipline dealing with cation,50-52 voice recognition53-59 and web-based
interactions among humans and other elements of solutions.60 Moreover, there has also been a demand
the system that optimize human wellbeing and over- for general improvement in patient safety in radi-
all system performance.31 Nontechnical skills are ology focusing on various interventions such as
cognitive, social and personal resource skills that learning from error,61 using incident reporting sys-
contribute to safe and efficient task performance. tems,29,62 safety rounds,36 awareness and cognitive
They are essential to complement the technical skills behavior,63 clinical audit,64 clinical governance,65
possessed by medical engineers, radiographers and teamwork and communication.66-68 A few studies
radiologists as situation awareness, decision making, have also shown that the use of a pre-procedural
communication, teamwork and leadership are checklists69 or surgical safety checklists70 in radi-
incorporated with technical tasks.30 Communi- ology improves communication and teamwork and
cation failure and delayed diagnosis are the most reduces adverse events.
prevalent of these patient safety incident types in However, critics of patient safety interventions,
radiology.32-39 such as those discussed previously, often claim that
Adverse events may also occur due to improper they negatively impact on throughput of patients or
human performance or failure to operate radiology clinician workflow.71,72 A clearer understanding of
HIT, such as incorrectly requesting a study by refer- the possible negative impacts of patient safety inter-
rer, lack of rigor in performance by a radiographer or ventions is required, and therefore, patient through-
misinterpreting a study by radiologist.40 Moreover, put in radiology departments, and/or radiologist
radiologists may be given minimal training on the workflow, will be included as secondary outcomes
use and operation of such systems41,42 or more in this systematic review. In addition, the success of
attention and concentration may be required to patient safety interventions is dependent on clini-
perform new tasks, interventions and treatments cian engagement73, therefore, knowing clinicians’
that are often not possible due to heavy workload perceptions and experiences of the intervention is
or deficiency in workforce.40,43,44 Radiology depart- essential to understanding why an intervention has
ments are required to address these risks in a timely or has not worked. The use of both qualitative and
manner using principles of system resilience and quantitative methods in patient safety research is
high-reliability organizations.14,15 proposed to contextualize results.74 Consequently,
The risks of adverse events may be overcome by this systematic review will also include the qualita-
improving understanding of error,45 ensuring tive experiences and perceptions of staff and
appropriate criteria at the time of entry of patient patients.
data,41 staff training,15,30 utilizing correct imaging The majority of previously cited studies examin-
technique,46 adhering to as low as reasonably ing interventions for improving patient safety in
achievable,44 proper integration of new HIT radiology are of low quality and/or use a study
systems,42-44,47 contingency planning and escalation design that is prone to bias. To date, no compre-
procedures,42 and configuration and communi- hensive systematic review has been identified that
cation between systems.14,48 In addition, healthcare appraises quality improvement interventions in radi-
providers are urged to improve safety culture, which ology. The initial search looking for such systematic
has been considered as an important precursor for reviews or systematic review protocols was
JBI Database of Systematic Reviews and Implementation Reports ß 2016 THE JOANNA BRIGGS INSTITUTE 66
conducted by the author during March 2015. Key intervention. These experiences or perspectives
search terms utilized for this initial search included could include descriptions of safety concerns, the
radiology, medical imaging, patient safety, safety context and culture of the workplace (including
and quality, and patient safety intervention. The factors such as conflict and how it is managed,
databases such as Cochrane Library, PROSPERO teamwork behaviors or the attitudes of staff to
and the JBI Database of Systematic Reviews and patient safety), the management of adverse events
Implementation Reports were searched accordingly. and near misses or changes to work practices. It is
Published reviews have addressed patient perspect- anticipated that this data would be obtained from
ive of receiving care in medical imaging or radi- interviews and/or focus groups with staff or patients
ology75,76; however, there is an absence of reviews and, potentially, participant observations.
on quality improvement interventions. The proposed
systematic review will provide comprehensive evi- Context
dence of quality improvement interventions in radi- The current systematic review will consider studies
ology practice. that are based on a radiological setting.
JBI Database of Systematic Reviews and Implementation Reports ß 2016 THE JOANNA BRIGGS INSTITUTE 67
data including, but not limited to, designs such as facility, super clinic, radiology department (using
phenomenology, grounded theory and ethnography. OR Boolean operator).
Mixed methods and descriptive studies will also Interventions: Health information technology,
be included. picture archiving communication system, radiology
information system, computer aided diagnosis, voice
Search strategy recognition technology, human factors, ergonomics,
The search strategy aims to find published and human engineering, training, education, staffing
unpublished studies. A three-step search strategy arrangement, incident reporting, peer review,
will be utilized in this review. An initial limited clinical audit, teamwork intervention, communi-
search of EMBASE and MEDLINE (via Ovid) cation intervention, team training, safety checklist,
will be undertaken followed by analysis of the text local governance, quality improvement intervention
words contained in the title and abstract, and of the (using OR Boolean operator).
index terms used to describe article. A second search Outcomes: Patient safety, incident, sentinel event,
using all identified keywords and index terms will event, near miss, adverse event, adverse incident,
then be undertaken across all included databases. safety incident, patient safety incident, event regis-
Third, the reference list of all identified reports ter, safety culture, nontechnical skills, patient
and articles will be searched for additional studies. throughput, workflow, patient experience, patients
Studies published in English will be considered for perspective, staff experience, staff perspective (using
inclusion in this review. Studies published from OR Boolean operator).
1990 (when the first substantive patient safety Types of studies: Randomized controlled trials,
research study, ‘‘Harvard Medical Practice’’, was cluster randomized controlled trials, quasi exper-
published)80,81 onward will be considered for imental, controlled before and after trials, inter-
inclusion in this review. rupted time series analysis, grounded theory,
There is little published evidence on interven- ethnography, phenomenology (using OR Boolean
tions to improve patient safety in radiology. operator).
Therefore, we have decided to keep the search Radiology and its modalities AND populations
broad and focus on different types of interventions AND interventions AND Outcomes AND Types of
that have been implemented with the intention studies. (using AND Boolean operator).
of improving patient safety as primary outcome
and other secondary outcomes as mentioned Assessment of methodological quality
above. Quantitative papers selected for retrieval will be
The databases for published studies to be searched assessed by two independent reviewers for methodo-
include EMBASE, MEDLINE, CINAHL, Cochrane logical validity prior to inclusion in the review using
Central Register of Controlled Trials, PsycINFO and standardized critical appraisal instruments from the
Web of Science. The search for unpublished studies Joanna Briggs Institute Meta Analysis of Statistics
will include Mednar, Trove, Google Grey and Assessment and Review Instrument (JBI-MAStARI)
OCLC WorldCat Dissertations and Theses. (Appendix I). Any disagreements that arise between
Initial keywords to be used will be: the reviewers will be resolved through discussion or
Radiology and its modalities: Radiology, diagnos- with other reviewers.
tic imaging, medical imaging, clinical radiology, X- Qualitative papers selected for retrieval will be
Rays, computed tomography, angiography, mam- assessed by two independent reviewers for methodo-
mography, magnetic resonance imaging, ultrasound, logical validity prior to inclusion in the review using
positron emission tomography, single photon emis- standardized critical appraisal instruments from the
sion computed tomography (Using OR Boolean Joanna Briggs Institute Qualitative Assessment and
operator). Review Instrument (JBI-QARI) (Appendix II). Any
Populations: Healthcare professional, health per- disagreements that arise between the reviewers will
sonnel, radiologist, radiology nurse, radiographer, be resolved through discussion or with other
radiology technician, radiology registrar, radiology reviewers.
consultant, ultra-sonographer, patient, consumer, Critical appraisal will be conducted on these
private hospital, public hospital, stand-alone papers. All papers will be included in the review.
JBI Database of Systematic Reviews and Implementation Reports ß 2016 THE JOANNA BRIGGS INSTITUTE 68
Where possible, sensitivity analysis will be con- Where textual pooling is not possible, the findings
ducted to determine if methodological quality will be presented in narrative form.
impacts on the results of meta-analysis. The results
of higher quality papers (in which a score of 80% or Acknowledgements
more is achieved in critical appraisal) will be com- The current review will contribute toward a PhD
pared with lower quality papers (a score of less than degree from the University of South Australia for the
80% in critical appraisal). main author (SRJ).
JBI Database of Systematic Reviews and Implementation Reports ß 2016 THE JOANNA BRIGGS INSTITUTE 69
15. Reason J. Human error: models and management. BMJ 32. Berlin L. Duty to directly communicate radiologic abnor-
2000;320(7237):768–70. malities: has the pendulum swung too far? AJR Am J
16. Heriot GS, McKelvie P, Pitman AG. Diagnostic errors in Roentgenol 2003;181(2):375–81.
patients dying in hospital: radiology’s contribution. J Med 33. Berlin L. Communicating results of all radiologic examin-
Imaging Radiat Oncol 2009;53(2):188–93. ations directly to patients: has the time come? AJR Am J
17. Fitzgerald R. Error in radiology. Clin Radiol 2001;56(12):938– Roentgenol 2007;189(6):1275–82.
46. 34. Berlin L. Standards for radiology interpretation and report-
18. FitzGerald R. Radiological error: analysis, standard setting, ing in the emergency setting. Pediatr Radiol 2008;38(Suppl
targeted instruction and teamworking. Eur Radiol 4):S639–44.
2005;15(8):1760–7. 35. Berlin L. Communicating results of all outpatient radiologic
19. Schiff GD, Hasan O, Kim S, Abrams R, Cosby K, Lambert BL, examinations directly to patients: the time has come. AJR
et al. Diagnostic error in medicine: analysis of 583 physician- Am J Roentgenol 2009;192(3):571–3.
reported errors. Arch Intern Med 2009;169(20):1881–7. 36. Miller DL. Safety in interventional radiology. J Vasc Interv
20. Quint LE, Quint DJ, Myles JD. Frequency and spectrum of Radiol 2007;18(1 Pt 1):1–3.
errors in final radiology reports generated with automatic 37. Singh H, Arora HS, Vij MS, Rao R, Khan MM, Petersen LA.
speech recognition technology. J Am Coll Radiol Communication outcomes of critical imaging results in a
2008;5(12):1196–9. computerized notification system. J Am Med Inform Assoc
21. Pezzullo JA, Tung GA, Rogg JM, Davis LM, Brody JM, Mayo- 2007;14(4):459–66.
Smith WW. Voice recognition dictation: radiologist as tran- 38. Singh H, Thomas EJ, Mani S, Sittig D, Arora H, Espadas D,
scriptionist. J Digit Imaging 2008;21(4):384–9. et al. Timely follow-up of abnormal diagnostic imaging test
22. Ketai L, Jordan K, Marom EM. Imaging infection. Clin Chest results in an outpatient setting: are electronic medical
Med 2008;29(1):77–105; vi. records achieving their potential? Arch Intern Med
23. Baleato-Gonzalez S, Garcia-Figueiras R, Casais MA, Diaz AA, 2009;169(17):1578–86.
Sanz-Falque I, Vilanova JC. Imaging in drug side effects. Curr 39. Renfrew DL, Franken EA Jr, Berbaum KS, Weigelt FH, Abu-
Med Imaging Rev 2015. Yousef MM. Error in radiology: classification and lessons in
24. Joint Commission. Universal protocol for preventing wrong 182 cases presented at a problem case conference. Radi-
site, wrong procedure, wrong person surgery.2003. ology 1992;183(1):145–50.
25. Angle JF, Nemcek AA Jr, Cohen AM, Miller DL, Grassi CJ, 40. Craciun H, Mankad K, Lynch J. Risk management in radi-
D’Agostino HR, et al. Quality improvement guidelines for ology departments. World J Radiol 2015;7(6):134–8.
preventing wrong site, wrong procedure, and wrong 41. Hannaford N, Mandel C, Crock C, Buckley K, Magrabi F, Ong
person errors: application of the joint commission ‘‘Uni- M, et al. Learning from incident reports in the Australian
versal Protocol for Preventing Wrong Site, Wrong Pro- medical imaging setting: handover and communication
cedure, Wrong Person Surgery’’ to the practice of errors. Br J Radiol 2013;86(1022):20120336.
interventional radiology. J Vasc Interv Radiol 2008; 42. Hannaford N, Mandel C. PACS and data availability. Royal
19(8):1145–51. Aust N Z Coll Radiol 2013;9(4):15.
26. Savader SJ, Venbrux AC, Savader BL, Fishman EK, Trerotola 43. The Joint Commission. TJC: HCOs need to be on alert for HIT
SO, Lund GB, et al. Complications of interventional radi- problems related to sociotechnical factors, take steps to
ology: an imaging overview. Clin Imaging 1993;17(4):282– improve safety culture, process, and leadership. ED Manag
91. 2015;27(6:Suppl 1-4).
27. Abujudeh H, Kaewlai R, Shah B, Thrall J. Characteristics 44. Gerard P, Arneja A, Kapadia N, Acharya J. Risk/reward:
of falls in a large academic radiology department: occur- patient safety initiatives in radiology and nuclear medicine:
rence, associated factors, outcomes, and quality improve- identification of various issues and unique risk reduction
ment strategies. AJR Am J Roentgenol 2011;197(1):154–9. strategies. J Nucl Med 2015;56(Suppl 3):1925.
28. Hendrix RW, Calenoff L, Lederman RB, Nieman HL. Radi- 45. Gunderman RB, Burdick EJ. Error and opportunity. AJR Am J
ology of pressure sores. Radiology 1981;138(2):351–6. Roentgenol 2007;188(4):901–3.
29. Jones DN, Benveniste KA, Schultz TJ, Mandel CJ, Runciman 46. Jones DN, Thomas MJ, Mandel CJ, Grimm J, Hannaford N,
WB. Establishing national medical imaging incident report- Schultz TJ, et al. Where failures occur in the imaging care
ing systems: issues and challenges. J Am Coll Radiol cycle: lessons from the radiology events register. J Am Coll
2010;7(8):582–92. Radiol 2010;7(8):593–602.
30. Flin R, O’Connor P, Crichton M. Safety at the sharp end. 47. Hains IM, Georgiou A, Westbrook JI. The impact of PACS on
Farnham, UK: Ashgate; 2008. clinician work practices in the intensive care unit: a system-
31. Salvendy G. Handbook of human factors and ergonomics. atic review of the literature. J Am Med Inform Assoc
4th ed. Hoboken, NJ: John Wiley & Sons, Inc; 2012. 2012;19(4):506–13.
JBI Database of Systematic Reviews and Implementation Reports ß 2016 THE JOANNA BRIGGS INSTITUTE 70
48. Collin S, Reeves BC, Hendy J, Fulop N, Hutchings A, Priedane urgent, and unexpected significant findings. Clin Radiol
E. Implementation of computerised physician order entry 2016;71(3):265–70.
(CPOE) and picture archiving and communication systems 65. Pearce CM, de Lusignan S, Phillips C, Hall S, Travaglia J. The
(PACS) in the NHS: quantitative before and after study. BMJ computerized medical record as a tool for clinical gover-
2008;337(7670):a939. nance in Australian primary care. Interact J Med Res
49. Pronovost P, Sexton B. Assessing safety culture: guidelines 2013;2(2):e26.
and recommendations. Qual Saf Health Care 2005;14(4): 66. Lewin JS. Interdisciplinary teams and the road to discovery.
231–3. Radiology 2010;254(1):26–30.
50. Allworth S, Lapsley P. Technology solutions to patient 67. Siegle RL. From errors to process improvement. J Am Coll
misidentification-report of review. Australian Commission Radiol 2004;1(2):133–4.
on Safety and Quality in Health Care; 2008. 68. Kubik-Huch RA, Klaghofer R, Rompler M, Weber A, Budde-
51. Chao C, Jen W, Chi Y, Lin B. Improving patient safety with berg-Fischer B. Workplace experience of radiographers:
RFID and mobile technology. Int J Electron Healthc impact of structural and interpersonal interventions. Eur
2007;3(2):175–92. Radiol 2010;20(2):377–84.
52. Jen WY, Chao CC. Measuring mobile patient safety infor- 69. Wong SS, Cleverly S, Tan KT, Roche-Nagle G. Impact and
mation system success: an empirical study. Int J Med Inform culture change after the implementation of a preprocedural
2008;77(10):689–97. checklist in an interventional radiology department. J
53. Hart JL, McBride A, Blunt D, Gishen P, Strickland N. Immediate Patient Saf 2015.
and sustained benefits of a ‘‘total’’ implementation of speech 70. Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat AH,
recognition reporting. Br J Radiol 2010;83(989):424–7. Dellinger EP, et al. A surgical safety checklist to reduce
54. Liu D, Zucherman M, Tulloss WB Jr. Six characteristics of morbidity and mortality in a global population. N Engl J
effective structured reporting and the inevitable integration Med 2009;360(5):491–9.
with speech recognition. J Digit Imaging 2006;19(1):98–104. 71. Hodler J, Strehle J, Schilling J, Zanetti M, Gerber C. Patient
55. Rana DS, Hurst G, Shepstone L, Pilling J, Cockburn J, throughput times for orthopedic outpatients in a depart-
Crawford M. Voice recognition for radiology reporting: is ment of radiology: results of an interdisciplinary quality
it good enough? Clin Radiol 2005;60(11):1205–12. management program. Eur Radiol 1999;9(7):1381–4.
56. Boland GW. Voice recognition technology for radiology 72. Khatib M. Improving emergency department and imaging
reporting: transforming the radiologist’s value proposition. throughput. Radiol Today Mag 2009;10(18):42.
J Am Coll Radiol 2007;4(12):865–7. 73. Pressman BD, Roy LT. Developing a culture of safety in an
57. Bhan SN, Coblentz CL, Norman GR, Ali SH. Effect of voice imaging department. J Am Coll Radiol 2015;12(2):198–
recognition on radiologist reporting time. Can Assoc Radiol 200.
J 2008;59(4):203–9. 74. Brown C, Hofer T, Johal A, Thomson R, Nicholl J, Franklin
58. Krishnaraj A, Lee JK, Laws SA, Crawford TJ. Voice recognition BD, et al. An epistemology of patient safety research: a
software: effect on radiology report turnaround time at an framework for study design and interpretation. Part 4.
academic medical center. AJR Am J Roentgenol 2010; One size does not fit all. Qual Saf Health Care 2008;
195(1):194–7. 17(3):178–81.
59. McGurk S, Brauer K, Macfarlane TV, Duncan KA. The effect of 75. Munn Z, Jordan Z. The patient experience of high technol-
voice recognition software on comparative error rates in ogy medical imaging: a systematic review of the qualitative
radiology reports. Br J Radiol 2008;81(970):767–70. evidence. Radiography 2011;17(4):323–31; JBI Library of
60. Robinson TJ, DuVall S, Wiggins R 3rd. Creation and usability Systematic Review.
testing of a web-based pre-scanning radiology patient 76. Munn Z, Lockwood C. The patient experience in medical
safety and history questionnaire set. J Digit Imaging imaging: a qualitative systematic review protocol. JBI Lib
2009;22(6):641–7. Syst Rev 2010;8(8):1–15.
61. Chakraverty S, Wright J. Managing errors in radiology: a 77. King HB, Battles J, Baker DP, Alonso A, Salas E, Webster J,
working model (2). Clin Radiol 2005;60(2):276. et al. TeamSTEPPS: team strategies and tools to enhance
62. Martin CJ. A survey of incidents in radiology and nuclear performance and patient safety. In: Henriksen K, Battles JB,
medicine in the West of Scotland. Br J Radiol 2005; Keyes MA, Grady ML, editorsAdvances in patient safety: new
78(934):913–21. directions and alternative approaches (vol 3: performance
63. Shapiro MJ, Croskerry P, Fisher S. Profiles in patient safety: and tools). Advances in patient safety. Rockville, MD: Agency
sidedness error. Acad Emerg Med 2002;9(4):326–9. for Healthcare Research and Quality, 2008.
64. Duncan KA, Drinkwater KJ, Dugar N, Howlett DC. Royal 78. Cooper S, Endacott R, Cant R. Measuring non-technical skills
College of Radiologists’ Clinical Radiology Audit Committee. in medical emergency care: a review of assessment
Audit of radiology communication systems for critical, measures. Open Access Emerg Med 2010;2010(2):7–16.
JBI Database of Systematic Reviews and Implementation Reports ß 2016 THE JOANNA BRIGGS INSTITUTE 71
79. Howell WLJ. Why patient satisfaction matters for radi- negligence in hospitalized patients. Results of the Harvard
ology.2012; [Cited 4 January 2016]. Available from: http:// Medical Practice Study I. N Engl J Med 1991;324(6):370–6.
www.diagnosticimaging.com/practice-management/why- 81. Leape LL, Brennan TA, Laird N, Lawthers AG, Localio AR,
patient-satisfaction-matters-radiology. Barnes BA, et al. The nature of adverse events in hospital-
80. Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, ized patients. Results of the Harvard Medical Practice Study
Lawthers AG, et al. Incidence of adverse events and II. N Engl J Med 1991;324(6):377–84.
JBI Database of Systematic Reviews and Implementation Reports ß 2016 THE JOANNA BRIGGS INSTITUTE 72
JBI Database of Systematic Reviews and Implementation Reports ß 2016 THE JOANNA BRIGGS INSTITUTE 73
JBI Database of Systematic Reviews and Implementation Reports ß 2016 THE JOANNA BRIGGS INSTITUTE 74
JBI Database of Systematic Reviews and Implementation Reports ß 2016 THE JOANNA BRIGGS INSTITUTE 75
JBI Database of Systematic Reviews and Implementation Reports ß 2016 THE JOANNA BRIGGS INSTITUTE 76
JBI Database of Systematic Reviews and Implementation Reports ß 2016 THE JOANNA BRIGGS INSTITUTE 77
JBI Database of Systematic Reviews and Implementation Reports ß 2016 THE JOANNA BRIGGS INSTITUTE 78