Professional Documents
Culture Documents
Quality in Practice
Address reprint requests to: Sharifah Munirah binte Abdullah Alhamid, Medicine Academic Clinical Programme Office,
Abstract
Problem: Effective handovers are critical for patient care and safety. Electronic handover tools are
increasingly used today to provide an effective and standardized platform for information exchange.
The implementation of an electronic handover system in tertiary hospitals can be a major challenge.
Previous efforts in implementing an electronic handover tool failed due to poor compliance and buy-
in from end-users. A new electronic handover tool was developed and incorporated into the existing
electronic medical records (EMRs) for medical patients in Singapore General Hospital (SGH).
Initial assessment: There was poor compliance by on-call doctors in acknowledging electronic
handovers, and lack of adherence to safety rules, raising concerns about the safety and efficiency of
the electronic handover tool. Urgent measures were needed to ensure its safe and sustained use.
Solution: A quality improvement group comprising stakeholders, including end-users, developed
multi-faceted interventions using rapid PDSA (P-Plan, D-Do, S-Study, A-Act ) cycles to address
these issues.
Implementation: Innovative solutions using media and online software provided cost-efficient
measures to improve compliance.
Evaluation: The percentage of unacknowledged handovers per day was used as the main outcome
measure throughout all PDSA cycles. Doctors were also assessed for improvement in their knowl-
edge of safety rules and their perception of the electronic handover tool.
Lessons learnt: An electronic handover tool complementing daily clinical practice can be success-
fully implemented using solutions devised through close collaboration with end-users supported
by the senior leadership. A combined ‘bottom-up’ and ‘top-down’ approach with regular process
evaluations is crucial for its long-term sustainability.
Key words: patient handovers, electronic handover, quality improvement, patient safety
© The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care. All rights reserved.
For permissions, please e-mail: journals.permissions@oup.com 1
2 Alhamid et al.
5 A red flag appears next to patient's name when handover created. This flag disappears when the handover acknowledged.
Figure 1 Electronic handover tool demonstrating creation and acknowledgment of handover (1–4) and patient list with handover flags (5).
calling doctors only when they were not compliant. The team resi- PDSA Cycle 4
dents sent these text messages during their free time. This took an Educational measures were stepped up. The team designed a video
estimated 20 minutes per day to perform. tutorial focusing on how to use the handover tool, while highlight-
ing the importance of adhering to the safety rules. Doctors had to
complete an online quiz that assessed their understanding of the
PDSA Cycle 3 safety rules and were required to score full marks in order to receive
Educational posters were designed to increase the awareness of the a certificate, as proof of completing the quiz. Senior clinicians from
safety rules. These posters were strategically displayed all over the the team sought support from the heads of each medical department
campus, especially at locations junior doctors frequented. This to mandate the completion of the quiz by all junior doctors prior to
included the on-call bedrooms, the doctors’ lounge, computer sta- the start of their first call.
tions and even toilet cubicles adjacent to the doctors’ lounge.
The reminder protocol was further revised. We used an internet-
based software to send pre-set timed text reminders to the on-call
Evaluation
doctors twice during each call shift; before the start and at the end Quantitative outcomes
of each call shift. A standard template was used for all messages. We evaluated the period from the launch date 17 February 2014 to
This task required the manual entry of mobile numbers of the on- the 31 December 2014 for quantifiable outcomes. This period con-
call doctors working every night into the system. An administrative sisted of four different rotations of junior doctors. We calculated the
team member performed this task at the start of each week, which percentage of unacknowledged handover flags per day as the main
took an estimated 60 minutes per week to complete. outcome measure represented by a statistical control chart (Fig. 2).
4 Alhamid et al.
Table 1 Safety rules for electronic handover and logic underlying rules
Verbal handover for late handovers Promote system safety and work efficiency
All electronic handovers created after 6 pm on weekdays and 1 pm on To prevent dropped handovers due to late creation of handovers.
weekends and public holidays must be accompanied by phone call to On-call doctors do not need to keep checking system for new handovers
on-call doctor. after the cut-off periods.
Verbal handover for selected patients Promote patient safety
All electronic handovers must be accompanied by a verbal call to on- To allow two-way clarification for patients who are more ill and whose
call doctor for: conditions are more complex than others.
(a) Patients requiring reviews at night
(b) Patients who are dangerously-ill (DIL)
All handovers must be acknowledged by 8 am next day Promote system efficiency
To prevent accumulation of handover flags from previous days. The
accumulation of old and new handover flags will inundate system, and
may make work more inefficient for doctors.
Electronic handovers for inpatients located in emergency department Promote system safety
are not allowed To prevent dropped handovers due to change of patient’s location.
Patients awaiting bed allocation may be transferred to any available ward,
at any time. Electronic handovers can be missed, as on-call doctors may
not be aware of patient’s transfer into their ward coverage.
60%
Percentage of unacknowledged flags per day
PDSA 1
PDSA 2
Daily calling
50% Single text message PDSA 3
20%
10%
0%
Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
Figure 2 P chart of percentage of unacknowledged handover flags per day (17th Feb 2014 to 31st December 2014).
Non-compliance rate spread to three other departments who had begun implementing the
The reminder protocols used in PDSA Cycles 1 and 2 did not result system for their patients in July. This increased the number of doc-
in a significant change in compliance, with an average of 6.7% tors who were new to the electronic handover system, causing a
(203/3043) of handovers remaining unacknowledged each day. In higher occurrence of special cause variations. These doctors were
addition, large variations in non-compliance were seen in the initial identified and ad hoc education was given.
months post-implementation, as expected in a new system. In April, PDSA Cycle 4 was launched to address the recurring need of
a changeover of doctors resulted in special cause variation, as the educating new doctors. An online video tutorial was designed and
new doctors were not familiar with the system. These doctors were mandated for new doctors rotating into all departments using the
identified and ad hoc education was provided, and this variation electronic handover system. This further improved the system’s cap-
was eliminated. ability in reducing the average percentage of unacknowledged flags
PDSA Cycle 3, which featured a revised reminder protocol using from 2.2% (106/4925) to 1.4% (74/5114). During this period, two
pre-set timed text reminders, significantly improved the system’s special cause variations were noted. This was attributed to specific-
capability in reducing the average percentage of unacknowledged ally one doctor in October and two doctors in December who were
flags per day from 6.7% (203/3043) to 2.2% (140/6248). However, not compliant with the system. On these occasions, which were rare,
special cause variations were noted on five occasions. These were senior clinicians on the team would step up to reiterate the import-
attributed to new doctors rotating into the division outside the usual ance of compliance to these doctors. There were no critical inci-
rotation cycle, and doctors who were rotating from other institu- dences or adverse patient events reported throughout the study
tions. In addition, the use of this electronic handover system had period.
Interventions to improve efficiency, safety and sustainability • Quality Assessment 5
Clinical utility and sustainable. The reminder protocol that used an internet-based
The use of the electronic handover system remained stable through- software in PDSA Cycle 3 had the most impact in reducing non-
out the study. The overall median percentage of handovers created compliance, as reminders were sent out in a timely and consistent
per medical inpatients per day was 7.3%, increasing to 8.1% after fashion. This intervention also proved to be cost-effective reducing
the 1st of July with three more departments using the system. The the total manpower hours from 210 minutes to 60 minutes required
median number of medical patients in the general wards per day per week. Similarly, in PDSA Cycle 4, the online educational tutorial
before and after 1st July was 427 (range 360 to 526) and 698 (range was a more efficient and sustainable solution compared to educa-
567 to 805) respectively. tional posters and ad hoc education. The use of online media was
especially useful in reaching a wider audience with the regular
changeover of doctors every 3 months, across 11 departments. The
Qualitative outcomes reminder protocol and online educational video interventions are
In our institution, junior doctors switch departments every 3 still in use today. We also learnt that senior endorsement is crucial
months. Hence qualitative measures had to be assessed across the in overcoming logistical and organizational barriers to change.
specific 3-month rotation of doctors in order to draw meaningful Their support provided access to administrative and IT experts
comparisons before and after intervention. We evaluated the cohort who make up the administrative backbone of the complex health-
of doctors rotating during April to June for their knowledge of care system today.
safety rules and perception towards the electronic handover. PDSA The success of the implementation of the electronic handover
Cycle 3, which was our most significant intervention, was initiated tool was in part due to the inherent advantage of embedding elec-
during this period. tronic handover into the existing EMR. This allowed for a highly
A questionnaire was administered at the start and end of the integrated ‘live’ platform, with real-time updates of patient informa-
evaluation period (e-supplement 1). A total of 42 doctors completed tion, obviating the need to duplicate data entry, thereby minimizing
both the pre- and post-intervention questionnaires, representing communication process errors [25]. This also spared clinicians from
62% of the total cohort of doctors during this period. We used having to learn how to use another software, which is always a hur-
Wilcoxon signed ranked test with two-tailed values to analyze the dle when any new system is implemented.
data. The improved documentation of clinical handovers as a result of
Doctors were given a list of statements relating to the safety rules the electronic handover system was a delightful bonus. The ‘who’,
and were asked to select which rules were true. There was a signifi- ‘what’, ‘where’, ‘when’ and ‘how’ of clinical handovers are now
Limitations
Lessons learnt Our study has several limitations. Firstly, we recognize there was no
The importance of engaging medical staff who are the end-users of single quantifiable measure that could accurately reflect all aspects
the electronic handover tool cannot be overstated, as this helps of improvement of the handover tool. We chose to measure the rate
ensure the sustainability of the new system. This echoes previous of non-compliance as an overall surrogate measure of adherence to
studies that have reiterated the absolute need to engage practicing the safety rules, and indirectly, overall buy-in and cultural assimila-
medical staff when implementing and designing electronic handover tion. Secondly, we were not able to assess the knowledge and per-
tools [21–24]. We prioritized safety as a key issue and worked to ception of doctors for every PDSA cycle. This was due to logistical
earn the doctors’ trust in and reliance on the system. and timing difficulties in synchronizing PDSA cycles with the
We learnt to stop protocols that did not work, early in the study, changeover dates of doctors. Thirdly, the response rate of 62%
and to use technology to deliver interventions that were consistent may not be reflective of all doctors present. The completion of the
76%
VERBAL HANDOVER NEEDED AFTER 1PM
94%
79%
NO ELECTRONIC FLAGS FOR A&E 88%
88%
ON-CALL MUST ACKNOWLEDGE ALL FLAGS
97%
Figure 3 Percentage of correct answers to safety rules. A&E, accident and emergency.
6 Alhamid et al.
Figure 4 Comparison of doctors’ perceptions of the electronic handover tool pre- and post-intervention.
questionnaires was voluntary. However, the most significant improve- Singapore General Hospital; Dr Ng Kangqi, MBBS, Internal Medicine
ment was seen in PDSA Cycle 3. This was mirrored by an improve- Residency, Singapore Health Services, Singapore General Hospital; Dr Orlanda
ment in the knowledge of safety rules, and an improvement in Goh Qi Mei, MBBS, Internal Medicine Residency, Singapore Health Services,
Singapore General Hospital; Dr Sii Sik Liong, MBBS, Internal Medicine
doctors’ perception of the electronic handover tool, particularly with
Residency, Singapore Health Services, Singapore General Hospital; Dr Vignesh
regard to patient safety. We can therefore deduce that the sustained
s/o Sivasamy, MBBS, Internal Medicine Residency, Singapore Health Services,
trend of improvement in compliance had translated to a safer and
Singapore General Hospital; Dr Wong Ningyan, MBBS, Internal Medicine
more efficient electronic platform for handover. This trend was fur- Residency, Singapore Health Services, Singapore General Hospital; Dr Mark
ther strengthened in PDSA Cycle 4 achieving the lowest rate of non- Cheah, MBBS, Internal Medicine Residency, Singapore Health Services,
compliance. This suggests that cultural assimilation of the handover Singapore General Hospital; Dr Li Weiquan James, MBBS, Internal
13. Barnes SL, Campbell DA, Stockman KA et al. From theory to practice of 21. Jha AK, DesRoches CM, Campbell EG et al. Use of electronic health
electronic handover. Aust Health Rev 2011;35:384–91. records in US hospitals. N Engl J Med 2009;360:1628–38.
14. Raptis DA, Fernandes C, Chua W et al. Electronic software significantly 22. Showell C, Thomas M, Wong MC et al. Patient safety and sociotechnical
improves quality of handover in a London teaching hospital. Health considerations for electronic handover tools in an Australian ehealth land-
Inform J 2009;15:191–8. scape. Stud Health Technol Inform 2010;157:193–8.
15. Govier M, Medcalf P. Living for the weekend: electronic documentation 23. Clark CJ, Sindell SL, Koehler RP. Template for success: using a resident-
improves patient handover. Clin Med 2012;12:124–7. designed sign-out template in the handover of patient care. J Surg Educ
16. Gonzalo JD, Yang JY, Stuckey HL et al. Patient care transitions from the 2011;68:52–7.
emergency department to the medicine ward: evaluation of a standardized 24. Wong MC, Cummings E, Turner P. User-centered design in clinical hand-
electronic signout tool. Int J Qual Health Care 2014;26:337–47. over: exploring post-implementation outcomes for clinicians. Stud Health
17. Karayiannis P, Warnock J. Improving handover of acute orthopaedic Technol Inform 2013;192:253–7.
admissions. BMJ Qual Improv Rep 2015;4(1). 25. Cheah LP, Arnott DH, Pollard J et al. Electronic medical handovers:
18. Till A, Sall H, Wilkinson J. Safe handover: safe patients—the electronic towards safer medical care. Med J Aust 2005;183:369–72.
handover system. BMJ Qual Improv Rep 2014;2(2). 26. Gandhi TK. Fumbled handoffs: one dropped ball after another. Ann
19. Metz D, Chard D, Rhodes J et al. Continuity of Care for Medical Intern Med 2005;142:352–8.
Inpatients: Standards of Good Practice. London: Royal College of 27. Clarke CM, Persaud DD. Leading clinical handover improvement: a
Physicians, 2004. change strategy to implement best practices in the acute care setting.
20. Royal College of Physicians Guide for Trainees and Trainers: General J Patient Saf 2011;7:11–8.
Professional Training Guide. London: RCP, 2005.