Professional Documents
Culture Documents
Incident reporting has become a widely used method for studying and Wales. Incidents can also be reported directly to the NRLS.
medication errors, mainly because these data are relatively easy to Data in the national system are designed not to retain any pa-
obtain and relatively low cost.20 tient or staff personal identifiable information. If such informa-
tion is submitted in error, the NRLS anonymize the data. The
Quality of Reporting data cleaning process also includes the removal of duplicates
When the quality of incident data in general is discussed, it is reports. Based on the NRLS reporting e-form,34 mandatory
mostly in terms of underreporting,21 which remains a significant fields of reporting are as follows: when (date, time) and where
problem.22 Only a fraction of incidents are reported. It has been (service, location, country, specialty area) an incident occurred,
estimated that self-reporting systems, such as the NRLS, detect description of what happened, whether the patient was actually
only 7% to 15% of all medication incidents,23 but the actual per- harmed and degree of such harm (if the answer was no harm,
centage may be even lower. Underreporting may be either intentional then they were asked to provide an evaluation of potential
or unintentional. Some unintentional reasons are the healthcare pro- harm), and patient characteristics such as age, sex, and ethnic
fessional failing to recognize the error or forgetting or not knowing background. In addition, it is mandatory to report contributing
how to report it. There may also be misunderstanding of incidents factors, as well as details related to the drugs involved such as
that should be reported, such as near misses or omissions of medica- stage of the medication process, type of error, and approved
tions.22 Intentional reasons and barriers to reporting include time drug name. Mandatory staff details are staff type, status, and
pressures and fear of the consequences,20–22,24 poor institutional sup- the role of the reporting staff member in the incident. Although
port or processing of incident reports,21,25 lack of awareness of how these fields are stated as being mandatory, most allow answers
the reported incidents will be analyzed, not knowing how the reports such as “unknown,” “other,” or “not applicable.”
will ultimately lead to changes that improve patient safety,22 lack of
feedback,21,22,26,27 blame culture, inadequate training, and poor coor- Data Source
dination of reporting.24 Incidents that are immediate and witnessed The data comprised MAEs reported to the NRLS as having oc-
are often better reported.22 Underreporting limits detection of rare in- curred between January 1, 2007, and December 31, 2016. We
cidents and presents an epidemiological bias; gaining accurate used only data from the closed questions, which are based on what
estimates of error rates becomes difficult and prone to bias.28 has been reported to the NRLS: incident category (type), degree of
Incident reporting has also received criticism in relation to se- harm, incident location, care setting of occurrence, specialty area
lective and incomplete reporting.29 There may be differences in where the incident occurred, age, and sex of patient and date and
how health professional groups rate incidents,30 and significant time of incident, as well as factors contributing to the incident.
variations in the quality of free-text descriptions in terms of length, These data are mainly captured using drop-down menus during
detail, and potential inaccuracies.31 Reporting of complex multi- entry. Incident severity was designated by reporters as no harm,
faceted events may reduce the incident to a simple descriptor such low harm [patient(s) required extra observation or minor treat-
as “medication error” and the cause into an equally simplistic cat- ment], moderate harm [short term harm – patient(s) required fur-
egory such as “communication failure” or “staffing.”32 Thus, im- ther treatment, or procedure], severe harm [permanent or long-
portant information and understanding will be lost. As the number term harm], or death (caused by the Patient Safety Incident).
of reported incidents continues to increase,33 it is vital to be able to
analyze those effectively, which requires well-documented information. Data Acquisition
The quality of NRLS medication incident data has been A data sharing agreement was signed after applying and receiv-
highlighted, with the Patient Safety Alert “Improving medication ing acceptance from the NRLS for data access. The NRLS ex-
error incident reporting and learning” published in 2014. This tracted the data in December 2017 using the following inclusion
alert calls further improvements to increase the number of incident filters: (a) incidents between January 1, 2007, and December
reports, improve the data quality, and maximize what can be 31, 2016 (based on the date the incident was reported to have oc-
learned from medication errors. A previous study reviewed NRLS curred), (b) medication incident, (c) administration/supply of a
medication error reports for a 6-year period (2005–2010).16 In medicine from a clinical area, and (d) acute NHS trust (either spe-
contrast to this previous analysis, our study will focus specifically cialist or nonspecialist).
on medication administration incidents and a 10-year period of
data to allow for trend analysis of reporting practices, describing
Data Analysis
missing and other invalid data, and thus offering more detailed in-
formation on the changes in data quality for this period. As far as Incidents were enumerated by year (2007–2016), month of oc-
we are aware, this is the first study to focus on a longitudinal anal- currence, time of day, care setting, location, specialty, patients’
ysis of reporting practices of medication administration incidents age, sex, error category, degree of harm, administration route,
for a 10-year period. Our specific objectives are to describe MAEs and contributing factors. Patients’ ethnicity was not analyzed as
reported in England and Wales between 2007 and 2016, to iden- it was reported for only 24.7% of reports. Unreported and indeter-
tify which factors are most strongly related to severity of reported minate information (classified into unknown, other, not stated, not
MAEs (reporting year, type of incident, patients’ age), and to as- applicable) was enumerated for those variables where this was an
sess how much information collected on MAEs is underreported issue (location, hour of occurrence, patients’ sex and age, error cat-
or indeterminate. egory, and administration route).
The severity of incidents was further disaggregated by
reporting year, error category, and patients’ age to explore whether
METHOD the severity of reported incidents has changed for the period con-
cerned and whether the severity of incidents varies in different er-
Design and Setting ror categories or patient age groups. The incident report severity
This is a retrospective trend analysis of anonymous self- classifications were used in their original form when the data were
reported MAEs. described but, because of small numbers in certain categories,
The NRLS collects reports of patient safety incidents from were reclassified into three groups, for cross-tabulation purposes:
NHS organizations and other healthcare providers in England (a) no harm, (b) low and moderate harm, and (c) severe harm and
© 2020 Wolters Kluwer Health, Inc. All rights reserved. www.journalpatientsafety.com e851
death. For similar reasons, patients’ age bands used within the Medication administration errors were mostly attributed to
NRLS were amalgamated into the following six groups: (a) youn- omitted medicines or ingredients (25.8%, n = 133,397), wrong
ger than 12 years, (b) 12 to 17 years, (c) 18 to 25 years, (d) 26 to frequency (9.9%, n = 51,003), or wrong/unclear dose or strength
55 years, (e) 56 to 75 years, and (f) older than 75 years. (9.0%, n = 46,389). Most MAEs caused “no harm” (83.5%,
Descriptive statistical analysis was conducted using IBM SPSS n = 432,097). The administration route was not reported for
Version 23.0. Characteristics of the data were described using fre- 73.0% of incidents, but of those for which this was reported, intra-
quencies and percentages, and relationships among factors were venous (9.1%, n = 46,837) and oral (9.0%, n = 46,728) adminis-
explored via cross-tabulation. tration was most common. Most incident reports (92.3%/
n = 477,728) included no description of perceived contributing
Ethics factors (online only supplementary material, http://links.lww.
The research ethics office of King’s College London gave an com/JPS/A250). Of the 39,656 incidents that did include con-
ethical approval for this study (LRS-17/18-5150) in October tributing factors, the most common were “medication factors”
2017. The data did not include any personal or organizational (33.6%, n = 13,306) and “task factors” (13.0%, n = 5,136) (Table 1).
identifiers; thus, anonymity of the reporters, patients, other in-
volved persons, and organizations could be guaranteed. Factors Related to Severity of Incidents
For the 10-year period, the percentage of MAEs reported as
RESULTS resulting in “no harm” increased (2007: 74.1% to 2016: 86.3%).
At the same time, percentage of incident with “low and moderate
Demographics harm” (2007: 25.2% to 2016: 13.6%) and “severe harm and
death” (2007: 0.7% to 2016: 0.1%) decreased. When severity of
During 2007 to 2016, there were a total of 517,384 MAEs re-
each error type was compared, the most common incident types
ported as occurring. The number of incidents increased every
associated with “no harm” or “low and moderate harm” were
year. In 2007, there were 29,455 and in 2016 72,390 MAEs re-
omitted medicine/ingredient, wrong frequency, or wrong or un-
ported (Fig. 1). Fewer incidents were reported as occurring in
clear dose or strength. For “severe harm and death,” omitted
February (7.6%, n = 39,517) and most in October (9.0%,
medicine/ingredient (24.1%) was mentioned most often, followed
n = 46,601) (Fig. 2). Most MAEs were reported to have occurred
by wrong/unclear dose or strength (13.4%), or wrong drug/
between 10:00 A.M. to 1:00 P.M. (16.0%, n = 82,997), 7:00 to
medicine (9.0%). A higher percentage of people with reports of
10:00 A.M. (14.4%) or 4:00 to 7:00 P.M. (14.4%), and fewer be-
“severe harm and death” were 56 years or older (51.8%) than
tween 4:00 and 7:00 A.M. (3.6%). Most MAEs occurred in acute
for “low and moderate harm” (46.9%) or “no harm” (42.3%).
or general hospitals (97.1%, n = 502,379), on wards (69.1%,
Conversely, a lower percentage of people with reports of “severe
n = 357,463), in intensive care unit/high dependency units (8%,
harm and death” were younger than 12 years (7.4%) than for
n = 41,149), or in operating theaters (2.3%, n = 11,867). The most
“low and moderate harm” (9.8%) or “no harm” (10.7%) (Table 2.)
common specialty areas were medical (44.5%, n = 230,205) and
surgical (20.0%, n = 103,686) (online only supplementary
material, http://links.lww.com/JPS/A250). Unreported and Indeterminate Information in
The mean reported patient age was 53.9 years and more than Incident Reports
40% were aged 75 years or older (43.1% n = 222,775). Children When the proportion of missing and indeterminate information
aged 12 to 17 (2.2%) and young adults aged 18 to 25 years (classified as “unknown”/“other”/“not stated”/“not applicable”
(3.0%) had fewest reports. A total of 182,451 patients were re- factors) in incident reports was studied, valid information de-
ported as being female (35.3%), 156,419 (30.2%) as males, and creased for the 10-year period for some factors. For example, in-
78 as sex indeterminate, and sex was not reported in 178,436 formation on “location of incident” decreased each year (2007:
(34.5%) (online only supplementary material, http://links.lww. 89.9% to 2016: 79.6%). In contrast, completeness increased for
com/JPS/A250). other factors, such as for “patient age,” which increased each year
FIGURE 1. Number of reported medication administration incidents per year between 2007 and 2016 (n = 517,384 in total).
e852 www.journalpatientsafety.com © 2020 Wolters Kluwer Health, Inc. All rights reserved.
FIGURE 2. Number of reported medication administration incidents/total per month between 2007 and 2016 (n = 517,384 in total).
(2007: 65.6% to 2016: 80.8%). However, for 122 patients, ages culture spreads more widely.33 An increase in the number of inci-
were recorded as being between 110 and 120 years, suggesting a dents reported should not be taken as a marker of deterioration in
data entry error (e.g., an extra zero). The completeness of patient safety but rather an indication of rising levels of safety
reporting increased for some factors: for example, reporting “ad- awareness among healthcare professionals. However, the increase
ministration route of drug” increased between 2007 (15.2%) and in medication incidents may also be partly linked also to increased
2015 (30.4%). For other factors, such as in “patient sex” or “med- use of drugs.16 In addition, the number of total reported incidents
ication error category,” completeness of reporting fluctuated over (not only medication related) has increased over the years. Inci-
time (Table 3.) dents have been reported to the NRLS since October 2003, with
all NHS organizations being able to access the system from
DISCUSSION 2005. There were 153 incidents reported from October to
This study focused specifically on a retrospective trend analysis December 2003 and 135,356 in October to December 2005; in
of anonymous self-reported MAEs for a 10-year period using the contrast, 508,409 incidents were reported from October to
NRLS national level data for England and Wales. We analyzed December 2017.35
more than 500,000 MAEs and found that the number of reported
MAEs increased year on year. Cousins et al16 found that the in- Findings Related to Severity of Incidents
creasing number of medication reports each year is significantly Most MAEs did not cause harm to patients either in this study
higher than increases in the total number of patient safety inci- or an earlier study of medication errors in the NRLS.15 Over the
dents reported to the NRLS. Many possible reasons for this exist. years, the number of “no harm” incidents has increased
First, staff are being encouraged to increase their reporting to pro- (2007–2016: 21,817 to 62,461) in this data set and “severe harm
mote a more open culture in healthcare services. It is anticipated and death” incidents decreased (2007–2016: 202 to 74). This is
that the volume of reporting will continue to increase as this an interesting finding because from 2010, it became mandatory
TABLE 1. Prespecified Standard Categories Reported as Contributing to Medication Administration Incidents Where This
Information Was Given in the Report
% of Reported
Contributing Factors No. Factors
Medication factors (where one or more drugs directly contributed to the incident) 13,306 33.6
Task factors (includes work guidelines/procedures/policies, availability of decision making aids) 5136 13.0
Unknown 4175 10.5
Education and training (e.g., availability of training) 3987 10.0
Communication (includes verbal, written and nonverbal between individuals, teams, and/or organizations) 3855 9.7
Work and environment (e.g., poor/excess administration, physical environment, work load and hours of work, 3037 7.7
time pressures)
Other 1839 4.6
Team and social factors (includes role definitions, leadership, support, and cultural factors) 1693 4.3
Patient factors (e.g., clinical condition, social/physical/psychological factors, relationships) 1651 4.2
Organization and strategic (e.g., organizational structure, contractor/agency use, culture) 800 2.0
Equipment and resources (e.g., clear machine displays, poor working order, size, placement, ease of use) 177 0.4
Total of reported contributing factors 39,656 100
© 2020 Wolters Kluwer Health, Inc. All rights reserved. www.journalpatientsafety.com e853
for the NHS trusts in England to report all serious patient safety of harm.” This should relate to the actual harm resulting directly
incidents to the Care Quality Commission. To avoid duplication from the incident itself rather than perceived potential harm. For
of reporting, all incidents resulting in death or severe harm should example, sometimes, the degree of harm is coded as “severe
therefore be reported to the NRLS, which are then passed onto the harm” in near-miss cases, where no harm resulted because the im-
Care Quality Commission.36 Despite this mandatory requirement, pact of the incident was prevented.37
there has been a clear decrease in the percentage of serious reports.
Most incidents occurred among patients aged 56 years or older.
More than 50% of “serious harm” incidents occurred in this age Findings Related to Data Quality
group. Howell et al7 also found that patients most vulnerable to re- We found many issues related to the quality of the data. Some
ported harm were elderly medical inpatients. of the fields had comparatively high levels of missing or indeter-
It should be noted that the reported severity is only indicative minate information; in one-third of the incidents, patients’ sex
evaluation. Possible inconsistencies in severity ratings may be was not reported, administration route was not reported in 73%,
caused by a lack of understanding of how to report the “degree and contributing factors were not reported for 93%. Similarly,
e854 www.journalpatientsafety.com © 2020 Wolters Kluwer Health, Inc. All rights reserved.
2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 Average
Location
Missing information 9.5 10.2 10.3 11.1 13.4 15.1 16.8 17.4 17.7 19.4 15.0
Other 0.7 0.6 0.9 0.9 0.8 1.0 1.0 0.9 1.0 1.0 0.9
Valid information ↓ 89.9 89.2↓ 88.8↓ 88.0↓ 85.8↓ 83.9↓ 82.2↓ 81.7↓ 81.3↓ 79.6↓ 83.2
Total
Hour of occurrences
Missing information 21.0 20.3 18.4 15.1 13.6 11.5 11.2 10.7 11.6 11.5 13.5
Valid information ↕ 79.0 79.7↑ 81.6↑ 84.9↑ 86.4↑ 88.5↑ 88.8↑ 89.3↑ 88.4↓ 88.5↓ 86.5
Total 100 100 100 100 100 100 100 100 100 100 100
Patient sex
Missing information 26.0 23.8 17.0 13.5 11.6 9.2 6.6 6.0 6.1 6.6 10.8
Not stated/unknown 9.5 11.6 16.3 21.7 24.2 27.4 25.8 26.4 27.7 29.0 23.7
Valid information ↕ 64.5 64.6↑ 66.7↑ 64.8↓ 64.2↓ 63.4↓ 67.6↑ 67.6↑ 66.2↓ 64.4↓ 65.5
Total 100 100 100 100 100 100 100 100 100 100 100
Patient age
Missing information 34.4 33.6 28.6 27.8 27.4 25.8 22.8 21.1 20.8 19.2 24.8
Valid information ↑ 65.6↑ 66.4↑ 71.4↑ 72.2↑ 72.6↑ 74.2↑ 77.2↑ 78.9↑ 79.2↑ 80.8↑ 75.2
Total
Medication error category
Other 18.8 21.8 20.8 20.5 21.4 21.9 20.7 19.3 17.7 17.3 19.8
Unknown 1.2 1.0 0.9 0.9 0.9 1.2 1.5 1.5 1.7 1.6 1.3
Valid information ↕ 80.0 77.2↓ 78.3↑ 78.6↑ 77.7↓ 76.9↓ 77.8↑ 79.2↑ 80.6↑ 81.1↑ 78.9
Total 100 100 100 100 100 100 100 100 100 100 100
Administration route of drug
Missing information 81.4 80.6 79.7 77.3 75.2 73.7 69.1 67.6 67.0 71.5 73.0
Not applicable 0.8 0.6 0.6 0.6 1.9 1.8 2.0 0.9 0.9 1.0 1.1
Other 0.5 0.4 0.5 0.5 0.6 0.7 0.9 0.8 0.8 0.9 0.7
Unknown 2.1 1.7 1.4 1.5 1.4 1.3 1.1 1.1 0.9 0.1 1.2
Valid information ↕ 15.2 16.7↑ 17.8↑ 20.1↑ 20.9↑ 22.5↑ 26.9↑ 29.6↑ 30.4↑ 26.5↓ 24.0
Total 100 100 100 100 100 100 100 100 100 100 100
↓ = decreasing, ↑ = increasing, ↕ = variation between decreasing and increasing.
Panesar et al6 found that sex was completed for approximately the findings. In addition, a lack of a true denominator limits what
70% of entries, age for 66%, and ethnicity for only 20%. For some can be inferred from epidemiological analysis, but it is important
variables, improvement in completeness of reporting could be to remember that the purpose of the NRLS is to enable learning
seen over time (e.g., age). For other variables, the volume of inde- and not carry out epidemiological analysis. Studies that reveal
terminate information increased each year, for example, “location the potential usefulness of incident data may help increase the fre-
of incidents.” Although most of the fields are stated as being man- quency and quality of reporting.28 Some of the NRLS questions
datory, it was common to use categories, such as other, unknown, may require further development to help minimize the amount
or not applicable. of unknown and invalid data, for example, incident type where
Low data quality and underreporting jeopardize the aims of in- one-fifth of incidents are coded to “other.”
cident reporting. Thus, individuals should therefore be encour-
aged to report incidents as accurately and completely as
possible.38 The reasons for reporting invalid information requires
further investigation. In some cases, this could be due to lack of Strengths and Weaknesses
available details, lack of time, or a willingness to prioritize. Time We studied the characteristics of MAEs for a 10-year period be-
pressure is one particular issue and choosing “other” or “un- tween 2007 and 2016 including more than 500,000 incident re-
known” is likely to speed up data entry and allow the person to re- ports. The unique strengths of the NRLS are its size, duration,
turn to more immediate activities. First and foremost, awareness of and the inclusion of reports of no and low levels of harm as well
the problem should be raised, because missing and indeterminate as adverse outcomes.39 This kind of national level incident analy-
information affect the reliability of the findings. In particular, sis can be valuable and has the advantage of highlighting the areas
Panesar et al6 state that it should not be assumed that missing or for improvement that can be disseminated widely for raising
other invalid data are evenly distributed, which has analysis impli- awareness, research, audits, training initiatives, curriculum, spe-
cations. Analysis is straightforward if data are missing randomly cific guidelines, and generating a culture of safety.22,40 Reporting
but becomes more taxing if they are not. It is important for re- systems overall can provide warnings, point to important prob-
searchers in this field to assess missing data and report this in lems, and provide some understanding of causes.
© 2020 Wolters Kluwer Health, Inc. All rights reserved. www.journalpatientsafety.com e855
The current study has some limitations, primarily around 9. Antinaho T, Kivinen T, Turunen H, et al. Nurses’ working time use - how
underreporting and the quality of the data although this seems to value adding it is? J Nurs Manag. 2015;23:1094–1105.
be improving overall. Some data entry errors relate to data collec- 10. Drach-Zahavy A, Somech A, Admi H, et al. (how) do we learn from errors?
tion and others to classifying. Reported severity may not relate A prospective study of the link between the ward’s learning practices
precisely to actual severity. Typically, this will be a subjective as- and medication administration errors. Int J Nurs Stud. 2014;51:
sessment and is sometimes mistaken for potential rather than ac- 448–457.
tual degree of harm. In addition, reports will include incidents 11. McLeod MC, Barber N, Franklin BD. Methodological variations and their
where the impact on the patient is not yet known. It is now man- effects on reported medication administration error rates. BMJ Qual Saf.
datory to report serious incidents in England and Wales to Strate- 2013;22:278–289.
gic Executive Information System, but not the less harmful
incidents, which rely on voluntary self-reporting. Therefore, less 12. Raban MZ, Westbrook JI. Are interventions to reduce interruptions and
errors during medication administration effective?: a systematic review.
harmful incidents may be more prone to underrepresentation,
BMJ Qual Saf. 2014;23:414–421.
which poses problems for analysis, interpretation and generaliz-
ability. On a smaller scale, the data may contain duplicates and 13. Keers RN, Williams SD, Cooke J. Causes of medication administration
some minor coding or data entry errors (e.g., age). The way the errors in hospitals: a systematic review of quantitative and qualitative
data are collected anonymously means that it is not possible to ver- evidence. Drug Saf. 2013;36:1045–1067.
ify or clarify incident details afterward.6 14. Härkänen M, Ahonen J, Kervinen M, et al. The factors associated with
medication errors in adult medical and surgical inpatients: a direct
CONCLUSIONS observation approach with medication record reviews. Scand J Caring Sci.
2015;29:297–306.
Based on the findings for the 10-year period (2007–2016), ab-
solute numbers of “no harm” incidents continued to increase an- 15. NPSA. 2007. Safety in doses: medication safety incidents in the NHS 2007.
nually. The total number of reported serious harm incidents has Available at: http://www.nrls.npsa.nhs.uk/EasySiteWeb/getresource.axd?
declined and fallen less than 100. However, it is important not to AssetID=61392. Accessed June 11, 2018.
lose sight of incidents categorized as “no harm” and “mild harm,” 16. Cousins DH, Gerrett D, Warner B. A review of medication incidents
which could be precursors or indicators of potential “serious reported to the National Reporting and Learning System in England and
harm.” The quality of reports should be improved, because Wales over 6 years (2005-2010). Br J Clin Pharmacol. 2012;74:597–604.
underreporting and indeterminate data, inaccuracies in reporting
17. WHO. Medication errors. Technical series on safer primary care. Available
and coding jeopardize the overall usefulness of the data. Further
at: http://apps.who.int/iris/bitstream/handle/10665/252274/
studies should clarify the reasons for indeterminate reporting 9789241511643-eng.pdf;jsessionid=
and missing data. As most serious medication administration inci- 2C5F14D40CBFE11B2D4CC3A0B130396C?sequence=1. Accessed
dents occurred in elderly patients, additional studies and interven- June 12, 2018.
tions should focus on safe administration of drugs to these patients.
18. NCCMERP. The National Coordinating Council for medication error
reporting and prevention. Medication errors – definition. Available at:
ACKNOWLEDGMENT http://www.nccmerp.org/about-medication-errors. Accessed June 12,
The authors thank the NHS Improvement Patient safety team 2018.
for helping the authors through the data acquisition process and
refining the data extraction. 19. Parry AM, Barriball KL, While AE. Factors contributing to registered nurse
medication administration error: a narrative review. Int J Nurs Stud. 2015;
52:403–420.
REFERENCES
20. Meyer-Massetti C, Cheng CM, Schwappach DL, et al. Systematic review
1. WHO. Medication without harm: WHO’s third global patient safety
of medication safety assessment methods. Am J Health Syst Pharm. 2011;
challenge. Available at: http://www.who.int/patientsafety/medication-
68:227–240.
safety/en/. Accessed June 10, 2018.
21. Noble DJ, Pronovost PJ. Underreporting of patient safety incidents reduces
2. Kohn LT, Corrigan JM, Donaldson MS, eds. To Err Is Human: Building a
health care’s ability to quantify and accurately measure harm reduction.
Safer Health System. Institute of Medicine (US) Committee on Quality of
J Patient Saf. 2010;6:247–250.
Health Care in America. Washington, DC: National Academies Press (US); 2000.
3. Leape LL. Reporting of adverse events. N Engl J Med. 2002;347:1633–1638. 22. Mahajan RP. Critical incident reporting and learning. Br J Anaesth. 2010;
105:69–75.
4. Savage SW, Schneider PJ, Pedersen CA. Utility of an online medication-
error-reporting system. Am J Health Syst Pharm. 2005;62:2265–2270. 23. Elliott RA, Camacho E, Campbell F, et al. Prevalence and economic burden
of medication errors in the NHS in England. Rapid evidence synthesis and
5. NRLS. NaPSIR quarterly data workbook up to June 2017. Data on patient
economic analysis of the prevalence and burden of medication error in the
safety incidents reported to the NRLS up to June 2017. Available at: https://
UK. Policy Research Unit in Economic Evaluation of Health & Care
improvement.nhs.uk/resources/national-patient-safety-incident-reports-
Interventions (EEPRU). 2018. Available at: http://www.eepru.org.uk/wp-
september-2017/. Accessed August 3, 2018.
content/uploads/2018/02/eepru-report-medication-error-feb-2018.pdf.
6. Panesar SS, Warner B, Sheikh A. Incident reporting and feedback Accessed June 14, 2018.
approaches. In: Tully MP, Franklin BD, eds. Safety in Medication Use.
Boca Raton, FL: CRC Press; 2016:157–170. 24. Holmström AR, Airaksinen M, Weiss M, et al. National and local
medication error reporting systems: a survey of practices in 16 countries.
7. Howell AM, Burns EM, Bouras G, et al. Can patient safety incident reports J Patient Saf. 2012;8:165–176.
be used to compare hospital safety? Results from a quantitative analysis of
the English National Reporting and Learning System Data. PLoS One. 25. Mitchell I, Schuster A, Smith K, et al. Patient safety incident reporting: a
2015;10:e0144107. qualitative study of thoughts and perceptions of experts 15 years after ‘to
err is human’. BMJ Qual Saf. 2016;25:92–99.
8. Westbrook JI, Duffield C, Li L, et al. How much time do nurses have for
patients? A longitudinal study quantifying hospital nurses’ patterns of task 26. Stavropoulou C, Doherty C, Tosey P. How effective are incident-reporting
time distribution and interactions with health professionals. BMC Health systems for improving patient safety? A systematic literature review.
Serv Res. 2011;11:319. Milbank Q. 2015;93:826–866.
e856 www.journalpatientsafety.com © 2020 Wolters Kluwer Health, Inc. All rights reserved.
27. Hartnell N, MacKinnon N, Sketris I, et al. Identifying, understanding and 34. NRLS reporting e-form. Available at: https://www.eforms.nrls.nhs.uk/
overcoming barriers to medication error reporting in hospitals: a focus staffreport/incident_report.jsp. Accessed June 12, 2018.
group study. BMJ Qual Saf. 2012;21:361–368. 35. NRLS national patient safety incident reports: commentary March 2018.
28. Panesar SS, Noble DJ, Mirza SB, et al. Can the surgical checklist reduce the Available at: https://improvement.nhs.uk/documents/2543/NAPSIR_
risk of wrong site surgery in orthopaedics?—can the checklist help? commentary_FINAL_data_to_December_2017.pdf. Accessed
Supporting evidence from analysis of a national patient incident reporting May 28, 2019.
system. J Orthop Surg Res. 2011;6:18. 36. NRLS. 2018b. About reporting patient safety incidents. Available at: http://
29. Donaldson LJ, Panesar SS, Darzi A. Patient-safety-related hospital deaths www.nrls.nhs.uk/report-a-patient-safety-incident/about-reporting-patient-
in England: thematic analysis of incidents reported to a National Database, safety-incidents/. Accessed June 12, 2018.
2010–2012. PLoS Med. 2014;11:e1001667. 37. NHS Improvement. Guidance notes on National Reporting and Learning
30. Williams SD, Ashcroft DM. Medication errors: how reliable are the severity System quarterly data summary publications. 22 March 2017. Available at:
ratings reported to the national reporting and learning system? Int J Qual https://improvement.nhs.uk/documents/834/QDS_GUIDE_TO_MAR17.
Health Care. 2009;21:316–320. pdf. Accessed May 28, 2019.
38. NHS England. Patient safety alert. Improving medication error incident
31. Sevdalis N, Jacklin R, Arora S, et al. Diagnostic error in a national incident
reporting and learning. 20 March 2014. Available at: https://www.england.
reporting system in the UK. J Eval Clin Pract. 2010;16:1276–1281.
nhs.uk/wp-content/uploads/2014/03/psa-sup-info-med-error.pdf. Accessed
32. Renshaw M, Vaughan C, Ottewill M, et al. Clinical incident reporting: June 7, 2018.
wrong time, wrong place. Int J Health Care Qual Assur. 2008;21:380–384.
39. Franklin BD, Panesar SS, Vincent C, et al. Identifying systems failures in
33. NHS Improvement. National patient safety incident reports: 2017. the pathway to a catastrophic event: an analysis of national incident report
Available at: https://improvement.nhs.uk/resources/national-patient-safety- data relating to vinca alkaloids. BMJ Qual Saf. 2014;23:765–772.
incident-reports-september-2017. Accessed June 12, 2018. 40. Vincent C. Incident reporting and patient safety. BMJ. 2007;334:51.
© 2020 Wolters Kluwer Health, Inc. All rights reserved. www.journalpatientsafety.com e857