Professional Documents
Culture Documents
Critical Appraisal Tools and ReportingGuidelines For Evidence-Based Practice
Critical Appraisal Tools and ReportingGuidelines For Evidence-Based Practice
ABSTRACT
Keywords Background: Nurses engaged in evidence-based practice (EBP) have two important sets of tools:
critical appraisal Critical appraisal tools and reporting guidelines. Critical appraisal tools facilitate the appraisal
tools, process and guide a consumer of evidence through an objective, analytical, evaluation process.
evidence-based Reporting guidelines, checklists of items that should be included in a publication or report, ensure
nursing, that the project or guidelines are reported on with clarity, completeness, and transparency.
evidence-based Purpose: The primary purpose of this paper is to help nurses understand the difference between
practice, critical appraisal tools and reporting guidelines. A secondary purpose is to help nurses locate the
reporting guidelines appropriate tool for the appraisal or reporting of evidence.
Methods: A systematic search was conducted to find commonly used critical appraisal tools and
reporting guidelines for EBP in nursing.
Rationale: This article serves as a resource to help nurse navigate the often-overwhelming terrain
of critical appraisal tools and reporting guidelines, and will help both novice and experienced
consumers of evidence more easily select the appropriate tool(s) to use for critical appraisal and
reporting of evidence. Having the skills to select the appropriate tool or guideline is an essential
part of meeting EBP competencies for both practicing registered nurses and advanced practice
nurses (Melnyk & Gallagher-Ford, 2015; Melnyk, Gallagher-Ford, & Fineout-Overholt, 2017).
Results: Nine commonly used critical appraisal tools and eight reporting guidelines were found
and are described in this manuscript. Specific steps for selecting an appropriate tool as well as
examples of each tool’s use in a publication are provided.
Linking Evidence to Action: Practicing registered nurses and advance practice nurses must be
able to critically appraise and disseminate evidence in order to meet EBP competencies. This
article is a resource for understanding the difference between critical appraisal tools and reporting
guidelines, and identifying and accessing appropriate tools or guidelines.
rigorous, reliable, unbiased, and methodologically appropriate ference attendance, reviewing EBP textbooks, and networking
research (Melnyk & Fineout-Overholt, 2015). with other EBP nurse educators. Next, both authors collabo-
Critical appraisal tools allow nurses to evaluate the evidence rated on a comprehensive search to validate the list and to iden-
using structured questions and/or a checklist. However, they tify other commonly used critical appraisal tools and reporting
are not a one-size-fits-all resource and nurses often turn to a guidelines. PubMed, CINAHL and Scopus were searched us-
familiar critical appraisal tool, regardless of whether or not it ing a combination of keywords and subject headings for the
is the most appropriate tool for the methodology of the article following concepts: Critical appraisal, critique tool, and report-
they are reviewing. Compounding the problem is the lack of ing guidelines.
a “gold standard” critical appraisal tool and the sheer volume Nine critical appraisal tools and eight reporting guidelines
of available tools. This can make matching the tool to the type were selected based on their relevancy to nursing, their ease
of evidence problematic, particularly for novice consumers of of use, and their reported frequency of use. The literature dis-
evidence (Katrak, Bialocerkowski, Massy-Westropp, Kumar, & cussing the development and use of each selected tool and
Grimmer, 2004). guideline was reviewed. A brief synopsis of each tool was de-
Having the skills to select the appropriate tool or guideline veloped, along with tables to help select the appropriate tool
is an essential part of meeting EBP competencies for both prac- or guideline, information about how to access the full text of
ticing registered nurses and advanced practice nurses (Melnyk the tool or guideline, and an example of the tool or guideline
& Gallagher-Ford, 2015; Melnyk, Gallagher-Ford, & Fineout- in a publication. Where one tool serves both functions—a tool
Overholt, 2017). Additionaly, critical appraisal is an EBP com- that was developed to be a critical appraisal tool and a report-
petency for both of these groups of practicing nurses. (Melnyk, ing guideline; we have noted it and included the tool in both
Gallagher-Ford, Long, & Fineout-Overholt, 2014). In order to categories.
educate nurses to evaluate a body of literature and translate
research into practice, academic institutions must lay the foun- CRITICAL APPRAISAL TOOLS
dation by teaching students to critically appraise research and The following steps provide a roadmap for selecting an appro-
other types of evidence using the most appropriate tools. priate critical appraisal tool:
Johns
Johns Hopkins
Hopkins Non- Rapid
CASP Research Research Critical
checklist JBI Evidence Evidence Appraisal
(Critical Cochrane checklists Appraisal Appraisal Checklists
a
AGREE II Appraisal Risk of EPQA (Joanna Tool Tool (Melnyk &
Name of rating scale (Brouwers Skills Pro- Bias Tool Guidelines GRADE Briggs (Dearholt (Dearholt Fineout-
or checklist/type et al., gramme, (Higgins et (Lee et al., (Dijkers, Institute, & Dang, & Dang, Overholt,
of evidence 2010) 2017) al., 2011) 2013) 2013) 2016) 2012) 2012) 2015)
Note. Directions: (a) Locate the type of evidence you would like to evaluate in the left column and read across the rows to identity an appropriate critical appraisal
tool. (b) For information on accessing the full text of a tool and to see an example of its use, see Table 2.
a
Developed to be both a critical appraisal tool and reporting guideline.
in 2010 (Brouwers et al., 2010). The AGREE II can be used Appraisal Skills Programme, 2017). The checklists all have
as a quality assessment tool for readers of clinical guidelines. between 10 and 12 yes or no items with some open-ended
The checklist covers six quality domains and each domain has questions. These checklists were developed for use in educa-
between two and six questions. The Agree II can be found at tional workshops and may be challenging for novices working
https://www.agreetrust.org/resource-centre/. independently. The various CASP checklists can be found at
https://www.casp-uk.net/#!casp-tools-checklists/c18f8.
Critical Appraisal Skills Programme Checklists
Critical Appraisal Skills Programme (CASP) checklists were Cochrane Risk of Bias Tool
developed in 1993 and are a product of the CASP from Oxford, This tool was developed to assess the risk of bias in each study
England. CASP checklists are critical appraisal tools, and CASP reported in a Cochrane Systematic Review. Bias occurs when,
offers checklists for the following eight types of research: sys- because of methodological flaws, authors overestimate or
tematic reviews, randomized controlled trials, diagnostic stud- underestimate the effect of interventions. Bias can affect the
ies, economic evaluations, qualitative research, case control validity of study findings. In clinical trials, common types of
studies, cohort studies, and clinical prediction rules (Critical bias include selection bias, performance bias, detection bias,
attrition bias, and reporting bias (Higgins, Altman, & Sterne, Bias Tool is published in chapter 8 of the Cochrane Handbook
2011). Unlike many of the other tools described in this paper, for Systematic Reviews of Interventions and can be found at
the Cochrane Risk of Bias Tool supports just one column in https://handbook.cochrane.org/chapter_8/table_8_5_a_the_
an evidence table—the risk of bias column. The Cochrane cochrane_collaborations_tool_for_assessing.htm.
Risk of Bias Tool includes seven items, and each item has
a “Support for Judgment” field that provides background Evidence-Based Process Quality Assessment
information on how to evaluate that item, and a “Review Guidelines
Authors’ Judgment” field that includes examples of language Evidence-Based Process Quality Assessment (EPQA) Guide-
that can be included in an evidence table. The Cochrane Risk of lines were created in 2013 in response to both the
CONSORT
AGREE checklist
a
Reporting and flow EPQA PRISMA SQUIRE 2.0 STROBE
Name of reporting Checklist diagram COREQ Guidelines ENTREQ Guidelines Guidelines (Vanden-
guideline/type of (Brouwers (Turner (Tong et al., (Lee et al., (Tong et al., (Moher et (Ogrinc broucke
evidence et al., 2016) et al., 2012) 2007) 2013) 2012) al., 2009) et al., 2016) et al., 2007)
Meta-analysis X
Systematic review X
Randomized X X
controlled trial
Cohort study X
Case-control study X
Cross-sectional study X
Meta-synthesis X
Qualitative study X
Evidence-based X
practice project
Quality improvement X
project
Clinical practice X
guideline
Note. Directions: Locate the type of evidence you are disseminating in the left column and read across the rows to identify an appropriate reporting guideline.
a
Developed to be both a critical appraisal tool and reporting guideline.
and reasons for inclusion and exclusion. The checklist can be both in the planning and reporting of their EBP project.
found at https://www.consort-statement.org/. More information about EPQA Guidelines can be found at
https://www.ncbi.nlm.nih.gov/pubmed/23387900.
COnsolidated Criteria for REporting Qualitative
Research ENhancing Transparency in REporting the
The COnsolidated Criteria for REporting Qualitative (COREQ) Synthesis of Qualitative Research
is a checklist developed as a reporting guideline for the explicit ENhancing Transparency in REporting the Synthesis of Qual-
and comprehensive reporting of qualitative studies that use in- itative Research (ENTREQ) reporting guideline was created
depth interviews and focus groups (Tong, Sainsbury, & Craig, in 2012 (Tong, Flemming, McInnes, Oliver, & Craig, 2012).
2007). The 32-item checklist covers three domains: Research ENTREQ provides a reporting guideline for meta-synthesis
team and reflexivity, study design, and analysis and findings. articles—articles that synthesize qualitative research. The EN-
The checklist was developed from a comprehensive search for TREQ reporting guideline consists of 21 items that are grouped
existing guidelines to assess qualitative research reports. The into five distinct domains: introduction, methods and method-
authors reported finding no comprehensive reporting checklist ology, literature search and selection, appraisal, and synthe-
for qualitative research so items retrieved were compiled into sis of findings. ENTREQ reporting guideline can be found
the COREQ. More information on the checklist can be found at at https://bmcmedresmethodol.biomedcentral.com/articles/
https://www.equator-network.org/reporting-guidelines/coreq. 10.1186/1471-2288-12-181.
experimental evidence. Sleep Medicine Reviews, 28, 82–91. tology, Arthroscopy, 15(11), 1301–1314. https://doi.org/10.1007/
https://doi.org/10.1016/j.smrv.2015.06.002 s00167-007-0390-0
Moher, D., Altman, D. G., Schulz, K. F., Simera, I., & Wager, E. SQUIRE. (2017). SQUIRE 2.0 guidelines. Retrieved from https://
(2014). Guidelines for reporting health research: A user’s manual. www.squire-statement.org/index.cfm?fuseaction=Page.
Chichester, UK: Wiley. ViewPage&PageID=471
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G. & The PRISMA Tong, A., Flemming, K., McInnes, E., Oliver, S., & Craig, J. (2012).
Group. (2009). Preferred reporting items for systematic reviews Enhancing transparency in reporting the synthesis of qualitative
and meta-analyses: The PRISMA statement. PLoS Med, 6(7), research: ENTREQ. BMC Medical Research Methodology, 12(181),
e1000097. https://doi.org/10.1371/journal.pmed.1000097 e1–e8. https://doi.org/10.1186/1471-2288-12-181
National Library of Medicine. (2015). Research reporting Tong, A., Sainsbury, P., & Craig, G. (2007). Consolidated criteria
guidelines and initiatives: By organization. Retrieved from for reporting qualitative research (COREQ): A 32-item checklist
https://www.nlm.nih.gov/services/research_report_guide.html for interviews and focus groups. International Journal for Quality
O’Brien, K., Bracht, M., Robson, K., Ye, X. Y., Mirea, L., Cruz, in Health Care, 19(6), 349–357.
M., . . . Lee, S. K. (2015). Evaluation of the family integrated Tremblay, M. S., LeBlanc, A. G., Janssen, I., Kho, M. E.,
care model of neonatal intensive care: A cluster randomized Hicks, A., Murumets, K., . . . Duggan, M. (2011). Cana-
controlled trial in canada and australia. BMC Pediatrics, 15, e1– dian sedentary behaviour guidelines for children and youth.
e9. https://doi.org/10.1186/s12887-015-0527-0 Applied Physiology, Nutrition and Metabolism, 36(1), 59–64.
Ogrinc, G., Davies, L., Goodman, D., Batalden, P., Davidoff, F., https://doi.org/10.1139/H11-012
Stevens, D. (2016). SQUIRE 2.0 (Standards for QUality Im- Turner, L., Shamseer, L., Altman, D. G., Weeks, L., Peters, J.,
provement Reporting Excellence): Revised publication guide- Kober, T., . . . Moher, D. (2012). Consolidated standards of re-
lines from a detailed consensus process. BMJ Quality & Safety, porting trials (CONSORT) and the completeness of reporting
25(12), 986–992. https://doi.org/10.1136/bmjqs-2015-004411 of randomised controlled trials (RCTs) published in medical
Paton, J., Hatton, A. L., Rome, K., & Kent, B. (2016). Effects of journals. Cochrane Database Systematic Reviews, 11, MR000030.
foot and ankle devices on balance, gait and falls in adults with https://doi.org/10.1002/14651858.MR000030.pub2.
sensory perception loss: A systematic review. JBI Database of Vandenbroucke, J. P., Von Elm, E., Altman, D. G., Gøtzsche, P.
Systematic Reviews and Implementation Reports, 14(12), 127–162. C., Mulrow, C. D., Pocock, S. J., . . . Initiative, Strobe (2007).
https://doi.org/10.11124/JBISRIR-2016-003229 Strengthening the reporting of observational studies in epidemi-
Repique, R. J. R., Vernig, P. M., Lowe, J., Thompson, J. ology (STROBE): Explanation and elaboration. PLoS Med, 4(10),
A., & Yap, T. L. (2016). Implementation of a recovery- e297. https://doi.org/10.1371/journal.pmed.0040297
oriented training program for psychiatric nurses in the inpa- van Esch, B. F., Stegeman, I., & Smit, A. L. (2017). Comparison
tient setting: A mixed-methods hospital quality improvement of laryngeal mask airway vs tracheal intubation: A systematic
study. Archives of Psychiatric Nursing, 30(6), 722–728. https:// review on airway complications. Journal of Clinical Anesthesia,
doi.org/10.1016/j.apnu.2016.06.003 36, 142–150. https://doi.org/10.1016/j.jclinane.2016.10.004
Samaan, Z., Mbuagbaw, L., Kosa, S., Borg Debono, V., Dillenburg, Walston, J. M., Cabrera, D., Bellew, S. D., Olive, M. N., Lohse, C. M.,
R., Zhang, S., . . . Thibane, L. (2013). A systematic scoping re- & Bellolio, M. F. (2016). Vital signs predict rapid-response team
view of adherence to reporting guidelines in health care liter- activation within twelve hours of emergency department admis-
ature. Journal of Multidisciplinary Healthcare, 2013(6), 169–188. sion. Western Journal of Emergency Medicine: Integrating Emer-
https://doi.org/10.2147/JMDH.S43952 gency Care with Population Health, 17(3), 324–330. https://doi.
Santos, S. C. V. O., Woith, W., Freitas, M. I. P., & Zeferino, org/10.5811/westjem.2016.2.28501
E. B. B. (2016). Methods to determine the internal length Whiffin, C. J., & Hasselder, A. (2013). Making the link between crit-
of nasogastric feeding tubes: An integrative review. Inter- ical appraisal, thinking and analysis. British Journal of Nursing,
national Journal of Nursing Studies, 61, 95–103. https://doi. 22(14), 831–835.
org/10.1016/j.ijnurstu.2016.06.004
Smith, T. O., Walker, J., & Russell, N. (2007). Outcomes of
medial patellofemoral ligament reconstruction for patellar in- doi 10.1111/wvn.12258
stability: A systematic review. Knee Surgery, Sports Trauma- WVN 2017;00:1–10