PCORI Methodology Standards:

Academic Curriculum

© 2016 Patient-Centered Outcomes Research Institute. All Rights Reserved.

Module 1: Introduction

Category 11: Systematic

Reviews

Prepared by Eric Bass, MD, MPH

Tianjing Li, MD, PhD

Presented by Eric Bass, MD, MPH

Overview of Modules

1 Introduction Step 6: Summarize and Synthesize

8
2 Learning Objectives
Step 1: Choose and Define a Question
3 9
for a Systematic Review
4 Step 2: Establish Eligibility Criteria
5 Step 3: Search the Literature 10
6 Step 4: Extract Data
Step 5: Evaluate Study Quality and
7 I
Applicability
Evidence
Putting it All Together: Appraising a
Systematic Review
Putting it All Together: Designing a
Systematic Review
Interview between Dr. Eric Bass and
Ellen Tambor: engaging stakeholders in
systematic reviews and comparative
effectiveness research

3
What Is a Systematic Review?

Define question

Establish eligibility
criteria
Search literature and
review citations

Extract data

Evaluate study quality

and applicability
Summarize and
synthesize

4
Who Needs to Know About Standards for Systematic Reviews?

 Anyone who wants to use a systematic review of evidence to guide decisions about
clinical practice, health education, medical research, or health policy—e.g.:
 Clinicians
 Educators
 Investigators
 Policy makers

5
For Whom Are These Modules Designed?

 Mainly for those who want to perform a systematic review as part of a program of
patient-centered research

 Also for:
 New systematic reviewers
 Readers and reviewers of systematic reviews
 PCORI grant reviewers

6
What Is an Appropriate Source of Up-to-Date
Standards for Systematic Reviews?

 Evidence-Based Practice Center Program (AHRQ)

 The Cochrane Collaboration

 Institute of Medicine (U.S.). (2011). Finding What Works in

Health Care: Standards for Systematic Reviews.
Washington, D.C.: National Academies Press.

7
What Are the Institute of Medicine (IOM) Standards for Systematic Reviews?

Initiating a Finding and Synthesizing

Reporting
systematic review assessing studies evidence
 Establish team  Conduct and  Use prespecified  Use structured
with appropriate document method to format and peer
expertise comprehensive evaluate evidence review
 Ensure user and search  Conduct  Ensure free public
stakeholder input  Screen and select qualitative and access
 Manage bias and studies quantitative
conflict of interest  Consider biased synthesis
reporting
 Manage data
collection
 Critically appraise
each study

8
Is PCORI Flexible or Rigid About Application of the IOM Standards?

 PCORI is flexible about some standards:

 Searches for studies reported in non-English languages may be appropriate for some
topics but are not routinely recommended
 Dual screening and data abstraction are desirable, but fact-checking may be
sufficient, and quality control procedures are more important than dual review
per se
 Independent librarian peer review of the search strategy is not required if internal
review is done by experienced researchers