Professional Documents
Culture Documents
Evidence-Based Psychiatry
Basic Principles and Case Studies
This page intentionally left blank
How to Practice
Evidence-Based Psychiatry
Basic Principles and Case Studies
Edited by
C. Barr Taylor, M.D.
Washington, DC
London, England
Note: The authors have worked to ensure that all information in this book is accurate at the time of publication
and consistent with general psychiatric and medical standards, and that information concerning drug dosages,
schedules, and routes of administration is accurate at the time of publication and consistent with standards set by
the U.S. Food and Drug Administration and the general medical community. As medical research and practice
continue to advance, however, therapeutic standards may change. Moreover, specific situations may require a specific
therapeutic response not included in this book. For these reasons and because human and mechanical errors
sometimes occur, we recommend that readers follow the advice of physicians directly involved in their care or the
care of a member of their family.
Books published by American Psychiatric Publishing, Inc., represent the views and opinions of the individual authors
and do not necessarily represent the policies and opinions of APPI or the American Psychiatric Association.
If you would like to buy between 25 and 99 copies of this or any other APPI title, you are eligible for a 20% discount;
please contact APPI Customer Service at appi@psych.org or 800-368-5777. If you wish to buy 100 or more copies
of the same title, please e-mail us at bulksales@psych.org for a price quote.
Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .xv
C. Barr Taylor, M.D.
PART I
Basic Principles of Evidence-Based Psychiatry
05 Clinical Trials . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
Gregory E. Gray, M.D., Ph.D.
C. Barr Taylor, M.D.
06 Systematic Reviews and Meta-Analyses . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Gregory E. Gray, M.D., Ph.D.
08 Measurement . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
C. Barr Taylor, M.D.
09 Diagnostic Tests. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
Gregory E. Gray, M.D., Ph.D.
PART II
Case Studies:
Evidence-Based Medicine Applied to Major DSM-IV Disorders
25 Schizophrenia
A FAMILY PSYCHOEDUCATIONAL APPROACH . . . . . . . . . . . . . . . . . . . . . . . . . . . 225
Douglas S. Rait, Ph.D.
Ira D. Glick, M.D.
Appendices
A Glossary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 349
Index. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 357
Contributors
ix
x How to Practice Evidence-Based Psychiatry
The following contributors to this book have indicated a finan- of Mental Health Study of the Pharmacotherapy of Psy-
cial interest in or other affiliation with a commercial supporter, chotic Depression (STOP-PD).
a manufacturer of a commercial product, a provider of a com- Alan F. Schatzberg, M.D.Consultant: BrainCells,
mercial service, a nongovernmental organization, and/or a CeNeRx, Corcept (Co-Founder), Eli Lilly and Company,
government agency, as listed below: Forest Laboratories, Merck, Neuronetics, Novartis, Path-
ways Diagnostics, Pfizer, PharmaNeuroBoost, Quintlies,
Ira D. Glick, M.D.Grant/research support: Astra- Synosis, Xytis, Wyeth. Honorarium: GlaxoSmithKline,
Zeneca, Bristol-Myers Squibb/Otsuka, GlaxoSmithKline, Roche. Patents: Named inventor on pharmacogenetic use
National Institute of Mental Health, Solvay, Shire, Pfizer, patents on prediction of antidepressant response.
Eli Lilly and Company; Consult/advisory board: Impax, Dennis Tannenbaum, M.B.Ch.B., F.R.A.N.Z.C.P.
Bristol-Myers Squibb, Janssen, Eli Lilly and Company, CEO of Sentiens Pty, Ltd.
Lunkbeck, Organon BioSciences, Pfizer, Shire, Solvay, C. Barr Taylor, M.D.Grant/research support: Na-
Vanda; Speakers bureau: AstraZeneca, Bristol-Myers tional Institute of Mental Health, National Institute on
Squibb/Otsuka, Janssen, Pfizer, Shire. Aging, National Cancer Institute, Schweizerische Anor-
Terence A. Ketter, M.D.Grant/research support: exia Nervosa Stiflung (Switzerland), Commonwealth De-
Abbott Laboratories, AstraZeneca, Bristol-Myers Squibb, partment of Health and Ageing (Australia), Department
Cephalon, Eli Lilly and Company, GlaxoSmithKline, of Veterans Affairs.
Pfizer, Repligen Corporation, Wyeth. Consultant: Abbott Madhukar H. Trivedi, M.D.Grant/research support:
Laboratories, AstraZeneca, Bristol-Myers Squibb, Dainip- Agency for Healthcare Research and Quality, Corcept
pon Sumitomo Pharma, Eli Lilly and Company, Glaxo- Therapeutics, Cyberonics, Merck, National Alliance for
SmithKline, Janssen, Jazz Pharmaceuticals, Novartis, Research in Schizophrenia and Depression, National In-
Organon International, Solvay, Valeant Pharmaceuticals, stitute of Mental Health, National Institute on Drug
Vanda Pharmaceuticals, Wyeth, Xenoport. Lecture hono- Abuse, Novartis, Pharmacia and Upjohn, Predix Pharma-
raria: Abbott Laboratories, AstraZeneca, Bristol-Myers ceuticals, Solvay, Targacept. Consultant/speaker: Abbott
Squibb, Eli Lilly and Company, GlaxoSmithKline, Noven Laboratories, Abdi Brahim, Akzo, AstraZeneca, Bristol-
Pharmaceuticals, Pfizer. Employee (Nzeera Ketter, M.D., Myers Squibb, Cephalon, Fabre-Kramer Pharmaceuticals,
spouse): Johnson & Johnson. Forest Laboratories, GlaxoSmithKline, Janssen, Johnson
Lorrin M. Koran, M.D.Grant/research support: Eli & Johnson, Eli Lilly and Company, Meade-Johnson In-
Lilly and Company, Somaxon, Sepacor. Consultant: Jazz ternational, Neuronetics, Parke-Davis Pharmaceuticals,
Pharmaceuticals. Speakers bureau: Forest Laboratories. Pfizer, Sepraco, VantagePoint, Wyeth-Ayerst Laborato-
Ben Kurian, M.D., M.P.H.Grant/research support: ries.
Agency for Healthcare Research and Quality, National Po W. Wang, M.D.Grant/research support: Abbott
Institute of Mental Health, Targacept. Laboratories, AstraZeneca, Bristol-Myers Squibb, Eisai,
Anthony J. Rothschild, M.D.Grant/research support: Elan Pharmaceuticals, Eli Lilly and Company, Glaxo-
Cyberonics, National Institute of Mental Health, Novar- SmithKline, Janssen, Novartis, Repligen Corporation,
tis, Takeda, Wyeth. Consultant: Eli Lilly and Company, Shire, Solvay, Wyeth. Consultant: Abbott Laboratories,
GlaxoSmithKline, Forest Laboratories, Pfizer. Trademarks: Corcept Therapeutics, Pfizer, Sanofi-Aventis. Lecture
The Rothschild Scale for Antidepressant Tachyphylaxis honoraria: AstraZeneca, Bristol-Myers Squibb, Eli Lilly
(RSAT). Other: Eli Lilly and Company and Pfizer provided and Company, GlaxoSmithKline, Pfizer, Sanofi-Aventis.
study medication free of charge for the National Institute
xi
xii How to Practice Evidence-Based Psychiatry
The following contributors stated that they had no competing Anthony J. Mascola, M.D.
interests during the year preceding manuscript submittal: Matthew H. May, M.D.
James E. Mitchell, M.D.
Bibi Das, M.D. Douglas S. Rait, Ph.D.
Gregory E. Gray, M.D., Ph.D. James Reich, M.D.
Keith Humphreys, Ph.D. Margaret F. Reynolds-May, B.A.
Anna Lembke, M.D. Richard E. Shanteau, M.D.
Steven E. Lindley, M.D., Ph.D. Caroline Spiranovic, Ph.D.
Gretchen Lindner, Ph.D. Violeta Tan, M.D.
Joanna M. Marino, M.A.
Foreword
W e are in a great practice era in psychiatry. Ad- both interesting and inspiring. I trust you will find
vances in both psychotherapy and psychopharmacol- them relevant and helpful to your everyday practice.
ogy have led to several effective approaches to many Over the last few years, the American Psychiatric
mental health problems. And the knowledge base on Association has developed tools to facilitate aspects
which we base psychiatric practice only continues to of evidence-based psychiatric practice, including the
grow. Thus, I am delighted with the publication of publication of practice guidelines and performance
How to Practice Evidence-Based Psychiatry: Basic Princi- measures. One example, the Handbook of Psychiatric
ples and Case Studies. This valuable new book will Measures, provides information about and ready ac-
help residents, practicing psychiatrists, and mental cess to many measures relevant to diagnosis, treat-
health workers find the most useful and relevant in- ment, and evidence-based psychiatric practice.
formation to inform and improve their practices. American Psychiatric Publishing, Inc., also has pub-
In this text, C. Barr Taylor, M.D., has approached lished a variety of resource books that provide the
expounding on evidence-based practice in two ways. latest evidence and information on available and de-
First, he has done a masterful job in revising and up- veloping treatments, including basic textbooks and
dating a splendid book, the Concise Guide to Evidence- practitioner guides to the core psychotherapy com-
Based Psychiatry, by Gregory E. Gray, M.D., Ph.D., petencies. Still, as Dr. Taylor notes, the major chal-
which provides details on how to obtain and inter- lenge for the modern practitioner is to apply and
pret medical evidence. The revisions include new incorporate into his or her practice the most effec-
chapters on how to consider other sources of infor- tive psychosocial and biological interventions that
mation, including guidelines and measurements, are based on the latest evidence.
and how to provide effective long-term treatment to How to Practice Evidence-Based Psychiatry: Basic
patients with complicated, comorbid problems. Sec- Principles and Case Studies is an invaluable tool in
ond, Dr. Taylor has recruited experts from a variety helping you become a better practitioner. My con-
of specialty areas and practice settings to describe gratulations to Dr. Taylor and his colleagues.
how they incorporate the latest evidence and out-
come studies into their practice. These cases are Alan F. Schatzberg, M.D.
xiii
This page intentionally left blank
Preface
I n recent years, there has been an increased emphasis derstandable book on this topic. I was fortunate to
on evidence-based psychiatric practice. Many prac- have Dr. Grays help with this process. The second
tice settings encourage clinicians to follow evidence- goal is to discuss how the psychiatrist and other
based guidelines and algorithms, medical students mental health specialists can incorporate evidence-
and residents are expected to develop and retain skills based psychiatry into their clinical practice. To do so
in evidence-based practice, and clinicians are encour- requires clinicians to use various toolssome of
aged to follow procedures to carefully evaluate the which may not be strictly evidence based, such as
quality of the evidence they use in their practice. De- guidelines, expert opinion, and their own clinical ex-
spite this emphasis, many psychiatrists and other perience and expertise. I invited experienced clini-
mental health professionals remain unfamiliar with cians, many of whom are experts in their own right,
methods and philosophy of evidence-based medicine to discuss cases in which they followed aspects of ev-
(EBM) and, even more important, have little experi- idence-based care. I also decided that it would be
ence or guidance as to how to use evidence and the useful to discuss the use of evidence-based practice
products developed from evidence (guidelines, algo- when American Psychiatric Association guidelines
rithms) in clinical practice. The purpose of this book are available and in various settings, including pri-
is to address the latter issue. The application of evi- vate practice. As the reader will see, the case present-
dence to real clinical cases is difficult. Much of the ev- ers approached this task in various ways.
idence comes from patients who are less impaired and This book was written with three audiences in
complicated than those we see in practice, focuses on mind. The first audience consists of psychiatrists
immediate rather than long-term issues, and fails to and other mental health professionals who wish to
address the need for integrated treatment. learn about evidence-based psychiatry on their own
I start with the assumption that guidelines, algo- and who wish to incorporate evidence-based psychi-
rithms, and other sources of evidence and the inter- atry into their busy practice. The first section (the
pretation of evidence need to be adapted to the updated Concise Guide) can be used both as an intro-
individual patient by the clinician. I also believe that duction to the topic and as a ready reference for re-
the best way to practice evidence-based psychiatry is searching the literature and appraising evidence.
to set measurable treatment goals and then to mon- The second audience is psychiatry residents and
itor progress toward those goals. other mental health trainees. Several textbooks on
This book was written with two major goals in the topic of EBM are available, including the Concise
mind. The first goal is to discuss the methods and Guide to Evidence-Based Psychiatry. The first section
philosophy of evidence-based psychiatry. To achieve of this book, the updated Concise Guide, focuses on
this goal, I updated and expanded the Concise Guide the needs of psychiatry residents and of other mental
to Evidence-Based Psychiatry, by Gregory E. Gray, health trainees by emphasizing the information re-
M.D., Ph.D., a popular, well-written, and easily un- sources of most use in finding answers to clinical
xv
xvi How to Practice Evidence-Based Psychiatry
questions in clinical practice. In addition, examples skills as part of the practice-based learning and im-
are drawn from the psychiatric literature rather than provement core competency, and the program di-
from general medicine or surgery. The second and rectors and faculty need to be more aware of these
third sections include cases that may be useful for practices. Chapter 15 includes updated suggestions
residents. I have used these cases in my lectures on from the Concise Guide to Evidence-Based Psychiatry
evidence-based psychiatry. I also invited a resident for teaching EBM in psychiatry residency training
to discuss a patient she treated. programs.
The third audience is residency program direc- It is my hope that the information and examples
tors and faculty who are looking for a brief introduc- in this book can help achieve the goal of evidence-
tion to evidence-based psychiatry and examples of based psychiatry, which is to provide the best care to
how evidence-based psychiatry can be practiced. our patients.
The Accreditation Council for Graduate Medical
Education requires that all residents develop EBM C. Barr Taylor, M.D.
Cautionary Statement
T he cases presented in this volume are meant to il- of measures that should be used or dosages of med-
lustrate how experienced clinicians have approached ications that should be given unless their status as
various clinical issues. However, they are not meant such is clearly stated by the authors.
to be recommendations as to how other clinicians Readers should note that Internet addresses
should treat similar cases, and other clinicians might change frequently. If a link provided is no longer
have equally useful approaches to their patients. The current, a search from the referenced homepage by
cases are not meant, either, to be recommendations title or keyword may locate the cited document.
xvii
This page intentionally left blank
Acknowledgments
T he development of How to Practice Evidence-Based this project, and Roxanne Rhodes, Senior Editor,
Psychiatry: Basic Principles and Case Studies has relied and the Books Department staff for their careful
on the help of many individuals. The first section of work in editing and preparing the manuscript.
the book is primarily an update of the excellent Con- I want to thank the many individuals who read
cise Guide to Evidence-Based Psychiatry, by Gregory E. drafts of various chapters and provided important
Gray, M.D., Ph.D., with new chapters added to ex- feedback and recommendations, including Vickie
pand the focus to evidence-based psychiatry prac- Chang, Darby Cunning, Debra Safer, Violeta Tan,
tice. I am deeply grateful for the chance to update and Mickey Trockel. This project began with discus-
this material. Dr. Gray was also very willing and sions in the Behavioral Medicine Clinic in the Stan-
available to review and revise updates. ford Medical School Department of Psychiatry
I also would like to thank all the contributors to about how to practice evidence-based medicine. I
this book. All prepared interesting and important want to thank Bruce Arnow, Chris Hayward, Elias
cases and responded to any suggestions for changes. Aboujaoude, Debra Safer, Anthony Mascola, and
I appreciate their willingness to be forthright in dis- Kim Bullock for their suggestions about how to
cussing how they approach cases with evidence- think about and present these difficult ideas. Smita
based medicine procedures. Das helped me develop some of the original forms
Many individuals from American Psychiatric and procedures that eventually became central to
Publishing contributed in many important ways to the cases I present. Nicole DeBias was incredibly
this project. I particularly want to thank Bob Hales, helpful in preparing, editing, and assembling the
Editor-in-Chief, and John McDuffie, Editorial Di- many pieces for submission to American Psychiatric
rector, who provided much support and advice for Publishing.
xix
This page intentionally left blank
I
Basic Principles of
Evidence-Based Psychiatry
This page intentionally left blank
1
What Is Evidence-Based
Psychiatric Practice?
C. Barr Taylor, M.D.
Gregory E. Gray, M.D., Ph.D.
Evidence-based psychiatric practice (EBPP) is a broad These are important sources for EBPP. In psychia-
term referring to clinical practice that is informed by try, we also need to consider psychosocial, psycho-
evidence about interventions and considers patient therapeutic, and psychopharmacological sources of
needs, values, and preferences and their integration expertise and evidence. Thus, we think it is better to
in determining individual care (Kazdin 2008). EBPP take a broad perspective and focus on both the evi-
uses evidence-based medicine (EBM) to assess the dence and the expertise. The goal of EBPP is to im-
quality of evidence relevant to the risks and benefits prove patient care, and we need to consider a set of
of treatments (including lack of benefit). According practices relevant to achieving that aim.
to the Centre for Evidence-Based Medicine, Evi- Gray (2004) has noted that all practice guidelines
dence-based medicine is the conscientious, explicit involve some degree of judgment and bias in their de-
and judicious use of current best evidence in making velopment (Browman 2001; Drake et al. 2001;
decisions about the care of individual patients (Sack- Greenhalgh 2001), the extent of which is often un-
ett et al. 1996). stated. In addition, clinical practice guidelines are of-
Gray (2004), in Concise Guide to Evidence-Based Psy- ten introduced as part of a top-down approach to
chiatry, noted that EBM focuses on the use of clinical changing clinician behavior, which may lead to clini-
expertise to integrate research evidence, patient pref- cian resistance. Ideally, EBM and EBPP are bot-
erences, and clinical state in making decisions about tom-up approaches, in which clinicians make
patient care (Guyatt et al. 2000; Haynes et al. 2002a, decisions based on ability to search and appraise the
2002b; Straus and McAlister 2000). Usually, EBM medical literature and use this information in their
addresses a particular issue (e.g., What is the evi- practice situation. Yet in practice, few clinicians have
dence that a particular treatment is effective for a the time to find and read systematic reviews and thus
particular problem?). EBPP refers to the more com- rely on guidelines and algorithms. What remains
plicated problem of integrating various sources of ev- most important is that patients are provided the best
idence, including experience, in treating patients in treatment available, and the best way to determine
real-world settings and over long periods. The chal- that is to monitor progress against some standard.
lenge of EBPP is to determine how the evidence Taking these considerations together, EBPP includes
fits a particular patient with multiple problems.
Over the last decade, the data from innumerable Accurate evaluation and treatment planning
studies have been massaged by experts into guide- Consideration of treatment algorithms, guide-
lines, algorithms, consensus statements, reviews, lines, and best practices when planning and pro-
textbooks, meta-analyses, and other documents. viding treatment
3
4 How to Practice Evidence-Based Psychiatry
Use of measures to determine progress of an in- beyond teaching critical appraisal skills and started
dividual patient developing a new philosophy of medical education,
Review of a patients progress against personal which they termed evidence-based medicine. In this new
and published standards model, physicians would rely heavily on the medical
Consideration of evidence and experts in clin- research literature, rather than on textbooks or tradi-
ical decisions tion, when approaching patient care problems. From
Expertise in providing a range of therapies or in 1993 to 2000, the McMaster group published a series
making them available through other resources of 25 articles in JAMA that defined many aspects of
or providers EBM. These articles have been revised and published
Periodic review of general practice outcomes in book form (Guyatt and Rennie 2002); they are also
available, in their original form, at the Centre for
The cases in Parts II and III of the book illustrate Health Evidence (2007) Web site.
how various clinicians have considered treatment al- Although EBM was developed in Canada and de-
gorithms, guidelines, and best practices and mea- scribed in JAMA, it has probably had its greatest ef-
sures when planning and delivering treatment. In fect in Britain. In part, this was because of the support
Chapter 4, we discuss the many resources available of the National Health Service (NHS) (Baker and
to find evidence relevant to your clinical questions. Kleijnen 2000; Ferguson and Russell 2000; Reynolds
Yet even with the availability of these many re- 2000; Trinder 2000). The NHS viewed EBM as a
sources for facilitating EBPP, new knowledge will way both to improve the quality of care and to con-
continue to be added, and the practitioner will be trol costs by identifying and promoting therapies that
faced with the need to interpret the summary worked and by eliminating therapies that were inef-
sources and to search for new information. In addi- fective or harmful. The NHS funds university-based
tion, the process an individual goes through in eval- centers for EBM, surgery, child health, general prac-
uating a source is similar to that used by many tice, pathology, pharmacotherapy, nursing, dentistry,
experts. For this reason, we have updated the Concise and mental health, as well as the NHS Centre for Re-
Guide to Evidence-Based Psychiatry (Gray 2004). Part I views and Dissemination (1999) and the United
of the book can be used to learn the principles and Kingdoms Cochrane Centre (Baker and Kleijnen
practices of EBM and EBPP. 2000; Sackett et al. 1996). In addition, the BMJ Pub-
lishing Group publishes several evidence-based jour-
The Development of Evidence- nals and the semiannual publication Clinical Evidence,
which is distributed to general practitioners by the
Based Medicine and Psychiatry NHS (Baker and Kleijnen 2000; Barton 2001).
EBM arose for a variety of reasons, but perhaps the In 1999, the Special Health Authority of the NHS
main one was the need to find ways to use the vast in England and Wales established the National In-
knowledge accumulating from clinical trials in ways stitute for Clinical Excellence (NICE). In 2005, it
that might improve or provide more cost-effective joined with the Health Development Agency to be-
care. A search (conducted 4/06/08) of the term de- come the new National Institute for Health and
pression treatment in PubMed identified more Clinical Excellence (still abbreviated NICE).
than 100,000 articles, with more than 10,000 pub- NICE publishes clinical appraisals of treatments
lished in the last few years. Many of the scientific with a consideration of cost-effectiveness. Since
practices of EBM are designed to find ways to sys- 2005, the NHS in England and Wales has been le-
tematically sort through such evidence to find infor- gally obliged to provide funding for medicines and
mation that might improve care. treatments recommended by NICEs technology
EBM had its origin in the Department of Clinical appraisal board. (Details as to how NICE develops
Epidemiology and Biostatistics at McMaster Univer- guidelines can be found at www.nice.org.uk.)
sity in Canada (Guyatt 2002). In 1981, members of NICE is not without its critics. As mentioned, it
that department began publishing a series of articles began with the goal of increasing access to effective
in the Canadian Medical Association Journal that were treatments. It has been criticized, however, for the
intended to teach clinicians how to critically appraise slow release of its appraisals; some of its assessments
the medical literature. In 1990, they began to move have seemed unfair, and the institute has been vili-
What Is Evidence-Based Psychiatric Practice? 5
fied for recommendations to limit or deny coverage large community-based outpatient clinics must pro-
for some high-profile medicines for cancer and vide adequate staff capacity to allow the delivery of
other life-threatening diseases. The most contro- evidence-based psychotherapy to their patients. In
versial decisions seem to be related to refusal to pay addition, all veterans with depression or anxiety dis-
for expensive treatments assessed to have marginal orders must have access to three evidence-based
benefit of extending life or improving quality of life. treatments, as appropriate: cognitive-behavioral
Some believe that one of the greatest threats of therapy (CBT), acceptance and commitment ther-
EBM is its use to determine what services will be re- apy, or interpersonal therapy. In addition, all care
imbursed (Steinbrook 2008). sites need to provide evidence-based pharmacother-
According to Gray (2002), the uptake of EBM has apy for mood disorders, anxiety disorders including
been slower in the United States than overseas. He PTSD, psychotic disorders, substance use disorders,
noted that the slow incorporation of EBM into psy- dementia, and other cognitive disorders. The VHA
chiatry practice may be related to mental health pro- noted, Such care is to be consistent with current VA
fessionals belief that their patients individuality clinical practice guidelines and informed by current
and the nonquantifiable aspects of psychotherapy scientific literature. The VA has restricted internal
preclude the application of EBM to psychothera- Web sites providing access to VA clinical practice
peutic interventions (Geddes 2000; Geddes et al. guidelines (vaww.oqp.med.va.gov/CPGintra/cpg/
1997; Goss and Rowland 2000; Kazdin 2008; Mace cpg.htm) and VHA clinical practice guidelines
et al. 2001; Parry 2000). We hope the cases pre- (vaww.national.cmop.va.gov/PBM/Clinical%20
sented later in this book dispel this myth. Guidance/Forms/AllItems.aspx).
In recent years, however, EBPP has achieved EBPP also has become important in some large
wide influence in many systems. In the United health maintenance organizations, such as the Kai-
States, the Agency for Healthcare Research and ser Permanente Health Care System, and in many
Quality (2008) has established the National Guide- preferred provider organizations.
line Clearinghouse (NGC; www.guideline.gov). The Accreditation Council for Graduate Medical
This important resource is a comprehensive data- Education (2008), the body that sets standards for
base of evidence-based clinical practice guidelines training residents in psychiatry and other specialties,
and related documents. NGC was originally created requires training programs to show how they are
by the Agency for Healthcare Research and Quality teaching competence in the methods of EBM.
in partnership with the American Medical Associa- EBM has had a major influence on psychiatric
tion (AMA) and the American Association of Health practice in the United Kingdom because of the role
Plans (now Americas Health Insurance Plans). The of the NHS, as well as the efforts of the Centre for
NGC mission is to provide physicians, nurses, other Evidence-Based Mental Health at the University of
health professionals, health care providers, health Oxford (Baker and Kleijnen 2000; Ferguson and
plans, integrated delivery systems, purchasers, and Russell 2000; Geddes 2000). These efforts have
others an accessible mechanism for obtaining ob- been aided by the journal Evidence-Based Mental
jective, detailed information on clinical practice Health, which is published jointly by the BMJ Pub-
guidelines and to further their dissemination, imple- lishing Group, the Royal College of Psychiatrists,
mentation, and use. and the British Psychological Society (Geddes et al.
The Veterans Health Administration (VHA) of 1997). In addition, skill in applying EBM is tested in
the U.S. Department of Veterans Affairs (VA) may the critical appraisal paper that is now included in
be in the forefront of providing evidence-based part II of the membership examination of the Royal
mental health practice. The recent VHA Handbook College of Psychiatrists (Dhar 2001; Geddes 2000).
lays out minimum requirements for VHA mental In 2006, the United Kingdom established the Im-
health services (U.S. Department of Veterans Af- proving Access to Psychological Therapies program
fairs 2008). In the section on evidence-based psy- to provide evidence-based mental health treatment
chotherapies, the VHA notes that all veterans with for patients with anxiety and depressive disorders
posttraumatic stress disorder (PTSD) must have ac- (Department of Health and Care Services Improve-
cess to cognitive processing therapy or prolonged ment Partnership 2006). The ambitious goal of this
exposure therapy and that medical centers and very program is to improve services to 900,000 or more
6 How to Practice Evidence-Based Psychiatry
depressed people over the next few years, with half mental and substance use disorders (www.national-
of those completing therapy recovering. The pro- registry.samhsa.gov/).
gram uses a stepped-care model with the expectation
that data will be obtained on all participants.
Does Evidence-Based Medicine
The American Psychological Association (2005)
has been slow to promote evidence-based inter- Improve Outcomes?
ventions, although they encourage evidence-based One should ask, however, whether the use of evi-
psychological practice. The Task Force on Evi- dence improves outcomes. This is actually a difficult
dence-Based Practice has a very nonspecific recom- question to answer. It would not be ethical to con-
mendation about evidence-based psychological duct a controlled trial to determine whether the use
practice: of EBM guidelines, compared with nonuse, im-
proved outcomes because the patients randomly as-
Clinical decisions should be made in collaboration signed to the nonuse condition would be offered a
with the patient, based on the best clinically rele- treatment that other evidence would suggest to be
vant evidence, and with consideration for the
inferior. One procedure is to estimate the benefit if
probable costs, benefits, and available resources
and options. It is the treating psychologist who guidelines were applied in a particular population or
makes the ultimate judgment regarding a particu- setting. For instance, some EBM guidelines have
lar intervention or treatment plan. The involve- been identified to provide the best care for post
ment of an active, informed patient is generally myocardial infarction (MI) patients, such as pre-
crucial to the success of psychological services. scribing aspirin and beta-blockers. Following these
Treatment decisions should never be made by un-
guidelines has been shown to improve outcome
trained persons unfamiliar with the specifics of the
case. The treating psychologist determines the ap- compared with previous practice (Krumholz et al.
plicability of research conclusions to a particular 1998). For instance, Gemell et al. (2005) estimated
patient. Individual patients may require decisions that following the United Kingdoms National Ser-
and interventions not directly addressed by the vice Framework guidelines for adopting the Na-
available research. The application of research ev- tional Service Framework recommendations for
idence to a given patient always involves probabi-
pharmacological interventions would prevent an ex-
listic inferences. Therefore, ongoing monitoring
of patient progress and adjustment of treatment as tra 1,027 deaths (95% confidence interval [CI] 418
needed are essential to EBPP [evidence-based 1,994) in postacute MI patients and an extra 37,899
psychological practice]. (p. 3) (95% CI 25,69052,503) deaths in heart failure pa-
tients in the first year after diagnosis. Lifestyle-
Clinicians need to be aware of the many resources based interventions would prevent an extra 848
available to evaluate the effectiveness of psycholog- (95% CI 711,614) deaths in postacute MI patients
ical interventions. Several textbooks have recently and an extra 7,249 (95% CI 99516,696) deaths in
been published on evidence-based psychological heart failure patients.
practice (e.g., Fisher and ODonogue 2006; Free- Collaborative care for depression treatment in
man and Power 2007; Goodheart et al. 2006; Levy populations is another example of an evidence-based
and Ablon 2009; Rubin 2007). The Oxford Univer- quality improvement intervention. This model has
sity Press has a division related to publishing de- been developed by Katon and others over many
tailed manuals for patients and therapists on how to years (Katon and Seelig 2008). In a total of 37 ran-
apply evidence-based practices (www.us.oup.com/ domized trials of collaborative care compared with
us/catalog/general/series/TreatmentsThatWork). usual primary care, collaborative care was associated
One Web site (http://ucoll.fdu.edu/apa/lnksinter with twofold increases in antidepressant adherence,
.html) provides links to more than 30 other Web improvements in depressive outcomes that last up to
sites providing data on evidence-based psychologi- 5 years, increased patient satisfaction with depres-
cal interventions. The Substance Abuse and Mental sion care, and improved primary care satisfaction
Health Services Administration (SAMHSA) has with treating depression (Katon and Seelig 2008). As
created the National Registry of Evidence-Based another example, better adherence to guidelines de-
Programs and Practices, a searchable database of in- veloped to treat opioid-dependent patients in Veter-
terventions for the prevention and treatment of ans Affairs opioid substitution clinics resulted in
What Is Evidence-Based Psychiatric Practice? 7
greater reductions in heroin and cocaine use and receive adequate dosages of antidepressants, and
greater improvement in mental health (Trafton et fewer than 10% receive evidence-based psychother-
al. 2007). apy (Katon and Seelig 2008). Estimates suggest that
about 40% of primary care patients drop out of de-
pression treatment within 6 weeks, and fewer than
Does Evidence-Based Psychiatric half are taking antidepressants at 6 months (Simon
Practice Improve Outcomes? 2002). Similar low levels of adherence to evidence-
Examining the effects of EBM-specific practices on based guidelines have been found for other disorders
carefully defined populations and problems is differ- such as substance abuse.
ent from studying EBPP (Kazdin 2008). Again, Wide variations are also seen in the way psychia-
EBM focuses on discrete conditions and issues, and try and other medical specialties are practiced (Ged-
EBPP focuses on the broader care of patients. EBPP des and Harrison 1997; Geyman 2000). Clearly,
is not what researchers study (Kazdin 2008), and do- some methods of treatment must be more effective
ing so is difficult. The parameters of EBPP have not than others and have more research to support their
been clearly defined. We gave examples in the pre- use, yet surveys conducted in academic medical cen-
vious section of how following guidelines can im- ters have found that up to 40% of clinical decisions
prove care, but following guidelines is only one are unsupported by evidence from the research lit-
aspect of EBPP as previously defined. The system- erature (Geddes et al. 1996; Greenhalgh 2001).
atic application of the Sequenced Treatment Alter-
natives to Relieve Depression (STAR*D) study Why the Gap?
guidelines, as illustrated in Trivedi and Kurian,
Two general types of information problems contrib-
Chapter 21 of this volume, is likely to improve treat-
ute to patients receiving less than optimal care (Gray
ment of depression.
2002; Haynes et al. 1997). The first problem is one
of information overload, which creates difficulties
Psychiatric Clinical Practice Is Not for clinicians who want to determine which treat-
ments are truly most effective. There are thousands
Always Evidence Based of medical journals and millions of articles; there-
Over the past few years, evidence has accumulated to fore, no psychiatrist or other clinician should expect
suggest that there is a significant gap between the to keep up with all of the developments in his or her
knowledge obtained from clinical trials regarding ef- field. Furthermore, when one looks at the results of
fective treatments for mental disorders and the actual various studies, they often appear to be contradic-
treatment received by patients in clinical practice tory. In part, this is caused by false-positive and
(Drake et al. 2001; Lehman and Steinwachs 1998; false-negative results, which often arise from small
U.S. Department of Health and Human Services samples (Collins and MacMahon 2001; see also
1999; Young et al. 2001). Similar discrepancies have Gray and Taylor, Chapter 5 in this volume). One
been noted in other fields of medicine, in which prac- could consult review articles to summarize the liter-
tice often lags years behind research findings (Egger ature, but most such reviews are journalistic or
et al. 2001; Geyman 2000; Haines and Donald 1998; narrative reviews, not systematic reviews (see
Haines and Jones 1994). Other examples are that Gray, Chapter 6 in this volume). As a result, such ar-
only about half of patients with diabetes have hemo- ticles are subject to the biases of the reviews au-
globin A1c levels below the recommended level of thor(s), both in terms of studies cited and in the
8.0%; only one-third of patients with hypertension method of summarizing conflicting results (Cook et
receive adequate treatment to lower blood pressure al. 1998; Egger et al. 2001; Greenhalgh 2001). Text-
below guideline-recommended levels. According to book chapters have the added problem of rapidly be-
a recent review, among patients in the community coming out of date. All of this contributes to the lag
and primary care settings, more than 50% of those before advances in treatment are recognized and
with depression do not receive accurate diagnoses or find their way into practice.
any prescription of depression treatment. Of those The second type of information problem causes
who are prescribed treatment, more than 50% do not ineffective treatments to be adopted or maintained.
8 How to Practice Evidence-Based Psychiatry
The problem is not a lack of information but rather of the manic episodes would have qualified for the
the uncritical acceptance of available information. hypothetical trial.
This may occur for a variety of reasons, such as over- Exclusion criteria do not necessarily bias the
reliance on ones own clinical experiences or on ex- study in terms of a favorable outcome, although they
pert opinion, the uncritical acceptance of results of may limit the external validity of the study. For in-
single studies, and the excessive influence of phar- stance, in the Storosum et al. (2004) sample, the
maceutical companies through advertising and most common exclusion criterion was the use of
sponsorship of speakers (Greenhalgh 2001; Sackett contraceptives. Excluding such patients reduces the
et al. 2000). At the same time, ones own clinical ex- external validity of the trial. In contrast, some other
periences and expert opinions are important sources exclusion criteria (e.g., comorbid alcohol and drug
of information on how to provide patient care. use disorders) may have resulted in an overestima-
tion of the efficacy of antimanic medications. An-
Problems With Evidence-Based other limitation is that many clinical trials are very
shortlasting less than a few monthsand do not
Medicine deal with the many patients who do not improve. A
There are also many good reasons to question evi- notable exception, among others, is the STAR*D
dence-based medicine. A common complaint we trial, which has attempted to apply evidence-based
hear from clinicians is that randomized studies enroll care to real clinical populations as mentioned earlier.
patients very unlike my patients. This statement Faced with these issues, clinicians need to con-
has some truth to it. First, patients in clinical studies sider the evidence of a treatments efficacy as a
tend to be younger or older than many patients in source of information. From our standpoint, the
clinical practice. In medicine (less so in psychiatry), challenge of the clinician is to view all evidence with
women have been underrepresented in clinical trials. a keen eye to its limitations but a possibility for its
Minorities are often absent or present in such small usefulness. In the cases provided later in this book,
numbers as to make subanalyses meaningless. Many we include examples of how clinicians have used
clinical trials exclude 90% or more of potentially in- and struggled withsources of evidence as they try
terested subjects. For instance, Yastrubetskaya et al. to provide effective care. The evidence needs to fit
(1997) found that only 4% of 186 elderly patients the realities of the patient. Because of the clinical
with elevated Hamilton Rating Scale for Depression challenges of integrated evidence with real cases, we
scores were eligible for a Phase III trial of a new anti- favor a focus on how the patient is doing.
depressant. Taylor et al. (2007) compared patients
used in meta-analyses of cardiac rehabilitation pro-
grams with two large samples of patients actually in Evidence Is Often Not Available
such programs. Compared with patients in actual EBM assumes that treatments proven to be effica-
practice, patients presented in the meta-analyses cious should be used over those lacking in evidence.
were younger (54 vs. 64 years), more likely to be Unfortunately, depending on the criteria for effec-
males (90% vs. 74%), more likely to have had an MI tiveness, very few treatments have been shown to be
(86% vs. 53%) and not a coronary artery bypass graft beneficial. For instance, the BMJ Clinical Evidence
(6% vs. 24%), and more likely to be in the program base has evaluated more than 2,500 treatments
longer (18 vs. 8 weeks). (www.clinicalevidence.bmj.com/ceweb/about/
Randomized studies often exclude comorbid knowledge.jsp). According to their criteria, only
problems, whereas most patients seen in clinical 13% were rated as beneficial, 23% were rated as
practice have one or more comorbidities. To deter- likely to be beneficial, 8% were rated as a trade-off
mine whether the results from placebo-controlled between beneficial and harmful, 6% were rated as
studies conducted in patients with manic episode unlikely to be beneficial, and 4% were rated as likely
can be generalized to a routine population of hospi- to be ineffective or harmful. Of the treatments,
talized acute manic patients, Storosum et al. (2004) 46%the largest proportionwere of unknown ef-
examined the baseline characteristics of 68 patients fectiveness. Use of only clearly beneficial treatments
with 74 episodes of acute mania who had been re- would severely limit options in patient care. Further-
ferred for routine treatment. In this study only 16% more, the evidence for such beneficial treatments is
What Is Evidence-Based Psychiatric Practice? 9
likely to have been derived from studies that, as men- the practitioner to evaluate a potentially useful new
tioned earlier, may have limited applicability to pa- intervention. The procedures for doing so require
tients seen in clinical practice. A reasonable approach following EBM procedures, as discussed in the
is first to consider treatments shown to be effective chapters in Part I of this book, but can be time con-
with similar patients and then to retain a healthy suming. Many other sources of more easily obtained
skepticism about other treatments. current information, such as industry-sponsored
Two particular situations in which lack of evidence continuing medical education courses, information
is especially problematic are the head-to-head com- from pharmaceutical representatives, and industry-
parison of new pharmacological treatments and situ- sponsored reviews and seminars, may be biased.
ations involving treatment-resistant patients. The
first situation is problematic because new drugs are Lack of Incentives for Evidence-Based
evaluated relative to placebos or older medications Psychiatric Practice
not newer medicationsin the Phase III trials con-
Some practice settings now incorporate best prac-
ducted to obtain U.S. Food and Drug Administra-
tices as one form of EBPP, and clinicians are held ac-
tion approval. The second situation is problematic
countable to these standards. However, in most
because few studies other than the STAR*D trial
settings, clinicians are free to practice EBPP as they
have systematically evaluated treatment approaches
wish. EBPP, particularly because it involves some of
to treatment-resistant patients.
the more structured psychotherapies, may feel more
demanding than do less-structured, nondirected ap-
Problems in Practicing Evidence- proaches. As noted earlier, indications are that reim-
Based Psychiatry bursement may become more related to EBPP. The
main reason that one should practice EBPP is the
In addition to concerns about EBM and evidence- belief that doing so will improve patient care.
based treatments, several practical problems arise in
practicing evidence-based psychiatry.
No Resources for Assessment
Limited Time to Look for Answers EBPP requires assessment of progress. Although
The first problem is time. Finding new information simple assessment procedures are available, more
relevant to a case can be time-consuming, and clini- routine assessments and data management may seem
cians often have very tight schedules. It is important too much of an encumbrance for many practitioners.
to consider that some general guidelines to help di- We discuss some simple procedures that can help
rect care can be easily obtained. The practitioner overcome some of these problems (Chapters 8, 14,
should periodically update guidelines and even cus- 16, 17) and also provide models in which electronic
tomize them, as discussed in Taylor, Chapter 18 of systems can support EBPP (Chapters 21 and 33).
this volume, if he or she believes that the evidence
justifies doing so. Guidelines are also frequently up-
dated and revised. Guidelines are available to cover
Summary
most common conditions, and once they have been The goal of mental health professionals should be to
selected, using them requires less time. provide the most effective treatments to their pa-
A more complicated problem is how to build on tients. Doing so requires that they can determine
these guidelines and algorithms, particularly to find which treatment approaches are more likely to be ef-
evidence of therapies useful across procedures, and fective for a given patient, and this is, in essence,
to evaluate new information. what EBPP is all about. Over the last decade, the
Although many sources of evidence about treat- data from innumerable studies have been massaged
ments have been developed to aid the busy practi- by experts into guidelines, algorithms, consensus
tioner, such sources can be out of date. First, most statements, reviews, textbooks, meta-analyses, and
EBM procedures rely on large data sets, and many other documents. These resources and the general
meta-analyses may be focused on results from older principles developed for EBM have the potential to
studies and interventions. Thus, it is a challenge for improve psychiatric practice significantly.
10 How to Practice Evidence-Based Psychiatry
Katon WJ, Seelig M: Population-based care of depression: Sackett DL, Straus SE, Richardson WS, et al: Evidence-
team care approaches to improving outcomes. J Occup Based Medicine: How to Practice and Teach EBM, 2nd
Environ Med 50:459467, 2008 Edition. New York, Churchill Livingstone, 2000
Kazdin AE: Evidence-based treatment and practice: new op- Simon GE: Evidence review: efficacy and effectiveness of
portunities to bridge clinical research and practice, en- antidepressant treatment in primary care. Gen Hosp
hance the knowledge base, and improve patient care. Am Psychiatry 24:213222, 2002
Psychol 63:146159, 2008 Steinbrook R: Saying no isnt NICEthe travails of Britains
Krumholz HM, Philbin DM Jr, Wang Y, et al: Trends in the National Institute for Health and Clinical Excellence. N
quality of care for Medicare beneficiaries admitted to the Engl J Med 359:19771981, 2008
hospital with unstable angina. J Am Coll Cardiol 31:957 Storosum JG, Fouwels A, Gispen-de Wied CC, et al: How real
963, 1998 are patients in placebo-controlled studies of acute manic
Lehman AF, Steinwachs DM: Patterns of usual care for episode? Eur Neuropsychopharmacol 14:319323, 2004
schizophrenia: initial results from the Schizophrenia Pa- Straus SE, McAlister FA: Evidence-based medicine: a com-
tient Outcomes Research Team (PORT) client survey. mentary on common criticisms. CMAJ 163:837841, 2000
Schizophr Bull 24:1120, 1998 Taylor RS, Bethell HN, Brodie DA: Clinical trials versus the
Levy R, Ablon JS: Handbook of Evidenced-Based Psychody- real world: the example of cardiac rehabilitation. British
namic Psychotherapy: Bridging the Gap Between Sci- Journal of Cardiology 14:175178, 2007
ence and Practice. New York, Humana Press, 2009 Trafton JA, Humphreys K, Harris AH, et al: Consistent ad-
Mace C, Moorey S, Roberts B (eds): Evidence in the Psycho- herence to guidelines improves opioid dependent pa-
logical Therapies: A Critical Guide for Practitioners. tients first year outcomes. J Behav Health Serv Res
Philadelphia, PA, Brunner Routledge, 2001 4:260271, 2007
National Health Service Centre for Reviews and Dissemina- Trinder L: Introduction: the context of evidence-based prac-
tion: Getting evidence into practice. Eff Health Care tice, in Evidence-Based Practice: A Critical Appraisal.
5(1):116, 1999 Edited by Trinder L, Reynolds S. Oxford, UK, Blackwell
Parry G: Evidence-based psychotherapy: an overview, in Ev- Scientific, 2000, pp 116
idence-Based Counseling and Psychological Therapies: U.S. Department of Health and Human Services: Mental
Research and Applications. Edited by Rowland N, Goss health: a report of the Surgeon General. Washington, DC,
S. Philadelphia, PA, Routledge, 2000, pp 5775 U.S. Department of Health and Human Services, 1999
Reynolds S: The anatomy of evidence-based practice: princi- U.S. Department of Veterans Affairs: Uniform mental health
ples and methods, in Evidence-Based Practice: A Critical services in VA medical centers and clinics. Available at:
Appraisal. Edited by Trinder L, Reynolds S. Oxford, UK, http://www.va.gov/vhapublications/ViewPublication.asp?
Blackwell Scientific, 2000, pp 1734 pub_ID=1762 (p 31). Accessed June 25, 2009
Rubin A: Practitioners Guide to Using Research for Evi- Yastrubetskaya O, Chiu E, OConnell S: Is good clinical re-
dence-Based Practice. New York, Wiley, 2007 search practice for clinical trials good clinical practice?
Sackett DL, Rosenberg WMC, Gray JAM, et al: Evidence- Int J Geriatr Psychiatry 12:227231, 1997
based medicine: what it is and what it isnt. BMJ 312:71 Young AS, Klap R, Sherbourne C, et al: The quality of care
72, 1996 for depressive and anxiety disorders in the United States.
Arch Gen Psychiatry 58:5563, 2001
This page intentionally left blank
2
13
14 How to Practice Evidence-Based Psychiatry
Step 4: Apply the Results to Your practitioners now have access to important data-
bases through the Internet. In Chapter 4, we discuss
Patient
how to assess these resources.
Assuming that the evidence that the clinician has The use of structured approaches to asking and
found is valid, important, applicable to his or her pa- answering questions can be an excellent approach to
tient, and feasible in the practice setting, the next teaching EBM.
step is to apply it to the care of the patient, which is For instance, the Chairmans Rounds at the De-
where clinical expertise is most important. partment of Psychiatry at Duke University has resi-
dents use the QUEST model (QUestion, Evaluate,
Step 5: Assess the Outcome and SynThesize) to address a clinical issue. For in-
stance, one of the grand rounds addressed the fol-
Step 5 includes an evaluation of the clinicians per- lowing issues: How do long-term medication and
formance in searching the literature and in finding behavioral treatments compare with each other?
an answer to the clinical question posed, as well as an Are there additional benefits when they are used
assessment of the patients response to treatment. together? What is the effectiveness of systematic,
carefully delivered treatments compared with rou-
Some Shortcuts tine community care? The resident then provided a
critical review of a randomized trial that addressed
Studies in academic settings have found that the full
that issue, which included a review of the study de-
5-step model can be incorporated into routine prac-
sign, with an assessment of validity, a discussion of
tice (Ball 1998; Del Mar and Glasziou 2001; Sackett
strengths and weaknesses, and the bottom line. The
et al. 2000). In nonacademic settings, however, prac-
grand rounds topics, indexed by diagnosis, can be
titioners frequently voice concerns that are related
found at http://psychiatry.mc.duke.edu/Residents/
to lack of time and information resources, as well as
Quest.html. Despite these shortcuts, there still will
to an inadequate knowledge of the EBM process
be questions that cannot be readily answered by the
(Ely et al. 2002; Haines and Donald 1998; Lipman
results of a previous search (or by the use of preap-
2000; McColl et al. 1998; Straus and McAlister
praised information resources). It is important,
2000; Trinder 2000; Young and Ward 2001).
therefore, that psychiatrists and other clinicians be
Several shortcuts can be taken to streamline the
able to carry out the full 5-step EBM process when
process and to make it more practical in everyday
necessary (Evans 2001; Gray 2002; Guyatt et al.
clinical practice. First, it is important to recognize
2000; R.B. Haynes 2001; Straus et al. 2002).
that a clinician does not have to go through the 5-step
process for every patient encounter. After a question
has been researched for one patient with a particular References
diagnosis, the answer can be applied to similar pa-
Ball C: Evidence-based medicine on the wards: report from
tients with the same diagnosis. In addition, because
an evidence-based minion. Evid Based Med 3:101103,
most patients of most clinicians fall into relatively few
1998
diagnostic categories, it soon becomes the excep- Del Mar CB, Glasziou PP: Ways of using evidence-based med-
tional patient who triggers the application of the full icine in general practice. Med J Aust 174:347350, 2001
5-step process. However, we believe it is important Ely JW, Osheroff JA, Ebell MH, et al: Obstacles to answering
for the practitioner to set aside some time on a rou- doctors questions about patient care with evidence:
tine basis to search the literature and review evidence. qualitative study. BMJ 324:710713, 2002
One way to keep up with the literature is to use Evans M: Creating knowledge management skills in primary
care residents: a description of a new pathway to evi-
preappraised information resources. Reviews, syn-
dence-based practice in the community. Evid Based Med
opses, and summaries are available that address
6:133134, 2001
many issues raised by clinicians. The BMJ group has Gray GE: Evidence-based medicine: an introduction for psy-
developed a whole set of tools to foster EBM (http:// chiatrists. J Psychiatr Pract 8:513, 2002
ebmh.bmj.com.). Some of these are available for free Guyatt GH, Meade MO, Jaeschke RZ, et al: Practitioners of
on the Internet, and others can be purchased. Most evidence based care. BMJ 320:954955, 2000
The 5-Step Evidence-Based Medicine Model 15
Haines A, Donald A: Getting research findings into practice: Straus SE, McAlister FA: Evidence-based medicine: a com-
making better use of research findings. BMJ 317:7275, mentary on common criticisms. CMAJ 163:837841,
1998 2000
Haynes RB: Of studies, summaries, synopses, and systems: Straus S, McAlister F, Cook D, et al: Expanded philosophy of
the 4S evolution of services for finding current best ev- evidence-based medicine: criticisms of evidence-based
idence. Evid Based Ment Health 4:3739, 2001 medicine, in Users Guides to the Medical Literature: A
Lipman T: Evidence-based practice in general practice and Manual for Evidence-Based Clinical Practice. Edited by
primary care, in Evidence-Based Practice: A Critical Ap- Guyatt G, Rennie D. Chicago, IL, AMA Press, 2002, pp
praisal. Edited by Trinder L, Reynolds S. Oxford, UK, 211222
Blackwell Scientific, 2000, pp 3565 Trinder L: A critical appraisal of evidence-based practice, in
McColl A, Smith H, White P, et al: General practitioners Evidence-Based Practice: A Critical Appraisal. Edited by
perception of the route to evidence based medicine: a Trinder L, Reynolds S. Oxford, UK, Blackwell Scientific,
questionnaire study. BMJ 316:361365, 1998 2000, pp 212241
Sackett DL, Straus SE, Richardson WS, et al: Evidence- Young JM, Ward JE: Evidence-based medicine in general
Based Medicine: How to Practice and Teach EBM, 2nd practice: beliefs and barriers among Australian GPs.
Edition. New York, Churchill Livingstone, 2000 J Eval Clin Pract 7:201210, 2001
This page intentionally left blank
3
E very clinical encounter generates questions. Foreground questions, in contrast, concern the cur-
Some of these require information that can be ob- rent best information on diagnosis, treatment, or
tained only from the patient or from a collateral prognosis of a disorder. Such questions are best an-
source, such as a friend or family member. Answers swered by the research literature, not by textbooks,
to such questions are unique to the particular patient because they involve information that is still in a
and concern that patients illness or situation. These state of flux as new knowledge is accumulated. Fore-
types of questions form the basis of a psychiatric in- ground questions are the most frequent type of
terview and are not the subject of this chapter. questions generated by senior residents or by prac-
ticing clinicians.
17
18 How to Practice Evidence-Based Psychiatry
TABLE 31. The 4-part PICO question For questions related to etiology, the interven-
tion is actually a risk factor. Here the comparison is
P: Patient or problem of interest
often implicit (i.e., the absence of that risk factor).
I: Intervention of interest Questions related to prognosis may be either 3-
Treatment or 4-part questions. A 3-part question might ask the
Diagnostic test
prognosis of patients with first-episode schizophre-
nia in general, whereas a 4-part question might ask
Risk factor
whether a particular patient characteristic (prognos-
Prognostic factor tic factor) alters the prognosis. Here, as in questions
C: Comparison related to etiology, the comparison can be implicit
(i.e., the absence of the particular prognostic factor).
Implicit or explicit
O: Outcome of interest
Outcome(s)
Positive or negative The fourth part of the question relates to the out-
come or outcomes of interest. Such outcomes can be
either positive (clinical improvement, remission, or
used as the starting point for the literature search,
survival) or negative (relapse, self-injury, or death).
the patient or problem should be defined with a de-
For questions involving diagnosis, the outcome is a
gree of specificity consistent with the way that study
measure of agreement between the two diagnostic
populations are defined. For example, if the clinician
methods.
is interested in the treatment of depression in
preadolescents, specifying that population as pre-
Examples of 4-Part PICO Questions
adolescents with major depression is preferable to
patients with major depression because there are Treatment
reasons to believe that the response to treatment Example of a 4-part question related to treatment:
might be different. However, if the clinician be-
comes overly specific and specifies 9-year-old Lat- In adult patients with schizophrenia, does the ad-
ino girls with a first episode of major depression and dition of cognitive-behavioral therapy to usual
care, compared with usual care alone, prevent re-
with a paternal but not maternal history of recurrent
lapse?
major depression, he or she may not be able to find
evidence that is specific to such a narrowly defined In this example, the patients are adult patients
population. with schizophrenia, the intervention is the addi-
tion of cognitive-behavioral therapy to usual care,
Intervention and Comparison the comparison is usual care alone, and the out-
Intervention can be a treatment or a diagnostic test. come is relapse.
Loosely defined, it can also refer to a risk factor or
prognostic factor. In most cases, the intervention of Diagnosis
interest will be compared with another intervention; Example of a 4-part question related to diagnosis:
in some cases, the comparison is explicit.
For questions related to treatment, the interven- In a primary care clinic population, is the self-
administration of a brief screening instrument as
tion can be either a specific medication or a psycho-
effective in identifying patients with major depres-
social intervention. The comparison can be another sion as is a structured brief clinical interview by a
active treatment, a placebo, or usual care. psychiatrist?
Diagnostic questions are usually questions re-
lated to the performance of a diagnostic test, screen- In this example, the patients are a primary care
ing instrument, or rating scale. The performance is clinic population, the intervention (diagnostic test)
usually compared with either a diagnostic gold is a self-administered brief screening instrument,
standard or outcome on a commonly used instru- the comparison (i.e., the gold standard) is a struc-
ment. Details of such comparisons are given in tured brief clinical interview by a psychiatrist, and
Chapter 9, Diagnostic Tests, in this volume. the outcome is a diagnosis of major depression.
Asking Answerable Questions 19
After formulating a question, the next step in the tional studies may give misleading results compared
evidence-based medicine (EBM) process is to search with RCTs (Lacchetti and Guyatt 2002). Whether
for the best evidence to answer it. However, before the observational studies over- or underestimate the
beginning a search for an answer to a clinical ques- effectiveness of a particular treatment or preventive
tion, it is important to understand the nature of the practice depends on the specific intervention being
question and the type of evidence that would best considered (Reeves et al. 2001).
address it. As an example of the use of an evidence hierarchy
for questions related to treatment (Table 41), re-
sults from a systematic review of RCTs should be
What Type of Evidence Is Best? given more weight than the results from a single
Some experts propose that certain types of research RCT, and results from an RCT should be given
results should be given more weight than other types more weight than results from uncontrolled or non-
(Badenoch and Heneghan 2002; Phillips et al. 2001). experimental studies. Thus, if a literature search
In this model, types of evidence are put on a hierar- produces a systematic review of RCTs, several indi-
chy with systematic reviews of randomized con- vidual RCTs, case reports, and an editorial, the cli-
trolled trials (RCTs) being the best source of nician should rely on the systematic review because
evidence and expert opinion the worst (see Table 4 it is likely to be highest in the evidence hierarchy.
1). The specific hierarchy depends on the type of However, one well-designed and conducted clinical
clinical question being asked. Table 41 presents the trial with an adequate number of subjects followed
evidence hierarchy for studies of therapy or harm. up for a long time might very well provide much bet-
Types of evidence higher in the hierarchy are more ter evidence than that provided by analyzing results
apt to give a valid and unbiased estimate of the effect from many poorly conducted, short-term trials.
of an intervention than are those lower in the hier-
archy. When attempting to answer a clinical ques- Expert Opinion
tion, the clinician should always rely on the evidence In the original publication (Gray 2004), expert opin-
found that is highest in the hierarchy or in other ion was listed, in Table 41, below case series as the
ways determined to be the best evidence available. worst source of evidence on the basis that some stud-
These hierarchies of evidence have been vali- ies have suggested that expert opinion does not nec-
dated by comparing results obtained from studies essarily reflect the best evidence found in the
that addressed the same question but used different literature (Antman et al. 1992) and may be influ-
designs. In studies of a variety of therapies, for ex- enced by personal gain or benefit from the recom-
ample, it has repeatedly been shown that observa- mendations. On the other hand, experts are often
21
22 How to Practice Evidence-Based Psychiatry
TABLE 41. Hierarchy of evidence for that results in, or has the appearance of resulting in,
studies of therapy or harm personal, organizational, or professional gain (www.
icmje.org/#conflicts). The assumption is that the
Quality Type of evidence declaration of conflict of interest allows the reader to
1a (best) Systematic review of RCTs be aware that the experts judgment may be clouded
and makes the expert less likely to be affected by
1b Individual RCT with narrow confidence
interval whatever conflict he or she has. This assumption has
never been proven and is likely to be incorrect.
1c All-or-none case series
Conflicts of interest can exist in all aspects of eval-
2a Systematic review of cohort studies uating evidence. Lets assume that Dr. T and three
2b Individual cohort study colleagues submit a review of the early effect of se-
RCT with <80% follow-up lective serotonin reuptake inhibitors on depression
to the Archives of General Psychiatry. Before the arti-
2c Outcomes research
cle is accepted, each author is required to disclose
Ecological study all potential conflicts of interest, including specific
3a Systematic review of case-control studies financial interests and relationships and affiliations
3b Individual case-control study
(other than those affiliations listed on the title page
of the manuscript) relevant to the subject of their
4 (worst) Case series
manuscript (http://archpsyc.ama-assn.org). Au-
Note. RCT =randomized controlled trial. thors are instructed to err on the side of full disclo-
Source. Adapted from Gray 2004; Phillips et al. 2001; Sack- sure and should contact the editorial office if they
ett et al. 2000.
have questions or concerns. All such disclosures
should be listed in the Acknowledgments section at
used to write systematic reviews, perform meta- the end of the manuscript. Authors without conflicts
analyses, construct guidelines, and recommend best of interest, including specific financial interests and
practices. Thus, expert opinion influences all relationships and affiliations relevant to the subject
sources of information and is a valuable and neces- of their manuscript, should include a statement of
sary source of information on how to choose treat- no such interest in the Acknowledgments section of
ments. Expert opinion should not, however, be the manuscript. In addition, authors are expected
considered fact unless the expert has provided to provide detailed information about all relevant fi-
strong evidence for that opinion. Furthermore, the nancial interests and relationships or financial con-
expertise and bias of the experts should be consid- flicts within the past 5 years and for the foreseeable
ered in judging their recommendations in all sources future (e.g., employment/affiliation; grants or fund-
of evidence-based psychiatry practice (EBPP). ing; consultancies; honoraria; stock ownership or
Experts are considered to be individuals with con- options; expert testimony; royalties; patents filed,
siderable knowledge about a subject. Experts are received, or pending; or donation of medical equip-
called on to write guidelines, reviews, and synopses ment), particularly those present at the time the re-
and to provide opinions about treatments. In judging search was conducted and through publication, as
expert opinion, one must consider both the persons well as other financial interests (such as patent appli-
level of expertise and how biased his or her judgment cations in preparation) that represent potential fu-
is likely to be about the issue at hand. A biased opin- ture financial gain (http://archpsyc.ama-assn.org).
ion is not necessarily bad. An experts strong convic- Now suppose that the lead author, a well-known
tion about a treatment he or she has studied or depression researcher, has received honoraria from
developed may be appropriate. However, the expert several pharmaceutical companies and attended
must reassure the reader that his or her interpreta- meetings sponsored by drug companies. The second
tion of the evidence base is influenced by this bias. author, also a well-known researcher, has received
In medical publishing, journals now require au- funding for research and consulting, speakers fees,
thors to declare any conflicts of interest they might and travel expenses from a variety of companies that
have. A conflict of interest is often defined as an ac- manufacture antidepressant drugs. The third author
tual or a perceived interest by an expert in an action has received grants from pharmaceutical companies
Searching for Answers 23
and from the government. The fourth author is an financial, professional, or other personal gain or loss
adviser to several pharmaceutical companies. for you, members of your household, or employer.
Now suppose that the same authors report no fi- The author or reviewer needs to answer this in rela-
nancial conflicts of interest. Which publication tion to employment, research grants, other research
would one have more confidence in and why? support, speakers bureau, honoraria, ownership in-
Would you trust a positive outcome from the second terest, consultation/advisory board, or other. The
group more than from the first and a negative out- instructions note that A relationship is considered
come from the first more than from the second? In to be Significant if (a) the person receives $10,000
practice, this information about conflict of interests or more during any 12 month period, or 5% or more
is not very helpful in judging an article. The first set of the persons gross income; or (b) the person owns
of authors might have a level of expertise that allows 5% or more of the voting stock or share of the entity,
them to interpret the database more accurately than or owns $10,000 or more of the fair market value of
does the second. The second group may have many the entity. A relationship is considered to be Mod-
conflicts but of a different nature. For instance, they est if it is less than Significant from the preceding
may have a bias against the pharmaceutical industry definition. Such relationships are important to dis-
or the use of medications. It is necessary to report close, but more importantly, the authors or review-
such conflicts, but the mere reporting does not re- ers should be asked to note that their opinions are
ally help the reader determine whether the analysis based on an unbiased assessment of the facts. In
is unbiased. (The example is derived from an actual practice, it is often very difficult to evaluate the ex-
article: see Taylor et al. 2006.) pertise of the expert.
The same issues apply to reviewers of articles. A
reviewer is just as likely as an author to have conflicts The 5S Approach to Searching
of interest. For instance, reviewers are sometimes
selected by looking at the publications at the end of
for Answers
an article. Are reviewers likely to accept papers that Although many clinicians begin their search with
support their own ideas or support the conven- MEDLINE, this is a relatively inefficient strategy
tional wisdom and to reject ideas that go against because it typically identifies numerous articles that
their own ideas or conventional wisdom? Is this bias must then be individually reviewed for validity. A
less serious than that of an investigator who might more efficient approach is the hierarchical 5S
have some financial gain in a product because he or strategy developed by Haynes (2001a, 2001b, 2006),
she holds some shares of the company that produces which involves systems, summaries, synopses, syntheses,
it? Coyle, the editor of the Archives of General Psychi- and studies (Table 42). At the top of the list are sys-
atry, notes: It would not be reasonable to banish tems, by which Haynes means very detailed, often
from the ARCHIVES all authors and reviewers who patient-specific data sources, which link the patients
have perceived financial conflicts of interest. This conditions to current best practices. Summaries inte-
strategy would exclude important clinical research grate the best available evidence to provide a full
and scientific expertise from these pages (Coyle and range of evidence addressing all management op-
Heckers 2006). tions for a given health problem, not just one aspect
The American Heart Association attempts to ad- of the problem as found in single-study resources
dress the issue of conflict of interest quite broadly. that make up the lower three categories in the 5S
For instance, members of writing groups are asked model. Synopses are very brief descriptions of origi-
to identify all relationships within the last 2 years nal articles and reviews. They can be found under
that are relevant to the topic of the manuscript. A search terms such as meta-analyses. Syntheses are usu-
relationship is relevant if the relationship or inter- ally called systematic reviews in the research liter-
est relates to the topic of the manuscript in terms of ature. Some databases allow you to limit search
any of the following: the same or similar subject results by using that term in the search strategy. Sin-
matter or topic; the same, similar, or competing gle studies are the original journal articles that
drug or device, product or service, intellectual prop- present the entire report of one study on one aspect
erty or asset; a drug or device company or its com- or management of a health problem. The distinc-
petitor; or has the reasonable potential to result in tions between these categories are somewhat arbi-
24 How to Practice Evidence-Based Psychiatry
Type of information
resource Examples Web site
Systems Electronic records linked to
patient guidelines and other
evidence
Summaries American Psychiatric http://www.psychiatryonline.com
Association Practice
Guidelines
National Guideline http://www.guideline.gov
Clearinghouse
Clinical Evidence http://clinicalevidence.bmj.com
PIER (Physicians Information http://pier.acponline.org/index.html
and Education Resource)
National electronic Library for http://www.library.nhs.uk/mentalhealth
Mental Health
TRIP http://www.tripdatabase.com
PubMed http://www.ncbi.nlm.nih.gov/sites/entrez?db=pubmed
Google Scholar http://scholar.google.com
Evidence-based textbooks and
journals
Synopses Evidence-Based Mental Health http://ebmh.bmj.com
(abstracts/summaries)
ACP Journal Club http://www.acpjc.org
PubMed http://www.ncbi.nlm.nih.gov/sites/entrez?db=pubmed
Database of Abstracts of Reviews http://www.crd.york.ac.uk/crdweb
of Effects (DARE)
Syntheses Cochrane Database of http://www.cochrane.org/reviews
(systematic reviews) Systematic Reviews
DARE http://www.crd.york.ac.uk/crdweb
Studies PubMed http://www.ncbi.nlm.nih.gov/sites/entrez?db=pubmed
Google Scholar http://scholar.google.com
Cochrane Central Register of http://www.mrw.interscience.wiley.com
Controlled Trials
National Institutes of Health http://www.clinicaltrials.gov
clinical trials
Source. Adapted from Gray 2004; Haynes 2001a, 2000b, 2006.
trary, and searches in any one category often result practicing in settings with an electronic medical
in finding articles or outcomes in all of the catego- record system may be able to link their patients char-
ries listed in Table 42. acteristics with current evidence-based guidelines
In the 5S strategy, priority is given to sources of for care within that system. If such a system is not
high-quality, preappraised information so that the available, he recommends that the clinicians then be-
clinician can omit the appraisal step (step 3) in the gin to look for summaries. Table 42 lists many
EBM process. Haynes (2006) noted that clinicians sources of summaries, discussed later in this chapter.
Searching for Answers 25
If no summaries, guidelines, algorithms, or other relevant medical knowledge for treatment decisions
more comprehensive and systematic reviews are (http://clinicalevidence.bmj.com). Clinical Evidence
available, Haynes recommends that the clinician then attempts to provide clinically useful information by
look for brief summaries and synopses over lengthier also including a comments section with recom-
reviews, assuming that a busy clinician wants an an- mended options, allowing for interactions among us-
swer as quickly and effortlessly as possible. Although ers. Clinical Evidence uses Cochrane reviews as a
this strategy is appropriate for quickly answering source of high-quality, systematic reviews but also
clinical questions in a practice setting, it is not neces- uses reviews of primary studies and reviews of re-
sarily the most appropriate strategy for performing a views. Reviews are updated annually with a new
comprehensive search of the clinical literature. planned systematic search of databases and include
frequent updating through Clinical Evidence Updates
Systems (www.bmjupdates.com). BMJ provides online access,
a printed handbook, and a version for a personal dig-
The starting point for the search should be what
ital assistant (PDA). The reviews may cover issues re-
Haynes (2006) has termed a system, an information
lated to an intervention or condition. For instance,
source that covers a variety of diagnoses, provides a
the review of smoking cessation (Putting Evidence
summary of the results of high-quality systematic
Into Practice: Smoking Cessation; available as a
reviews, and is frequently updated. Such a system
PDF file at: www.clinicalevidence.bmj .com/ceweb/
would provide the user with a concise summary of
resources/index.jsp) provides information on smok-
the evidence, linked to the original studies. Some
ing rates, the disease burden from smoking and
clinicians have access to electronic medical record
health benefits of cessation, predictors of quitting
systems with a computerized decision support sys-
and maintained cessation, public policy on smoking,
tem that can link a patients characteristics to current
and interventions.
evidence-based guidelines for care. For instance, the
Another emerging and important source of EBM
Clinical Research Information System (CRIS) used
is PIER (the Physicians Information and Education
at Duke University, according to their Web site,
Resource). Unfortunately, PIER is only available to
provides all of the tools to seamlessly allow clinicians
American College of Physicians (2009; ACP) mem-
to use standard measures to assess patients. This in-
bers, although some reviews can be accessed online
formation can be used to establish and enforce clin-
through the ACP Journal Club (www.acpjc.org). The
ical practices and guidelines. Many systems are
ACP Journal Club (Haynes 2008) is designed to keep
developing quality assessment metrics that monitor
clinicians up to date, but articles may be relevant to
aggregate outcomes related to preestablished stan-
an issue a clinician is researching.
dards. In theory, the standards and the practices that
The United Kingdoms National Health Service
lead to them are evidence based.
offers an online evidence-based mental health li-
brary (NeLMH 2009). This library is collabora-
Summaries (Including Guidelines, tively produced by a core team working for the
Algorithms, and Best Practices) library with assistance from core groups, including
Many resources are available to help clinicians rap- the Centre for Evidence-Based Medicine (www
idly find evidence-based information. We have ar- .cebm.net), the Centre for Evidence-Based Mental
bitrarily divided these into resources of clinical Health (www.cebmh.com), the Royal College of
evidence, clinical guidelines, and algorithms. Psychiatrists, the University of Oxford Department
of Psychiatry, and the World Health Organization
Clinical Evidence United Kingdom Collaborating Centre. For in-
The BMJ Publishing Group has several publica- stance, the Schizophrenia Annual Evidence Update
tions, products, and activities to promote evidence 2008 (Mental Health Specialist Library 2008) brings
medicine. BMJ s Clinical Evidence is an international together evidence-based guidelines, systematic re-
peer-reviewed journal that publishes systematic re- views, important primary research, service develop-
views of important clinical conditions. The reviews ment literature, and patient information.
are frequently updated with the goal of providing The TRIP Database (www.tripdatabase.com) be-
busy clinicians with access to the very latest and most gan in 1997 with the goal of answering real clinical
26 How to Practice Evidence-Based Psychiatry
questions using the principles of EBM. The TRIP ical practice guidelines and algorithms can be found
Database includes a variety of resources that can in Gray and Taylor, Chapter 7 in this volume.)
be easily searched. The results can be filtered by Most American psychiatrists are familiar with the
systematic reviews, evidence-based synopses, guide- practice guidelines developed by the American Psy-
lines, clinical questions, core-primary research, chiatric Association (APA). These guidelines cover
e-textbooks, and others. the major psychiatric disorders and are available
both in print form (American Psychiatric Associa-
Clinical Practice Guidelines and Algorithms tion 2006) and online (www.psychiatryonline.com).
Table 43 lists major guidelines and algorithms
available to practitioners. Online access to these may Synopses
require registration and payment. The most useful If you have no access to a system and found no re-
starting point in searching for these guidelines is the sults from the summaries, the next step is to search
National Guideline Clearinghouse (www.guide- for what Haynes (2001a, 2001b, 2006) has termed
line.gov). This database of clinical practice guide- synopses, structured abstracts of high-quality system-
lines is operated by the Agency for Healthcare atic reviews or original articles. The advantages of
Research and Quality (AHRQ), in association with these resources are that they have already been ap-
the American Medical Association (AMA) and the praised for quality and are summarized; therefore,
American Association of Health Plans (AAHP). All busy clinicians can quickly get to the bottom line
guidelines must meet explicit quality criteria for in- without reading a lengthy article. Furthermore,
clusion (Agency for Healthcare Research and Qual- these synopses can be accessed through online data-
ity 2000). Searching the database yields a structured bases that can be searched quickly. Because these da-
abstract that is linked to the actual guideline. The tabases contain summaries of only those articles that
database also allows several guidelines to be com- meet certain quality criteria, they are much smaller
pared side by side. (General information about clin- than MEDLINE and yield fewer references.
Library, which provided a November 18, 2002, re- possible hepatotoxicity; and 22 possible systematic re-
view that concluded the following: views, including those mentioned earlier. SUM-
Search also included several articles from Wikipedia
Systematic literature database. Twenty-two that seemed irrelevant to the issue of efficacy and
potentially relevant double-blind, placebo- safety. However, we found this ready reference to
controlled RCTs were identified. Twelve trials
things such as kava production rather interesting.
met the inclusion criteria. The meta-analysis of
seven trials suggests a significant treatment effect
for the total score on the Hamilton Anxiety Scale Google Scholar
in favor of kava extract. Few adverse events were The Google Scholar search produced 3,210 articles
reported in the reviewed trials, which were all
in 0.09 seconds. However, it included (at the top)
mild, transient and infrequent. These data imply
that, compared with placebo, kava extract might
many older and nonrelevant articles.
be an effective symptomatic treatment for anxiety
although, at present, the size of the effect seems to PubMed
be small. Rigorous trials with large sample sizes Finally, we ran a search on PubMed. It produced
are needed to clarify the existing uncertainties.
many of the same articles but also some that we had
Particularly long-term safety studies of kava are
needed. not seen in other searches.
The third step is to go to clinical guidelines. How- another option. Although expert opinion is at the
ever, these higher-level approaches may not answer bottom of the evidence hierarchy, it is still better
more specific questions. The guidelines had to be re- than nothing. Finally, EBM retains a place for clin-
viewed to find statements about kava, for instance. ical judgment (Haynes et al. 2002a, 2002b). In the
A quick look at SUMSearch and/or TRIP is absence of evidence from the literature, clinical
worthwhile. The final step in our search would be judgment becomes even more important.
PubMed. This allows for a very quick perusal of in-
formation. Table 45 outlines this approach. References
Agency for Healthcare Research and Quality: The National
Inability to Find an Answer Guideline Clearinghouse fact sheet [Agency for Health-
There are three general reasons for not finding an an- care Research and Quality Web site]. July 2000. Available
at: http://www.ahcpr.gov/clinic/ngcfact.htm. Accessed
swer to a clinical question. The first reason has to do
June 18, 2002
with the mechanics of the search process. Changing American College of Physicians: PIER: Physicians Informa-
the search terms, searching by MeSH heading as well tion and Education Resource. 2009. Available at: http://
as text words, and other techniques described in more pier.acponline.org/index.html. Accessed June 25, 2009
detail elsewhere (Greenhalgh 1997, 2001; McKibbon American Psychiatric Association: Practice guideline for the
et al. 1999, 2002) may be of value if this is the case. treatment of patients with schizophrenia, 2nd edition, in
The second reason has to do with the nature of the Practice Guidelines for the Treatment of Psychiatric
question itself. Perhaps the patient population speci- Disorders, Compendium. Washington, DC, American
Psychiatric Association, 2006, pp 565746
fied in the question is overly specific. Broadening the
American Psychiatric Association: Practice Guidelines for the
patient population in the question may result in the Treatment of Psychiatric Disorders, Compendium. Wash-
search yielding a possible answer. The problem then ington, DC, American Psychiatric Association, 2006
becomes one of deciding whether that answer can be Antes G, Oxman AD: The Cochrane Collaboration in the
generalized to a particular patient. This is a topic dis- 20th century, in Systematic Reviews in Health Care:
cussed in more detail in subsequent chapters. Meta-Analysis in Context. Edited by Egger M, Smith
The third reason for not finding an answer is ei- GD, Altman DG. London, BMJ Books, 2001, pp 447458
ther that the evidence does not exist or that the only Antman EM, Lau J, Kupelnick B, et al: A comparison of re-
sults of meta-analyses of randomized control trials and
evidence is relatively unreliable. The search strate-
recommendations of clinical experts: treatments for my-
gies outlined earlier tend to find evidence that is ocardial infarction. JAMA 268:240248, 1992
high in the evidence hierarchy (Table 41). If such Badenoch D, Heneghan C: Evidence-Based Medicine Tool-
high-quality evidence does not exist, it is necessary kit. London, BMJ Books, 2002
to search for evidence lower in the hierarchy. This CINAHL [Edward G. Miner Library Web site]. 2002a.
can be done through PubMed, by changing the Available at: http://www.urmc.rochester.edu/Miner/
search filters in the Clinical Queries interface from Educ/ebnfilt.htm. Accessed June 27, 2003
specificity to sensitivity, or by doing a MED- Clinical Research Information System (CRIS). Available at:
http://psychiatry.mc.duke .e du/CM RIS/CMR In-
LINE search without filters. Such strategies may re-
dex.htm. Accessed December 2, 2008
sult in lower-quality evidence, such as case series or Cochrane Collaboration: Introductory leaflets. Available at:
case reports. In some cases, this may represent the http://www.cochrane.org/cochrane/leaflet.htm. May 15,
best available evidence. Obtaining consultation is 2003. Accessed June 25, 2008
Searching for Answers 33
Coyle JT, Heckers S: Update on the conflict of interest policy McKibbon A, Eady A, Marks S: PDQ Evidence-Based Prin-
for the ARCHIVES. Arch Gen Psychiatry 63:1178, 2006 ciples and Practice. Hamilton, ON, Canada, BC Decker,
Davidoff F, Haynes B, Sackett D, et al: Evidence based med- 1999
icine. BMJ 310:10851086, 1995 McKibbon A, Hunt D, Richardson WS, et al: Finding the ev-
Etchells E: Ovid. ACP J Club 132:A15, 2000 idence, in Users Guides to the Medical Literature: A
Glanville J, Lefebvre C: Identifying systematic reviews: key Manual for Evidence-Based Clinical Practice. Edited by
resources. Evid Based Ment Health 3:6869, 2000 Guyatt G, Rennie D. Chicago, IL, AMA Press, 2002, pp
Gray GE: Concise Guide to Evidence-Based Psychiatry. 247265
Washington, DC, American Psychiatric Publishing, National electronic Library for Health (NeLMH): NHS Ev-
2004 idencemental health. July 2002. Available at: http://
Greenhalgh T: How to read a paper: the Medline database. www.library.nhs.uk/MentalHealth. Accessed June 25,
BMJ 315:180183, 1997 2009
Greenhalgh T: How to Read a Paper: The Basics of Evidence National Health Service Centre for Reviews and Dissemina-
Based Medicine, 2nd Edition. London, BMJ Books, 2001 tion (DARE): Available at: http://www.crd.york.ac.uk/
Greenhalgh T, Peacock R: Effectiveness and efficiency of crdweb. Accessed June 25, 2009
search methods in systematic reviews of complex evi- National Library for Health: The Mental Health Specialist
dence: audit of primary sources. BMJ 331(7524):1064 Library. 2008. Available at: http://www.library.nhs.uk/
1065, 2005 mentalhealth. Accessed June 25, 2009
Haase A, Follmann M, Skipka G, et al: Developing search Phillips B, Ball C, Sackett D, et al: Levels of evidence [Centre
strategies for clinical practice guidelines in SUMSearch for Evidence-Based Medicine Web site]. May 2001.
and Google Scholar and assessing their retrieval perfor- Available at: http://www.cebm.net/levels_of_evidence.asp.
mance. BMC Med Res Methodol 7:28, 2007 Accessed June 27, 2003
Haynes RB: Of studies, summaries, synopses, and systems: Pittler MH, Ernst E: Kava extract for treating anxiety. Co-
the 4S evolution of services for finding current best ev- chrane Database Syst Rev (1):CD003383, 2003
idence. Evid Based Ment Health 4:3739, 2001a Rathod S, Kingdon D, Weiden P, et al: Cognitive-behavioral
Haynes RB: Of studies, syntheses, synopses, and systems: the therapy for medication-resistant schizophrenia: a review.
4S evolution of services for finding current best evi- J Psychiatr Pract 14:2233, 2008
dence. ACP J Club 134:A11A13, 2001b Reeves BC, MacLehose RR, Harvey IM, et al: A review of ob-
Haynes RB: Of studies, syntheses, synopses, summaries, and servational, quasi-experimental and randomised study de-
systems: the 5S evolution of information services for signs for the evaluation of the effectiveness of healthcare
evidence-based healthcare decisions. Evid Based Med interventions, in The Advanced Handbook of Methods in
11:162164, 2006 Evidence Based Healthcare. Edited by Stevens A, Abrams
Haynes RB: ACP Journal Club: the best new evidence for pa- K, Brazier J, et al. London, Sage, 2001, pp 116135
tient care. ACP J Club 148:2, 2008 Sackett DL, Straus SE, Richardson WS, et al: Evidence-
Haynes RB, Devereaux PJ, Guyatt GH: Clinical expertise in Based Medicine: How to Practice and Teach EBM, 2nd
the era of evidence-based medicine and patient choice. Edition. New York, Churchill Livingstone, 2000
ACP J Club 136:A11A14, 2002a Saeed SA, Bloch RM, Antonacci DJ: Herbal and dietary sup-
Haynes RB, Devereaux PJ, Guyatt GH: Physicians and pa- plements for treatment of anxiety disorders. Am Fam
tients choices in evidence based practice. BMJ 324:1350, Physician 76:549556, 2007
2002b Shojania KG, Berg LA: Taking advantage of the explosion of
Haynes RB, McKibbon KA, Wilczynski NL, et al: Optimal systematic reviews: an efficient MEDLINE search strat-
search strategies for retrieving scientifically strong stud- egy. Eff Clin Pract 4:157162, 2001
ies of treatment from Medline: analytical survey. BMJ Taylor MJ, Freemantle N, Geddes JR, et al: Early onset of se-
330(7501):1179, 2005 lective serotonin reuptake inhibitor antidepressant ac-
Jones C, Cormac I, Silveira da Mota Neto JI, et al: Cognitive tion: systematic review and meta-analysis. Arch Gen
behaviour therapy for schizophrenia. Cochrane Database Psychiatry 63:12171223, 2006
Syst Rev 2004 Oct 18;(4):CD000524 van der Watt G, Laugharne J, Janca A: Complementary and
Lacchetti C, Guyatt G: Therapy and validity: surprising re- alternative medicine in the treatment of anxiety and de-
sults of randomized controlled trials, in Users Guides to pression. Curr Opin Psychiatry 21:3742, 2008
the Medical Literature: A Manual for Evidence-Based Wilczynski NL, Haynes RB, Lavis JN, et al: Optimal search
Clinical Practice. Edited by Guyatt G, Rennie D. Chi- strategies for detecting health services research studies in
cago, IL, AMA Press, 2002, pp 1347 MEDLINE. CMAJ 171:11791185, 2004
This page intentionally left blank
5
Clinical Trials
Gregory E. Gray, M.D., Ph.D.
C. Barr Taylor, M.D.
After identifying one or more articles or other re- to a therapy when it was, in fact, the result of spon-
sources to answer a clinical question, the next step in taneous improvement. Published single case reports
the evidence-based medicine (EBM) process is to have the added problem of publication bias: clini-
appraise the evidence. In this chapter and in Chap- cians are more apt to report their successes with a
ters 6, 7, and 912 in this volume, guidance on ap- novel treatment than they are their failures (Easter-
praising a variety of different types of evidence is brook et al. 1991; Fletcher et al. 1996; Montori and
provided. Guyatt 2002; Song et al. 2001). Although a single
Because questions about therapy are among those case report might result in a hypothesis that is later
most frequently asked by clinicians, we begin with a tested in a clinical trial, such reports cannot be relied
discussion of individual studies of therapies. In on to guide treatment (Fletcher et al. 1996; Hennek-
Chapter 6, Gray focuses on the appraisal of system- ens et al. 1987; Sackett et al. 1991). Single case re-
atic reviews of therapies, whereas in Chapter 7, Gray ports may be more useful, however, in alerting a
and Taylor focus on the appraisal of treatment clinician to possible adverse effects of a treatment,
guidelines. although even here the adverse event may be unre-
lated to the treatment (i.e., coincidental). In the psy-
chological literature, single case studies (different
Controlled Versus
from reports) have been used to generate hypotheses
Uncontrolled Trials about potentially useful treatments. One model for a
Evidence about the effectiveness of a therapy can single case design is to use an ABAB approach, in
come from a variety of sources (Table 51). How- which a baseline is obtained (A), followed by an in-
ever, evidence from some types of studies is apt to be tervention period (B), a return to baseline (A), and
more biased and misleading than evidence from then a reintroduction of the intervention (B).
more rigorous study designs (Greenhalgh 2001;
Guyatt 2002; Guyatt et al. 2002b; Lacchetti and Case Series
Guyatt 2002), as explained in this section. A case series is only slightly better than a single case
report (Fletcher et al. 1996). Here the author re-
Single Case Reports ports on a series of patients treated for a particular
The least rigorous and potentially most biased type condition. Because patients are not enrolled in a for-
of evidence is that arising from a single case (Fletcher mal study, it is difficult to know whether the results
et al. 1996; Sackett et al. 1991). As clinicians, we like reflect all patients receiving a particular therapy or
to believe that patients improve as a result of our ef- whether they reflect only the successes. As with sin-
forts. We sometimes attribute patient improvement gle case reports, publication bias is a significant
35
36 How to Practice Evidence-Based Psychiatry
TABLE 51. Types of studies used to various factors can bias the results. These factors
address treatment include the Hawthorne, experimenter expectancy
effectiveness (Pygmalion), and placebo effects; observer bias; re-
gression toward the mean (Yudkin and Stratton
Uncontrolled studies
1996); and the natural history of the illness (Fletcher
Single case reports et al. 1996).
Case series
All-or-none case seriesa Historical Controls
Uncontrolled clinical trials Because improvement can occur spontaneously, as
well as being a result of treatment, more convincing
Controlled studies
evidence about the effectiveness of a therapy comes
Studies with historical controls from controlled trials. However, various control
Studies with concurrent nonrandomized controls groups are sometimes used in clinical trials (Altman
Patients of other physicians or clinical sites 1991; Bland 2000; Fletcher et al. 1996). The first
type is a historical control. In this situation, the out-
Patient or physician choice of treatment
comes of the patients receiving the experimental
Systematic allocation therapy in the trial are compared with the outcomes
Randomized controlled trialsa of the patients with the same disorder and in the
same treatment setting but who have received an-
With blindinga
other therapy in the past. An example is the com-
Without blinding (open-label study) parison of the lengths of stay of inpatients with
a
Strongest study designs. schizophrenia treated with atypical antipsychotic
medications with those of inpatients with schizo-
problem in case series, and they are best regarded as phrenia treated in the same institution a decade
a source of ideas for further study. earlier, prior to the introduction of atypical antipsy-
A particular type of case series, however, does chotic medications. Although the use of historical
rank high in the evidence hierarchy: the all-or- controls might be convenient, the results can be bi-
none case series (Badenoch and Heneghan 2002) ased by changes in diagnostic criteria, patient acuity
(Table 41, Chapter 4). An all-or-none case series and demographics, and other aspects of care that
refers to a series of patients who receive treatment may have occurred over time (Fletcher et al. 1996;
for a disease with a universally bad (usually fatal) Hennekens et al. 1987). Furthermore, information
outcome. If a new treatment leads to a better out- about the historical control group typically comes
come in all of the patients treated, there is strong ev- from medical records recorded for purposes other
idence of treatment effectiveness. Examples of such than research, whereas the information about pa-
an all-or-none case series are some of the earliest re- tients receiving the experimental therapy is collected
ports of the effectiveness of antibiotics in treating with the purpose of the study in mind. This differ-
infections, which were performed 6 decades ago. It ence in the type of information collected is a form of
is difficult, however, to think of a psychiatric disor- observer bias (Daly and Bourke 2000). As a result,
der for which an all-or-none case series would be an clinical trials using historical controls often may pro-
appropriate study design. vide misleading answers and generally overestimate
the true treatment effectiveness (Altman 1991; Bland
2000; Everitt 1989; Fletcher et al. 1996).
Uncontrolled Clinical Trials
An uncontrolled clinical trial is a step up from a case
series. In this study design, patients enrolled in the Nonrandomized Clinical Trials
study receive the new treatment, but there is no con- In other types of nonrandomized clinical trials, sub-
trol group. Unlike in a case series, there is a study jects are nonrandomly assigned to one or more ther-
protocol in an uncontrolled clinical trial that speci- apies (Altman 1991; Bland 2000; Fletcher et al.
fies the nature of the subjects, treatment, and out- 1996). Examples include studies comparing treat-
come measures. Because no control group is used, ments at one clinic with treatments at another clinic
Clinical Trials 37
fects. The Hawthorne effect was first observed in improvement (Chaput de Saintonge and Herx-
studies of worker productivity at the Hawthorne heimer 1994; Crow et al. 2001). The magnitude of
Western Electric plant in Illinois in 1924 and refers the placebo response rate varies by disorder; it is
to the tendency of subjects to do better solely be- greater in depression and anxiety disorders than in
cause they are being studied (Fletcher et al. 1996; schizophrenia, but even in acute mania, there is a
Holden 2001). Some of this may involve subject ex- sizable placebo response (Charney et al. 2002) (Ta-
pectations, but it can also be the result of nonspecific ble 52). To separate the specific effects of a therapy
effects of the study situation, such as the increased from the nonspecific placebo effects, it is necessary
attention received. The Hawthorne effect is one to have a control group. Blinding the patient to the
reason that studies involving historical controls will therapy being administered further reduces the pla-
produce biased results: experimental subjects know cebo effect (Altman et al. 2001; Guyatt 2002), al-
that they are part of a study, and they therefore show though this is far more difficult with psychosocial
the Hawthorne effect, whereas historical control interventions than with drug therapies.
subjects were not originally experimental subjects
and hence did not show such an effect. The Haw- Observer, Detection, or Ascertainment Bias
thorne effect affects both the experimental and the The final important source of bias in a clinical trial is
control groups in an RCT and thus is eliminated as a observer, detection, or ascertainment bias (Altman
source of bias in this study design. et al. 2001; Jadad 1998; Jni et al. 2001). If an inter-
viewer or rater knows which treatment a patient is
Pygmalion Effect and Co-interventions receiving, he or she may differentially inquire about
The Pygmalion effect, also called the experimenter certain symptoms or see improvement where none
expectancy effect, was first described in educational re- exists. Blinding the interviewer or rater to the treat-
search, in which it was found that teacher expecta- ment is an important way of minimizing observer
tions affect pupil performance (Rosenthal and bias (Altman et al. 2001; Guyatt 2002; Jni et al.
Jacobson 1968). Subsequent research has indicated 2001); however, it is difficult to do this entirely
that experimenter expectations regarding treatment because the treatment received sometimes may be
effect may result in differential attention or interac- discerned from treatment side effects or from a pa-
tions with some subjects, which results in a change tients comments.
in subject behavior in the direction of experimenter
hypothesis (Rosenthal and Rosnow 1991). A related Minimizing Bias Through Blinding
effect is that of a clinician involved in a trial provid- To minimize sources of bias, the optimal study de-
ing additional care (e.g., time, support) to patients in sign is an RCT in which the subjects, clinicians, and
one treatment group but not to those in the other raters are all blind to the treatment being adminis-
treatment group. This effect is known as co-interven- tered. This is possible in drug trials; however, in
tion or performance bias (Altman et al. 2001; Fletcher many trials involving psychosocial interventions,
et al. 1996; Guyatt 2002; Jni et al. 2001). In clinical only the rater can be blinded. The terms single blind,
trials, this effect can be minimized by blinding clini- double blind, and triple blind are often used to describe
cians to the treatment being provided. Such blinding the design type of a study, but there is little agree-
can occur in drug trials; however, such blinding is ment about the meaning of the terms (Devereaux et
obviously impossible in trials of psychotherapy. It al. 2001; Montori et al. 2002). Consequently, it is
can, however, be minimized by documenting adher- preferable to simply specify which of the various
ence to treatment protocols (Guyatt 2002). participants in a study are blinded to the treatment
(Altman et al. 2001; Devereaux et al. 2002; Fletcher
Placebo Effect et al. 1996).
The third nonspecific effect is the placebo effect
(Crow et al. 2001; Kaptchuk 1998; Laporte and
Figueras 1994). In this effect, it is the subjects ex-
Basic Statistical Concepts
pectation of improvement, combined with other In reviewing the results of a clinical trial, it is impor-
nonspecific psychotherapeutic effects, that leads to tant to have at least a basic understanding of biosta-
Clinical Trials 39
Placebo
response
Disorder Outcome measure Study duration rate (%)
Schizophrenia, acute episode 40% reduction in BPRS 6 weeks 832
Schizophrenia, maintenance No relapse 9 months 34
Bipolar disorder, acute mania 50% reduction in YMRS 3 weeks 24
Bipolar disorder, maintenance No relapse 2 years 19
Major depression 50% reduction in Ham-D 424 weeks (average 6 weeks) 30
Panic disorder 50% decrease in attacks 12 weeks 50
Social phobia Much or very much improved 814 weeks 1732
Obsessive-compulsive disorder 35% reduction in Y-BOCS 913 weeks 860
Note. BPRS=Brief Psychiatric Rating Scale; Ham-D= Hamilton Rating Scale for Depression; Y-BOCS=Yale-Brown Obses-
sive Compulsive Scale; YMRS= Young Mania Rating Scale.
Source. Data from Cookson et al. 2002; Walsh et al. 2002; Woods et al. 2001.
tistics. The following qualitative discussion does not The results of this clinical trial also can be con-
discuss specific methods of statistical analysis or cal- ceptualized as falling into one of three categories:
culations; for such topics, the reader is referred to uncontrolled studies, controlled but not randomized
several excellent texts (Altman 1991; Bland 2000; studies, and randomized controlled trials (Table 53).
Daly and Bourke 2000). In reality, the experimental and control treatments
are either equivalent or different. In our experiment,
Hypothesis Testing either the difference exceeds the preset threshold
We begin with a hypothetical clinical trial compar- and is considered statistically significant or it does
ing an experimental therapy with a control therapy. not. Let us now consider some of the various com-
In this trial, participants are randomly assigned to binations.
one of two treatment groups. At the end of the trial,
we assess the outcome in the two groups and find a Type I Errors
difference. How do we know whether this difference If there is truly no difference between the experimen-
is because the treatments differ in effectiveness or tal and the control treatments, our experiment, by
whether it is the result of chance? We know that even chance alone, might find a difference large enough to
if the two treatments are identical, by chance alone be called statistically significant. This is the equiv-
there could be some difference in outcome. We alent of a false-positive result on a diagnostic test. In
therefore need to set a threshold, with differences in statistical terms, it is considered a type I error. In the
outcome greater than that threshold unlikely to be example in the previous subsection, the threshold has
the result of chance alone. Conventionally, this been set so that a type I error occurs less than 5% of
threshold is set so that there is a 5% chance that a dif- the time. In statistical terms, it is represented as
ference of that magnitude (or greater) will be the re- =0.05, where is the probability of a type I error.
sult of chance alone. In practice, an appropriate test
statistic (e.g., t, F, or 2) is computed, from which a P Type II Errors
value is derived. If P< 0.05, the difference is consid- Now suppose that a difference truly exists between
ered statistically significant. This approach to data the two treatments. In our experiment, sometimes
analysis is referred to as hypothesis testing, in that a dif- we find a large difference between the treatment
ference in treatment effect that exceeds a threshold groups, and sometimes, by chance alone, we may
leads us to reject the null hypothesis that there is no find only a small difference. Because we have set a
difference between treatments. threshold such that only differences that exceed the
40 How to Practice Evidence-Based Psychiatry
threshold are considered statistically significant, some exceeds a threshold is said to reject the null hypoth-
of the results may not be considered significant, even esis that there is no difference between treatments.
though there is truly an underlying difference in the Such an approach focuses on P values and statistical
effectiveness of the two treatments. This is consid- significance, but it largely ignores the magnitude of
ered a type II error and is the equivalent of a false- any difference found (Sterne and Smith 2001).
negative result from a diagnostic test. The probabil- An alternative approach that has become popular
ity of a type II error occurring is represented by . in recent years involves confidence intervals (CIs)
(Gardner and Altman 2000). In this approach, the
Power difference in treatment effectiveness between
groups in the clinical trial is used to construct a CI. If
Ideally, we would like to have a high probability of
a 95% CI is constructed, it implies that there is a
detecting a difference when such a difference truly
95% chance that the true difference in effectiveness
exists. This is the equivalent of a true-positive test re-
lies within that interval. An interval that does not
sult. Such a probability is given the term power and is
include zero is the equivalent of rejecting the null
represented by 1 minus .
hypothesis (i.e., the equivalent of a statistically sig-
The magnitude of the treatment effect needed for
nificant result).
it to be considered statistically significant is deter-
There are several advantages to using CIs instead
mined by the variability of the results and by the
of hypothesis testing (Gardner and Altman 2000;
number of subjects studied. The more variable the
Guyatt et al. 2002c). First, CIs provide a range in
data, the larger the difference that must be obtained;
which the true treatment effectiveness is expected,
the larger the number of subjects, the smaller the
with a narrow CI implying a precise estimate of
treatment difference needed for statistical signifi-
treatment effectiveness. Second, in negative studies
cance. The same is true regarding the power of the
in which the null hypothesis is not rejected, CIs may
experiment to detect a real treatment effect: the
suggest that a clinically important difference is
more variable the data, the larger the number of sub-
present but that the power of the study to detect it
jects required. In general, small studies often lack
was too low. There is a difference, for example, be-
the power to detect clinically significant differences
tween a wide CI that barely overlaps zero and a nar-
in treatment effectiveness; for that reason, such
row CI that centers on zero. In the first case, the
studies are considered by some to be unethical (Col-
width suggests that the study was too small to pro-
lins and MacMahon 2001; Halpern et al. 2002).
vide a precise estimate and that a large treatment dif-
ference cannot be excluded. In the second case, the
Confidence Intervals estimate is quite precise and implies that any differ-
The approach to data analysis that has been summa- ence that exists is too small to be clinically impor-
rized thus far is the classical approach of hypothesis tant. Finally, CIs are useful in systematic reviews and
testing, in which a difference in treatment effect that meta-analyses (see Gray, Chapter 6 in this volume).
Clinical Trials 41
in the second example; however, both examples yield Number Needed to Treat
the same RR. The measure believed by many to be the best ex-
pression of relative treatment effectiveness is num-
Relative Risk Reduction ber needed to treat (NNT) (Cook and Sackett 1995;
Relative risk reduction (RRR) is calculated with the Jaeschke et al. 2002; Laupacis et al. 1988; Sackett
formulas (CER EER)/CER or RRR =1 RR. Using et al. 1991, 2000; Szatmari 1998). NNT is simply
the data in Table 54, RRR = 0.2/0.6 = 0.33, which the reciprocal of the ARR. In our example, NNT =
means that the nonresponse rate was decreased by 1/0.2 = 5, which means that for every five patients
one-third. Like RR, RRR varies between 0 and 1 for treated with medication, there will be one less case
effective treatments; however, in this case, larger of nonresponse than if all patients had received the
values (i.e., values closer to 1) indicate a more effec- control treatment. Put another way, for every five
tive treatment. RRR has the same limitations as RR. patients treated with medication, there will be one
additional patient who responds to medication who
would not have responded to the placebo. The cal-
Odds Ratio
culation of CIs for NNT is given by Altman (1998)
The odds ratio (OR) is a measure of treatment effect
and can be found in Appendix B.
that is similar to RR. The odds of an event occurring
NNT is believed by most clinical epidemiologists
are expressed as the ratio of the probability of the
to be the least misleading and the most clinically
event occurring to the probability of the event not
useful measure of treatment effectiveness, although
occurring. In our example, the odds of nonresponse
patients sometimes have difficulty understanding
are 1.5 (or 60 to 40) in the placebo group and 0.67
the concept (Kristiansen et al. 2002). Inclusion of
(or 40 to 60) in an experimental group. The OR is
NNT in the reporting of the results of clinical trials
simply the ratio of the odds of a bad outcome in the
is recommended in the Consolidated Standards
experimental group divided by the odds of a bad out-
of Reporting Trials (CONSORT) guidelines (Alt-
come in a control group: 0.67/1.5= 0.45. As with RR,
man et al. 2001; Begg et al. 1996) (statement avail-
for effective treatments, the OR varies between 0
able at www.consort-statement.org). Despite this
and 1, smaller values being associated with a greater
recommendation, relatively few trials report NNTs
treatment effect. The OR is often used as an effect
(Nuovo et al. 2002), so it is often necessary for the
measure in meta-analyses because of its statistical
reader to go through the calculations himself or her-
properties (Deeks and Altman 2001).
self with the data presented in a published article.
Examples of NNTs for common therapies for
Absolute Risk Reduction psychiatric disorders are given in Table 55. As can
Absolute risk reduction (ARR) is simply the differ- be seen, most psychiatric therapies have NNTs in
ence between the CER and the EER. Using the data the range of 3 to 6, which means that for every three
from Table 54, ARR = 60% 40% = 20%, which to six patients treated, there is one good outcome
means that 20% fewer patients taking medication that would not otherwise have occurred. For com-
failed to respond; conversely, 20% more patients parative purposes, in a 5-week follow-up of patients
taking medication responded. Because this is an with acute myocardial infusion, using death as an
absolute (not relative) measure, it can be used to es- outcome measure, streptokinase infusion had an
timate the percentage of patients undergoing treat- NNT of 15; in a 5.5-year follow-up of patients with
ment who will benefit more from the experimental moderate hypertension (diastolic blood pressures of
treatment than from the control treatment. ARR for 90109 mm Hg), using death, stroke, and myocar-
effective treatments varies from 0% to 100% (or 0 dial infarction as outcomes, antihypertensive drugs
and 1, if not expressed as a percentage), with larger had an NNT of 128 (Sackett et al. 2000). Hence psy-
values indicating more effective treatments. Unlike chotropic medications are relatively effective when
RR and RRR, ARR provides a measure of how many compared with other classes of drugs used in medi-
patients receiving treatment will benefit from it and cine. As another example, Citrome (2008) used
thus avoids some of the limitations of these prior NNT to compare new treatments for depression,
measures. schizophrenia, and bipolar disorder.
Clinical Trials 43
TABLE 55. Examples of number needed to treat (NNT) for common psychiatric disorders
and treatments
Critical Appraisal Guide for effective in nonrandomized trials being much less
effective or ineffective in randomized studies, al-
Therapy Studies
though this is not always the case (Ioannidis et al.
In this section of the chapter, we introduce a struc- 2001; Kunz and Oxman 1998; Lacchetti and Guyatt
tured approach to the critical appraisal of therapy 2002). Of equal importance, however, is that the al-
studies, which is mirrored in subsequent chapters that location list is concealed. There have been some in-
deal with other types of studies. The guidelines for stances in which investigators have been able to
appraisal of therapy studies are found in Table 56. determine the assignment of the next patient to be
enrolled and have used that information to system-
Is the Study Valid? atically enroll sicker patients into one treatment
Before considering the results of a study, one must group (Altman and Schulz 2001). In addition, stud-
first focus on its Methods section to assess the ies comparing trials in which allocation was con-
studys validity. The first question to ask is whether cealed with those in which it was not concealed have
the study was randomized with a concealed random- found important differences in the size of the treat-
ization list. Randomization minimizes bias that ment effect (Altman and Schulz 2001; Jni et al.
might result from patients with different prognoses 2001; Kunz and Oxman 1998; Lacchetti and Guyatt
being enrolled in either the experimental or the con- 2002; Schulz 2000).
trol treatment group (Altman et al. 2001; Collins The next question to ask is whether subjects and
and MacMahon 2001; Fletcher et al. 1996; Jni et al. clinicians were blinded to the treatment that was ad-
2001; Lacchetti and Guyatt 2002; Sackett et al. ministered. As noted earlier, blinding represents an
1991, 2000). Studies comparing randomized and attempt to prevent observer bias, placebo effects,
nonrandomized trials of the same therapies have and experimenter expectancy effects from being re-
noted several instances of therapies that seemed sponsible for any observed difference between the
44 How to Practice Evidence-Based Psychiatry
experimental and the control groups. In general, Accounting for all subjects is made easier when a
nonblinded studies overestimate the true treatment flow diagram of subject progress through the phases
effect size (Jni et al. 2001; Schulz 2000). Third, one of a randomized trial is included in the article, as
should check whether all subjects who entered the suggested by the CONSORT guidelines (Altman
trial were accounted for at its conclusion and whether et al. 2001; Moher et al. 2001). This is important
they were analyzed in the groups to which they had because substantial loss of subjects to follow-up can
been randomly assigned. seriously bias the results, an effect referred to as
In 1993, 30 experts, including medical journal ed- attrition bias (Guyatt and Devereaux 2002; Jni et al.
itors, clinical trialists, epidemiologists, and method- 2001). It is sometimes stated that at least 80% fol-
ologists, met with the aim of developing a new scale low-up is sufficient for the results to be valid
to assess the quality of RCT reports. However, dur- (Streiner and Geddes 2001), although other authors
ing preliminary discussions, participants thought argue that this rule of thumb is misleading (Guyatt
that many of the suggested scale items were irrele- et al. 2002a). Intention-to-treat analysis, which in-
vant because they were not regularly reported by au- cludes data on patients who did not complete the
thors. In fact, accumulating evidence indicated that trial in their assigned group, is the preferred method
the quality of reports of RCTs was unsatisfactory of analyzing the data, although the method has lim-
(Altman and Dor 1990; Pocock et al. 1987). There- itations (Altman et al. 2001; Collins and MacMahon
fore, the group began to focus on ways to improve 2001; Guyatt and Devereaux 2002; Guyatt et al.
the reporting of RCTs, which resulted in recom- 2002a; Jni et al. 2001; Streiner and Geddes 2001).
mendations for the standardized reporting of clini- Many journals now require clinical trials to
cal trials (Working Group on Recommendations for include a CONSORT flowchart (available at www
Reporting of Clinical Trials in the Biomedical Lit- .consort-statement.org/index.aspx?o=1031) and to
erature 1994). In 2001, the group created the CON- provide evidence that issues raised in the CON-
SORT Statement (www.consort-statement.org) to SORT statement have been followed.
help authors improve reporting of two parallel- Many clinical trials are now available through
design RCTs by using a checklist and flow diagram www.clinicaltrials.gov, which includes more than
(Altman et al. 2001). 62,000 trials from 157 countries. To be registered, the
Clinical Trials 45
trial sponsor needs to complete a detailed description tient. The first is whether the treatment is consistent
of the study. The interested reader can find how to with the patients values and preferences. The sec-
register a trial at http://prsinfo.clinicaltrials.gov. Trial ond is whether the treatment is feasible in the clini-
registries acceptable to the Archives of General Psychi- cians setting. Assuming that the clinician has
atry include www.clinicaltrials.gov, http://isrctn.org, identified a valid study which has found an effective
http://actr.org.au, http://trialregister.nl, and www.umin treatment that can be applied to his or her patient,
.ac.jp/ctr. the next steps in the EBM process (Table 21, Chap-
Finally, clinicians should determine whether other ter 2) are to apply the treatment and then to evaluate
differences between the control and the experimental the outcome.
groups could bias the results. For example: Despite
randomization, were there significant differences be-
Industry-Sponsored Trials
tween the two groups at the start of the trial that
could have affected the outcome (i.e., confounding)? Industry-sponsored trials are a major source of in-
Aside from the experimental treatment, were the formation about the effectiveness of new medica-
groups treated equally (i.e., no co-intervention)? tions. A recent review of 397 articles published over
Only after the validity has been appraised should 3 years in four psychiatric journals found that 60%
one turn to the results. After all, if the results are not were industry supported (Perlis et al. 2005). Aston-
valid, it does not matter what they show. ishingly, a systematic review of drug treatments of
insomnia by the Agency for Healthcare Research
and Quality found that all but 5 of 56 RCTs were ap-
Are the Results Important?
parently funded by the industry (Buscemi et al.
When reviewing the results of a study, clinicians
2007). Industry-sponsored trials accounted for most
should give some thought as to what would be con-
of the results used in the meta-analysis, and results
sidered a clinically significant outcome measure-
from the meta-analysis were used to make evidence-
ment. As noted earlier, these are often dichotomous
based treatment recommendations.
outcome measures, and NNT should be calculated
From a marketing standpoint, pharmaceutical
if it is not given in the results.
companies are interested in showing that their prod-
uct is equally as effective as competing medications
Can the Results Be Applied to Other Patients? or may have advantages, such as fewer side effects
The final step in the appraisal process is to assess (M. Angell 2004; Safer 2002). New medications also
whether the study results can be applied to other pa- must be shown to be safe. The long-standing con-
tients. Several considerations enter into this assess- cerns about the role of industry in sponsoring trials
ment. First, is the patient so different from the and presenting biased results were fueled by two ar-
patients in the studies that the results do not apply? ticles that showed that many publications related to
The question here can be reframed as: Is the patho- a new cyclooxygenase (COX) inhibitor attributed
biology of this patient so different from that of the primarily or solely to academic investigators were
study patients that the results cannot apply? In gen- actually written by the sponsoring pharmaceutical
eral, the answer to this question is no (Sackett et company or medical publishing companies hired by
al. 1991, 2000; Straus and McAlister 2001). How- the company (Ross et al. 2008) and that the sponsor-
ever, quantitative differences may apply. In particu- ing pharmaceutical company manipulated the data
lar, if a patients likelihood of improving without the analysis in two clinical trials to minimize the in-
experimental treatment is greater than that of the creased mortality associated with the drug (Psaty
patients in the study, then the patient will receive and Kronmal 2008). According to several authors,
less benefit from the treatment than expected, ac- bias in the way industry-sponsored research is con-
cording to the calculated NNT (Sackett et al. 2000). ducted and reported is not unusual (Angell 2004,
Methods of calculating NNT related to outcomes 2008; DeAngelis and Fontanarosa 2008). Because of
can be found in Appendix B. Furukawa et al. (2002) the importance of the role of industry-sponsored re-
confirmed the validity of this approach. search in establishing the database often used to
Two additional questions must be asked before generate evidence-based guidelines, we review this
the clinician applies the treatment to his or her pa- issue in detail in this chapter.
46 How to Practice Evidence-Based Psychiatry
Safer (2002) identified several ways that pharma- TABLE 57. Study design issues that can
ceutical companies can bias the interpretation of the bias the outcome of a study
effects of their medication (see Table 57). comparing two medications
Using a dose of the comparable drug that is outside of
Using Doses Outside the Usual Range for the standard clinical range
Competitive Advantage
Altering the usual dosing schedule of the competing
If a new medication is compared with an older med- drug
ication prescribed at a higher-than-usual dose and a
Using misleading research measurement scales
dose associated with more side effects, then patients
taking the older medication will be less likely to con- Selecting end points post hoc
tinue taking it. For instance, Safer (2002) noted that Masking unfavorable side effects
at least eight industry-sponsored trials have com-
Repeatedly publishing the same or similar findings
pared a second-generation neuroleptic drug to a
fixed high dose of haloperidol (20 mg) or to a halo- Selectively highlighting findings favorable to the
sponsor
peridol dose averaging > 20 mg/day. Doses of halo-
peridol exceeding the customary levels of 410 mg/ Editorializing in the abstract
day may not produce better clinical results than do Publishing the obvious
doses greater than that range, but they induce more Engaging in statistical obfuscation
extrapyramidal side effects (EPS) and lead to far
Selecting subjects and a time frame designed to
more treatment dropouts. Comparing a newer neu-
achieve a favorable outcome
roleptic with an older one used at a very high dose
also can make the newer medication appear to have Withholding unfavorable results
lower rates of EPS. However, one might argue that a Using masked sponsorship
high dose of the medication used for comparison Source. Adapted from Safer 2002.
may ensure that patients receive an adequate dose.
impression that the medication was not associated
Substantially Altering the Dose Schedule of with EPS. Alternatively, a nonstandard criterion for
the Comparison Drug for Competitive interpreting the outcome from a measurement can
Advantage be misleading.
Industry-sponsored studies comparing two antide-
pressant drugs may schedule an unusually rapid and Selecting the Major Findings and
substantial dose increase in the one not manufactured End Points Post Hoc
by the sponsoring company (Safer 2002). Doses and Safer (2002) noted that some industry-sponsored
dose schedules beyond the usual range, particularly trials select the end points post hoc. Doing so opens
early in treatment, may bring an increased rate of side the door to fishing for results favorable to the
effects. In studies comparing side effects of a new medication. For instance, Jureidini and Tonkin
medication with those of an older one, use of a rela- (2003) argued that in a study of the effects of parox-
tively low dose of the new medication may minimize etine on reducing depression, the authors changed
the side effects of the new medication compared with the predetermined criteria to a criterion that seemed
the older one. In judging any industry-sponsored to favor the medication. However, Keller et al.
trial, the reader should assess whether the protocol (2003) responded to Jureidini and Tonkins criticism
follows standard dosing and if not, why not. by arguing that the field had since considered some
of the secondary measures as better than those ini-
Using Self-Serving Measurement Scales and tially proposed. The CONSORT guidelines require
Making Misleading Conclusions From that the primary analyses be specified in advance and
Measurement Findings followed up in part to avoid such problems. Never-
In early studies of risperidone, the investigations theless, secondary, exploratory analyses can provide
used a measure of the worst extrapyramidal symp- important clues that need to be confirmed with ran-
toms score, which Safer (2002) argued creates the domized studies.
Clinical Trials 47
done that compared the same set of agents (risperi- called black-box warning that all antidepressants
done and olanzapine), the two medications were pose significant risks of suicidality in children and
found to be not different on 33 of 37 efficacy mea- adolescents and that children and adults taking anti-
sures, including the a priori primary end points of depressants should be watched closely for increased
the study, yet the abstract emphasized the greater ef- suicidal thinking or behavior (U.S. Food and Drug
ficacy of risperidone (Tandon 2006). Administration 2004). The warning immediately
generated controversy in addition to opening dis-
Caveat Emptor cussion on more general issues of the FDAs role in
In recent years, the rise of clinical trial registries, the drug safety.
requirement that studies meet prespecified stan- One researcher believed that the focus for report-
dards to be included in medical reviews, the adop- ing should be on the pharmaceutical industry:
tion of the CONSORT standards, and the emphasis
by medical publishers to address issues like those Why was it left to regulatory bodies to publicize
the lack of effectiveness of paroxetine and ven-
raised earlier may have reduced potential bias in tri-
lafaxine? The single published placebo controlled
als, including those sponsored by the pharmaceuti- trial concluded that paroxetine was effective and
cal industry. Nevertheless, the practitioner should safe in adolescent depression. But none of the
be very alert to the potential for bias, particularly large negative trials (2 each for paroxetine and
given the influence of pharmaceutical representa- venlafaxine) were published, a phenomenon that
tives in medical education. Dr. Daniel Carlat (2007) undermines evidence-based medicine. Pharma-
ceutical companies seeking regulatory approval
described how he had been recruited, as a respected are obliged to make the results of all clinical trials
practitioner, to give drug talks and how difficult he they sponsor available to regulatory agencies.
found it to question the evidence he had been given However, there is no requirement for these results
to present. to be published or even made available to investi-
gators. Those researchers, including myself, who
did see results of negative paroxetine industry tri-
Antidepressants and Suicide Risk
als were prohibited by nondisclosure contracts
The recent controversy about the potential risk of from discussing them. (Garland 2004)
antidepressants increasing suicidal ideation or risk in
adolescents illustrates some of the complex issues re- The black-box warning was controversial from
lated to evaluating evidence. We include it here, in the outset. Several organizations and researchers be-
part because the role of the pharmaceutical industry gan to re-review both the efficacy and the risk of anti-
has been highlighted, but also to illustrate many of depressants used in children and adolescents. In
the limitations of the knowledge base used in evi- 2003, the American College of Neuropharmacology
dence-based psychiatry practice. (ACNP) convened a task force to evaluate the evi-
The possibility that antidepressant medications, dence for safety of SSRIs in youths, including re-
especially SSRIs, increase the risk of suicidal behav- viewing published clinical trials and data from the
ior was first raised in several case reports of children U.K. Medicines and Healthcare Products Regula-
and adults during the early 1990s (King et al. 1991; tory Agency (MHRA), as well as FDA analyses and
Rothschild and Locke 1991; Teicher et al. 1990). In reports made public online (Hammad 2004). The
2003, the U.K. Department of Health warned phy- review by the ACNP concluded that fluoxetine is
sicians against prescribing any SSRI antidepressant effective in treating depression in children and ado-
drug except fluoxetine for depressed youths younger lescents (Mann et al. 2006). The task force also ad-
than 18 years. In 2003, the FDA was also concerned dressed the relation between SSRIs and suicidal
about this risk and announced that it was reviewing behavior in youths. The FDAs meta-analyses of the
a possible increased rate of suicidal behavior in adverse event report data pooled across all drugs in-
youths taking paroxetine hydrochloride (U.S. Food dicated that there was a statistically significant ele-
and Drug Administration 2003). The FDA recom- vation (about twofold) in risk of suicidality for
mended that paroxetine not be used in children and antidepressants relative to placebo (Hammad 2004).
adolescents for the treatment of major depressive However, the ACNP report did not find convincing
disorder. On October 15, 2004, the FDA issued a so- evidence that SSRIs increased the suicide rate in
Clinical Trials 49
youths. The World Psychiatric Association (Mller males, the suicide rate decreased by 1.8% between
et al. 2008) undertook an extensive review of the 2004 and 2005 (7.13 to 7.00 per 100,000), rates of
database and concluded that antidepressants, in- suicide in 2004 and 2005 were still significantly
cluding SSRIs, carry a small risk of inducing suicidal greater than predicted by the 19962003 trend
thoughts and suicide attempts, in age groups below (2004 95% prediction interval [PI] 5.906.90; 2005
25 years. 95% PI 5.636.66). The rate of suicide for females
Klein (2006) argued that the FDA relied on a ages 1019 years decreased by 16.7% between 2004
poorly defined surrogate measure of completed and 2005 (2.22 to 1.85 per 100,000); both 2004 and
suicide and noted that the validation of surrogate 2005 rates were significantly greater than the ex-
measures is very difficult when used to predict very pected rates (2004 95% PI 1.181.67; 2005 95% PI
rare events. He also noted that a major potential 1.111.62). Although a reduction in antidepressant
source of information of medicationsthat is, of use needs to be considered as one factor, Bridge et al.
their use postmarketingis deeply flawed because (2008) note:
it can rely on a few events (such as completed sui-
cides) without considering the more complicated Studies to identify causal agents are important
epidemiologic issues that would provide a more ac- next steps. These studies should involve compre-
hensive assessment of individual-level exposure
curate position of risk (e.g., what is the relative risk
and outcome data, as aggregate data alone cannot
in the population). establish causal links. Possible factors to consider
Posner et al. (2007) have developed the Columbia include changes in the prevalence of known risk
Classification Algorithm of Suicide Assessment (C- factors (e.g., alcohol use, access to firearms), the
CASA) to classify suicidal events in terms of sui- influence of Internet social networks, higher rates
cidal ideation, preparation toward suicide attempt, of untreated depression in the wake of recent
boxed warnings on antidepressants and increases
or completed suicide. In an analysis of 25 pediatric in suicide among US troops, some being older ad-
antidepressant trials, they found that the system was olescents.
reliable. The FDA safety analysis of the risk of sui-
cidality in a depressed pediatric sample that used The ACNP task force recommended the contin-
these C-CASA ratings (Hammad et al. 2006) found ued use of fluoxetine as an effective and readily avail-
reduced risk estimates when compared with earlier able treatment for major depression in youth suicide,
FDA estimates that relied on the pharmaceutical la- suicidal thinking, and plans for suicide. They also
bel. The practitioner faced with the evidence en- recommended that ongoing monitoring of suicidal
counters a very complicated and confusing issue. thoughts in patients taking antidepressants is neces-
The warnings had an effect on reducing antide- sary.
pressant use (Olfson et al. 2008). During the pre- The American Academy of Child and Adolescent
warning study period, a 36.0% per year (P < 0.001) Psychiatry (AACAP) urged the FDA not to issue a
increase in total youth (ages 617 years) antidepres- black-box warning against the use of all antidepres-
sant use was reported, which was followed by de- sants for the treatment of depression in children and
creases of 0.8% per year (P = 0.85) and 9.6% per year adolescents, noting that Efficacy and safety data on
(P= 0.21) during the paroxetine and black-box warn- pediatric antidepressant use has been the subject of
ing study periods, respectively. The difference in ongoing review. The research and its reviews show
trends between the prewarning and the paroxetine efficacy, while the signal for the risks of increased
warning periods was significant (P< 0.001). Paroxe- suicidal thinking and self-harm events is not strong
tine use in young people also significantly increased and can be monitored (Sarles 2004). AACAP and
during the prewarning study period (30.0% per the American Psychiatric Association (n.d.) also is-
year; P <0.001) before significantly declining during sued guidelines for physicians related to this recom-
the paroxetine warning study period (44.2% per mendation.
year; P < 0.001) (Olfson et al. 2008). What is the truth about the risk-benefit ratio of
There has been a more recent concern about antidepressant use in depressed children and adoles-
raised suicide rates in adolescents (Bridge et al. cents? Are antidepressants beyond fluoxetine effec-
2008). For males and females, ages 1019, rates of tive in reducing depressive symptoms in children? In
suicide increased from 2003 to 2004. Although for adolescents? Do they increase suicidal thoughts?
50 How to Practice Evidence-Based Psychiatry
Behaviors? Completed events? Is the reduction in Citrome L: Compelling or irrelevant? Using number needed
antidepressant use responsible for the rise in suicide to treat can help decide. Acta Psychiatr Scand 117:412
rates in recent years? The uncertainty of the answers 419, 2008
Collins R, MacMahon S: Reliable assessment of the effects of
to these questions reflects the limits of evidence-
treatment on mortality and major morbidity, I: clinical
based practice and the challenges to the practitioner trials. Lancet 357:373380, 2001
in using evidence-based recommendations. Cook RJ, Sackett DL: The number needed to treat: a clini-
cally useful measure of treatment effect. BMJ 310:452
454, 1995
References Cookson J, Taylor D, Katona C: The Use of Drugs in Psy-
Altman DG: Practical Statistics for Medical Research. Boca chiatry: The Evidence From Psychopharmacology, 5th
Raton, FL, Chapman & Hall, 1991 Edition. London, Gaskell, 2002
Altman DG: Confidence intervals for the number needed to Crow R, Gage H, Hampson S, et al: The placebo effect:
treat. BMJ 317:13091312, 1998 methodological process and implications of a structured
Altman DG, Dor CJ: Randomisation and baseline compar- review, in The Advanced Handbook of Methods in Evi-
isons in clinical trials. Lancet 335:149153, 1990 dence Based Healthcare. Edited by Stevens A, Abrams K,
Altman DG, Schulz KF: Statistics notes: concealing treat- Brazier J, et al. London, Sage, 2001, pp 7389
ment allocation in randomised trials. BMJ 323:446447, Cummings SR, Grady D, Hulley SB: Designing an experi-
2001 ment: clinical trials I, in Designing Clinical Research,
Altman DG, Schulz KF, Moher D, et al: The revised CON- 2nd Edition. Edited by Hulley SB, Cummings SR,
SORT statement for reporting randomized trials: explana- Browner WS, et al. Philadelphia, PA, Lippincott Wil-
tion and elaboration. Ann Intern Med 134:663694, 2001 liams & Wilkins, 2001, pp 143155
American Psychiatric Association (APA), American Academy Daly LE, Bourke GJ: Interpretation and Uses of Medical Sta-
of Child and Adolescent Psychiatry (AACAP): The use of tistics, 5th Edition. Oxford, UK, Blackwell Scientific,
medication in treating childhood and adolescent depres- 2000
sion: information for physicians. n.d. Available at: http:// DeAngelis CD, Fontanarosa PB: Impugning the integrity of
www.parentsmedguide.org/physiciansmedguide.pdf. medical science: the adverse effects of industry influence.
Accessed June 8, 2009 JAMA 299:18331835, 2008
Angell A: The Truth About the Drug Companies: How They Deeks JJ, Altman DG: Effect measures for meta-analysis of
Deceive Us and What to Do About It. New York, Ran- trials with binary outcomes, in Systematic Reviews in
dom House, 2004 Health Care: Meta-Analyses in Context, 2nd Edition.
Angell A: Industry-sponsored clinical research: a broken sys- Edited by Egger M, Smith GD, Altman DG. London,
tem. JAMA 300:10691071, 2008 BMJ Books, 2001, pp 313335
Badenoch D, Heneghan C: Evidence-Based Medicine Tool- Devereaux PJ, Manns BJ, Ghali WA, et al: Physician inter-
kit. London, BMJ Books, 2002 pretations and textbook definitions of blinding terminol-
Begg C, Cho M, Eastwood S, et al: Improving the quality of ogy in randomized controlled trials. JAMA 285:2000
reporting of randomized controlled trials: the CON- 2003, 2001
SORT statement. JAMA 276:637639, 1996 Devereaux PJ, Bhandari M, Montori VM, et al: Double
Bland M: An Introduction to Medical Statistics, 3rd Edition. blind, you have been voted off the island! Evid Based
Oxford, UK, Oxford University Press, 2000 Ment Health 5:3637, 2002
Bridge JA, Greenhouse JB, Weldon AH, et al: Suicide trends Easterbrook PJ, Berlin JA, Gopalan R, et al: Publication bias
among youths aged 10 to 19 years in the United States, in clinical research. Lancet 337:867872, 1991
19962005. JAMA 300:10251026, 2008 Everitt BS: Statistical Methods for Medical Investigations.
Buscemi N, Vandermeer B, Friesen C, et al: The efficacy and New York, Oxford University Press, 1989
safety of drug treatments for chronic insomnia in adults: Fletcher RH, Fletcher SW, Wagner EH: Clinical Epidemi-
a meta-analysis of RCTs. J Gen Intern Med 22:1335 ology: The Essentials, 3rd Edition. Baltimore, MD, Wil-
1350, 2007 liams & Wilkins, 1996
Carlat D: Dr. Drug Rep. The New York Times Magazine, Furukawa TA, Guyatt GA, Griffith LE: Can we individualize
November 25, 2007 the number needed to treat? An empirical study of
Chaput de Saintonge DM, Herxheimer A: Harnessing pla- summary effect measures in meta-analyses. Int J Epide-
cebo effects in health care. Lancet 344:995998, 1994 miol 31:7276, 2002
Charney DS, Nemeroff CB, Lewis L, et al: National Depres- Gardner MJ, Altman DG: Confidence intervals rather than P
sive and Manic-Depressive Association consensus state- values, in Statistics With Confidence, 2nd Edition. Ed-
ment on the use of placebo in clinical trials of mood ited by Altman DG, Machin D, Bryant TN, et al. Lon-
disorders. Arch Gen Psychiatry 59:262270, 2002 don, BMJ Books, 2000, pp 1527
Clinical Trials 51
Garland EJ: Facing the evidence: antidepressant treatment in Huston P, Moher D: Redundancy, disaggregation, and the
children and adolescents. CMAJ 170:489491, 2004 integrity of medical research. Lancet 347:10241026,
Geddes J, Butler R: Depressive disorders. Clin Evid 6:726 1996
742, 2001 Ioannidis JPA, Haidich A-B, Pappa M, et al: Comparison of
Gray GE: Evidence-based medicine: an introduction for psy- evidence of treatment effects in randomized and nonran-
chiatrists. J Psychiatr Pract 8:513, 2002 domized studies. JAMA 286:821830, 2001
Gray GE: Concise Guide to Evidence-Based Psychiatry. Jadad A: Randomised Controlled Trials. London, BMJ
Washington, DC, American Psychiatric Publishing, 2004 Books, 1998
Greenhalgh T: How to Read a Paper: The Basics of Evidence Jaeschke R, Guyatt G, Barratt A: Therapy and understanding
Based Medicine, 2nd Edition. London, BMJ Books, 2001 the results: measures of association, in Users Guides to
Guyatt G: Therapy and harm: why study results mislead the Medical Literature: A Manual for Evidence-Based
bias and random error, in Users Guides to the Medical Clinical Practice. Edited by Guyatt G, Rennie D. Chi-
Literature: A Manual for Evidence-Based Clinical Prac- cago, IL, AMA Press, 2002, pp 351368
tice. Edited by Guyatt G, Rennie D. Chicago, IL, AMA Jni P, Altman DG, Egger M: Systematic reviews in health
Press, 2002, pp 223231 care: assessing the quality of controlled clinical trials.
Guyatt G, Devereaux PJ: Therapy and validity: the principle BMJ 323:4246, 2001
of intention-to-treat, in Users Guides to the Medical Jureidini J, Tonkin A: Paroxetine in major depression (letter).
Literature: A Manual for Evidence-Based Clinical Prac- J Am Acad Child Adolesc Psychiatry 42:514, 2003
tice. Edited by Guyatt G, Rennie D. Chicago, IL, AMA Kaptchuk TJ: Powerful placebo: the dark side of the ran-
Press, 2002, pp 267273 domised clinical trial. Lancet 351:17221725, 1998
Guyatt G, Cook D, Devereaux PJ, et al: Therapy, in Users Keller MB, Ryan R, Strober M, et al: Paroxetine in major de-
Guides to the Medical Literature: A Manual for Evi- pression: Dr. Keller et al reply. J Am Acad Child Adolesc
dence-Based Clinical Practice. Edited by Guyatt G, Ren- Psychiatry 42:514515, 2003
nie D. Chicago, IL, AMA Press, 2002a, pp 5579 King RA, Riddle MA, Chappell PB, et al: Emergence of self-
Guyatt G, Haynes B, Jaeschke R, et al: Introduction: the phi- destructive phenomena in children and adolescents dur-
losophy of evidence-based medicine, in Users Guides to ing fluoxetine treatment. J Am Acad Child Adolesc Psy-
the Medical Literature: A Manual for Evidence-Based chiatry 30:179186, 1991
Clinical Practice. Edited by Guyatt G, Rennie D. Chi- Klein DF: The flawed basis for FDA post-marketing safety
cago, IL, AMA Press, 2002b, pp 312 decisions: the example of anti-depressants and children.
Guyatt G, Walter S, Cook D, et al: Therapy and understand- Neuropsychopharmacology 31:689699, 2006
ing the results: confidence intervals, in Users Guides to Kristiansen IS, Gyrd-Hansen D, Nexoe J, et al: Number
the Medical Literature: A Manual for Evidence-Based needed to treat: easily understood and intuitively mean-
Clinical Practice. Edited by Guyatt G, Rennie D. Chi- ingful? Theoretical considerations and a randomized
cago, IL, AMA Press, 2002c, pp 339349 trial. J Clin Epidemiol 55:888892, 2002
Halpern SD, Karlawish JHT, Berlin JA: The continuing un- Kunz R, Oxman AD: The unpredictability paradox: review of
ethical conduct of underpowered clinical trials. JAMA empirical comparisons of randomised and non-ran-
288:358362, 2002 domised clinical trials. BMJ 317:11851190, 1998
Hammad TA: Review and evaluation of clinical data. August Lacchetti C, Guyatt G: Therapy and validity: surprising re-
16, 2004. Available at: http://www.fda.gov/ohrms/dockets/ sults of randomized controlled trials, in Users Guides to
ac/04/briefing/2004-4065b1-10-TAB08-Hammads- the Medical Literature: A Manual for Evidence-Based
Review.pdf. Accessed June 9, 2009 Clinical Practice. Edited by Guyatt G, Rennie D. Chi-
Hammad TA, Laughren T, Racoosin J: Suicidality in pediat- cago, IL, AMA Press, 2002, pp 247265
ric patients treated with antidepressant drugs. Arch Gen Laporte J-R, Figueras A: Placebo effects in psychiatry. Lan-
Psychiatry 63:332333, 2006 cet 344:12061209, 1994
Hay P, Bacaltchuk J: Bulimia nervosa. Clin Evid 6:715725, Laupacis A, Sackett DL, Roberts RS: An assessment of clin-
2001 ically useful measures of the consequences of treatment.
Hennekens CH, Buring JE, Mayrent SL: Epidemiology in N Engl J Med 318:17281733, 1988
Medicine. Boston, MA, Little, Brown, 1987 Lexchin J, Bro LA, Djulbegovic B, et al: Pharmaceutical in-
Heres S, Davis J, Maino K, et al: Why olanzapine beats ris- dustry sponsorship and research outcome and quality:
peridone, risperidone beats quetiapine, and quetiapine systematic review. BMJ 326:11671170, 2003
beats olanzapine: an exploratory analysis of head-to-head Mann JJ, Emslie G, Baldessarini R, et al: ACNP Task Force
comparison studies of second-generation antipsychotics. report on SSRIs and suicidal behavior in youth. Neuro-
Am J Psychiatry 163:185194, 2006 psychopharmacology 31:473492, 2006
Holden JD: Hawthorne effects and research into professional McIntosh A, Lawrie S: Schizophrenia. Clin Evid 6:776797,
practice. J Eval Clin Pract 7:6570, 2001 2001
52 How to Practice Evidence-Based Psychiatry
Moher D, Schulz KF, Altman D: The CONSORT state- Ross JS, Hill KP, Egilman DS, et al: Guest authorship and
ment: revised recommendation for improving the quality ghostwriting in publications related to rofecoxib: a case
of reports of parallel-group randomized trials. JAMA study of industry documents from rofecoxib litigation.
285:19871991, 2001 JAMA 299:18001812, 2008
Mller HJ, Baldwin DS, Goodwin G, et al: Do SSRIs or an- Rothschild AJ, Locke CA: Reexposure to fluoxetine after se-
tidepressants in general increase suicidality? WPA Sec- rious suicide attempts by three patients: the role of
tion on Pharmacopsychiatry: consensus statement. Eur akathisia. J Clin Psychiatry 52:491493, 1991
Arch Psychiatry Clin Neurosci 258 (suppl 3):323, 2008 Sackett DL, Haynes RB, Guyatt GH, et al: Clinical Epide-
Montgomery JH, Byerly M, Carmody T, et al: An analysis of miology: A Basic Science for Clinical Medicine, 2nd Edi-
the effect of funding source in randomized clinical trials tion. Boston, MA, Little, Brown, 1991
of second generation antipsychotics for the treatment of Sackett DL, Straus SE, Richardson WS, et al: Evidence-
schizophrenia. Control Clin Trials 25:598612, 2004 Based Medicine: How to Practice and Teach EBM, 2nd
Montori V, Guyatt G: Summarizing the evidence: publication Edition. New York, Churchill Livingstone, 2000
bias, in Users Guides to the Medical Literature: A Manual Safer DJ: Design and reporting modifications in industry-
for Evidence-Based Clinical Practice. Edited by Guyatt G, sponsored comparative psychopharmacology trials.
Rennie D. Chicago, IL, AMA Press, 2002, pp 529538 J Nerv Ment Dis 190:583592, 2002
Montori VM, Bhandari M, Devereaux PJ, et al: In the dark: Sarles RM: AACAP comment on pending pediatric anti-
the reporting of blinding status in randomized controlled depressants warning. September 28, 2004. Available at:
trials. J Clin Epidemiol 55:787790, 2002 http://www.aacap.org/cs/root/resources_for_families/
Nuovo J, Melnikow J, Chang D: Reporting number needed psychiatric_medication/aacap_comment_on_pending_
to treat and absolute risk reduction in randomized con- pediatric_antidepressants_warning. Accessed June 8, 2009
trolled trials. JAMA 287:28132814, 2002 Schulz KF: Assessing allocation concealment and blinding in
Olfson M, Marcus SC, Druss BG: Effects of Food and Drug randomised controlled trials: why bother? Evid Based
Administration warnings on antidepressant use in a na- Ment Health 3:45, 2000
tional sample. Arch Gen Psychiatry 65:94101, 2008 Sitthi-amorn C, Poshyachinda V: Bias. Lancet 342:286288,
Perlis RH, Perlis CS, Wu Y, et al: Industry sponsorship and fi- 1993
nancial conflict of interest in the reporting of clinical trials Song F, Eastwood A, Gilbody S, et al: Publication and related
in psychiatry. Am J Psychiatry 162:19571960, 2005 biases, in The Advanced Handbook of Methods in Evi-
Peto R, Pike MC, Armitage P, et al: Design and analysis of dence Based Healthcare. Edited by Stevens A, Abrams K,
randomized clinical trials requiring prolonged observa- Brazier J, et al. London, Sage, 2001, pp 371390
tion of each patient, I: introduction and design. Br J Can- Sterne JAC, Smith GD: Sifting the evidence: whats wrong
cer 34:585612, 1976 with significance tests? BMJ 322:226231, 2001
Pocock SJ, Hughes MD, Lee RJ: Statistical problems in the Straus SE, McAlister F: Applying the results of trials and sys-
reporting of clinical trials: a survey of three medical jour- tematic reviews to our individual patients. Evid Based
nals. N Engl J Med 317:426432, 1987 Ment Health 4:67, 2001
Posner K, Oquendo MA, Gould M, et al: Columbia Classifi- Streiner D, Geddes J: Intention to treat analysis in clinical
cation Algorithm of Suicide Assessment (C-CASA): classi- trials when there are missing data. Evid Based Ment
fication of suicidal events in the FDAs pediatric suicidal Health 4:7071, 2001
risk analysis of antidepressants. Am J Psychiatry 164:1035 Szatmari P: Some useful concepts and terms used in articles
1043, 2007 about treatment. Evid Based Ment Health 1:3940, 1998
Preskorn SH: Clinically relevant pharmacology of selective Tandon R: Comparing antipsychotic efficacy. Am J Psychia-
serotonin reuptake inhibitors: an overview with emphasis try 163:1645, 2006
on pharmacokinetics and effects on oxidative drug me- Teicher MH, Gold C, Cole JO: Emergence of intense sui-
tabolism. Clin Pharmacokinet 32 (suppl 1):121, 1997 cidal preoccupation during fluoxetine treatment. Am J
Psaty BM, Kronmal RA: Reporting mortality findings in Psychiatry 147:207210, 1990
trials of rofecoxib for Alzheimer disease or cognitive U.S. Food and Drug Administration: FDA statement regard-
impairment: a case study based on documents from rofe- ing the anti-depressant Paxil for pediatric population
coxib litigation. JAMA 299:18131817, 2008 (FDA Talk Paper). June 19, 2003. Available at: http://www
Rennie D: Fair conduct and fair reporting of clinical trials. .fda.gov/bbs/topics/ANSWERS/2003/ANS01230.html.
JAMA 282:17661768, 1999 Accessed June 8, 2009
Rosenthal R, Jacobson L: Pygmalion in the Classroom. New U.S. Food and Drug Administration: Worsening depression
York, Holt, Rinehart & Winston, 1968 and suicidality in patients being treated with antidepres-
Rosenthal R, Rosnow RL: Essentials of Behavioral Research: sant (FDA Public Health Advisory). March 22, 2004.
Methods and Data Analysis, 2nd Edition. Boston, MA, Available at: http://www.fda.gov/Drugs/DrugSafety/
McGraw-Hill, 1991 PublicHealthAdvisories/ucm161696.htm. Accessed Au-
gust 11, 2009
Clinical Trials 53
Walsh BT, Seidman SN, Sysko R, et al: Placebo response in comments on a proposal to improve reporting of clinical
studies of major depression: variable, substantial, and trials in the biomedical literature. Ann Intern Med
growing. JAMA 287:18401847, 2002 121:894895, 1994
Woods SW, Stolar M, Sernyak MJ, et al: Consistency of atyp- Yudkin PL, Stratton IM: How to deal with regression to the
ical antipsychotic superiority to placebo in recent clinical mean in intervention studies. Lancet 347:241243, 1996
trials. Biol Psychiatry 49:6470, 2001 Zajecka J, Amsterdam JD, Quitkin FM, et al: Changes in ad-
Working Group on Recommendations for Reporting of verse events reported by patients during 6 months of flu-
Clinical Trials in the Biomedical Literature: Call for oxetine therapy. J Clin Psychiatry 60:389394, 1999
This page intentionally left blank
6
In Chapter 5, Taylor and I discussed individual reviewing the literature (D. J. Cook et al. 1998; Eg-
studies of therapies. As we pointed out in that chap- ger et al. 2001c; Greenhalgh 2001). Such reviews
ter, both false-positive and false-negative results can may contribute to delays in implementing changes
occur in clinical trials because of chance and bias. In in clinical practice that are based on important re-
particular, false-negative results are common be- search findings (Egger et al. 2001c).
cause studies are often too small to detect important
treatment effects. As a result, when attempting to
TABLE 61. Steps in conducting a
answer a clinical question, it is best not to depend on
systematic review
the results of a single clinical trial. It is preferable in-
stead to average out the results of all such clinical 1. Formulate the question
trials related to a specific clinical question because
2. Locate studies
this will give a better estimate of the treatment effect
than will the results of any single study. This is ex- Online databases (e.g., MEDLINE, EMBASE)
actly what is done in a meta-analysis, and it is why Registers of clinical trials:
systematic reviews rank at the top of the evidence hi- ClinicalTrials.gov
erarchy (Table 41, Chapter 4).
Cochrane Central Register of Controlled Trials
metaRegister of Controlled Trials
Narrative Reviews Versus
Contact authors or manufacturers
Systematic Reviews
Check reference lists
In the typical journalistic or narrative review article,
Perform manual searches
the author attempts to present a coherent review of a
topic, selectively citing the literature to support the 3. Assess study quality
statement made in the article. When studies of a treat- Rating scales
ment are not in agreement, the author of the review
Two or more reviewers
may tally the positive and negative results (sometimes
called vote counting), indicating that controversy exists 4. Extract and summarize the data
and that more research is needed to resolve the issue. Tables
Although such reviews are common in medical
Forest plots
journals (Rochon et al. 2002), they are often mis-
leading, reflecting the authors biases in selectively Pooled effect size and confidence intervals
55
56 How to Practice Evidence-Based Psychiatry
and Guyatt 2002; Montori et al. 2000; Olson et al. those studies that meet certain quality criteria (Jni
2002; Song et al. 2001; Stern and Simes 1997; et al. 2001). The method of doing so is similar to the
Thornton and Lee 2000). approach used in Chapter 5 to appraise a randomized
Language bias can occur if English-language jour- controlled trial (RCT). A standardized approach to
nals publish a greater proportion of positive studies appraisal, generally involving two reviewers, should
than do non-English-language journals. Such a bias be used to avoid biasing the review (Glasziou et al.
could occur if foreign investigators preferentially 2001; Moher et al. 2001). A variety of instruments
submit positive findings to English-language jour- for rating the quality of studies have been developed
nals (Egger and Smith 1998; Egger et al. 2001a; Song for this purpose, but there is no single best instru-
et al. 2001). Location bias, a similar type of bias, refers ment (Jni et al. 2001; West et al. 2002).
to the tendency to publish lower-quality positive Specific study quality aspects may have a greater
studies of complementary medicine in low-impact effect on estimates of treatment effect than others,
journals (Pittler et al. 2000). The extent to which lan- but this depends on the particular disease and treat-
guage and location bias occurs seems to vary, de- ment in question (Balk et al. 2002). Nonrandomized
pending on the medical specialty and the disease in trials, trials with inadequate allocation concealment,
question (Jni et al. 2002; Moher et al. 2000b). and unblinded trials tend to overestimate the magni-
tude of a treatments effectiveness, although this is
Assess Study Quality not uniformly true for all diseases and their treat-
Because the goal of the search strategy is to be as in- ments (Altman and Schulz 2001; Ioannidis et al.
clusive as possible to avoid missing relevant studies, 2001; Jni et al. 2001; Kjaergard et al. 2001; Kunz
a search typically will identify numerous studies, and Oxman 1998; Lacchetti and Guyatt 2002; Schulz
many of which are either irrelevant or of poor qual- 2000). As a general rule, though, selecting higher-
ity. Including such irrelevant or poor-quality studies quality studies will lead to a less biased and generally
in the review and subsequent meta-analysis yields less optimistic view of a treatments effectiveness.
misleading results. Statisticians refer to this as gar- In the process of appraising study quality, an at-
bage in, garbage out. tempt also should be made to identify duplicate or
As was discussed in Chapter 5, evidence from less overlapping publications. These can occur, for ex-
rigorously designed studies is more apt to be biased ample, if preliminary data are first published, fol-
and misleading than is evidence from more rigor- lowed by a second (more complete) publication. It
ously designed studies (Greenhalgh 2001; Guyatt can also occur if different outcome measures are
2002; Lacchetti and Guyatt 2002; Schulz et al. 1995). each presented in a separate publication. If such du-
It is therefore necessary to appraise the studies iden- plicate or overlapping publications are not identi-
tified in the search and to limit further analysis to fied, the same study may be overrepresented in any
58 How to Practice Evidence-Based Psychiatry
meta-analysis, a result known as multiple publication whether the outcome variable is dichotomous or
bias (Egger and Smith 1998; Tramer et al. 1997). continuous.
cumstances, misinterpretation of an OR as RR will equivalent to saying that 84% of the control group
lead the reader to overestimate or underestimate the has scores below the mean of the experimental
effects of a treatment (Deeks and Altman 2001). group. A table for interpreting the standardized
mean difference is given in Appendix B5.
Number Needed to Treat
Although NNT is believed by many to be the best Fixed and Random Effects Models
expression of relative treatment effectiveness (R.J. As noted earlier, there are both fixed effects and ran-
Cook and Sackett 1995; Sackett et al. 1991, 2000), dom effects models for combining the results of
its mathematical properties are such that it cannot clinical trials. The choice of model is a topic of de-
be directly used in a meta-analysis (Deeks and Alt- bate among statisticians, and readers are referred
man 2001). NNT can, however, be calculated from elsewhere for a more complete discussion (Egger et
the summary OR and the estimated control event al. 2001b; Freemantle and Geddes 1998; Montori et
rate (CER) with the formula in Appendix B. This al. 2002; Petitti 2000; Sutton et al. 2000). At the risk
approach assumes that the OR for a particular of oversimplifying a complex issue, it is probably
treatment comparison is independent of the CER. sufficient to say that fixed effects models assume that
Empirically, this appears to be the case (Furukawa et there is no heterogeneity in study results, whereas
al. 2002; McAlister 2002). random effects models assume that there is hetero-
geneity. As a result, the random effects model should
Continuous Outcome Measures be preferred when heterogeneity is present.
Continuous outcome measures, which include If there is no heterogeneity, both models will pro-
things such as body weight, intelligence quotient, or duce similar pooled estimates of the OR, but the CIs
scores on a rating scale, are common in psychiatric obtained with the random effects models are wider
research. In meta-analyses of continuous outcome (less precise). As a result, the null hypothesis (i.e.,
measures, standardized mean differences, not the that there is no difference between the two treat-
means of the outcome measures, are used as the ments) will be rejected less often if calculations are
measure of treatment effect (Deeks et al. 2001; performed with the random effects model. This has
Petitti 2000; Sutton et al. 2000). The results of each led to the claim that the random effects model is
study are transformed into a standardized mean dif- overly conservative when minimal heterogeneity is
ference (represented by the letter d), using the fol- present. In contrast, when there is heterogeneity,
lowing formula: hypothesis testing, using the random effects model,
gives the more appropriate results. (See Gray and
d= (meane meanc )/SDp Taylor, Chapter 5 in this volume, for further discus-
sion of hypothesis testing.)
where meane and meanc are the means for the exper- A second practical consideration is that the ran-
imental and control groups, respectively, and SD p is dom effects model gives more equal weighting to
the pooled estimate of the standard deviation (SD) large and small studies than does the fixed effects
of the outcome measure. The results are then model, which gives more weight to large studies. If
pooled by taking a weighted average of the ds for there is heterogeneity between the results of large
each study, with the weight for a given study being and small studies as the result of either publication
the inverse of the variance of that studys effect size bias or differences in quality that vary by study size,
(Deeks et al. 2001; Petitti 2000; Sutton et al. 2000). the pooled estimate obtained with the random ef-
The standardized mean difference is a measure of fects model will be more subject to such biases than
the degree of overlap of the experimental and con- the estimate obtained with the fixed effects model.
trol group results, expressed in terms of SDs (Free- As a practical note, in most cases the two models
mantle and Geddes 1998). If d= 0, the means of the give similar results. When the results differ, hetero-
control and experimental groups are identical. If geneity is generally present, and the causes for the
d = 1, the mean of the experimental group is 1 SD heterogeneity need to be taken into account rather
above the mean of the control group. From a stan- than relying on only the pooled estimate of treat-
dard statistical table for a normal distribution, this is ment effect.
60 How to Practice Evidence-Based Psychiatry
Audini-London
Bond-Chicago 1
Lehman-Baltimore
Bond-Indiana 1
Test-Wisconsin
Chandler-California
Pooled odds ratio (fixed effects)
Pooled odds ratio (random effects)
Odds ratio
FIGURE 61. Example of a forest plot showing effects of assertive community treatment
versus usual care on odds of hospitalization of patients with severe mental
illness.
Source. Reprinted from Freemantle N, Geddes J: Understanding and Interpreting Systematic Reviews and Meta-Analyses, II:
Meta-Analyses. Evidence-Based Mental Health 1:102104, 1998. Copyright 1998 BMJ Publishing Group. Used with permission.
Systematic Reviews and Meta-Analyses 61
1994, 2001). Some of the causes of heterogeneity in- the results of a meta-analysis, especially if the ran-
clude differences between studies in patient popula- dom effects model is assumed.
tion (e.g., disease severity or other prognostic Publication bias is usually assessed with a funnel
factors), nature of the intervention (e.g., medication plot (Egger et al. 1997b; Glasziou et al. 2001; Mon-
dose, frequency or number of psychotherapy ses- tori and Guyatt 2002; Montori et al. 2000; Sterne et
sions, or presence of co-interventions), compliance, al. 2001). In a funnel plot, the x axis is treatment ef-
outcome measures, study duration, study quality, fect, and the y axis is either study size or a measure of
and other sources of bias (Glasziou et al. 2001; Sut- the study standard error, with standard error now
ton et al. 2000). considered the preferable measure (Sterne and Eg-
If the source of the heterogeneity can be identi- ger 2001).
fied, it is sometimes useful to present the results by Examples of funnel plots are given in Figure 62.
subgroup (Sutton et al. 2000). Unfortunately, differ- Figure 62A shows a situation in which no publica-
ences in subgroups identified in this post hoc fashion tion bias exists. It can be seen that the plot is sym-
may represent the effects of chance or bias rather metrical. On average, the results of smaller studies
than true differences in response to treatment are the same as those of larger studies; however, re-
(Smith and Egger 2001; Sutton et al. 2000). If, how- sults from small studies are more variable. As a re-
ever, such subgroup differences are anticipated from sult, they deviate more from the mean, producing
the start of the meta-analysis process (i.e., prior to the funnel shape.
looking at the forest plot, combining the results, or If there is publication bias, there will be a tendency
testing for heterogeneity), then such subgroup anal- to publish positive small study results, but not negative
yses may be appropriate. small study results. Such a tendency diminishes as the
size of the study increases. In Figure 62A, the open
Funnel Plots and Publication Bias circles represent the negative studies; these studies
As previously noted, publication bias is often a con- were not published. Removing these studies gives the
cern in systematic reviews. Furthermore, it can bias asymmetrical funnel plot in Figure 62B.
A B C
Standard error of log odds ratio
0 0 0
1 1 1
2 2 2
3 3 3
0.1 0.33 0.6 1 3 0.1 0.33 0.6 1 3 0.1 0.33 0.6 1 3
Relative risk
Because small studies may be of lower method- ing that failure to adhere to the item proposed could
ological quality, they may be more likely to exagger- lead to biased results. The conference resulted in
ate the effects of a treatment (Kjaergard et al. 2001; the QUOROM (Quality Of Reporting Of Meta-
Sterne et al. 2000, 2001). This situation, too, can analyses) statement, a checklist, and a flow diagram
produce an asymmetrical funnel plot, as demon- (Moher et al. 2000a). The checklist describes the
strated in Figure 62C. groups preferred way to present the abstract, intro-
duction, methods, results, and discussion sections of
Sensitivity Analysis a report of a meta-analysis. The QUOROM state-
Questions often arise about whether a particular ment, checklist, and flow diagram can be obtained
study or set of studies should be included in a meta- online at www.consort-statement.org/index.aspx?
analysis because of differences in study design (e.g., o=1065.
patient population, treatment, co-intervention, out-
come measure, duration, quality). In sensitivity anal- Did the Review Address a
ysis, the calculations are performed with and without Clearly Defined Issue?
a particular subset of studies to see whether this has The first step in planning a systematic review is for-
any effect on the overall results (Egger and Smith mulating the question. The authors of the review
2001; Sutton et al. 2000). should indicate the 4-part PICO question (Chapter
A good example of the usefulness of sensitivity 3) that they are trying to address. Unless the ques-
analysis comes from a systematic review of the effec- tion itself is clear, the subsequent literature search
tiveness of antidepressants versus placebo in dysthy- likely will be unfocused. As a result, if the clinical
mic disorder (Lima and Moncrieff 2002). Because question is not clear, the clinician should probably
the pre-1980 literature does not use the term dysthy- try to find another review (Seers 1999). However, a
mic disorder, patients with this disorder were labeled review also may be either too broad or too narrow
as having depressive neurosis, neurotic depression, de- (Oxman et al. 2002). For example, a systematic re-
pressive personality disorder, and so forth. Lima and view of psychotherapy for mental illness is such a
Moncrieff included studies of such patients but then broad topic that it is unlikely that the reviewers
used sensitivity analysis to show that the results were could do it justice within the confines of even a
the same if the diagnosis were limited to dysthymia as book-length review. Conversely, a systematic review
they would be if these other studies were included. of a topic that is too narrow may not generate appro-
priate studies, and such a review may be of limited
generalizability.
Critical Appraisal Guide for
Systematic Reviews Did the Authors Select the Right
Even systematic reviews from respected sources can
Sort of Studies?
have methodological problems (Hopayian 2001; As noted in Table 41 in Chapter 4, some study de-
Olsen et al. 2001); therefore, all such reviews should signs are better than others for answering particular
be appraised by the reader. Several guides have been types of clinical questions. For example, as was dis-
developed for the critical appraisal of systematic re- cussed in Chapter 5, the RCT is the preferred study
views (Badenoch and Heneghan 2002; Centre for Ev- design for answering therapy questions. The au-
idence-Based Medicine 2005; Freemantle and Geddes thors of a review should specify their inclusion cri-
1998; Geddes et al. 1998; Greenhalgh 2001; Oxman et teria for which types of studies were selected, and
al. 2002; Sackett et al. 2000; Seers 1999; Shea et al. these criteria should be appropriate to the clinical
2001). One such guide appears in Table 63. question being asked (Seers 1999).
In 1996, a group of 30 clinical epidemiologists,
clinicians, statisticians, editors, and researchers, Were All Relevant Studies Included?
concerned about the quality of meta-analyses, met Several questions can be asked with regard to the
to identify items they thought should be included in studies included. How comprehensive was the
a checklist of standards. Whenever possible, check- search strategy? Did the authors search only MED-
list items were guided by research evidence suggest- LINE, or did they also search other online data-
Systematic Reviews and Meta-Analyses 63
bases? Did the authors make other attempts to cently reviewed the criteria used to perform various
locate studies? For example, did they contact au- searches. They found no clear consensus regarding
thors of published studies or manufacturers of optimum reporting of systematic review search
drugs, check reference lists of published studies or methods, and commonly recommended items were
prior reviews (i.e., snowballing), perform manual not optimally reported.
searches of journals or proceedings abstracts that are
not abstracted in MEDLINE or similar databases, Was the Quality of the Studies Addressed?
and check databases of clinical trials? If such mea- As was discussed earlier and in Chapter 5, evidence
sures are not taken, several sources of bias could in- from less rigorously designed studies is more apt to
fluence the results, including publication bias and be biased and misleading than is evidence from more
language bias (Table 62). Sampson et al. (2008) re- rigorously designed studies. The authors of the
64 How to Practice Evidence-Based Psychiatry
review should describe the criteria used for assessing First, is the patient so different from those in the
quality, including the minimum quality needed for studies that the results do not apply? The question
inclusion. For example, they may decide to include can be reframed in the following way: Is the patho-
only RCTs with at least 80% follow-up and inten- biology of this patient so different from that of the
tion-to-treat analysis. Whatever the criteria, they study patients that the results cannot apply? Typi-
should be explicit and decided in advance so that cally, the answer to this question is no, although
they are not influenced by study results (Silagy et al. there may be quantitative differences. To quantify
2002). In addition, the assessment of quality should the likelihood of a patient benefiting from a treat-
generally involve two reviewers and a mechanism ment, it is first necessary to convert the pooled esti-
for resolving a difference between them (Glasziou et mate of the OR to NNT (McQuay and Moore 1998;
al. 2001; Oxman et al. 2002; Seers 1999). Reviews Sackett et al. 2000) (see Appendix B).
should list which studies were excluded from the Finally, the clinician must consider two additional
analysis for quality reasons, and the reason for exclu- questions before applying the treatment to his or her
sion should be given. patient. First, is the treatment consistent with his
or her patients values and preferences? Second, is
Are the Results Similar From Study to Study? the treatment feasible in the clinicians setting? As-
Many systematic reviews present their results graph- suming that the clinician has found a high-quality
ically in the form of forest plots. As previously dis- systematic review that has identified an effective
cussed, forest plots can be used to assess whether the treatment for the patient, the next steps in the EBM
results are similar from study to study. The more process (Table 21, Chapter 2) are to treat the pa-
formal statistical approach is to use a chi-square test tient and to evaluate the outcome.
for heterogeneity.
If heterogeneity is detected, an attempt should be References
made to assess the cause of the heterogeneity. Sub-
Allen IE, Olkin I: Estimating time to conduct a meta-analysis
group analysis may be appropriate if the rationale
from number of citations retrieved. JAMA 2892:634
was identified beforehand. Sensitivity analysis also 635, 1999
may indicate whether the inclusion of certain studies Altman DG, Schulz KF: Statistics notes: concealing treatment
has a significant effect on the pooled measure of allocation in randomised trials. BMJ 323:446447, 2001
treatment effect. Antes G, Oxman AD: The Cochrane Collaboration in the
20th century, in Systematic Reviews in Health Care:
What Are the Overall Results (With Meta-Analysis in Context. Edited by Egger M, Smith
Confidence Intervals)? GD, Altman DG. London, BMJ Books, 2001, pp 447458
Badenoch D, Heneghan C: Evidence-Based Medicine Tool-
The results of a meta-analysis generally will be pre- kit. London, BMJ Books, 2002
sented as a forest diagram that includes a pooled ef- Balk EM, Bonis PAL, Moskowitz H, et al: Correlation of
fect measure and its CIs. For dichotomous outcome quality measures with estimates of treatment effect in
measures, this is an OR; for continuous measures, it meta-analyses of randomized controlled trials. JAMA
is a standardized mean difference. If the CIs for the 287:29732982, 2002
pooled OR include 1 or if the CIs for the standard- Centre for Evidence-Based Medicine: Critical Appraisal
Worksheet for Systematic Review of Therapy [Centre
ized mean difference include 0, there is no statisti-
for Evidence-Based Medicine Web site]. 2005. Available
cally significant difference between the experimen-
at: http://www.cebm.net/index.aspx?o=1157. Accessed
tal and the control treatments. June 28, 2009
Centre for Evidence-Based Mental Health: Critical appraisal
Can the Clinician Apply the Results to form for an overview [Centre for Evidence-Based Mental
His or Her Patient? Health Web site]. Available at: http://cebmh.warne
.ox.ac.uk/cebmh/downloads/education_resources/
The final step in the appraisal process is to assess
overview.pdf. Accessed June 28, 2009
whether the clinician can apply the results to his or
Clarke M, Oxman AD (eds): Cochrane Reviewers Hand-
her patient. As with the discussion of a single ther- book 4.1.6. [Cochrane Collaboration Web site]. April
apy study in Chapter 5, several considerations enter 2002. Available at: http://www.cochrane.org/cochrane/
into this assessment. hbook.htm. Accessed September 5, 2002
Systematic Reviews and Meta-Analyses 65
Cochrane Collaboration: The Cochrane Collaboration leaf- Freemantle N, Geddes J: Understanding and interpreting
let [Cochrane Collaboration Web site]. Available at: systematic reviews and meta-analyses, II: meta-analyses.
http://www.cochrane.org/resources/leaflet.htm. Septem- Evid Based Ment Health 1:102104, 1998
ber 1997. Accessed June 18, 2002 Furukawa TA, Guyatt GH, Griffith LE: Can we individual-
Cook DJ, Mulrow CD, Haynes RB: Synthesis of best evi- ize the number needed to treat? An empirical study of
dence for clinical decisions, in Systematic Reviews: Syn- summary effect measures in meta-analysis. Int J Epide-
thesis of Best Evidence for Health Care Decisions. miol 31:7276, 2002
Edited by Mulrow C, Cook D. Philadelphia, PA, Ameri- Geddes J, Freemantle N, Streiner D, et al: Understanding
can College of Physicians, 1998, pp 512 and interpreting reviews and meta-analyses, I: rationale,
Cook RJ, Sackett DL: The number needed to treat: a clinically search strategy, and describing results. Evid Based Ment
useful measure of treatment effect. BMJ 310:452454, 1995 Health 1:6869, 1998
Davies P, Boruch R: The Campbell Collaboration does for Glasziou P, Irwig L, Bain C, et al: Systematic Reviews in
public policy what Cochrane does for public health. BMJ Health Care: A Practical Guide. Cambridge, UK, Cam-
323:294295, 2001 bridge University Press, 2001
Deeks JJ, Altman DG: Effect measures for meta-analyses of Greenhalgh T: How to Read a Paper: The Basics of Evidence
trials with binary outcomes, in Systematic Reviews in Based Medicine, 2nd Edition. London, BMJ Books, 2001
Health Care: Meta-Analysis in Context. Edited by Egger Guyatt G: Therapy and harm: why study results mislead
M, Smith GD, Altman DG. London, BMJ Books, 2001, bias and random error, in Users Guides to the Medical
pp 313335 Literature: A Manual for Evidence-Based Clinical Prac-
Deeks JJ, Altman DG, Bradburn MJ: Statistical methods for tice. Edited by Guyatt G, Rennie D. Chicago, IL, AMA
examining heterogeneity and combining results from Press, 2002, pp 223231
several studies in meta-analysis, in Systematic Reviews in Helmer D, Savoie I, Green C, et al: Evidence-based practice:
Health Care: Meta-Analysis in Context. Edited by Egger extending the search to find material for the systematic
M, Smith GD, Altman DG. London, BMJ Books, 2001, review. Bull Med Libr Assoc 89:346352, 2001
pp 285312 Hopayian K: The need for caution in interpreting high qual-
DerSimonian R, Laird N: Meta-analysis in clinical trials. ity systematic reviews. BMJ 323:681684, 2001
Control Clin Trials 7:177188, 1986 Ioannidis JPA, Haidich A-B, Pappa M, et al: Comparison of
Dwan K, Altman DG, Arnaiz JA, et al: Systematic review of evidence of treatment effects in randomized and nonran-
the empirical evidence of study publication bias and out- domized studies. JAMA 286:821830, 2001
come reporting bias. PLoS ONE 3(8):e3081, 2008 Jni P, Altman DG, Egger M: Assessing the quality of ran-
Egger M, Smith GD: Meta-analysis: potentials and promise. domised controlled trials, in Systematic Reviews in
BMJ 315:13711374, 1997 Health Care: Meta-Analysis in Context. Edited by Egger
Egger M, Smith GD: Bias in location and selection of studies. M, Smith GD, Altman DG. London, BMJ Books, 2001,
BMJ 316:6166, 1998 pp 87108
Egger M, Smith GD: Principles and procedures for system- Jni P, Holenstein F, Sterne J, et al: Direction and impact of
atic reviews, in Systematic Reviews in Health Care: language bias in meta-analyses of controlled trials: em-
Meta-Analysis in Context. Edited by Egger M, Smith pirical study. Int J Epidemiol 31:115123, 2002
GD, Altman DG. London, BMJ Books, 2001, pp 2342 Kjaergard LL, Villumsen J, Gluud C: Reported method-
Egger M, Smith GD, Phillips AN: Meta-analysis: principles ologic quality and discrepancies between large and small
and procedures. BMJ 315:15331537, 1997a randomized trials in meta-analyses. Ann Intern Med
Egger M, Smith GD, Schneider M, et al: Bias in meta-anal- 135:982989, 2001
ysis detected by a simple, graphical test. BMJ 315:629 Kunz R, Oxman AD: The unpredictability paradox: review
634, 1997b of hempirical comparisons of randomised and non-
Egger M, Dickersin K, Smith GD: Problems and limitations randomised clinical trials. BMJ 317:11851190, 1998
in conducting systematic reviews, in Systematic Reviews Lacchetti C, Guyatt G: Therapy and validity: surprising re-
in Health Care: Meta-Analysis in Context. Edited by Eg- sults of randomized controlled trials, in Users Guides to
ger M, Smith GD, Altman DG. London, BMJ Books, the Medical Literature: A Manual for Evidence-Based
2001a, pp 4368 Clinical Practice. Edited by Guyatt G, Rennie D. Chi-
Egger M, Smith GD, Altman DG (eds): Systematic Reviews cago, IL, AMA Press, 2002, pp 247265
in Health Care: Meta-Analysis in Context. London, BMJ Lefebvre C, Clarke MJ: Identifying randomised trials, in Sys-
Books, 2001b tematic Reviews in Health Care: Meta-Analysis in Con-
Egger M, Smith GD, ORourke K: Rationale, potentials, and text. Edited by Egger M, Smith GD, Altman DG.
promise of systematic reviews, in Systematic Reviews in London, BMJ Books, 2001, pp 6986
Health Care: Meta-Analysis in Context. Edited by Egger Lewis S, Clarke M: Forest plots: trying to see the wood and
M, Smith GD, Altman DG. London, BMJ Books, 2001c, the trees. BMJ 322:14791480, 2001
pp 319
66 How to Practice Evidence-Based Psychiatry
Lima MS, Moncrieff S: Drugs versus placebo for dysthymia, Petitti DB: Meta-Analysis, Decision Analysis, and Cost-
in The Cochrane Library, Issue 3. Oxford, UK, Update Effectiveness Analysis: Methods for Quantitative Syn-
Software, 2002 thesis in Medicine, 2nd Edition. New York, Oxford Uni-
Mantel N, Haenszel W: Statistical aspects of the analysis of versity Press, 2000
data from retrospective studies of disease. J Natl Cancer Pittler MH, Abbot NC, Harkness EF, et al: Location bias in
Inst 22:719748, 1959 controlled clinical trials of complementary/alternative
McAlister FA: Commentary: relative treatment effects are therapies. J Clin Epidemiol 53:485489, 2000
consistent across the spectrum of underlying risksusu- Robinson KA, Dickersin K: Development of a highly sensi-
ally. Int J Epidemiol 31:7677, 2002 tive search strategy for the retrieval of reports of con-
McQuay HJ, Moore RA: Using numerical results from sys- trolled trials using PubMed. Int J Epidemiol 31:150153,
tematic reviews in clinical practice, in Systematic Re- 2002
views: Synthesis of Best Evidence for Health Care Rochon PA, Bero LA, Bay AM, et al: Comparison of review
Decisions. Edited by Mulrow C, Cook D. Philadelphia, articles published in peer-reviewed and throwaway jour-
PA, American College of Physicians, 1998, pp 2336 nals. JAMA 287:28532856, 2002
Moher D, Cook DJ, Eastwood S, et al: Improving the quality Rosenthal R: The file drawer problem and tolerance for
of reports of meta-analyses of randomised controlled tri- null results. Psychol Bull 86:638641, 1979
als: the QUOROM statement. QUOROM Group. Br J Sackett DL, Haynes RB, Guyatt GH, et al: Clinical Epide-
Surg 87:14481454, 2000a miology: A Basic Science for Clinical Medicine, 2nd Edi-
Moher D, Klassen TP, Schulz KF, et al: What contributions tion. Boston, MA, Little, Brown, 1991
do languages other than English make on the results of Sackett DL, Straus SE, Richardson WS, et al: Evidence-
meta-analyses? J Clin Epidemiol 5:964972, 2000b Based Medicine: How to Practice and Teach EBM, 2nd
Moher D, Klassen TP, Jones AL, et al: Assessing the quality Edition. New York, Churchill Livingstone, 2000
of reports of randomised trials included in meta-analyses: Sampson M, McGowan J, Tetzlaff J, et al: No consensus ex-
attitudes, practice, evidence and guides, in The Advanced ists on search reporting methods for systematic reviews.
Handbook of Methods in Evidence Based Healthcare. J Clin Epidemiol 61:748754, 2008
Edited by Stevens A, Abrams K, Brazier J, et al. London, Schulz KF: Assessing allocation concealment and blinding in
Sage, 2001, pp 409425 randomised controlled trials: why bother? Evid Based
Montori V, Guyatt G: Summarizing the evidence: publica- Ment Health 3:45, 2000
tion bias, in Users Guides to the Medical Literature: A Schulz KF, Chalmers I, Hayes RJ, et al: Empirical evidence of
Manual for Evidence-Based Clinical Practice. Edited by bias: dimensions of methodological quality associated
Guyatt G, Rennie D. Chicago, IL, AMA Press, 2002, pp with estimates of treatment effects in controlled trials.
529538 JAMA 273:408412, 1995
Montori VM, Smieja M, Guyatt GH: Publication bias: a brief Seers K: Systematic review, in Evidence-Based Medicine: A
review for clinicians. Mayo Clin Proc 75:12841288, Primer for Health Care Professionals. Edited by Dawes
2000 M, Davies P, Gray A, et al. Edinburgh, Churchill Living-
Montori V, Guyatt G, Oxman A, et al: Summarizing the ev- stone, 1999, pp 85100
idence: fixed-effects and random-effects models, in Us- Shea B, Dube C, Moher D: Assessing the quality of reports of
ers Guides to the Medical Literature: A Manual for systematic reviews: the QUORUM statement compared
Evidence-Based Clinical Practice. Edited by Guyatt G, to other tools, in Systematic Reviews in Health Care:
Rennie D. Chicago, IL, AMA Press, 2002, pp 539545 Meta-Analysis in Context. Edited by Egger M, Smith GD,
National Health Service Centre for Reviews and Dissemina- Altman DG. London, BMJ Books, 2001, pp 122139
tion [NHS CRD]: Undertaking systematic reviews of re- Silagy CA, Middleton P, Hopewell S: Publishing protocols of
search on effectiveness: CRDs guidance for those systematic reviews: comparing what was done to what
carrying out commissioning reviews. CRD Report No 4, was planned. JAMA 287:28312834, 2002
2nd Edition [NHS CRD Web site]. March 2001. Avail- Smith GD, Egger M: Going beyond the grand mean: sub-
able at: http://www.york.ac.uk/inst/crd/report4.htm. Ac- group analysis in meta-analysis of randomised trials, in
cessed September 5, 2002 Systematic Reviews in Health Care: Meta-Analysis in
Olsen O, Middleton P, Ezzo J, et al: Quality of Cochrane re- Context. Edited by Egger M, Smith GD, Altman DG.
views: assessment of sample from 1998. BMJ 323:829 London, BMJ Books, 2001, pp 143156
832, 2001 Song F, Eastwood A, Gilbody S, et al: Publication and related
Olson CM, Rennie D, Cook D, et al: Publication bias in ed- biases, in The Advanced Handbook of Methods in Evi-
itorial decision making. JAMA 287:28252828, 2002 dence Based Healthcare. Edited by Stevens A, Abrams K,
Oxman A, Guyatt G, Cook D, et al: Summarizing the evidence, Brazier J, et al. London, Sage, 2001, pp 371390
in Users Guides to the Medical Literature: A Manual for Stern JM, Simes RJ: Publication bias: evidence of delayed
Evidence-Based Clinical Practice. Edited by Guyatt G, publication in a cohort study of clinical research projects.
Rennie D. Chicago, IL, AMA Press, 2002, pp 155173 BMJ 315:640645, 1997
Systematic Reviews and Meta-Analyses 67
Sterne JAC, Egger M: Funnel plots for detecting bias in Thornton A, Lee P: Publication bias in meta-analysis: its
meta-analysis: guidelines on choice of axis. J Clin Epide- causes and consequences. J Clin Epidemiol 53:207216,
miol 54:10461055, 2001 2000
Sterne JAC, Gavaghan D, Egger M: Publication and related bias Tramer MR, Reynolds DJM, Moore RA, et al: Impact of co-
in meta-analysis: power of statistical tests and prevalence in vert duplicate publication on meta-analysis: a case study.
the literature. J Clin Epidemiol 53:11191129, 2000 BMJ 315:635640, 1997
Sterne JAC, Egger M, Smith GD: Systematic reviews in health Turner EH, Matthews AM, Linardatos E, et al: Selective
care: investigating and dealing with publication and other publication of antidepressant trials and its influence on
biases in meta-analysis. BMJ 323:101105, 2001 apparent efficacy. N Engl J Med 358:252260, 2008
Sutton AJ, Abrams KR, Jones DR, et al: Methods for Meta- West S, King V, Carey TS, et al: Systems to Rate the Strength
Analysis in Medical Research. New York, Wiley, 2000 of Scientific Evidence (Evidence Report/Technology As-
Thompson SG: Why sources of heterogeneity in meta-anal- sessment, No 47). Rockville, MD, Agency for Healthcare
ysis should be investigated. BMJ 309:13511355, 1994 Research and Quality, 2002
Thompson SG: Why and how sources of heterogeneity Yusuf S, Peto R, Lewis J, et al: Beta blockade during and after
should be investigated, in Systematic Reviews in Health myocardial infarction: an overview of the randomized tri-
Care: Meta-Analysis in Context. Edited by Egger M, als. Prog Cardiovasc Dis 27:335371, 1985
Smith GD, Altman DG. London, BMJ Books, 2001, pp
157175
This page intentionally left blank
7
Clinical practice guidelines are generally defined as medical literature (Browman 2001; Drake et al.
systematically developed statements to assist practi- 2001; Gray 2002; Greenhalgh 2001; Kahn et al.
tioner decisions about appropriate health care for 1997; Woolf et al. 1999a, 1999b). All guidelines in-
specific clinical circumstances (Field and Lohr volve some degree of judgment and bias in their de-
1990, p. 1). Over the past two decades, there has been velopment (Browman 2001; Drake et al. 2001;
considerable interest and activity in developing these Greenhalgh 2001; Greenhalgh and Peacock 2005),
guidelines for a variety of clinical conditions, driven the extent of which is often unstated. In addition,
by concerns about variability in clinical practice, cost, clinical practice guidelines are often introduced as
quality, and legal liability (Birkmeyer 2001; Field and part of a top-down approach to changing clinician
Lohr 1992; Greenhalgh 2001; Woolf et al. 1999b). behavior, leading to clinician resistance (Haines and
We believe clinical practice guidelines are an invalu- Jones 1994; Lipman 2000). Ideally, evidence-based
able source for improving patient care. Guidelines psychiatric practice (EBPP) is a bottom-up ap-
have many limitations, however, including the fact proach in which clinicians make decisions on the
that most guidelines focus on a single disorder, that basis of ability to search and appraise the medical lit-
guidelines for treating one problem may conflict with erature.
aspects of guidelines for treating a comorbid problem From our standpoint, evidence-based clinical
in the same patient, and that many guidelines include practice guidelines should play an important role in
recommendations that are not evidence based. EBPP. Guidelines can serve as a very useful starting
point for the practitioner to assess the major treat-
Role of Guidelines in Evidence- ment principles that should be considered. Studies
of practicing clinicians have found that clinicians of-
Based Practice ten do not have the time to search and appraise the
Most clinical practice guidelines represent an at- literature themselves but that they would welcome
tempt to improve clinical care by focusing on effec- evidence-based guidelines when faced with clinical
tive evidence-based interventions. Although practice questions (McColl et al. 1998; Young and Ward
guidelines are sometimes equated with evidence- 2001). In such cases, high-quality evidence-based
based medicine (EBM) (Grol 2001a), they should be guidelines can provide useful guidance (Feder et al.
viewed as distinct for several reasons (Gray 2002; 1999; Grimshaw and Eccles 2001; Woolf et al.
Lipman 2000). First, as noted later in this chapter, 1999b). In addition, such evidence-based guidelines
not all practice guidelines are based on the best evi- generally either include or reference a systematic re-
dence, as derived from a systematic review of the view of the relevant literature.
69
70 How to Practice Evidence-Based Psychiatry
The Sequenced Treatment Alternatives to Relieve (22%) (Keller et al. 2000). This trial sets a new stan-
Depression (STAR*D) trial has shown the benefit of dard of care for the treatment of depression in clin-
using algorithms, particularly in the context of ical practice.
clearly defined and important clinical outcomes. The
STAR*D trial is the largest study (N = 4,041) ever Differences Among Guidelines
conducted evaluating and comparing algorithmic
treatment effectiveness in real-world patients experi- As indicated in the previous section, not all guide-
encing a depressive episode as part of major depres- lines are based on the best available evidence. Some
sive disorder (Trivedi et al. 2006). The STAR*D trial guidelines are based on expert consensus and are not
was supported by the National Institute of Mental truly evidence based (Berg et al. 1997; Browman
Health (NIMH) and was implemented over a 5-year 2001). Guidelines also differ considerably in com-
period. STAR*D was designed to assess effectiveness prehensiveness, format, frequency of review, and
of treatments in generalizable samples and to ensure ease of use. Milner and Valenstein (2002) have pro-
the delivery of adequate treatments, with the pri- vided a useful comparison of several of the guide-
mary outcome measure being remission. The algo- lines for the treatment of schizophrenia that details
rithm was designed to begin treatment with a many of these differences. Those produced by the
selective serotonin reuptake inhibitor (SSRI). Cit- APA, AHRQ, and the other organizations listed in
alopram was chosen as the initial drug (and SSRI) be- Table 43 in Chapter 4 are generally of high quality,
cause of the absence of discontinuation symptoms, but any guideline should be assessed before its use.
established safety in elderly and medically fragile pa-
tients, once-a-day dosing, few dose adjustment steps, Developing Evidence-Based
and favorable drug-drug interaction profile (Trivedi Practice Guidelines
et al. 2006). The protocol required that an adequate
dose of citalopram be given for a sufficient time to The development of evidence-based clinical prac-
ensure that an adequate treatment trial was con- tice guidelines is generally viewed as a 6-step process
ducted. A systematic but easily implemented ap- (Eccles et al. 2001; Shekelle et al. 1999a, 1999b) (Ta-
proach to treatment, which the investigators referred ble 71).
to as measurement-based care, was developed.
Measurement-based care includes the routine Identify the Topic
measurement of symptoms and side effects at each The first step in the guideline development process is
treatment visit and the use of a treatment manual de- to identify and refine the subject of the guideline.
scribing when and how to modify medication doses Given the large number of diagnoses and the time
according to these measures. The details of how the needed to develop guidelines, some prioritization
algorithm can be implemented are provided by must occur. Often this step is based on considerations
Trivedi and Kurian in Chapter 21, and the general such as the prevalence or economic effects of a disor-
algorithm has been described in many publications der (Berg et al. 1997; Cook et al. 1998; Shekelle et al.
(Trivedi et al. 2006b). The study was designed to 1999a, 1999b). Furthermore, decisions must be made
evaluate several issues, including identifying poten- on the scope of the guideline (e.g., whether it should
tial moderators of outcome. The overall results have be restricted to pharmacological treatment or
been presented in many publications and should be whether it should include psychosocial interventions,
familiar to most readers. The 8-week remission rates patient education, etc.). Some authors suggest creat-
(28% for Hamilton Rating Scale for Depression; ing a causal pathway that diagrams the links be-
33% for Quick Inventory of Depressive Symptom- tween steps in a diagnostic or treatment process and
atologySelf-Report) were robust and similar to the potential outcomes (benefits or harms) that could
rates found in uncomplicated, nonchronic, symp- occur (Berg et al. 1997; Shekelle et al. 1999a, 1999b).
tomatic volunteers enrolled in placebo-controlled,
randomized controlled trials with SSRIs (Agency for Convene a Group
Health Care Policy and Research 1993b). These re- The group convened to develop the guideline
mission rates were better than those found in effi- should include individuals with expertise in statistics
cacy studies among patients with chronic depression and epidemiology, as well as clinical expertise related
72 How to Practice Evidence-Based Psychiatry
TABLE 71. Steps in developing evidence- its own systematic review (see Gray, Chapter 6 in
based practice guidelines this volume).
In the process of assessing the evidence, different
1. Identify and refine the topic of the guideline
weight must be given to evidence from different
2. Convene an appropriate group study designs. As described in Chapter 4, hierarchies
Typically 620 members of evidence have been developed for this process
(Badenoch and Heneghan 2002; Harbour and
Requires both clinical and statistical expertise
Miller 2001; Shekelle et al. 1999a, 1999b). For ex-
Should be multidisciplinary ample, the National Institute for Health and Clini-
3. Gather and assess the evidence cal Excellence (NICE) guidelines grade the level of
evidence using the criteria provided in Table 72.
Systematic review of literature
Hierarchy of evidence
Translate the Evidence Into
4. Translate the evidence into recommendations Recommendations
Some degree of clinical judgment always needed The fourth step is to translate the evidence into the
a) to weigh conflicting information and b) when recommendations that will make up the guideline.
there is little evidence Clinical judgment is required in this step, both to
5. Use outside reviewers to review the recom- weigh conflicting information and to make recom-
mendations mendations when little or no hard evidence exists
Should include users, as well as experts (Harbour and Miller 2001; Shekelle et al. 1999a,
1999b). Various procedures have been developed to
Assess for validity and practicality
facilitate this process (Black et al. 2001; Kahn et al.
6. Update the guideline periodically 1997). Final recommendations should include an in-
Source. Adapted from Berg et al. 1997; Eccles et al. 2001; dication of the strength of evidence on which they
Shekelle et al. 1999a. are based (Harbour and Miller 2001; Pinsky and
Deyo 2000; Shekelle et al. 1999a, 1999b). Again, the
to the condition or treatment that will be the topic of NICE guideline developers have developed a de-
the guideline (Berg et al. 1997; Shekelle et al. 1999a, tailed procedure as to how to do this.
1999b). Such groups typically have 620 members,
with one member serving as the group leader to Forming and Grading the Statements and
moderate discussions, often supported by a project Recommendations
management team (Shekelle et al. 1999a, 1999b). It The standards and procedures developed by NICE
is best to convene a multidisciplinary group that in- are models for the field (National Institute for
cludes representation from all of the stakeholders in- Health and Clinical Excellence 2007). As summa-
volved in implementing the guideline (Cook et al. rized from the guideline comparison search avail-
1998; Shekelle et al. 1999a, 1999b). Concerns have able through www.guideline.gov (and used in the
been raised regarding the extent to which pharma- comparison of guidelines discussed in the Compar-
ceutical company relationships may influence deci- ison of Guidelines section later in this chapter), the
sions by members of guideline development groups NICE guidelines were developed as follows:
(Choudhry et al. 2002; Greenhalgh 2001).
The evidence tables and forest plots formed the
basis for developing clinical statements and rec-
Gather and Assess the Evidence ommendations. For intervention studies, the
The third step is to gather and assess the evidence statements were classified according to an ac-
regarding the subject of the guideline. Preexisting cepted hierarchy of evidence. Recommendations
systematic reviews can be helpful in this step, pro- were then graded A to C based on the level of as-
sociated evidence. In order to facilitate consis-
vided that the systematic reviews themselves are
tency in generating and drafting the clinical
valid (Browman 2001; Cook et al. 1998; Eccles et al. statements the guideline development group
2001; Shekelle et al. 1999a, 1999b). If they are not, (GDG) utilised a statement decision tree. The
then the guideline development group must develop flowchart was designed to assist with, but not re-
Clinical Practice Guidelines 73
Chapter 9, screening low-risk populations produces Patients With Eating Disorders, American Psychiatric
far more false-positive than true-positive test re- AssociationMedical Specialty Society, 1993 (re-
sults. Similarly, if the recommendation involves pre- vised June 2006) (NGC:004987). We then went back
ventive measures, implementing them in a low-risk to the home page to Compare Checked Guidelines
population may produce more harm than good and selected these two guidelines to compare. The
(Sackett et al. 2000). Guidelines developed for use in program provided the basic characteristics of the two
tertiary care settings, where the severity of illness guidelines on several dimensions: guideline develop-
and degree of comorbidity are high, may not be ap- ers, sources of funding, composition of group that
plicable in primary care settings, where illness sever- authored the guideline, conflicts of interest, guide-
ity is lower (Greenhalgh 2001). line objectives, major outcomes considered, methods
used to collect or select evidence, methods used to as-
Are the Beliefs of My Patients Incompatible sess the quality and strength of the evidence, major
With the Guidelines? recommendations, and so forth.
If your patients prefer psychotherapy and the rec- The NICE method seemed superior to the APA
ommendation is for medications (or vice versa), the method, but both recommendations were worth
guideline will be difficult to implement. considering. Unfortunately, the actual recommenda-
tions are difficult to compare. Both list more than
Are the Costs and Other Barriers to 100 treatment recommendations (although many are
Implementation Too High? specific to one disorder or another; e.g., anorexia or
Perhaps the guideline recommends a type of therapy bulimia).
that is unavailable in your geographic area. Is it prac- Another approach to comparing guidelines is to
tical for someone to be trained in its application? Or use the Guideline Synthesis function. For example,
perhaps the recommendation concerns a method of we used the Guideline Synthesis function to gen-
delivering services (e.g., assertive community treat- erate a list of available syntheses. We then selected
ment) that is not available in your setting. What are Management of Eating Disorders from the list.
the costs and other barriers to implementation? The synthesis was conducted on three guidelines:
eating disorders not otherwise specified (EDNOS). other medications; APA notes that topiramate may
This implies that in searching for a guideline address- be useful (III). We view these guidelines as sources
ing atypical eating disorders, the FMSD would not be of information.
useful. More important, the synthesis examines areas
of agreement and disagreement. Implementing Practice Guidelines
We then examined in more detail some specific
and Algorithms
recommendations related to the case of a young
woman with bulimia presented in Chapter 18. The The reason that guidelines are usually developed is
two guidelines would lead the clinician in somewhat to attempt to improve the delivery of care within an
different directions. organization, geographic area, or profession. The re-
Table 74 lists the main psychotherapy recom- sults of such attempts have been mixed (Bero et al.
mendations for the two guidelines. The NICE 1998; Davis and Taylor-Vaisey 1997; Greenhalgh
guideline suggests starting with a self-help ap- 2001; Grimshaw and Russell 1993; Grol 2001b; Lip-
proach, which may not be feasible in private practice man 2000; National Health Service Centre for Re-
but might work well in a health maintenance orga- views and Dissemination 1999; Owen et al. 2008;
nization. The NICE guideline also recommends Oxman et al. 1995; Worrall et al. 1997). We men-
cognitive-behavioral therapy (CBT) as the next tioned in the beginning of the book that recent stud-
choice. The APA notes that the evidence supports ies show that compared with treatment as usual, the
CBT as the most effective single intervention. How- use of algorithms and collaborative care approaches
ever, the guidelines differ as to what to do if CBT in the care of depressed patients enhances treatment
fails or if the patient prefers another treatment. outcomes by modifying practice procedures and
NICE states that interpersonal psychotherapy (IPT) treatment processes (Adli et al. 2006). Although im-
should be considered as an alternative to CBT. The plementation of STAR*D has not been compared
APA notes that IPT is effective in some cases but with treatment without following STAR*D, the pro-
argues that CBT is associated with more rapid re- tocol is designed to achieve a clinically significant
mission of eating symptoms and adds that using outcome. On the other hand, Owen et al. (2008)
psychodynamic interventions in conjunction with compared the effectiveness of a conceptually based,
CBT and other psychotherapies may yield better multicomponent enhanced strategy with a basic
global outcomes. A clinician curious about these strategy for implementing antipsychotic manage-
different interpretations may want to go to the ment recommendations of Department of Veterans
guideline to determine the database behind the rec- Affairs (VA) schizophrenia guidelines. Two VA med-
ommendations, but this can be time-consuming. We ical centers in each of three Veterans Integrated Ser-
searched PubMed with the terms bulimia, psychother- vice Networks were randomly assigned to either a
apy and with limits of reviews, summaries, and basic educational implementation strategy or the en-
meta-analyses. The most comprehensive review hanced strategy, in which a trained nurse promoted
was by Wilson (2005), who stated: provider guideline adherence and patient compli-
ance. Patients with acute exacerbation of schizophre-
There is no evidence that an integrated psycho- nia were enrolled and were assessed at baseline and
therapy is effective with BN [bulimia nervosa], let 6 months, and their medical records were abstracted.
alone more effective than CBT alone. It has been The enhanced guideline implementation strategy in-
suggested that complex cases characterized by co-
creased addition of second-generation antipsychotic
morbid personality disorders require a blend of
to first-generation antipsychotic therapy but did not
CBT and psychodynamic psychotherapy.. .. No
evidence supports this speculation. Controlled significantly increase guideline-recommended
studies of the effectiveness of psychodynamic switching from first-generation antipsychotic to sec-
therapies are still conspicuously lacking. ond-generation antipsychotic monotherapy. Anti-
psychotic dosing was not significantly altered.
The guidelines also differ on the use of medica- On the contrary, some organizations have found
tions (see Table 75). NICE recommends SSRIs but an improvement in quality of care and reduction of
grades the recommendation as a C. APA rates the costs with the widespread implementation of guide-
use of fluoxetine as I. NICE does not recommend lines (Mullaney 2005). Guidelines may be particu-
Clinical Practice Guidelines 77
TABLE 74. A comparison of psychotherapy recommendations for treating bulimia for two
guidelines
larly important when they recommend a treatment mendation (McEvoy et al. 2006). Yet clinicians ap-
that is not widely used but might be associated with a pear to prefer to try many additional monotherapy
better outcome. For instance, the algorithms for trials, various combinations of antipsychotics, and
treating schizophrenia developed by TMAP, the In- other polytherapy before starting clozapine. The rea-
ternational Psychopharmacology Algorithm Project, sons for not following this recommendation are not
and the Psychopharmacology Algorithm Project at known but may be related to the fact that it is a more
the Harvard South Shore Department of Psychiatry demanding treatment to implement for the physician
all recommend using clozapine after two adequate and the patient. There may be concerns about ad-
monotherapy trials of other antipsychotics in schizo- verse effects, additional time and effort to obtain con-
phrenia. The latest Clinical Antipsychotic Trials of sent, and the need for medical monitoring in addition
Intervention Effectiveness data support this recom- to patient reluctance for some of the same reasons.
78 How to Practice Evidence-Based Psychiatry
TABLE 75. Comparison of medication recommendations for treating bulimia for two
guidelines
In general, the passive dissemination of guidelines their mind based on experience, training, and per-
has little effect on clinical practice (Bero et al. 1998; haps some updating of the literature.
Davis and Taylor-Vaisey 1997; Oxman et al. 1995) With all these limitations, guidelines are still an
or on patient outcome (Farmer et al. 2008). Guide- important part of managing patients. As noted sev-
lines are more apt to be adopted if they take account eral times in this book, we review guidelines as a
of local circumstances, are disseminated by active ed- starting place. They are not a definitive source of pa-
ucational interventions, and are implemented using tient care. However, clinicians should use guidelines
patient-specific reminders (Bero et al. 1998; Feder et as an important source of care options for their pa-
al. 1999; Greenhalgh 2001; National Health Service tients. The point is not to bring the patient to the
Centre for Reviews and Dissemination 1999). Mul- guideline but to bring the guideline to the patient.
tifaceted interventions tend to be more effective, but The authors of some of the cases presented in this
they are also more expensive (Bero et al. 1998; Davis volume created checklists from the guidelines, and
and Taylor-Vaisey 1997; Greenhalgh 2001; Grol they used the checklists both to guide therapy and as
1997; National Health Service Centre for Reviews a review to help them identify areas in which they
and Dissemination 1999; Oxman et al. 1995). In the could improve their practice.
cases presented in Chapters 1734, we discuss ways
to use guidelines more effectively.
Choosing Guidelines
Choosing which guideline or guidelines to follow
Improving the Use of Guidelines for the complicated, comorbid cases we see in clini-
Reluctance and resistance to using guidelines come cal practice is a challenge. Guidelines and medica-
from many sources. Curiously, clinicians may agree tion algorithms are usually developed to treat most
with the recommendations when they are presented single disorders; few address comorbid problems.
to them separately (Cabana et al. 1999). Many clini- As illustrated in Chapter 18, a guideline for treating
cians probably have a working set of guidelines in one disorder may be contradicted by a guideline for
Clinical Practice Guidelines 79
treating a comorbid disorder in the same patient. Antman EM, Lau J, Kupelnick B, et al: A comparison of re-
Many clinicians may prefer to follow only one sults of meta-analyses of randomized control trials and
guideline, presumably the one relevant to the pri- recommendations of clinical experts: treatments for my-
ocardial infarction. JAMA 268:240248, 1992
mary problem. Other clinicians may wish to com-
Badenoch D, Heneghan C: Evidence-Based Medicine Tool-
bine algorithms and guidelines drawn from various kit. London, BMJ Books, 2002
sources, as illustrated in Chapters 18, 20, and 34 Berg AO, Atkins D, Tierney W: Clinical practice guidelines
among others. As therapy progresses, new problems, in practice and education. J Gen Intern Med 12 (suppl
not covered by the initial guidelines and algorithms, 2):S25S33, 1997
may emerge and require consideration of other evi- Bero LA, Grilli R, Grimshaw JM, et al: Closing the gap be-
dence bases and approaches. tween research and practice: an overview of systematic
The treatment setting and nature of the clinicians reviews of interventions to promote the implementation
of research findings. The Cochrane Effective Practice
practice also affect which guidelines are selected. A
and Organization of Care Review Group. BMJ 317:465
guideline developed for a 20- to 30-minute patient 468, 1998
visit might be very different from a guideline devel- Birkmeyer JD: Primer on geographic variation in health care.
oped for a 50-minute visit. A guideline for a 50- Eff Clin Pract 4:232233, 2001
minute session involving a nondirective psychody- Black N, Murphy M, Lamping D, et al: Consensus develop-
namic approach will be quite different from a guide- ment methods and their use in creating clinical guide-
line for a 50-minute directive, structured session. lines, in The Advanced H andbook of Methods in
Clinicians can find guidelines and algorithms appro- Evidence Based Healthcare. Edited by Stevens A, Abrams
K, Brazier J, et al. London, Sage, 2001, pp 426448
priate for their practice setting and situation, and it is
Browman GP: Development and aftercare of clinical guide-
important for clinicians to continue to update them lines: the balance between rigor and pragmatism. JAMA
as a result of their experience and new information. 286:15091511, 2001
Another major problem in following guidelines is Cabana MD, Rand CS, Powe NR, et al: Why dont physi-
that they tend to focus on treatment planning rather cians follow clinical practice guidelines? A framework for
than on implementation. The latter is much more improvement. JAMA 282:14581465, 1999
challenging for most clinicians. In Chapters 1734, Choudhry NK, Stelfox HT, Detsky AS: Relationships be-
experienced clinicians present examples of how they tween authors of clinical practice guidelines and the
pharmaceutical industry. JAMA 287:612617, 2002
have used guidelines, algorithms, and other sources
Cook DJ, Greengold NL, Ellrodt AG, et al: The relation be-
of EBPP to provide care for the individuals they dis- tween systematic reviews and practice guidelines, in Sys-
cuss. We believe the cases in this volume provide tematic Reviews: Synthesis of Best Evidence for Health
wonderful examples of how EBPP can improve pa- Care Decisions. Edited by Mulrow C, Cook D. Philadel-
tient care! phia, PA, American College of Physicians, 1998, pp 55
65
Davis DA, Taylor-Vaisey A: Translating guidelines into prac-
References tice: a systematic review of theoretic concepts, practical
Adli M, Bauer M, Rush AJ: Algorithms and collaborative- experience and research evidence in the adoption of clin-
care systems for depression: are they effective and why? A ical practice guidelines. CMAJ 157:408416, 1997
systematic review. Biol Psychiatry 59:10291038, 2006 Drake RE, Goldman HH, Leff HS, et al: Implementing evi-
Agency for Health Care Policy and Research: Depression in dence-based practices in routine mental health settings.
primary care, Vol 2: Treatment of major depression. Psychiatr Serv 52:179182, 2001
Clinical Practice Guideline No 5. Rockville, MD, U.S. Eccles M, Freemantle N, Mason J: Using systematic reviews
Department of Health and Human Services, 1993b in clinical guideline development, in Systematic Reviews
American Psychiatric Association: Diagnostic and Statistical in Health Care: Meta-Analysis in Context. Edited by Eg-
Manual of Mental Disorders, 4th Edition, Text Revision. ger M, Smith GD, Altman DG. London, BMJ Books,
Washington, DC, American Psychiatric Association, 2001, pp 400409
2000 Expert Consensus Guidelines: Psychiatric treatment guide-
American Psychiatric Association: Practice Guidelines for the lines for the most difficult questions facing clinicians [Ex-
Treatment of Psychiatric Disorders, Compendium. Wash- pert Consensus Guidelines Web site]. April 3, 2002.
ington, DC, American Psychiatric Association, 2006 Available at: http://www.psychguides.com. Accessed
September 13, 2002
80 How to Practice Evidence-Based Psychiatry
Farmer AP, Lgar F, Turcot L, et al: Printed educational ma- Kapur S, Remington G: Atypical antipsychotics. BMJ 321:
terials: effects on professional practice and health care out- 13601361, 2000
comes. Cochrane Database Syst Rev (3):CD004398, 2008 Keller MB, McCullough JP, Klein DN, et al: A comparison of
Feder G, Eccles M, Grol R, et al: Using clinical guidelines. nefazodone, the cognitive behavioral-analysis system of
BMJ 318:728730, 1999 psychotherapy, and their combination for the treatment
Field MJ, Lohr KN (eds): Clinical Practice Guidelines: Di- of chronic depression. N Engl J Med 342:14621470,
rections for a New Program. Washington, DC, National 2000
Academy Press, 1990 Lipman T: Evidence-based practice in general practice and
Field MJ, Lohr KN (eds): Clinical Practice Guidelines: From primary care, in Evidence-Based Practice: A Critical Ap-
Development to Use. Washington, DC, National Acad- praisal. Edited by Trinder L, Reynolds S. Oxford, UK,
emy Press, 1992 Blackwell Scientific, 2000, pp 3565
Geddes J, Freemantle N, Harrison P, et al: Atypical antipsy- McColl A, Smith H, White P, et al: General practitioners
chotics in the treatment of schizophrenia: systematic perception of the route to evidence based medicine: a
overview and meta-regression analysis. BMJ 321:1371 questionnaire survey. BMJ 316:361365, 1998
1376, 2000 McEvoy JP, Lieberman JA, Stroup TS, et al: Effectiveness of
Gilbert DA, Altshuler KZ, Rago WV, et al: Texas Medication clozapine versus olanzapine, quetiapine, and risperidone
Algorithm Project: definitions, rationale, and methods to in patients with chronic schizophrenia who did not re-
develop medication algorithms. J Clin Psychiatry spond to prior atypical antipsychotic treatment. Am J
59:345351, 1998 Psychiatry 163:600610, 2006
Gray GE: Evidence-based medicine: an introduction for psy- Milner KK, Valenstein M: A comparison of guidelines for the
chiatrists. J Psychiatr Pract 8:513, 2002 treatment of schizophrenia. Psychiatr Serv 53:888890,
Greenhalgh T: How to Read a Paper: The Basics of Evidence- 2002
Based Medicine, 2nd Edition. London, BMJ Books, 2001 Mullaney TJ: Doctors wielding data. Business Week, No-
Greenhalgh T, Peacock R: Effectiveness and efficiency of vember 21, 2005, pp 94, 98
search methods in systematic reviews of complex evi- Mulrow CD: Systematic reviews: rationale for systematic re-
dence: audit of primary sources. BMJ 331(7524):1064 views. BMJ 309:597599, 1994
1065, 2005 National Health Service Centre for Reviews and Dissemina-
Grimshaw J, Eccles M: Identifying and using evidence-based tion: Getting evidence into practice. Eff Health Care
guidelines in general practice, in Evidence-Based Prac- 5(1):116, 1999
tice in Primary Care, 2nd Edition. Edited by Silagy C, National Institute for Health and Clinical Excellence: How
Haines A. London, BMJ Books, 2001, pp 120134 NICE clinical guidelines are developed: an overview for
Grimshaw JM, Russell IT: Effect of clinical guidelines on stakeholders, the public and NHS. London, National
medical practice: a systematic review of rigorous evalua- Health Service, 2007
tions. Lancet 342:13171322, 1993 Owen RR, Hudson T, Thrush C, et al: The effectiveness of
Grol R: Personal paper: beliefs and evidence in changing guideline implementation strategies on improving anti-
clinical practice. BMJ 315:418421, 1997 psychotic medication management for schizophrenia.
Grol R: Improving the quality of medical care: building Med Care 46:686691, 2008
bridges among professional pride, payer profit, and pa- Oxman AD, Thomson MA, Davis DA, et al: No magic bullet:
tient satisfaction. JAMA 286:25782585, 2001a a systematic review of 102 trials of interventions to im-
Grol R: Successes and failures in the implementation of evi- prove professional practice. CMAJ 153:14231431, 1995
dence-based guidelines for clinical practice. Med Care 39 Pinsky LE, Deyo RA: Clinical guidelines: a strategy for
(suppl 2):II-46II-54, 2001b translating evidence into practice, in Evidence-Based
Guyatt G, Hayward R, Richardson WS, et al: Moving from Clinical Practice: Concepts and Approaches. Edited by
evidence to action, in Users Guides to the Medical Lit- Geyman JP, Deyo RA, Ramsey SD. Boston, MA, Butter-
erature: A Manual for Evidence-Based Clinical Practice. worth-Heinemann, 2000, pp 119123
Edited by Guyatt G, Rennie D. Chicago, IL, AMA Press, Sackett DL, Haynes RB, Guyatt GH, et al: Clinical Epide-
2002, pp 175199 miology: A Basic Science for Clinical Medicine, 2nd Edi-
Haines A, Jones R: Implementing findings of research. BMJ tion. Boston, MA, Little, Brown, 1991
308:14881492, 1994 Sackett DL, Straus SE, Richardson WS, et al: Evidence-
Harbour R, Miller J: A new system for grading recommenda- Based Medicine: How to Practice and Teach EBM, 2nd
tions in evidence based guidelines. BMJ 323:334336, 2001 Edition. New York, Churchill Livingstone, 2000
Kahn DA, Docherty JP, Carpenter D, et al: Consensus meth- Shekelle PG, Woolf SH, Eccles M, et al: Developing clinical
ods in practice guideline development: a review and de- guidelines. West J Med 170:348351, 1999a
scription of a new method. Psychopharmacol Bull Shekelle PG, Woolf SH, Eccles M, et al: Developing guide-
33:631639, 1997 lines. BMJ 318:593596, 1999b
Clinical Practice Guidelines 81
Shekelle PG, Ortiz E, Rhodes S, et al: Validity of the Agency Wilson GT: Psychological treatment of eating disorders.
for Healthcare Research and Quality clinical practice Annu Rev Clin Psychol 1:439465, 2005
guidelines: how quickly do guidelines become outdated? Woolf SH, Grol R, Hutchinson A, et al: Clinical guidelines:
JAMA 286:14611467, 2001 international overview [BMJ Web site]. February 20,
Snowball R: Critical appraisal of clinical guidelines, in Evi- 1999a. Available at: http://bmj.com/cgi/content/full/
dence-Based Practice: A Primer for Health Care Profes- 318/7182/527/DC1/1. Accessed September 24, 2002
sionals. Edited by Dawes M, Davies P, Gray A, et al. Woolf SH, Grol R, Hutchinson A, et al: Potential benefits,
Edinburgh, Churchill Livingstone, 1999, pp 127131 limitations, and harms of clinical guidelines. BMJ
Texas Medication Algorithm Project: TMAPa collabora- 318:527530, 1999b
tive effort [Texas Medication Algorithm Project Web Worrall G, Chaulk P, Freake D: The effects of clinical prac-
site]. April 3, 2002. Available at: http://www.dshs.state tice guidelines on patient outcomes in primary care: a
.tx.us/mhprograms/TIMA.shtm. Accessed July 1, 2009 systematic review. CMAJ 156:17051712, 1997
Trivedi MH, Rush AJ, Wisniewski SR, et al: Evaluation of Young JM, Ward JE: Evidence-based medicine in general
outcomes with citalopram for depression using measure- practice: beliefs and barriers among Australian GPs.
ment-based care in STAR*D: implications for clinical J Eval Clin Pract 7:201210, 2001
practice. Am J Psychiatry 163:2840, 2006
This page intentionally left blank
8
Measurement
C. Barr Taylor, M.D.
M easuring and monitoring patient progress are tained or purchased online. Many instruments rele-
key to practicing evidence-based psychiatry. For vant to psychiatric practice are available on the CD-
many decades, researchers, policy makers, insurers, ROM that accompanies the American Psychiatric
and some clinicians have noted the need to focus as Publishing Handbook of Psychiatric Measures, 2nd
much on outcomes as on process (Ellwood 1988; Edition (Rush et al. 2008). Copyright protection and
McGrath and Tempier 2003). Recently, the Se- other issues may limit the use of some standardized
quenced Treatment Alternatives to Relieve Depres- assessment instruments, but alternative public do-
sion (STAR*D) investigators have argued that mea- main instruments usually can be found to measure
surement should be the paradigm for psychiatric outcomes. Second, practice management software
practice (Trivedi and Daly 2007; Trivedi et al. 2007). systems are now available that make assessment and
Yet few clinicians routinely monitor outcomes unless record keeping easier, as discussed at the end of this
compelled to do so. Why? The main reason is prob- chapter. Some of the cases illustrate how measure-
ably that they have little incentive to do so and some ment can be incorporated into clinical practice.
good reasons not to. In a busy practice, the added pa- Third, many guidelines and algorithms use mea-
perwork could be seen as a needless addition to an al- surement to guide decision making, and adherence
ready pressured schedule. Even simple assessment to such guidelines and algorithms may improve
forms and instruments need to handed out, scored, practice. Fourth, evidence-based medicine (EBM)
stored, and interpreted, contributing to increased and evidence-based psychiatric practice (EBPP) are
charting burden. Some clinicians believe that pa- based on measurement.
per assessment, at least beyond the initial sessions, In this chapter, I discuss what to measure, re-
can interfere with the therapeutic relationship view how one can consider the reliability and validity
a piece of paper is substituted for a more meaningful of a measure, present examples of some nonstand-
interaction. The clinician might argue that if pa- ard measures, and provide examples of how process
tients seem to be improving and seem satisfied with and outcome measures have been implemented in
their care, then they should not make changes. Ulti- several practice settings.
mately, the clinician must decide that the effort re-
sults in better patient care.
Fortunately, obtaining and using assessment in-
Which Outcomes to Measure
struments have become easier in recent years. First, Several factors need to be considered in deciding
numerous assessment instruments can be readily ob- what to measure. 1 The type of measures may be
1
Instruments used to assess baseline function, psychological process, and other phenomena may be different from instruments
used to assess outcome. In this section, we focus on outcome assessment instruments.
83
84 How to Practice Evidence-Based Psychiatry
determined by the practice setting or by the insurer. lication. The text of the Handbook includes a descrip-
For instance, the Department of Veterans Affairs tion of each measure (e.g., number of items), the
(VA) is adopting outcome measures for a variety of goals of the measure, practical issues (how long does
problems. Some insurers ask providers to complete it take to administer, where permission can be ob-
periodic assessments. Domains of outcome mea- tained), the psychometric properties of the instru-
surement to consider include symptomatology, pa- ment (reliability, validity), and the clinical utility
tient functioning, quality of life, patient satisfaction, (what useful information it provides).
and even cost and cost-benefit ratio. We recom-
mend a smorgasbord approach. If a clinician is using
a guideline or algorithm that has a measure to guide
Constructing a Measure
treatment decisions, then that measure should be Given the importance of measures, it is worthwhile
adopted. For instance, those who are following the to consider how they are developed. Measures can
STAR*D guidelines would want to use a version of be constructed in several ways. Many of the classic
the Quick Inventory of Depressive Symptomatol- psychiatric measurement skills were developed by a
ogy (QIDS), and those using the Beck model of cog- researcher simply trying to identify the main fea-
nitive-behavioral therapy (CBT) would want to use tures of a disorder and then finding a way to rate the
the Beck Depression InventoryII (BDI-II) and also, frequency and intensity of these features. For in-
perhaps, the QIDS because it has defined outcomes stance, when Hamilton decided to develop a mea-
for remission and relapse. sure for depression in the 1950s, he presumably
If a clinician has decided to follow practice rec- began by listing the main features: depressed mood,
ommendations from the evidence base for a partic- feelings of guilt, suicidality, insomnia, trouble with
ular problem and the analyses have used an available work and activities, psychomotor retardation, agita-
instrument, that would be a logical choice as a mea- tion, mental and somatic anxiety, gastrointestinal
sure. For example, the Hamilton Rating Scale for and other somatic symptoms, hypochondriasis,
Depression (Ham-D) is a widely used measure for change in weight, change in insight, diurnal varia-
depression outcome studies and might serve as a tion of mood, depersonalization and derealization,
good reference in helping clinicians determine how paranoia, and obessionality. He then developed a
well their patients are doing against published stan- system to rate each of these items. Hamilton proba-
dards. bly erred in mixing nominal and ordinal items and in
The clinicians values and interests should also assuming that each item was more or less equally as
guide what domains they assess. For instance, one important as any other item (Babgy et al. 2004).
might want to include a quality-of-life measure (see Beck developed his inventory (Beck et al. (1961;
Chapter 30). Second, one should consider measur- perhaps the most widely used self-report depression
ing behaviors, attitudes, and issues of relevance to instrument in psychiatry) by first identifying symp-
individual patients but not necessarily covered in toms and attitudes that were common in depressed
standard instruments. Table 161 in Chapter 16 lists patients but rare in nondepressed patients. These
the measures used by the therapists in the case pre- ideas were systematically consolidated into 21 symp-
sentations. Some of the measures are standardized toms and attitudes that could be rated from 0 to 3 in
outcomes, with extensive psychometric data (e.g., intensity. The items included mood, pessimism,
the Posttraumatic Stress Disorder [PTSD] Check- sense of failure, lack of satisfaction, guilt, sense of
list, the QIDSSelf-Report, the Yale-Brown Obses- punishment, sense of self-dislike, self-accusation,
sive Compulsive Scale). Others represent self- suicide wishes, crying, irritability, social withdrawal,
reports of behaviors (e.g., binge and purge fre- fatigability, and loss of appetite. Seemingly, indi-
quency, alcohol use), relationships, symptoms (e.g., viduals who score higher are more depressed. Both
dizziness, panic attacks, trouble swallowing), or the Ham-D and the BDI-II have undergone some
medical parameters (e.g., weight). revision, but the core measures remain much the
The Handbook of Psychiatric Measures, 2nd Edition same.
(Rush et al. 2008), has provided an invaluable re- Both Hamilton and Beck used clinical observation
source of standard measures for clinicians. Table 81 to select items to measure. Some other approaches
lists the categories of measures available in this pub- for scale construction are available. Another ap-
Measurement 85
TABLE 81. Categories of measures behavior scales to 967 sixth- and seventh-grade girls.
available in Handbook of A principal components analysis was conducted to
Psychiatric Measures reduce redundancy to find a set of independent vari-
ables. The result was a set of five items measuring
Measures are provided for: worry about weight and body shape, weight gain, di-
Diagnosis in adults eting, importance of weight, and feeling fat.
General psychiatric symptoms Once items are identified, the next issue in scale
development is to determine how to rate them.
Mental health status, functioning, and disabilities
Items can be rated in several ways. For instance, they
General health status, functioning, and disabilities can be rated in terms of frequency (never to very of-
Quality of life ten) or intensity (not at all to very) across dimensions
Adverse effects
(see the Ham-D, item 5, for an example of this).
Books and articles on scale development are avail-
Patient perceptions of care able for the interested reader (e.g., DeVellis 2003).
Stress and life events Before giving forms to a patient, it is a good idea for
Family risk factors the clinician to fill out a copy to get a sense of exactly
what is being asked.
Suicide risk
Diagnosis and screening in children and
adolescents Psychometric Properties of Scales
Disorders usually first diagnosed in infancy, Scientific studies favor standard measures with
childhood, or adolescence known and acceptable reliability and validity.
Child and adolescent functional status
Personality traits and defense mechanisms Reliability
Delirium and behavioral symptoms of cognition
In statistics, reliability is the consistency of a set of
measurements or a measuring instrument. Three
Aggression
types of reliability are reported, depending on the
Cognitive, substance use, psychotic, mood, purpose of the measure and how it is administered.
anxiety, somatoform, factitious and malingering, Clinical assessment instruments report the internal
dissociative, sexual dysfunction, eating, sleep, reliability (or consistency) of individual items, the
impulse-control, and personality disorders
test-retest reliability of the total score and/or items
Source. Rush AJ Jr, First MB, Blacker D (eds): Handbook of in the measurement instrument, and interrater reli-
Psychiatric Measures, 2nd Edition. Washington, DC, Ameri-
ability of the instrument. Reliability is inversely re-
can Psychiatric Publishing, 2008.
lated to random error; that is, high reliability scores
make one more confident that the scale is measuring
proach would be to develop a rating scale based on what it is supposed to.
the standard items of some diagnostic system, such as Internal consistency represents how well the items of
DSM-IV-TR (American Psychiatric Association a scale measure a single dimension of an underlying
2000). This was the approach used in developing the construct. Because individuals may use different
QIDS, which was used in the STAR*D project (Rush words to describe some aspect of their functioning, a
et al. 2003). Another approach is to ask many ques- scale that assesses a dimension with several questions
tions of a population of interest and then to use sta- might allow for more people to be able to report
tistical methods to identify those items that best more accurately. Some measurement instruments in-
distinguish one population (such as depressed indi- clude several scales, each of which might have good
viduals) from another (nondepressed individuals). internal consistency. Good internal consistency of a
The items then can be used to form a scale. We used scale may actually limit its usefulness for some pur-
this approach several years ago when we wanted to poses. For instance, an instrument to measure mania
develop a measure to identify students at risk for de- may assess both psychotic and neurovegetative
veloping an eating disorder (Killen et al. 1993). We symptoms. Because these symptoms are not strongly
gave various standard eating disorder attitude and correlated in bipolar patients, the measure would
86 How to Practice Evidence-Based Psychiatry
have poor internal consistency, although it might ac- 2004) (see section Reliability and Validity of the
curately measure mania from a clinical standpoint. Hamilton Rating Scale for Depression). The clini-
Interrater reliability is a measure of agreement be- cian also should determine whether the items mea-
tween two or more observers evaluating the same se- sure areas that are expected to change with therapy.
ries of subjects and using the same information. Concurrent validity refers to the degree to which
Interrater reliability is best measured with the sta- the measure correlates with other measures of the
tistic, which is a measure of agreement corrected or same construct measured at the same time. Concur-
changed (Fleiss 1981). For categorical measures, a rent validity is adequate when a scale shows Pearson
value of 1 indicates perfect agreement; a of 0 indi- r values of at least 0.50 in correlation with other
cates no agreement. In clinical trials, s of greater measures of the same syndrome.
than 0.60.7 are considered adequate, and a greater Other types of validity are important, depending
than 0.8 is considered excellent (Landis and Koch on the purpose of the scale. Discriminant validity re-
1977). The clinician should be wary of studies with a fers to how well the measure distinguishes groups
less than 0.5 because it suggests that two raters cannot differing in their diagnostic status. Predictive validity
agree on what they are judging. Reliability for contin- refers to how well the measure can predict the onset
uous measures is more complicated. Suppose a rater is of symptom(s). Cultural validity refers to how well
asked to determine whether a patient does not look at the measure works in various populations.
all sad, looks a little sad, looks somewhat sad, looks
very sad, or looks very, very sad. It is harder for raters Sensitivity to Change
to agree on such levels, and statistical methods have For outcome studies, measurements should be used
been developed to account for this. Interrater reliabil- that are likely to be able to detect change in the do-
ity is extremely important for research studies. main assessed. In general, sensitivity to change is re-
Test-retest reliability measures whether the same flected in the effect size (see Gray, Chapter 6 in this
observers or individuals completing a measure an- volume). Within a treatment group, effect size is of-
swer questions the same way from one time to the ten calculated as the difference between the mean
next, assuming there is no intervening change. Typ- score at time 1 and the mean score at time 2 for each
ically, the same test is repeated a few days or weeks subscale, divided by the standard deviation at time 1
apart. For retest reliability of scale items, a Pearson r or over time. Measures that have large standard de-
greater than 0.70 is considered acceptable (Anastasia viations relative to the mean require either very
and Urbina 1997). strong interventions to show effects or very large
sample sizes. An effect size of approximately 0.2 is
Validity generally somewhat arbitrarily considered to be
Reliability does not prove that a scale is valid. Valid- small, one of 0.5 indicates moderate differences, and
ity refers to how well an instrument measures what it that of 0.8 or higher indicates large differences (Co-
is supposed to. Types of validity of psychiatric rating hen 1988). Of course, an instrument may be very
scales include content, convergent, discriminant, sensitive to change, but the change itself may be
factorial, predictive, and cultural validity. clinically meaningless. For this reason, some re-
Content validity is a nonstatistical type of validity. searchers argue that categorical measures (e.g., how
The basic issue is whether the content of the scale many patients depressed at baseline are no longer
seems to cover a representative sample of the phe- depressed at posttreatment or follow-up on the basis
nomenon to be measured. Content validity is as- of some criteria such as DSM-IV-TR) are more
sessed by examining scale items to determine meaningful than ordinal measures.
correspondence with known features of a syndrome. A second approach is to define an outcome on a
Some of the very standard assessment instruments, measure as indicated improvement; for instance, to
such as the Ham-D, which was developed before the expect at least a 50% reduction in a baseline measure
advent of the DSM-IV (American Psychiatric Asso- or a score below a certain level on a scale such as the
ciation 1994) system, have been criticized for not in- Ham-D. STAR*D provides guidelines for what con-
cluding content relevant to the new diagnostic stitutes remission or improvement (see Chapter 21).
system, as discussed later in this chapter (Bagby et al. A third approach is to estimate how many patients fit
Measurement 87
into the nondysfunctional range of the outcome ternal reliabilities greater than 0.70. All of the single
measure or measures. For example, in a study of items of the test also showed good reliability except
panic attack interventions, Newman et al. (1997) for loss of insight, which was quite variable. Over-
and later Kenardy et al. (2003) used norms and test- all, the Ham-D has good internal reliability, sug-
retest reliability estimates from previous studies to gesting that the items measure one construct.
determine the dysfunctional/functional range. A Interrater reliabilities were quite high: total
successful outcome would be that, following treat- Ham-D interrater reliabilities ranged from 0.82 to
ment, a participant was no longer in the dysfunc- 0.98, and the intraclass r ranged from 0.46 to 0.99.
tional range, and his or her change from pre- to However, a large range was seen on the individual
posttest exceeded measurement error. In addition, items. This suggests that two individuals who were
Jacobson and Truax (1991) required subjects to trained to administer the Ham-D and rated a de-
meet both a reliable change index and a functional pressed individual came up with similar scores, al-
recovery criterion, which was defined as being panic though they varied as to how negatively they rated
attack free. A fourth approach is to determine what one item to the next.
would be considered a minimal clinically important The overall retest reliability of the Ham-D was
difference, defined as being the smallest difference high, ranging from 0.81 to 0.98. However, the test-
in score in the domain of interest that patients per- retest reliability of individual items ranged from
ceive as beneficial and that would mandate, in the 0.00 to 0.85. This suggests that over time with no in-
absence of troublesome side effects and excessive tervening treatment, an individual is rated as having
cost, a change in the patients management (Jaeschke the same overall extent of depression from one time
et al. 1989). This is a complicated issue, and some to the next. However, changes in particular items are
doubt exists that it is possible to arrive at a minimal much less reliable. Bagby et al. (2004) criticized how
clinically important difference (Beaton et al. 2002). the scale was constructed, noting, for instance, that
some items require ratings that may even cross di-
Reliability and Validity of the mensions. For example, the question of hypochon-
driasis is rated from self-absorption to delusions.
Hamilton Rating Scale for
Are hypochondriacal delusions on the same contin-
Depression uum as hypochondriacal symptoms?
The Ham-D is the most frequently used measure for
depression in psychopharmacology studies (Wil- Validity
liams 2001), and changes in its score are used to
Content Validity
judge the effectiveness of a medication. The Ham-D
was developed in the late 1950s to assess the effec- Bagby et al. (2004) also questioned the content va-
tiveness of the first generation of antidepressants lidity of the Ham-D, noting that the items were gen-
and was originally published in 1960 (Hamilton erated well before DSM-IV, and asked if the Ham-D
1960). How reliable and valid is the Ham-D? To an- accurately reflects depression as defined by DSM-
swer this question, Bagby et al. (2004) reviewed the IV. Important features of DSM-IV depression are
psychometric properties of the 17-item Ham-D, buried within more complex items in the Ham-D
perhaps the most widely used version. They used and sometimes are not captured at all. The inter-
MEDLINE to identify all studies published during ested reader may want to examine the Depression
the period from January 1980 to May 2003 that ad- Interview and Structured Hamilton (DISH), a struc-
dressed the psychometric properties of the Ham-D. tured interview developed for the National Heart,
Seventy articles met their selection criteria and were Lung, and Blood Institutes Enhancing Recovery in
categorized into three groups on the basis of the ma- Coronary Heart Disease trial that combines the
jor psychometric property examinedreliability, Ham-D and the clinical items of DSM-IV (Freed-
item response, or validity. land et al. 2002).
ever, that the Ham-D does not reflect DSM-IV (2005), also critical of Bagby et al. (2004), argued
items, poor convergent validity between the Ham-D that the Ham-D may not be perfect but that it cap-
and the Structured Clinical Interview for DSM-IV tures the many different ways that depression pre-
was reported in a Turkish study. Language/transla- sents and has proved sensitive to change, thus
tion issues might have been a factor in this result. providing a useful outcome to determine the effec-
tiveness of medications.
Discriminant Validity Changing a measure that has been the gold stan-
The Ham-D, at cut-off points of greater than 1.0, dard for evidence-based trials creates many prob-
had reasonable sensitivity (most studies reported lems. Whereas statistical approaches can adjust
sensitivities in the 0.70.8 range) and specificity between measures, the same measure used in the
(0.751.0). same way for the same presenting problem allows for
easy comparison. Although this is not a compelling
Predictive Validity and Sensitivity to Change reason to continue using the Ham-D, a PubMed
Several very large meta-analyses involving thou- search (July 20, 2008) identified hundreds of cita-
sands of patients and a variety of treatments have tions since Bagby et al. (2004) recommended that it
shown that the Ham-D is more sensitive to change be abandoned. It may not be perfect, but it endures.
than is the BDI, a widely used self-report instrument From a practical standpoint, a clinician could use the
(Edwards et al. 1984; Lambert et al. 1986). Such Ham-D total score to measure improvement but be
studies also suggest that the instrument is sensitive less confident that changes in the individual items are
to change. meaningful. I favor use of the QIDS-SR16 because it
is tied into a measurement outcomebased protocol.
Factorial Validity
Overall, the results from 15 studies suggested that
Practical Issues in Finding and
the Ham-D is not unidimensional because separate
sets of items seem to represent general depression Using Measures
and insomnia factors; however, the exact structure of An instrument with excellent psychometric proper-
its multidimensionality remains unclear. ties may not be useful in clinical practice for several
Bagby et al. (2004) concluded that the Ham-D reasons. Some self-report measures include items
has adequate internal, interrater, and retest reliabil- that are reverse scored so that the clinician needs to
ity and good convergent, discriminant, and predic- have a scoring sheet or to have the form scored by a
tive validity. They noted that the same is not true for vendor or through software. The purpose of the re-
individual items. For this reason, they recom- verse scoring is to help ensure that the person filling
mended that the Ham-D should be replaced by out the form reads each item and does not simply
other instruments and noted that the Inventory of choose one end of the scale. Other assessments can
Depressive Symptomatology (Rush et al. 1986) and be very lengthy and require a long time to complete.
the Montgomery-sberg Depression Rating Scale Many forms are also copyrighted. Simply because a
(Montgomery and sberg 1979), designed to ad- form is available on the Internet does not mean that
dress the limitations of the Ham-D, represent two it is in the public domain and can be used for free or
potential replacement alternatives. The QIDS is ob- without permission. It is illegal and unethical to use
viously another one. a copyrighted test without buying it or receiving
Critics of the Bagby et al. (2004) article noted that permission to use it from the owner of the copyright.
their analyses included studies in which the Ham-D American Psychiatric Publishing provides contact
was not used as intended, to measure change in de- information for the use of the forms included on the
pression, but to assess nondepressed populations CD-ROM accompanying the Handbook of Psychiatric
(Corruble and Hardy 2005). A scale designed for Measures (Rush et al. 2008).
one population may have excellent psychometric One may be surprised to learn that forms that
properties but do poorly in another population. For have been used for some time are actually copy-
instance, in a normal population, in which very righted. For instance, the Mini-Mental State Exam
low scores on most items are expected, any small (MMSE) is now copyrighted and must be purchased.
change may generate poor agreement. Carroll et al. As an example of what forms cost, a package of 50
Measurement 89
MMSE test forms costs $60. The American Psychi- times, I use a very simple satisfaction measure to as-
atric Publishing Handbook of Psychiatric Measures, 2nd sess progress. Figure 82 provides an example of a
Edition (Rush et al. 2008), includes a Practical Is- simple scale to measure confidence and satisfaction
sues section for most measures that mentions how with dating in a patient with relationship issues (see
long it takes to complete the form, whether the form also Chapter 18). The figure also uses a scale to rate
is copyrighted, and how it can be obtained. the patients confidence to use parenting skills. Such
measures help remind me what the therapy is fo-
Developing Your Own cused on and can be used to determine whether
progress is occurring.
Assessment Measures When I began to focus more on evidence-based
Some therapy goals can be measured without rely- practice, I decided to implement a very simple system
ing on standardized instruments. For instance, many that could work in most outpatient practice settings.
behaviors, such as frequency of binge eating or I developed a weekly check-in form that evaluates
drinking or the number of panic attacks experi- mood (depression and anxiety) and includes measures
enced, can be assessed by self-report. The actual specific to the patient. I also created a blank form that
number of events can be counted, or the frequency can be used to measure two target symptoms (per
can be described more generally. For instance, a pa- page) by frequency and severity, as appropriate. In the
tient may be experiencing nausea for psychological waiting room or at the beginning of the session, the
reasons. To get a sense of how the patient is doing, patient is asked to complete the form, and if time per-
the clinician asks him to rate his nausea over the last mits and if relevant, we might plot the data together
week on the basis of how often he experienced it to see how the patient is progressing. These measures
(Figure 81). The clinician also could ask the patient are meant to be guides. Single-item measures are
to rate it by severity (Figure 81). Table 161 in subject to biases, but the form also helps ensure that
Chapter 16 of this volume lists cases in which the au- my patients and I share similar goals. As one symp-
thors used a variety of nonstandardized measures to tom or target behavior improves, or as events occur in
help guide their therapy. the patients life, we might add or refine our goals. I
A more complicated, and perhaps more interest- also include a general assessment of self-care activi-
ing, issue is to determine how to measure complex ties that I consider to be important for most patients
phenomena specific to a particular patient. For in- (exercise, stress management/relaxation/doing some-
stance, one might want to monitor the patients in- thing fun, nutrition, social support, sleep hygiene)
sight, satisfaction with relationships, confidence in and treatment use (medication adherence, side ef-
conducting a job interview, or any number of the fects, use of CBT or other strategies) and, as appro-
many phenomena that we address in therapy. Some- priate, use standard measures.
FIGURE 82. Two examples of simple, therapist-developed scales used to measure progress
toward therapy goals.
Examples of Electronic Data 2007), to refine further its features and show its ef-
ficacy in the management of longer-term health
Systems to Facilitate Evidence-
conditions. The Sentiens system can be used to pro-
Based Psychiatric Practice vide real-time data on symptom severity, plotted
against clinical activities including medications.
Example 1: A Measurement System to
Facilitate Implementation of the STAR*D Example 3: Clinical Research Information
Guidelines System at Duke University
An example of a potentially useful office-based sys- Duke University has developed the Clinical Re-
tem is the one developed by Trivedi and Daly (2007) search Information System (CRIS), described as a
to help implement the STAR*D guidelines. In the comprehensive electronic behavioral health care
STAR*D trial, poorer outcomes were most clearly management system (psychiatry.mc.duke.edu/CM-
associated with a failure to change medication after RIS/CMRIndex.htm). CRIS was designed to inte-
an extended (1224 weeks) treatment trial that had grate clinical care at all levels. CRIS also employs a
not produced a meaningful benefit, as well as with a clinical rules engine to help guide clinical practices
failure to increase the medication dose in a timely and create a clinical outcomes data warehouse for
manner within the first 12 weeks, despite a lack of retrospective decision support. Progress reports can
significant side effects (Trivedi and Daly 2007). The also be generated in real time (http://psychiatry.mc
system developed by Trivedi and Daly (2007) incor- .duke.edu/CMRIS/Image4Symptom.htm).
porates the most current information about the The cases presented in Parts II and III of this vol-
treatment of depression and provides an easy-to-use ume also provide examples of how measurement can
interface allowing physicians to use this decision be used in a variety of clinical settings.
support tool within the context of a routine clinical
visit. A computerized algorithm has been developed
to facilitate the process of following the suggested References
dosing schedules and tactical recommendations by American Psychiatric Association: Diagnostic and Statistical
displaying the recommended dosages and pretreat- Manual of Mental Disorders, 4th Edition. Washington,
ment options at that point in time according to the DC, American Psychiatric Association, 1994
decision. Additionally, all patient information, med- American Psychiatric Association: Diagnostic and Statistical
Manual of Mental Disorders, 4th Edition, Text Revision.
ication information, medication dosages, next ap-
Washington, DC, American Psychiatric Association, 2000
pointments, and progress notes are accessible with a
Anastasia A, Urbina S: Psychological Testing, 7th Edition.
click of the computer mouse and recorded electron- New York, Macmillan, 1997
ically. The program also provides a recommended Bagby RM, Ryder AG, Schuller DR, et al: The Hamilton
time frame for the patient to return according to al- Depression Rating Scale: has the gold standard become a
gorithm stage. lead weight? Am J Psychiatry 161:21632177, 2004
Barnes C, Harvey R, Mitchell P, et al: Evaluation of an online
Example 2: An Electronic System to Help relapse prevention program for bipolar disorder: an over-
view of the aims and methodology of a randomised con-
Monitor Symptom Severity, Plotted Against
trolled trial. Disease Management and Health Outcomes
Clinical Activities
15:215224, 2007
Sentiens has developed an e-health system to pro- Beaton DE, Boers M, Wells GA: Many faces of the minimal
vide improved health care for the Western Austra- clinically important difference (MCID): a literature re-
lian population (see Chapter 30 for an example of view and directions for future research. Curr Opin Rheu-
how it was used in a clinical case). The system was matol 14:109114, 2002
designed to be used by practitioners to manage and Beck AT, Ward C, Mendelson M: An inventory for measur-
ing depression. Arch Gen Psychiatry 4:561571, 1961
monitor patients wherever they may bewhether
Carroll BJ: Why the Hamilton Depression Rating Scale en-
close by in Perth, in less populated areas of Western dures. Am J Psychiatry 162:23952396, 2005
Australia, or working overseas. The resultant Cohen J: Statistical Power for the Behavioral Sciences, 2nd
HealthSteps system has been implemented in a few Edition. Hillsdale, NJ, Erlbaum, 1988
research trials, in both Australia (e.g., Barnes et al. Corruble E, Hardy P: Why the Hamilton Depression Rating
2007) and the United States (e.g., Harvey et al. Scale endures. Am J Psychiatry 162:2394, 2005
92 How to Practice Evidence-Based Psychiatry
DeVellis RF: Scale Development: Theory and Applications, Lambert MJ, Hatch DR, Kingston MD, et al: Zung, Beck,
2nd Edition. Thousand Oaks, CA, Sage, 2003 and Hamilton Rating Scales as measures of treatment
Edwards BC, Lambert MJ, Moran PW, et al: A meta-analytic outcome: a meta-analytic comparison. J Consult Clin
comparison of the Beck Depression Inventory and the Psychol 54:5459, 1986
Hamilton Rating Scale for Depression as measures of Landis JR, Koch GG: The measurement of observer agree-
treatment outcome. Br J Clin Psychol 23 (part 2):9399, ment for categorical data. Biometrics 33:159174, 1977
1984 McGrath BM, Tempier RP: Implementing quality manage-
Ellwood PM: Shattuck lecture outcomes management: a tech- ment in psychiatry: from theory to practiceshifting fo-
nology of patient experience. N Engl J Med 318:1549 cus from process to outcome. Can J Psychiatry 48:467
1556, 1988 474, 2003
Fleiss, JL. Statistical Methods for Rates and Proportions. Montgomery SA, sberg M: A new depression scale designed
Hoboken, NJ, Wiley Interscience, 1981 to be sensitive to change. Br J Psychiatry 134:382389,
Freedland KE, Skala JA, Carney RM, et al: The Depression 1979
Interview and Structured Hamilton (DISH): rationale, Newman MG, Kenardy J, Herman S, et al: Comparison of
development, characteristics, and clinical validity. Psy- cognitive-behavioral treatment of panic disorder with
chosom Med 64:897905, 2002 computer assisted brief cognitive-behavioral treatment.
Hamilton M: A rating scale for depression. J Neurol Neuro- J Consult Clin Psychol 65:173178, 1997
surg Psychiatry 23:5662, 1960 Rush AJ, Giles DE, Schlesser MA, et al: The Inventory for
Harvey R, Smith M, Abraham N, et al: The Hurricane Depressive Symptomatology (IDS): preliminary find-
Choir: remote mental health monitoring of participants ings. Psychiatry Res 18:6587, 1986
in a community based intervention in the post Katrina Rush AJ, Trivedi MH, Ibrahim HM, et al: The 16-Item Quick
period. J Health Care Poor Underserved 18:356361, Inventory of Depressive Symptomatology (QIDS), clini-
2007 cian rating (QIDS-C), and self-report (QIDS-SR): a psy-
Jacobson NS, Truax P: Clinical significance: a statistical ap- chometric evaluation in patients with chronic major
proach to defining meaningful change in psychotherapy depression. Biol Psychiatry 54:573583, 2003
research. J Consult Clin Psychol 59:1219, 1991 Rush AJ Jr, First MB, Blacker D (eds): Handbook of Psychi-
Jaeschke R, Singer J, Guyatt GH: Measurement of health sta- atric Measures, 2nd Edition. Washington, DC, American
tus: ascertaining the minimal clinically important differ- Psychiatric Publishing, 2008
ence. Control Clin Trials 10:407415, 1989 Trivedi MH, Daly EJ: Measurement-based care for refrac-
Joubert AF: PQMPsychiatry Quality Measurement. Int tory depression: a clinical decision support model for
Clin Psychopharmacol 16 (suppl 3):S2533, 2001 clinical research and practice. Drug Alcohol Depend 88
Kenardy JA, Dow MGT, Johnston DW, et al: A comparison (suppl 2):S61S71, 2007
of delivery methods of cognitive-behavioral therapy for Trivedi MH, Rush AJ, Gaynes BN, et al: Maximizing the ad-
panic disorder: an international multicenter trial. J Con- equacy of medication treatment in controlled trials and
sult Clin Psychol 71:10681075, 2003 clinical practice: STAR(*)D measurement-based care.
Killen JD, Taylor CB, Hammer LD, et al: An attempt to Neuropsychopharmacology 32:24792489, 2007
modify unhealthful eating attitudes and weight regula- Williams JB: Standardizing the Hamilton Depression Rating
tion practices of young adolescent girls. Int J Eat Disord Scale: past, present, and future. Eur Arch Psychiatry Clin
13:369384, 1993 Neurosci 251 (suppl 2):II6II12, 2001
9
Diagnostic Tests
Gregory E. Gray, M.D., Ph.D.
Questions about diagnostic tests are most com- unresolved issues concerning the validity of the cri-
monly related to the accuracy of the test, which is the teria themselves (Goldstein and Simpson 2002;
focus of this chapter. For information on topics such Kendell 1989; Kendler 1990).
as the clinical and economic impact of screening, The second issue relates to the method of eliciting
clinical decision rules, and the differential diagnosis symptoms from patients and of using this informa-
process, readers are referred to recent monographs tion to arrive at a diagnosis. In unstructured clinical
(Hunink et al. 2001; Knottnerus 2002) and standard interviews, clinicians may ignore or not inquire
textbooks of clinical epidemiology (Fletcher et al. about certain symptoms and may choose not to fol-
1996; Sackett et al. 1991). low the DSM criteria in arriving at a diagnosis (Rob-
ins 2002). As a result, unstructured interviews may
not be reliable. For this reason, a variety of diagnos-
Evaluating Diagnostic Tests tic instruments have been developed to standardize
The accuracy of a diagnostic test is generally as- the process of psychiatric diagnosis, including struc-
sessed in a cross-sectional study, in which patients tured clinical interviews (e.g., the Structured Clini-
are evaluated with both the gold standard diagnos- cal Interview for DSM-IV [SCID]) and structured
tic procedure and the diagnostic test under evalua- interviews that may be administered by either a lay
tion (Knottnerus and Muris 2002; Knottnerus et al. interviewer or a computer (e.g., the Composite In-
2002; Newman et al. 2001). Several important issues ternational Diagnostic Interview [CIDI] and the Di-
can affect the validity of such evaluations (Fletcher agnostic Interview Schedule [DIS]) (Kobak et al.
et al. 1996; Knottnerus and Muris 2002; Knottnerus 2008). Although these standardized instruments in-
et al. 2002; Newman et al. 2001; Sackett et al. 1991), crease the reliability of the diagnoses made, issues of
but the two major issues are the choice of the gold validity remain (Murphy 2002; Narrow et al. 2002;
standard and the choice of subjects. Regier et al. 1998; Robins 2002).
For the assessment of particular symptoms or
Choice of Gold Standard specific measures of cognitive function (e.g., mem-
The first issue is related to the choice of the gold ory or intelligence), well-established instruments
standard. In some branches of medicine, the gold are generally used as the gold standard. Descriptions
standard might be a pathological diagnosis based on of many of these are included in the Handbook of Psy-
a biopsy or an autopsy; in psychiatry, we usually rely chiatric Measures (Rush et al. 2008)
on the DSM-IV-TR criteria (American Psychiatric
Association [APA] 2000). Choice of Subjects
Although the DSM-IV-TR diagnostic criteria are The other major issue relates to the choice of sub-
often used as the gold standard for evaluating diag- jects. We administer diagnostic tests because we
nostic tests, they have limitations. First, there are have uncertainty about a diagnosis. A cross-sectional
93
94 How to Practice Evidence-Based Psychiatry
study that includes a spectrum of patients who are D/(B+ D). A highly specific test is one that does not
similar to those to whom the test is expected to be misidentify healthy individuals as having disease.
administered in clinical practice is the most appro- Although it may seem counterintuitive, highly
priate design. All too often, a test is evaluated in a sensitive diagnostic tests are most useful for ruling
population composed of a mix of very ill patients and out diseases. This is because such tests seldom miss
a healthy control group. In such a population, the cases of disease. Sackett et al. (2000) have proposed
test performs much better in distinguishing the ill the mnemonic SnNout (Sensitive test, Negative re-
from the healthy than in actual practice. This is re- sult, rules out disease) as a teaching aid. Similarly,
ferred to as spectrum bias (Knottnerus et al. 2002; highly specific tests are most useful for ruling in dis-
Newman et al. 2001). eases, because they seldom misidentify healthy indi-
viduals. The mnemonic for such tests is SpPin
(Specific test, Positive test, rules in disease).
Measures of Test Performance: Confidence intervals (CIs) for specificity and sen-
Dichotomous Results sitivity can be calculated using the tables given by
A variety of terms are used to describe the perfor- Habbema et al. (2002).
mance of a diagnostic test (Habbema et al. 2002). As
an aid in discussing these terms, Table 91 displays Positive and Negative Predictive Values
the results of a hypothetical comparison of a new di- The positive predictive value (PPV) is the propor-
agnostic test with an appropriate gold standard. In tion of positive test results that is true positives. Us-
this section, we consider test results to be dichoto- ing Table 91, PPV is calculated as A/(A + B). The
mous (i.e., either positive or negative). negative predictive value (NPV) is the proportion of
negative test results that is true negatives. Using Ta-
True Positive, True Negative, False Positive, ble 91, NPV is calculated as D/(C + D).
and False Negative PPV and NPV can also be looked at in terms of
If both the diagnostic test being evaluated and the posttest probabilities of disease (Fletcher et al. 1996;
gold standard yield positive results, the result of the Habbema et al. 2002). PPV represents the probabil-
diagnostic test is considered true positive (Table 91, ity that an individual with a positive test result has
cell A). Likewise, if both yield negative results, the the disease, whereas NPV represents the probability
result of the diagnostic test is considered true nega- that an individual with a negative test result does not
tive (Table 91, cell D). If the diagnostic test under have the disease.
evaluation gives a positive result, but the gold stan- PPV and NPV are dependent on the prevalence
dard gives a negative result, the result of the diag- of disease in the population being tested, which is
nostic test is considered false positive (Table 91, also referred to as the pretest probability of disease
cell B). Similarly, if the diagnostic test result is neg- (Fletcher et al. 1996). Mathematically, the relation-
ative, but the gold standard result is positive, the re- ship is as follows:
sult of the diagnostic test is considered false negative
PPV =
(Table 91, cell C).
sensitivity prevalence
------------------------------------------------------------------------------------------------------------------------------------------------------
( sensitivity prevalence ) + [(1 specificity)(1 prevalence)]
Sensitivity and Specificity
Sensitivity refers to the proportion of patients with Because of this dependence on disease prevalence,
the disease (as assessed by the gold standard) who are screening for diseases in low-prevalence populations
detected by the diagnostic test. In Table 91, this is yields few true-positive test results, regardless of the
calculated as A/(A +C). A highly sensitive test is one sensitivity and specificity of the test (Fletcher et al.
that detects most cases of disease. 1996). Baldessarini et al. (1983) have provided an ex-
Specificity refers to the proportion of patients cellent discussion of the effects of disease prevalence
without the disease (as assessed by the gold standard) on PPV in psychiatric practice, using as their exam-
who are identified by the diagnostic test as not ple the dexamethasone suppression test as a diagnos-
having the disease. In Table 91, this is calculated as tic test for depression.
Diagnostic Tests 95
Using diagnostic tests in this way to quantify the can be seen from Table 92, the single question had
risk of disease in a patient and to then use these prob- a sensitivity of 86% and a specificity of 78%.
abilities in clinical decision making has become an We can use LRs to see the impact of a positive or
important field of study, but it is outside the scope negative response to the question on the probability
this chapter. For further details, readers are referred of a patient being depressed. Depression typically
to Hunink et al. (2001) and Sackett et al. (1991, 2000). occurs in 25%40% of patients with stroke and
other neurologic conditions (APA 2000). Thus, the
pretest odds for such a patient are between 25/
Error Rate and Accuracy 75 = 0.33 and 40/60 = 0.67. If the patient answers
The error rate of a diagnostic test is the percentage yes to the question, the posttest odds are between
of test results that is either false positives or false 0.33 3.87 = 1.28 and 0.67 3.87 =2.59, correspond-
negatives (Habbema et al. 2002). Using the data in ing to posttest probabilities of 56%72%. If the pa-
Table 91, error rate can be calculated as follows: tient answers no, the posttest odds are between
0.33 0.18 = 0.06 and 0.67 0.18 =0.12, correspond-
B+C
----------------------------- ing to posttest probabilities of 6%11%.
A+B+C+ D
TABLE 92. Accuracy of a single question (Do you often feel sad or depressed?) in screening
for depression in stroke patients
(ROC) curve (Figure 91). An ROC curve plots the 1991). It can be seen that as the CAGE score in-
sensitivity against (1 specificity) for each cutoff creases from 0 to 4, LRs increase from 0.14 to 100.
value (Fletcher et al. 1996; Sackett et al. 1991, 2000). Assuming a prevalence (pretest probability) of alco-
The ROC curve can be used to identify a cutoff hol dependence of 5% (APA 2000), a CAGE score of
value, where a point near the upper left corner is the 0 decreases the posttest probability to 1%. Using the
appropriate cutoff. ROC curves can also be used to same figures, a CAGE score of 2 increases the post-
compare two diagnostic tests; the better test is the test probability to 19% and a CAGE score of 5 in-
one with its ROC curve closer to the upper left cor- creases the posttest probability to 84%. Clearly, this
ner (Fletcher et al. 1996). provides more information than simply treating the
results as positive (2+) or negative (01).
Likelihood Ratios
Intuitively, it would seem that converting numerical Systematic Reviews and
or ordered test results into just two categories would
result in a loss of information. It would seem that a
Meta-Analyses of Diagnostic Tests
value greatly over the cutoff would be more indica- As with the evaluation of therapies, systematic re-
tive of disease than a value that is barely more than views that are related to diagnostic tests may be con-
the cutoff. LRs allow these differences to be taken ducted. However, there are several approaches to
into account. meta-analysis (Deeks 2001; Glasziou et al. 2001).
If a test result takes multiple values, LRs can be One approach is to use one forest plot for sensitivi-
calculated for multiple scores, not just LR+ and LR. ties and their CIs and another for specificities and
This is illustrated in Table 94, using the same their CIs (see Chapter 6). Another approach is to
CAGE data found in Table 93 (Buchsbaum et al. plot the sensitivity against (1 specificity) on an
TABLE 93. Sensitivity and specificity of the CAGE questionnaire in screening for alcohol
abuse in general medical patients
TABLE 95. Critical appraisal guide for Conversely, if the posttest probability remains
studies of diagnostic accuracy low even if the test result is positive, the test should
probably not be performed because it is likely that
Is the study valid?
any positive test result will be a false positive. Order-
Is it a cross-sectional study? ing the test under these circumstances would be
Was the test evaluated in an appropriate spectrum of both a waste of money and an unnecessary cause
patients? of anxiety for patients with false-positive results
Was there an independent blind comparison with a (Fletcher et al. 1996).
gold standard? To do these sorts of calculations, you will need the
Were both tests administered, regardless of outcome?
LR+ and LR from the article reporting the perfor-
mance of the test in question and an estimate of your
Are the results important? patients pretest probability of disease. If your patient
What is the sensitivity? is similar to patients in the study population, the pre-
What is the specificity? test probability can be derived from the study evalu-
ating the diagnostic test. If not, the pretest probability
What is the positive predictive value?
can be estimated from epidemiologic data or from pa-
What is the negative predictive value? tient data from your hospital or health maintenance
What is the likelihood ratio for a positive test result? organization (Mant 1999; Sackett et al. 2000). If pub-
What is the likelihood ratio for a negative test result? lished data are not available, you may have to make a
subjective estimate of the pretest. In this case, it is
Can I apply the results to my patient? probably best to estimate an upper and lower limit
Is the test available or feasible in my setting? and to do the calculations with both values.
Do I have enough information to apply the test and to If the test is valid and feasible and if the results
interpret the results? will make a difference in patient management, you
should use it.
Given reasonable pretest estimates of disease
probability in my patient, what are the posttest
probabilities if the test is positive? If it is negative? References
Will these probabilities change my management of the American Psychiatric Association: Diagnostic and Statistical
patient? Manual of Mental Disorders, 4th Edition, Text Revision.
Source. Based on Gilbert et al. 2001; Glasziou et al. 2001; Washington, DC, American Psychiatric Association,
Sackett et al. 2000. 2000
Baldessarini RJ, Finkelstein S, Arana GW: The predictive
power of diagnostic tests and the effect of prevalence of
sessments of the probability of disease in a given illness. Arch Gen Psychiatry 40:569573, 1983
patient. If that probability is high, physicians treat Buchsbaum DG, Buchanan RG, Centor RM, et al: Screening
the patient; if that probability is intermediate, phy- for alcohol abuse using CAGE scores and likelihood ra-
tios. Ann Intern Med 115:774777, 1991
sicians order more diagnostic tests; and if it is low,
Deeks JJ: Systematic reviews of evaluation of diagnostic and
physicians do neither. The probability at or above
screening tests. BMJ 323:157162, 2001
which tests are ordered is termed the test threshold, Elstein AS, Schwartz A: Clinical problem solving and diag-
and the probability at or above which treatment is nostic decision making: a selective review of the cognitive
begun is termed the treatment threshold (Hunink et research literature, in The Evidence Base of Clinical Di-
al. 2001; Sackett et al. 2000). agnosis. Edited by Knottnerus JA. London, BMJ Books,
If your patients pretest probability is already 2002, pp 179195
above the treatment threshold, there is no point in Fagan TJ: Nomogram for Bayes theorem. N Engl J Med
293:257, 1975
ordering the diagnostic test. For example, if your di-
Fletcher RH, Fletcher SW, Wagner EH: Clinical Epidemi-
agnostic interview shows that your patient met the
ology: The Essentials, 3rd Edition. Baltimore, MD, Wil-
DSM-IV-TR criteria for major depression, there is liams & Wilkins, 1996
no need to also use a rating scale developed to screen Gilbert R, Logan S, Moyer VA, et al: Assessing diagnostic
for depression. You have already established the di- and screening tests, II: how to use the research literature
agnosis with enough certainty to begin treatment. on diagnosis. West J Med 175:3741, 2001
100 How to Practice Evidence-Based Psychiatry
Glasziou P: Which methods for bedside Bayes? ACP J Club Martino S, Poling J, Rounsaville BJ: Substance use disorders
135:A11A12, 2001 measures, in Handbook of Psychiatric Measures, 2nd
Glasziou P, Irwig L, Bain C, et al: Systematic Reviews in Edition. Edited by Rush AJ, First MB, Blacker D. Wash-
Health Care: A Practical Guide. Cambridge, UK, Cam- ington, DC, American Psychiatric Publishing, 2008, pp
bridge University Press, 2001 437470
Goldstein JM, Simpson JC: Validity: definitions and applica- McGinn T: Practice corner: using clinical prediction rules.
tions to psychiatric research, in Textbook in Psychiatric ACP J Club 137:A10A11, 2002
Epidemiology, 2nd Edition. Edited by Tsuang MT, To- Murphy JM: Symptom scales and diagnostic schedules in
hen M. New York, Wiley-Liss, 2002, pp 149163 adult psychiatry, in Textbook in Psychiatric Epidemiol-
Greenhalgh T: How to Read a Paper: The Basics of Evidence ogy, 2nd Edition. Edited by Tsuang MT, Tohen M. New
Based Medicine, 2nd Edition. London, BMJ Books, 2001 York, Wiley-Liss, 2002, pp 273332
Habbema JDF, Eijkemans R, Krijnen P, et al: Analysis of data Narrow WE, Rae DS, Robins LN, et al: Revised prevalence
on the accuracy of diagnostic tests, in The Evidence Base estimates of mental disorders in the United States: using
of Clinical Diagnosis. Edited by Knottnerus JA. London, a clinical significance criterion to reconcile 2 surveys es-
BMJ Books, 2002, pp 117143 timates. Arch Gen Psychiatry 59:115123, 2002
Hunink M, Glasziou P, Siegel J, et al: Decision Making in Newman TB, Browner WS, Cummings SR: Designing stud-
Health and Medicine: Integrating Evidence and Values. ies of medical tests, in Designing Clinical Research: An
New York, Cambridge University Press, 2001 Epidemiologic Approach, 2nd Edition. Edited by Hulley
Kendell RE: Clinical validity. Psychol Med 19:4555, 1989 SB, Cummings SR, Browner WS, et al. Philadelphia, PA,
Kendler KS: Toward a scientific psychiatric nosology: Lippincott Williams & Wilkins, 2001, pp 175191
strengths and limitations. Arch Gen Psychiatry 47:969 Regier DA, Kaelber CT, Rae DS, et al: Limitations of diag-
973, 1990 nostic criteria and assessment instruments for mental dis-
Knottnerus JA (ed): The Evidence Base of Clinical Diagno- orders: implications for research and policy. Arch Gen
sis. London, BMJ Books, 2002 Psychiatry 55:109115, 1998
Knottnerus JA, Muris JWM: Assessment of the accuracy of Robins LN: Birth and development of psychiatric interviews,
diagnostic tests: the cross-sectional study, in The Evi- in Textbook in Psychiatric Epidemiology, 2nd Edition.
dence Base of Clinical Diagnosis. Edited by Knottnerus Edited by Tsuang MT, Tohen M. New York, Wiley-Liss,
JA. London, BMJ Books, 2002, pp 3960 2002, pp 257271
Knottnerus JA, van Weel C, Muris JWM: Evaluation of di- Rush AJ, First MB, Blacker D (eds): Handbook of Psychiatric
agnostic procedures. BMJ 324:477480, 2002 Measures, 2nd Edition. Washington, DC, American Psy-
Kobak KA, Skodol AE, Bender DS: Diagnostic measures chiatric Publishing, 2008
for adults, in Handbook of Psychiatric Measures, 2nd Sackett DL, Haynes RB, Guyatt GH, et al: Clinical Epide-
Edition. Edited by Rush AJ, First MB, Blacker D. Wash- miology: A Basic Science for Clinical Medicine, 2nd Edi-
ington, DC, American Psychiatric Publishing, 2008, pp tion. Boston, MA, Little, Brown, 1991
3560 Sackett DL, Straus SE, Richardson WS, et al: Evidence-
Mant J: Is this test effective? In Evidence-Based Practice: A Based Medicine: How to Practice and Teach EBM, 2nd
Primer for Health Professionals. Edited by Dawes M, Edition. New York, Churchill Livingstone, 2000
Davies P, Gray A, et al. New York, Churchill Living- Watkins C, Daniels L, Jack C, et al: Accuracy of a single ques-
stone, 1999, pp 133157 tion in screening for depression in a cohort of patients af-
ter stroke: comparative study. BMJ 323:1159, 2001
10
Questions about disease frequency take various time. It is measured by starting with a population
forms. A patients family member or member of the (cohort) that is initially free of the disease in ques-
public may wonder about the risk of developing a tion and by then counting the cases that develop in a
disease. An administrator may wonder about the defined period of time. The incidence rate has
number of patients who will need treatment. A cli- cases as its numerator and person-years at risk
nician attempting to evaluate a patients risk of dis- as its denominator. The incidence rate is the mea-
ease, based on the results of a diagnostic test, will sure of frequency of most interest to epidemiologists
need information on the patients pretest probability seeking to understand the cause of a disease, because
of disease (see Chapter 9). it measures the actual risk of developing the disease.
All of these questions require quantitative infor-
mation about the frequency of a particular illness in Point Prevalence
a defined population of interest, which is the subject When epidemiologists use the term prevalence, they
of descriptive epidemiology. This chapter reviews are usually referring to the point prevalence (i.e., the
the various measures of disease frequency and the number of cases of disease in a defined population
methods of descriptive epidemiology, as background at a given point in time). It is measured in a cross-
information for the critical appraisal of studies of sectional survey in which individuals are identified
disease frequency. For additional information, read- as either having or not having a disease at the time of
ers are referred to standard epidemiology texts the survey.
(Fletcher et al. 1996; Gordis 2000; Hennekens et al. Point prevalence is of interest to health care plan-
1987; Lilienfeld and Stolley 1994) and reviews of ners, because it measures the burden of illness in a
psychiatric epidemiology (Regier and Burke 2000; population. It is also of interest to clinicians, because
Tsuang and Tohen 2002). it is a measure of a patients pretest probability of dis-
ease (see Chapter 9).
Measures of Disease Frequency Point prevalence is less helpful in understanding
the causes of disease, because it reflects both the in-
A number of terms, such as incidence, prevalence, and
cidence (risk) of disease and the duration of the ill-
lifetime prevalence, are usedand often misusedto
ness. In a steady state situation in which the incidence
refer to the frequency of disease in a population.
rate and average duration of illness are constant, the
following relationship between incidence and point
Incidence
prevalence exists:
The incidence of disease is the number of new cases of
disease in a defined population in a given period of point prevalence = incidence rate average duration of illness
101
102 How to Practice Evidence-Based Psychiatry
This relationship allows for the calculation of the morbid risk (Faraone et al. 2002; Slater and Cowie
third variable in the equation, if the other two vari- 1971). This measure corrects the denominator to re-
ables are known. flect the fact that younger individuals have had less
chance to develop the illness than older individuals
Period Prevalence and is a better estimate of the risk of developing the
Period prevalence is a measure of the proportion of illness at some point during a normal lifespan.
individuals in a defined population who have an ill-
ness in a specified period of time. It is a hybrid mea- Age- and Sex-Specific and Adjusted Rates
sure that reflects both the proportion of patients The incidence and prevalence of many psychiatric
who have the illness at the start of the time interval disorders vary with age and sex. The incidence of
(prevalence), as well as the number of new cases that major depression, for example, is greater in women
develop during the time period (incidence time). than in men (Horwath et al. 2002), and the incidence
Although period prevalence is seldom used outside and prevalence of dementia increase with age, be-
psychiatry (Hennekens et al. 1987), it is widely used ginning at about age 65 years (Hybels and Blazer
in surveys of the frequency of psychiatric illnesses 2002). In determining the pretest probability of dis-
(Fleming and Hsieh 2002; Regier and Burke 2000). ease for an individual, using age- and sex-specific
In the National Comorbidity Survey, for example, re- prevalences will be more accurate than using the
sults were reported as 12-month prevalences, which prevalence figures for the population as a whole.
indicates that an individual had the disorder in ques- When comparing rates between geographic areas
tion at some time during the 12 months prior to the or over time, it is important to take demographic dif-
interview date (Kessler and Walters 2002). ferences into account. For example, differences in the
The popularity of period prevalence in psychiat- incidence of depression in two populations could re-
ric epidemiology relates to the fact that many psy- flect actual differences in risk for disease or they
chiatric illnesses have a recurring or episodic course; could simply reflect differences in age or sex distribu-
therefore, the period prevalence is believed to be a tion. To eliminate demographic differences as the ex-
better reflection of disease burden in the population planation, rates can be standardized. In essence, this
than is the proportion of patients who are symptom- involves calculating a weighted average of the age-
atic at a given point in time. and sex-specific rates, using identical weights for
both populations. Methods of standardization and
Lifetime Prevalence details of the calculations can be found in standard
Lifetime prevalence is a specific type of period prev- epidemiology and biostatistics texts (Gordis 2000;
alence used in psychiatric epidemiology. As used in Hennekens et al. 1987; Pagano and Gauvreau 2000).
the National Comorbidity Survey and in similar stud-
ies, lifetime prevalence is the proportion of the patients
in population studies who have experienced an illness
Using Registries and
up to the point in their life that they are surveyed. Existing Records
Defined in this way, lifetime prevalence has sev- There are several potential sources of existing or
eral limitations (Fleming and Hsieh 2002; Regier routinely collected information about the frequency
and Burke 2000). First, it is dependent on memory of disease in a population. These resources include
(recall bias). Second, it is highly dependent on the disease registries, reporting systems, and insurance
age structure of the population, with young people or health plan statistics (Gordis 2000; Lilienfeld and
less likely to develop the disease than older people. Stolley 1994).
Third, if the disease is associated with excess mortal- For some diseases (e.g., cancer and some infec-
ity from suicide or other causes, lifetime prevalence tious diseases), established disease reporting systems
may decline with age. and case registries can provide considerable infor-
mation about incidence or prevalence. In psychiatry,
Morbidity Risk largely because of privacy concerns, such registers or
An alternative measure of lifetime risk, sometimes reporting systems are largely nonexistent. Notable
referred to as lifetime expectancy, is morbidity risk or exceptions to this include case registers of psychiat-
Surveys of Disease Frequency 103
frequency. A guide for critically appraising these TABLE 101. Critical appraisal guide for
studies is given in Table 101. surveys of disease frequency
Is the study valid?
Is the Study Valid?
Is the study design appropriate (cross-sectional survey
The first questions relate to the study design. For es- for measuring prevalence or cohort study for
timating prevalence, a cross-sectional survey, in measuring incidence)?
which individuals are identified as either having or
Was an appropriate sampling method used?
not having a disease either at the time of the survey
or during some defined time period, is the appropri- Was the response rate sufficiently high?
ate design. Incidence rates are measured in cohort Was a standardized method used to determine the
studies, in which a group of individuals who are ini- presence of disease?
tially free of the disease in question is followed over Is the assessment instrument reliable and valid?
time, and cases of disease that develop in the cohort
Are the results important?
during the follow-up period are counted.
Regardless of study design, the individuals sur- What is the incidence or prevalence?
veyed should be members of a defined population Are there important differences by age, sex, ethnicity,
that is sampled in such a way as to give an unbiased etc.?
estimate or incidence or prevalence rate. A conve- How precise are the estimates?
nience sample or the use of volunteers recruited
Can I apply the results to my patient?
from an advertisement cannot be considered repre-
sentative of a defined population; it will give a biased Does my patient come from a population similar to
that surveyed?
estimate of disease frequency, which is referred to as
selection bias (Daly and Bourke 2000). Are there age- or sex-specific estimates (if appropriate)
Nonresponse bias is an additional concern, be- that apply to my patient?
cause individuals who refuse to participate in the Source. Based in part on the criteria of Barker et al. 1998;
survey may be systematically different from individ- Fletcher et al. 1996.
uals who do participate (Aday 1996; Barker et al.
1998; Daly and Bourke 2000). For example, tele- tient, rates specific to age, sex, and other demographic
phone follow-up of nonresponders in the National characteristics will be helpful. In contrast, if your in-
Comorbidity Survey found that they were more apt terest lies in comparing the rates in two populations,
to have an anxiety disorder than were responders standardized rates will be of more interest.
(Kessler and Walters 2002). In general, it is consid-
ered desirable to have as high a response rate as pos- Can I Apply the Results to My Patient?
siblegenerally, at least 75%80% (Aday 1996; The first question to ask is whether the population is
Barker et al. 1998; Kelsey et al. 1996). similar enough that the results can reasonably be
It is essential to use standard criteria to decide generalized to your patient (Hulley et al. 2001). In
whether an individual has a disorder or not, because addition, if your clinical question relates to a pretest
prevalence will depend on the definition of what con- probability of disease in your patient (see Chapter
stitutes a case (Fletcher et al. 1996). In addition, as de- 9), the availability of age- and sex-specific preva-
scribed above under Surveys of Disease Frequency, lence rates will give you a more accurate estimate
the assessment instrument must have acceptable reli- than will crude or standardized rates.
ability and validity (Regier and Burke 2000).
References
Are the Results Important?
Aday LA: Designing and Conducting Health Surveys: A
Which results are important will, of course, be related
Comprehensive Guide, 2nd Edition. San Francisco, CA,
to your initial clinical question. At a minimum, you Jossey-Bass, 1996
would expect to see an incidence or prevalence rate American Psychiatric Association: Diagnostic and Statistical
for each disorder surveyed, with confidence limits. If Manual of Mental Disorders, 4th Edition, Text Revision.
your goal is to apply the results to an individual pa- Washington, DC, American Psychiatric Association, 2000
Surveys of Disease Frequency 105
Barker DJP, Cooper C, Rose G: Epidemiology in Medical Kessler RC, Walters E: The National Comorbidity Survey,
Practice, 5th Edition. New York, Churchill Livingstone, in Textbook in Psychiatric Epidemiology, 2nd Edition.
1998 Edited by Tsuang MT, Tohen M. New York, Wiley-Liss,
Burke JD: Mental health services research, in Textbook in 2002, pp 343362
Psychiatric Epidemiology, 2nd Edition. Edited by Tsuang Kobak KA, Skodol AE, Bender DS: Diagnostic measures
MT, Tohen M. New York, Wiley-Liss, 2002, pp 165179 for adults, in Handbook of Psychiatric Measures, 2nd
Daly LE, Bourke GJ: Interpretation and Uses of Medical Sta- Edition. Edited by Rush AJ, First MB, Blacker D. Wash-
tistics, 5th Edition. Oxford, UK, Blackwell Scientific, 2000 ington, DC, American Psychiatric Publishing, 2008, pp
Faraone SV, Tsuang D, Tsuang MT: Methods in psychiatric 3560
genetics, in Textbook in Psychiatric Epidemiology, 2nd Lilienfeld DE, Stolley PD: Foundations of Epidemiology,
Edition. Edited by Tsuang MT, Tohen M. New York, 3rd Edition. New York, Oxford University Press, 1994
Wiley-Liss, 2002, pp 65130 Murphy JM: Symptom scales and diagnostic schedules in
Fleming JA, Hsieh C-C: Introduction to epidemiologic re- adult psychiatry, in Textbook in Psychiatric Epidemiol-
search methods, in Textbook in Psychiatric Epidemiol- ogy, 2nd Edition. Edited by Tsuang MT, Tohen M. New
ogy, 2nd Edition. Edited by Tsuang MT, Tohen M. New York, Wiley-Liss, 2002, pp 273332
York, Wiley-Liss, 2002, pp 333 Narrow WE, Rae DS, Robins LN, et al: Revised prevalence
Fletcher RH, Fletcher SW, Wagner EH: Clinical Epidemi- estimates of mental disorders in the United States: using
ology: The Essentials, 3rd Edition. Baltimore, MD, Wil- a clinical significance criterion to reconcile 2 surveys es-
liams & Wilkins, 1996 timates. Arch Gen Psychiatry 59:115123, 2002
Gordis L: Epidemiology, 2nd Edition. Philadelphia, PA, WB Pagano M, Gauvreau K: Principles of Biostatistics, 2nd Edi-
Saunders, 2000 tion. Pacific Grove, CA, Duxbury, 2000
Hennekens CH, Buring JE, Mayrent SL: Epidemiology in Regier DA, Burke JD: Epidemiology, in Kaplan and Sadocks
Medicine. Boston, MA, Little, Brown, 1987 Comprehensive Textbook of Psychiatry, 7th Edition. Ed-
Horwath E, Cohen RS, Weissman MM: Epidemiology of de- ited by Sadock BJ, Sadock VA. Philadelphia, PA, Lippin-
pressive and anxiety disorders, in Textbook in Psychiatric cott Williams & Wilkins, 2000, pp 500522
Epidemiology, 2nd Edition. Edited by Tsuang MT, To- Regier DA, Kaelber CT, Rae DS, et al: Limitations of diag-
hen M. New York, Wiley-Liss, 2002, pp 389426 nostic criteria and assessment instruments for mental dis-
Hulley SB, Newman TB, Cummings SR: Choosing the study orders: implications for research and policy. Arch Gen
subjects: specification, sampling, and recruitment, in De- Psychiatry 55:109115, 1998
signing Clinical Research: An Epidemiologic Approach, Robins LN: Birth and development of psychiatric interviews,
2nd Edition. Edited by Hulley SB, Cummings SR, in Textbook in Psychiatric Epidemiology, 2nd Edition.
Browner WS, et al. Philadelphia, PA, Lippincott Will- Edited by Tsuang MT, Tohen M. New York, Wiley-Liss,
iams & Williams, 2001, pp 2536 2002, pp 257271
Hybels CF, Blazer DG: Epidemiology and geriatric psychia- Rush AJ, First MB, Blacker D (eds): Handbook of Psychiatric
try, in Textbook in Psychiatric Epidemiology, 2nd Edi- Measures, 2nd Edition. Washington, DC, American Psy-
tion. Edited by Tsuang MT, Tohen M. New York, Wiley- chiatric Publishing, 2008
Liss, 2002, pp 603628 Slater E, Cowie V: The Genetics of Mental Disorder. New
Kalton G: Introduction to Survey Sampling. Newbury Park, York, Oxford University Press, 1971
CA, Sage, 1983 Tsuang MT, Tohen M (eds): Textbook in Psychiatric Epide-
Kelsey JL, Whittemore AS, Evans AS, et al (eds): Methods in miology, 2nd Edition. New York, Wiley-Liss, 2002
Observational Epidemiology, 2nd Edition. New York,
Oxford University Press, 1996
This page intentionally left blank
11
This chapter covers the appraisal of two types of clinical trials (Jones 2001). Unfortunately, such re-
studies: those that assess the harm associated with porting is often incomplete (Ioannidis and Lau
a therapy (e.g., medication side effects) and those 2001). Furthermore, premarketing trials are often of
that attempt to identify factors that increase the risk short duration, are limited to fewer than 2,000 pa-
of developing a disease. A variety of study designs tients, and simply do not have the statistical power
are presented, including case reports, randomized to detect ADRs that occur in 1 of 10,000 drug expo-
controlled trials (RCTs), cohort studies, and case- sures (for which 30,000 patients would have to be
control studies (Levine et al. 2002; Turcotte et al. studied) (Brewer and Colditz 1999; Pirmohamed et
2001) (Table 111). al. 1998).
For common side effects, however, an RCT pro-
Case Reports and Case Series vides the best evidence that the side effect was caused
by medication, not chance (Turcotte et al. 2001). A
As noted in Chapter 5, case reports and case series variety of statistical measures are used to assess the
are best viewed as sources of hypotheses for further magnitude of the difference in adverse events be-
testing (Fletcher et al. 1996; Hennekens et al. 1987). tween a control and experimental treatments. Most
They have been used traditionally to describe rare of these measures are discussed in Chapter 5; how-
clinical events and often provide the first warnings ever, there are three measures that are unique to
about rarebut clinically significantadverse drug studies of harm: relative risk increase (RRI), absolute
reactions (ADRs) (Brewer and Colditz 1999). risk increase (ARI), and number needed to harm
Unfortunately, case reports and case series may (NNH) (Sackett et al. 2000) (Table 112).
also include coincidental occurrences, and without a
denominator it is impossible to determine the actual Relative Risk and Relative Risk Increase
risk of an adverse event. For example, case reports
If a therapy increases the risk of an adverse event, the
have wrongly implicated beta-blockers as a cause of
experimental event rate (EER) is greater than the
depression, which actually occurs no more fre-
control event rate (CER), and relative risk (RR), cal-
quently in patients on beta-blockers than in patients
culated as EER/CER, is greater than 1. RRI is cal-
receiving placebos (Ko et al. 2002).
culated using the following formula:
107
108 How to Practice Evidence-Based Psychiatry
Randomized
Case reports or controlled
case series trial (RCT) Cohort study Case-control study
Advantages Used to describe Least biased study Less apt to be biased Quicker, less
rare or unusual design than case-control study expensive than
events Can demonstrate Better able to assess rare cohort study
cause-effect outcomes than RCT Useful for rare
relationship diseases
Disadvantages Cannot prove Cannot assess risk of Involves large numbers More prone to bias
association or rare side effects of subjects than RCT or cohort
causality Unethical to conduct Loss to follow-up may study
Often misleading trial specifically to limit validity Cannot measure
cause harm absolute risks
Risk statistics None Relative risk increase Relative risk Odds ratio
Absolute risk increase Risk difference
Number needed to Number needed to harm
harm
of 0.5% and a CER of 0.1% yield the same RR and more complete discussion (Fletcher et al. 1996;
RRI as an EER of 50% and an CER of 10%, yet the Gordis 2000; Hennekens et al. 1987; Kelsey et al.
absolute magnitude of the increase in adverse events 1996; Rothman 2002).
is greater in the latter case.
Cohort Studies
Absolute Risk Increase and Number In a cohort study, a group of subjects (cohort) is fol-
Needed to Harm lowed over time, and the incidence of disease is deter-
ARI is calculated as EER CER. Unlike RR and mined (see Chapter 10). The members of the cohort
RRI, ARI provides a measure of the proportion of can be classified as either exposed or unexposed to a
patients receiving treatment who will be harmed by medication or suspected risk factor for disease. Such
it, which thus avoids some of the limitations of the characteristics are determined at the beginning of the
relative measures of effect. study, before disease occurrence. If exposure increases
NNH is simply the reciprocal of ARI. It is analo- the risk of disease, the incidence in the exposed group
gous to NNT (see Chapter 5) as a measure of treat- is greater than the incidence in the unexposed group.
ment effect; it indicates the number of patients who
would need to be treated with the experimental TABLE 112. Measures of risk: randomized
treatment to produce one more adverse event than controlled trial
would have occurred with the control treatment.
Experimental Control
treatment treatment
Epidemiologic Studies Harm A B
Because we do not ordinarily conduct experiments No harm C D
to prove that something is harmful to patients, much
Total A+C B +D
of our knowledge about the etiology of disease, as
well as of less common medication side effects, Experimental event rate (EER) =A/(A+C)
comes from epidemiologic studies. In this section, Control event rate (CER) =B/(B +D)
Relative risk (RR)=EER/CER
the two most common study designs, cohort studies Relative risk increase = (EERCER)/CER =RR1
and case-control studies, are reviewed. The reader is Absolute risk increase (ARI)=EERCER
referred to several excellent epidemiology texts for a Number needed to harm= 1/ARI
Studies of Risk or Harm 109
Prospective Cohort Studies example, because olanzapine causes more weight gain
Cohort studies can be either prospective or retro- than risperidone (Lawrie and McIntosh 2002), ris-
spective (Hennekens et al. 1987). In a prospective or peridone might be prescribed more frequently to pa-
concurrent cohort study, the cohort is assembled and tients predisposed to obesity or diabetes, thus
the exposure status is determined; it is then followed confounding any observed relationship between
over time to determine the incidence of disease. In a medication and risk of diabetes. Confounding can be
prospective cohort study, Takeshita et al. (2002) fol- accounted for in the statistical analysis of the data, but
lowed a cohort of more than 3,000 Japanese Ameri- only to the extent that the confounding factors have
cans for 6 years and found that those with depressive been identified and measured. Statistical methods to
symptoms had an increased mortality rate, com- control for confounding in cohort studies include
pared with those without depressive symptoms. stratified analysis and Poisson regression, details of
which can be found in more advanced texts (Kelsey et
Retrospective Cohort Studies al. 1996; Rothman and Greenland 1998).
In a retrospective cohort study, existing records are There are also several potential biases in cohort
used to identify a historical cohort and to measure studies that could be problematic. These include
both exposures and outcomes of interest, all of which differential misclassification as to disease and expo-
have occurred at the time the study is initiated. Doing sure status, losses to follow-up, and nonparticipa-
so allows the study to be conducted more quickly and tion. Good discussions of biases and confounding in
with less expense than if the cohort was actually fol- cohort studies can be found in most standard epide-
lowed for several years. Because retrospective cohort miology texts (Gordis 2000; Hennekens et al. 1987;
studies are dependent on existing records, issues of Rothman 2002).
data quality often arise. An example of a retrospective
cohort study is that of Gunnell et al. (2002), in which Measures of Risk
intellectual performance at age 18 was determined In a cohort study, incidence rates are calculated for
from military psychological records for a cohort of exposed and nonexposed groups. Several measures
nearly 200,000 Swedish male conscripts examined of risk can then be calculated, including absolute
several years earlier and was found to predict the sub- risk, RR, odds ratio (OR), and risk difference (RD)
sequent development of schizophrenia and other psy- (Table 113). RD in a cohort study is analogous to
choses over an average follow-up period of 5 years. ARI in an RCT, and NNH may be calculated as 1/RD.
RR and OR are measures of the strength of associa-
Bias and Confounding tion between an exposure and outcome, whereas RD
Cohort studies are sometimes referred to as natural and NNH are better measures of the potential for
experiments, although they differ significantly in that prevention (Gordis 2000; Sackett et al. 2000).
the subjects are not randomly allocated in a cohort
study (Gordis 2000; Rothman 2002). This is an im-
portant difference, in that bias and confounding be- TABLE 113. Measures of risk: cohort study
come major considerations in interpreting the
Nonexposed
results. In an RCT, randomization minimizes the Exposed group group
chance that differences in outcomes between the
experimental and control groups are the result of Harm A B
preexisting differences in the subjects in the two No harm C D
groups. In a cohort study, preexisting differences be- Total A+C B +D
tween exposed and nonexposed subjects may influ-
ence the subsequent risk of disease. Incidence in exposed group= A/(A+C)
Incidence in nonexposed group= B/(B+D)
Confounding is especially problematic in studies Relative risk= incidence in exposed group/incidence in non-
of medication side effects, where the prescription of exposed group
particular medications may be influenced by the pre- Risk difference =incidence in exposed groupincidence in
existing medical conditions of patients, which is nonexposed group
Number needed to harm= 1/RD
called confounding by indication (Rothman 2002). For
110 How to Practice Evidence-Based Psychiatry
particular problem with life events and depression TABLE 114. Measure of risk:
research (Cooper and Paykel 1993; Creed 1993). case-control study
Criterion Description
Temporal relationship Exposure precedes disease
Strength of association Large relative risk or odds ratio
Doseresponse relationship Increasing exposure increases risk
Reversibility Reducing exposure decreases risk
Consistency Similar findings from other studies in different populations
Biological plausibility Consistent with pharmacological or toxicological data
Analogy Relationship established for similar cause and disease
Elimination of other explanations Not the result of confounding or bias
Specificity One cause, one effect
Source. Adapted from Fletcher et al. 1996; Gordis 2000; Hennekens et al. 1987; Sackett et al. 2000.
TABLE 117. Critical appraisal guide for effects, (as well as patient-specific NNTs and
randomized controlled NNHs) is given in Appendix B.
trials reporting harm
Is the study valid? Cohort Studies of Etiology Or Harm
Is it a randomized controlled trial?
A critical appraisal guide for a cohort study of etiol-
Was the randomization list concealed? ogy or harm is given in Table 118.
Were subjects and clinicians blinded to treatment
being administered? Is the Study Valid?
Were side effects assessed appropriately? Several questions should be asked to determine the
Was the trial of sufficient duration to detect the side validity of the study. First, how were the subjects se-
effects of interest? lected? The cohort should consist of individuals who
Were all subjects enrolled in the trial accounted for? are initially free of the disease under investigation,
but who are potentially at risk for developing the
Were subjects analyzed in the groups to which they
disease. In addition, the exposed and nonexposed
were assigned?
groups should be selected in such a way as to avoid
Despite randomization, were there clinically major differences other than exposure status.
important differences between groups at the start of
Was the cohort large enough and was the follow-
the trial?
up period long enough? For rare outcomes, large
Aside from the experimental treatment, were the numbers of individuals must often be studied for
groups treated equally? prolonged periods of time to detect statistically sig-
Are the results important? nificant differences in risk.
How large was the treatment effect (number needed How was exposure measured? If significant errors
to harm)? are made in classifying individuals as either ex-
How precise are the results (width of confidence
posed or not, the results will tend to be biased. Ran-
intervals)? dom misclassification will tend to bias the observed
RR toward 1.0, whereas differential misclassification
Can I apply the results to my patient? will result in either an overestimate or underesti-
Is my patient too different from patients in the study? mate of the actual RR (Hennekens et al. 1987).
How do the benefits and risks of treatment compare Were exposed and unexposed individuals assessed
for my patient? for outcomes with the same intensity and were out-
How does my patient value these benefits and risks? comes assessed blindly (i.e., without knowledge of
exposure status)? If not, any differences could be the
Do the benefits outweigh the harms (likelihood of
result of measurement bias, not true differences
being helped or harmed)?
(Fletcher et al. 1996).
Source. Based in part on the criteria of Levine et al. 2002; Similarly, were there differences in dropout rates
Sackett et al. 2000.
between the two groups? Because the outcomes of
patients who drop out may differ from the outcomes
(LHH) (Guyatt et al. 2002; Sackett et al. 2000). As a of patients completing the study, differences in
first approximation: dropout rates between the two groups may lead to
biased estimates of risk (Hennekens et al. 1987).
1/ NNT NNH
LHH = ------------------- = ------------- Were the exposed and nonexposed groups in fact
1/ NNH NNT
similar, except for exposure? If not, then confound-
with values of LHH > 1 indicating that the benefit ing may be responsible for any difference in risk that
outweighs the harm. This crude calculation weights is observed. If there were differences in potential
benefits and side effects equally. A more sophisti- confounding factors, appropriate statistical tech-
cated calculation, taking into account patients rela- niques (stratification or multivariate techniques)
tive preferences for side effects versus treatment should have been used in the data analysis.
114 How to Practice Evidence-Based Psychiatry
TABLE 118. Critical appraisal guide for If the clinical question is one that concerns the
cohort studies etiology of a disorder, the results will generally be
applicable, assuming that your patient could be at
Is the study valid?
risk for the outcome and bearing in mind that some
Were the exposed and nonexposed groups similar outcomes are limited to patients who are of a partic-
(other than exposure) to the risk factor at the onset of ular age, sex, or childbearing status. With regard to
the study?
etiology, the assumptions are that RR will apply to all
If there were differences between groups at the start of individuals and that risks are generally multiplica-
the trial, did the statistical analysis take the tive. In certain circumstances, however, interactions
differences into account?
between risk factors that could either increase or de-
Was the follow-up of the cohort sufficiently long for crease a particular patients risk beyond what is ex-
outcomes to develop? pected by the RR associated with the individual risk
Were outcomes measured in the same way in both factors are possible (Gordis 2000; Rothman 2002).
groups? In assessing the absolute risk to an individual pa-
Were there significant differences in losses to follow- tient, however, NNH is used as the measure of risk.
up in the two groups? Unlike RR, this measure is sensitive to the individ-
Were any of the criteria for causality met (Table 116)? uals baseline risk and may need to be individualized.
As with an RCT, in assessing the relative risks and
Are the results important? benefits of treatment, the issue is one of comparing
How strong is the association (relative risk)? NNT (usually derived from an RCT) with NNH
How large is the absolute increase in risk (risk from the cohort study, and the same considerations
difference)? apply as discussed for LHH above.
Can I apply the results to my patient?
Is my patient too different from patients in the study? Case-Control Study
How do the benefits and risks of treatment compare A critical appraisal guide for a case-control study is
for my patient? given in Table 119.
How does my patient value these benefits and risks?
Do the benefits outweigh the harms (likelihood of Is the Study Valid?
being helped or harmed)? The first question is how the cases were chosen. The
cases should be representative of patients with the
Source. Based in part on the criteria of Elwood 1998;
Levine et al. 2002; Sackett et al. 2000. disease. In addition, they should be incident (newly
diagnosed) cases, because a study of prevalent cases
may reveal more about risk factors for chronicity
Were any of the criteria for causality (Table 116)
than about the etiology of the disorder.
met? If so, the likelihood that the results were not the
The next question is how the control subjects
result of chance, bias, or confounding is increased.
were chosen. In a case-control study, control sub-
jects must be chosen from the same source popula-
Are the Results Important? tion as the cases, because control subjects are used to
In a cohort study, RR measures the strength of asso- estimate the prevalence of exposure to a risk factor
ciation between the exposure and outcome, whereas in the population from which the cases are drawn
NNH is a better measure of the potential harm to an (Lewis and Pelosi 1990; Rothman 2002). In other
individual patient (Sackett et al. 2000). words, if the cases in a study were identified from a
particular clinic or hospital, would the control sub-
Can I Apply the Results to My Patient? jects have obtained treatment from that same clinic
As with RCTs, this question can be reframed in the or hospital if they had the disease in question? Con-
following way: Is the biology of my patient so dif- trol subjects can include general population con-
ferent from that of the study patients that the results trols; hospital or clinic controls; and friends,
cannot apply? relatives, or neighbors of the cases. If more than one
Studies of Risk or Harm 115
TABLE 119. Critical appraisal guide for Are the Results Important?
case-control studies In a case-control study, the OR measures the
Is the study valid?
strength of association between the exposure and
the outcome. Measures of absolute risk cannot be
Did the method of selection of cases and control
determined from a case-control study alone.
subjects introduce bias?
Were outcomes measured in the same way in both Can I Apply the Results to My Patient?
groups, independent of disease status?
As in a cohort study, if the clinical question concerns
Were confounding factors identified and dealt with in the etiology of a disorder, the results will generally
the analysis?
be applicable, assuming your patient could be at risk
Were any of the criteria for causality met (Table 116)? for the outcome. The assumptions are that the OR
Are the results important? will apply to all individuals and that risks are multi-
plicative. There may be interactions between risk
How strong is the association (odds ratio)?
factors that may either increase or decrease a partic-
Can I apply the results to my patient? ular patients risk beyond what would be expected
Is my patient too different from patients in the study? from the OR associated with the individual risk fac-
tors (Gordis 2000; Rothman 2002).
What is the number needed to harm for my patient?
Because measures of absolute risk cannot be di-
How do the benefits and risks of treatment compare rectly estimated from a case-control study, the study
for my patient?
itself will not yield NNH. It is possible, however, to
How does my patient value these benefits and risks? estimate NNH from the OR if the probability of dis-
Do the benefits outweigh the harms (likelihood of ease in the patient (usually estimated from the inci-
being helped or harmed)? dence of disease in the population) is known (Bjerre
Source. Based in part on the criteria of Fletcher et al. 1996;
and LeLorier 2000). A method for calculating this es-
Levine et al. 2002; Mant 1999; Sackett et al. 2000. timation is given in Appendix B. As in an RCT or co-
hort study, the issue in assessing the relative risks and
benefits of treatment becomes one of comparing
control group was used in a particular study, were NNT (usually derived from an RCT) with NNH (es-
the results similar? If so, it is less likely that the re- timated from the OR and population incidence data).
sults were the result of selection bias.
The other serious concern in case-control studies
is information or recall bias. Exposure history References
should be gathered without knowledge of whether Bjerre LM, LeLorier J: Expressing the magnitude of adverse
the individual is a case or a control subject. In addi- effects in case-control studies: the number of patients
tion, using more than one information source may needed to be treated for one additional patient to be
harmed. BMJ 320:503506, 2000
increase the validity of the information being col-
Bradford Hill AB: The environment and disease: association
lected, because individuals with a disease often and causation. Proc R Soc Med 58:295300, 1965
search their memories for possible causes, and psy- Brewer T, Colditz GA: Postmarketing surveillance and ad-
chiatric illnesses may selectively influence memory. verse drug reactions: current perspectives and future
Were the cases and the control subjects generally needs. JAMA 281:824829, 1999
similar except for exposure? If not, confounding Cookson J, Taylor D, Katona C: The Use of Drugs in Psy-
may be responsible for any difference in the amount chiatry: The Evidence from Psychopharmacology, 5th
of risk that is observed. If there were differences in Edition. London, Gaskell, 2002
Cooper Z, Paykel ES: Social factors in the onset and mainte-
potential confounding factors, appropriate statisti-
nance of depression, in Principles of Social Psychiatry.
cal techniques (stratification or multivariate tech- Edited by Bhugra D, Leff J. London, Blackwell Scien-
niques) should have been used in the data analysis. tific, 1993, pp 99121
Were any of the criteria for causality (Table 116) Creed F: Life events, in Principles of Social Psychiatry. Ed-
met? If so, the likelihood that the results were not the ited by Bhugra D, Leff J. London, Blackwell Scientific,
result of chance, bias, or confounding is increased. 1993, pp 144161
116 How to Practice Evidence-Based Psychiatry
Elwood M: Critical Appraisal of Epidemiological Studies and Lawrie S, McIntosh A: Schizophrenia. Clin Evid 7:920944,
Clinical Trials, 2nd Edition. Oxford, UK, Oxford Uni- 2002
versity Press, 1998 Levine M, Haslam D, Walter S, et al: Harm, in Users Guides
Fletcher RH, Fletcher SW, Wagner EH: Clinical Epidemi- to the Medical Literature: A Manual for Evidence-Based
ology: The Essentials, 3rd Edition. Baltimore, MD, Wil- Clinical Practice. Edited by Guyatt G, Rennie D. Chi-
liams & Wilkins, 1996 cago, IL, AMA Press, 2002, pp 81100
Gordis L: Epidemiology, 2nd Edition. Philadelphia, PA, WB Lewis G, Pelosi AJ: The case-control study in psychiatry. Br
Saunders, 2000 J Psychiatry 157:197207, 1990
Gunnell D, Harrison G, Rasmussen F, et al: Associations be- Lloyd G, Lishman A: The effect of depression on speed of re-
tween premorbid intellectual performance, early life ex- call of pleasant and unpleasant experiences. Psychol Med
posures and early onset schizophrenia: cohort study. Br J 5:173190, 1976
Psychiatry 181:298305, 2002 Mant J: Case-control studies, in Evidence-Based Practice: A
Guyatt G, Straus S, McAlister F, et al: Moving from evidence Primer for Health Care Professionals. Edited by Dawes
to action: incorporating patient values, in Users Guides M, Davies P, Gray A, et al. Edinburgh, Churchill Living-
to the Medical Literature: A Manual for Evidence-Based stone, 1999, pp 7384
Clinical Practice. Edited by Guyatt G, Rennie D. Chi- Pirmohamed M, Breckenridge AM, Kitteringham NR, et al:
cago, IL, AMA Press, 2002, pp 567582 Adverse drug reactions. BMJ 316:12951298, 1998
Hennekens CH, Buring JE, Mayrent SL: Epidemiology in Rothman KJ: Epidemiology: An Introduction. New York,
Medicine. Boston, MA, Little, Brown, 1987 Oxford University Press, 2002
Ioannidis JPA, Lau J: Completeness of safety reporting in ran- Rothman KJ, Greenland S (eds): Modern Epidemiology, 2nd
domized trials: an evaluation of 7 medical areas. JAMA Edition. Philadelphia, PA, Lippincott-Raven, 1998
285:437443, 2001 Ruiz P (ed): Ethnicity and Psychopharmacology (Review of
Jones TC: Call for a new approach to the process of clinical Psychiatry Series, Vol 19, No 4). Washington, DC,
trials and drug registration. BMJ 322:920923, 2001 American Psychiatric Press, 2000
Kelsey JL, Whittemore AS, Evans AS, et al (eds): Methods in Sackett DL, Straus SE, Richardson WS, et al: Evidence-
Observational Epidemiology, 2nd Edition. New York, Based Medicine: How to Practice and Teach EBM, 2nd
Oxford University Press, 1996 Edition. New York, Churchill Livingstone, 2000
Ko DT, Hebert PR, Coffey CS, et al: Beta-blocker therapy Takeshita J, Masaki K, Ahmed I, et al: Are depressive symp-
and symptoms of depression, fatigue, and sexual dysfunc- toms a risk factor for mortality in elderly Japanese Amer-
tion. JAMA 288:351357, 2002 ican men? The Honolulu-Asia Aging Study. Am J
Koro CE, Fedder DO, LItalien GJ, et al: Assessment of in- Psychiatry 159:11271132, 2002
dependent effect of olanzapine and risperidone on risk of Turcotte K, Raina P, Moyer VA: Above all, do no harm. West
diabetes among patients with schizophrenia: population J Med 174: 325329, 2001
based nested case-control study. BMJ 325:243245, 2002
12
Studies of Prognosis
Gregory E. Gray, M.D., Ph.D.
Questions about prognosis are frequently raised cal centers have more severe disease, more comorbid
by patients and by their families. Such questions take conditions, and are more likely to be treatment re-
many forms. When will I get better? Will I be com- sistant or chronically ill than are those in community
pletely well? What are the chances of the disease re- settings (Cohen and Cohen 1984; Hulley et al. 2001;
curring? Such questions are studied by following Randolph et al. 2002). We know far less about the
groups of patients over time (i.e., in a cohort study). prognosis of individuals in the community who do
Some such studies are purely descriptive, whereas not seek treatment (Regier et al. 1998), but it is be-
other studies attempt to find prognostic factors that lieved that they have a better prognosis and more so-
predict a good or bad outcome. The latter types are cial supports (Cohen and Cohen 1984).
similar to the cohort studies of risk described in An example of such a difference in prognosis
Chapter 11 and are subject to the same design and comes from a study of the duration of major depres-
analysis issues. This chapter focuses on descriptive sive episodes in the general population conducted by
studies of prognosis and briefly reviews some of the Spijker et al. (2002). In this study, cases were identi-
issues in their design and analysis before discussing fied as part of a prospective epidemiological study in
their critical appraisal. a community, so the authors were able to identify
cases that did not seek treatment, as well as those
that did. Median durations of the depressive episode
Selecting Patients were 3.0 months for patients who had no profes-
The selection of patients in a cohort study of prog- sional care, 4.5 months for patients treated in pri-
nosis is of considerable importance. The two key is- mary care settings, and 6.0 months for patients who
sues are the populations from which the subjects are entered the mental health system.
obtained and whether they are newly diagnosed There is no right population to study, but the
cases or patients currently in treatment. population studied affects the generalizability of the
results (Gordis 2000; Randolph et al. 2002). Results
Source of Patients obtained from a study of patients in an academic
One can think of several populations of patients with medical center may not apply to individuals in the
the same illness: patients in the general population community.
who are in treatment with nonmental health prac-
titioners, those in outpatient treatment with mental Incident Versus Prevalent Cases
health professionals, those in specialized mental The other major issue concerns whether to select
health clinics (e.g., an academic mood disorders new (incident) cases or existing (prevalent) cases.
clinic), and those who are hospitalized for their con- There is a temptation to begin with a cohort of pa-
ditions. In general, patients seen at academic medi- tients already in treatment (a survival cohort), but
117
118 How to Practice Evidence-Based Psychiatry
such a sample would contain an overrepresentation gathered between the set follow-up intervals, and
of chronic patients and hence lead to a biased esti- the losses that follow lead to data that are based on
mate of prognosis (Cohen and Cohen 1984 ; smaller and smaller numbers of subjects at each sub-
Fletcher et al. 1996). Instead, an inception cohort (a sequent interview.
group of people assembled near the onset of disease)
should be studied (Fletcher et al. 1996). Time-to-Event Outcomes: Survival Analysis
A related issue is that of the starting point or zero The use of time-to-event as an outcome measure in
time (Fletcher et al. 1996; Gordis 2000). This could studies of prognosis is more common than the use of
either be at the onset of symptoms, when treatment specified follow-up times. The event may be a neg-
was first begun, or when a diagnosis was made. Re- ative one (e.g., death, relapse, rehospitalization, or
gardless of what is chosen as the zero time, it should dropping out of treatment) or a positive one (e.g., re-
be used consistently as the starting point (Fletcher et covery). Such data are analyzed using statistical tech-
al. 1996). niques called survival analysis or failure time analysis.
Survival analysis acknowledges that patients may
Follow-up and Attrition be lost to follow-up; however, the analysis does in-
clude these patients until such time as they are lost.
One of the major sources of bias in cohort studies
A basic statistical assumption, however, is that the
of prognosis concerns patients lost to follow-up. If
prognosis of patients lost to follow-up (i.e., cen-
patients lost to follow-up differ in outcomes from
sored) will be the same as for patients who continue
patients who remain in the study, estimates of prog-
in the study (Bland and Altman 1998; Gordis 2000).
nosis will be biased. This is called migration bias
Survival curves, such as the one in Figure 121, are
(Fletcher et al. 1996).
calculated using the Kaplan-Meier method, the de-
One way of dealing with losses to follow-up in the
tails of which are given in standard biostatistics texts
analysis is to perform a best case/worst case analysis, a
(e.g., Altman 1991; Pagano and Gauvreau 2000).
form of sensitivity analysis in which outcome statis-
The log-rank test can be used to test for differences
tics are first calculated assuming all of those lost to
in survival times between subgroups (Altman 1991;
follow-up did well, then recalculated assuming all of
Peto et al. 1977).
those lost to follow-up had a bad outcome (Fletcher
et al. 1996; Sackett et al. 2000). Ideally, researchers
should attempt to minimize losses to follow-up Critical Appraisal Guide for
through periodic contact and other means (Cum- Studies of Prognosis
mings et al. 2001).
Guidelines for appraising cohort studies of progno-
sis are given in Table 121. As with other types of
Outcomes and Data Analysis studies, validity should be assessed before consider-
There are two commonly used approaches for de- ing the results.
scribing the prognosis of a cohort: reporting on out-
comes at specified follow-up times and measuring Is the Study Valid?
time to an event. The study should be based on an inception (inci-
dence) cohort. If it is based on a survival cohort of
Outcomes at Specific Follow-Up Times patients at various stages of illness, it is simply not a
Investigators will sometimes recontact a cohort at valid study of prognosis.
specified times and collect data for a variety of out- The next question concerns follow-up losses.
come measures. Such an approach was taken by Sackett et al. (2000) have suggested using the 5 and
Wiersma et al. (2000) when they used several mea- 20 guideline, where <5% of patients lost to follow-
sures of social disability to assess a cohort of patients up is probably not significant, whereas >20% lost to
with schizophrenia at 1, 2, and 15 years after diag- follow-up seriously threatens the validity of the
nosis. The advantage of this approach is that consid- study.
erable information can be collected at each follow-up Finally, it is important that study outcomes be as-
interview. The disadvantage is that no information is sessed in a uniform way.
Studies of Prognosis 119
Hulley SB, Newman TB, Cummings SR: Choosing the study Regier DA, Kaelber CT, Rae DS, et al: Limitations of diag-
subjects: specification, sampling, and recruitment, in De- nostic criteria and assessment instruments for mental dis-
signing Clinical Research: An Epidemiologic Approach, orders: implications for research and policy. Arch Gen
2nd Edition. Edited by Hulley SB, Cummings SR. Phil- Psychiatry 55:109115, 1998
adelphia, PA, Lippincott Williams & Wilkins, 2001, pp Sackett DL, Straus SE, Richardson WS, et al: Evidence-
2535 Based Medicine: How to Practice and Teach EBM, 2nd
Pagano M, Gauvreau K: Principles of Biostatistics, 2nd Edi- Edition. New York, Churchill Livingstone, 2000
tion. Pacific Grove, CA, Duxbury, 2000 Spijker J, DeGraaf R, Bijl RV, et al: Duration of major de-
Peto R, Pike MC, Armitage P, et al: Design and analysis of pressive episodes in the general population: results from
randomized clinical trials requiring prolonged observa- The Netherlands Mental Health Survey and Incidence
tion of each patient, II: analysis and examples. Br J Can- Study (NEMESIS). Br J Psychiatry 181:208213, 2002
cer 35:139, 1977 Wiersma D, Wanderling J, Dragomirecka E, et al: Social dis-
Randolph A, Bucher H, Richardson WS, et al: Prognosis, in ability in schizophrenia: its development and prediction
Users Guides to the Medical Literature: A Manual for over 15 years in incidence cohorts in six European cities.
Evidence-Based Clinical Practice. Edited by Guyatt G, Psychol Med 30:11551167, 2000
Rennie D. Chicago, IL, AMA Press, 2002, pp 141154
13
Psychiatry residents are expected to acquire posi- yet it is still one with which physicians may have dif-
tive attitudes toward lifelong learning, and more spe- ficulty (Ely et al. 2002).
cifically, according to the Accreditation Council for The first question to ask is whether the clinician
Graduate Medical Education (ACGME): The phy- understands the concept of the 4-part PICO clinical
sician shall recognize limitations in his or her own question (i.e., patient/problem, intervention, com-
knowledge base and clinical skills, and understand parison, and outcome, as described in Chapter 3)
and address the need for lifelong learning. In this and whether he or she was able to formulate such
chapter, the focus is on evaluating evidence-based questions before beginning the most recent search
medicine (EBM) skills. In the next chapter, we focus for information. The next question to ask is whether
on the broader issues of evaluating ones practice. the clinician routinely formulates such questions in
In the 5-step EBM model (see Gray, Chapter 2 in his or her clinical practice.
this volume), the final step is assessing the outcome. Clinical questions arise every day in clinical prac-
In ordinary clinical practice, we assess whether a par- tice, but we often do not have the ability to answer
ticular treatment worked or whether a diagnostic test them on the spot (Del Mar and Glasziou 2001). To
provided helpful information. In the EBM model, incorporate EBM into daily practice requires that we
assessment has the added component of evaluating have a way of keeping track of the most important
the clinicians performance in the EBM process. questions so that they can be answered at a later time.
The model for such an evaluation, as suggested
by Sackett et al. (2000) and Wolf (2000), focuses on
skills in performing each of the five steps in the
Searching for Answers
EBM process (Table 131). A more in-depth discus- The next step in the process is searching for an an-
sion of the evaluation of clinical skills in general swer to the clinical question. In evaluating a partic-
and of EBM skills in particularcan be found in the ular search, barriers to finding the information
works of Sackett et al. (1991, 2000). should be identified. Common barriers include lack
of time and information resources, as well as the
search strategy itself (Cabell et al. 2001; Craig et al.
Formulating Clinical Questions 2001; Ely et al. 2002; McColl et al. 1998). Further-
The first necessary skill is formulating the 4-part more, many practitioners either lack awareness of
clinical questions (see Gray, Chapter 3 in this vol- the Cochrane Database of Systematic Reviews and
ume). Such a skill is important because it leads to a other resources or do not use them, even if available
more efficient search strategy (Cabell et al. 2001), (Kerse et al. 2001; McColl et al. 1998).
121
122 How to Practice Evidence-Based Psychiatry
TABLE 131. Self-evaluation of evidence- strategy would have proved more efficient. The final
based medicine skills question to ask is whether you are routinely search-
ing for answers in appropriate databases in your
Formulating clinical questions
clinical practice rather than relying on textbooks.
Do I understand what a 4-part PICO clinical question
is?
Was I able to formulate a 4-part PICO question this Appraising the Evidence
time? Critical appraisal skills are the most commonly
Do I routinely keep track of clinical questions that taught aspect of EBM (Green 1999), yet clinicians
arise in my practice and attempt to find answers to often remain unfamiliar with many of the basic con-
them? cepts (LeClair et al. 1999; McColl et al. 1998; Young
Searching for answers et al. 2002). Such skills, however, are associated with
the ability and willingness to apply the results of sys-
Do I know the common databases and how to search
tematic reviews in clinical practice (Doust and Silagy
them?
2000).
Did this particular search go well or could I have been In evaluating yourself, the first question to ask is
more efficient?
whether you have an understanding of the methods
Do I routinely attempt to answer clinical questions of critical appraisal, including the use of critical ap-
through searches or do I still rely primarily on praisal worksheets. (To review this information, see
textbooks?
Chapters 511.) The next question to ask is whether
Appraising the evidence you had any difficulties in appraising the evidence
Do I understand how to critically appraise research from this particular search. This also involves con-
articles and other evidence? sidering whether the evidence was applicable to your
patient, being able to individualize the results for
Was I able to apply the critical appraisal guide in this
case, including considering my patients individual your patient, and assessing whether it was consistent
risks, needs, and preferences? with patient needs and preferences. Finally, you
should ask whether your appraisal skills are improv-
Are my critical appraisal skills improving over time?
ing over time as a result of practice.
Applying the evidence
Do I incorporate the evidence that I have appraised
(and have found to be valid) into my clinical Applying the Evidence
practice? The fourth step involves applying the evidence to a
What proportion of my clinical decisions is based on particular patient. This is when clinicians often fal-
current best evidence? ter (Wolf 2000). The most important question to
ask here is whether ones practice is becoming more
Evaluating the results
evidence based. This can be done informally; for ex-
Do I routinely evaluate my evidence-based medicine ample, as the clinician sees patients, he or she should
skills?
ask whether the treatment provided, diagnostic test
Are there particular aspects of the evidence-based ordered, and so forth were supported by good evi-
medicine process that I need to review? dence. This may encourage clinicians to conduct
Note. PICO=Patient/Problem, Intervention, Comparison, searches for some common treatments that are be-
and Outcome. ing used, and the results may surprise them. It can
also be done in a more formal way, as part of a quality
In evaluating ones own performance, the first improvement project (Baker and Grol 2001).
question to ask is whether you have an understand-
ing of the basic search process (as outlined by Gray
and Taylor in Chapter 4 in this volume), including Evaluating the Results
the roles of the various databases that are available. Finally, clinicians should reflect on their own per-
The second question relates to the ability to perform formance of EBM. In Chapter 14, Taylor addresses
the particular search and whether another search the issue of evaluating ones practice in more detail,
Evaluating Your Performance of Evidence-Based Medicine 123
Kerse N, Arroll B, Lloyd T, et al: Evidence databases, the In- Sackett DL, Straus SE, Richardson WS, et al: Evidence-
ternet, and general practitioners: the New Zealand story. Based Medicine: How to Practice and Teach EBM, 2nd
N Z Med J 114:8991, 2001 Edition. New York, Churchill Livingstone, 2000
LeClair BM, Wagner PJ, Miller MD: A tool to evaluate self- Straus SE, Richardson WS, Glasziou P, et al: Evidence-Based
efficacy in evidence-based medicine. Acad Med 74:597, Medicine: How to Practice and Teach EBM, 3rd Edition.
1999 Edinburgh, Churchill Livingstone, 2005
McColl A, Smith H, White P, et al: General practitioners Wolf FM: Lessons to be learned from evidence-based medi-
perceptions of the route to evidence based medicine: a cine: practice and promise of evidence-based medicine and
questionnaire survey. BMJ 316:361365, 1998 evidence-based education. Med Teach 22:251259, 2000
Sackett DL, Haynes RB, Guyatt GH, et al: Clinical Epide- Young JM, Glasziou P, Ward JE: General practitioners self
miology: A Basic Science for Clinical Medicine, 2nd Edi- ratings of skills in evidence based medicine: validation
tion. Boston, MA, Little, Brown, 1991 study. BMJ 324:950951, 2002
14
Evidence-Based
Psychiatric Practice
C. Barr Taylor, M.D.
The goals of evidence-based psychiatric practice the core competencies psychiatry residents are now
are to improve patient care and to help ensure that expected to acquire in the course of training. Evalu-
patients receive the most effective treatments avail- ating ones practice is also a core feature of lifelong
able. In a broader sense, the goal for the clinician learning. In this chapter, I discuss several approaches
also should be to frequently assess and improve his to doing so.
or her clinical skills and acumen. The Accreditation
Council for Graduate Medical Education now re-
quires residents to learn how to use practice guide-
Evaluating Ones Practice
lines as part of the systems-based competency (An- Sir William Osler, one of the founders of modern
drews and Burruss 2004). In recent decades, the medicine, encouraged clinicians to classify cases as
knowledge base in all aspects of psychiatry has in- clear cases, doubtful cases and mistakes. He ar-
creased dramatically, with new findings of relevance gued that It is only by getting your cases grouped in
to patient care reported frequently in the scientific this way that you can make any real progress in your
literature. Modern clinicians need to enhance their post-collegiate education; only in this way you gain
psychotherapy skills and techniques and to be con- wisdom with experience (Cushing 1940, p. 328).
versant with new developments in medicine, psy- He also said that It is a common error to think the
chotherapy, and psychopharmacology that may af- more a physician sees the greater his experience and
fect their patients care. Keeping up to date on this more he knows, the implication being that experi-
knowledge requires the ability both to find informa- ence is not sufficient for lifelong learning. Yet from
tion relevant to a particular patient and to monitor an evidence-based standpoint, what constitutes a
information that may be relevant to ones overall clear case, doubtful case, and mistake? A clinician
practice. In this chapter, I consider how clinicians may prescribe a medication that is immediately fol-
can focus on the quality of care of their practice. lowed by a significant improvement in the patients
Evaluating ones practice is more complicated symptoms, but the time course of improvement may
than finding an answer to a particular therapeutic be too soon for the medication to have had an effect.
question. In this case, the clinician would want to A major life event also may have led to a significant
know not only about the choice of therapies but also improvement in the symptom. The patient dis-
how well the quality of his or her work measures up cussed in Taylor, Chapter 19 of this volume, had
to standards in the field or literature and the clini- multiple problems and showed substantial improve-
cians own personal standards. Learning how to eval- ment over the course of therapy, but it was not clear
uate and improve their practice as needed is one of that the therapy led to the improvement. The same
125
126 How to Practice Evidence-Based Psychiatry
can be said about a doubtful case in which the out- ternatives to Relieve Depression (STAR*D) and one
come is not as expected. Here again, several inter- of his colleagues, illustrates how a patients progress
ceding factors can affect the patient in ways that may is used to determine treatment decisions. Critics of
reduce an otherwise effective approach. Both clear STAR*D might argue that it does not adequately ad-
and doubtful outcomes must be considered as only dress or incorporate psychosocial issues or interven-
one source of information about ones practice, but tions, does not deal with comorbidities, and has an
they can serve to help the clinician consider what he important but limited outcome. Even so, patients
or she may be doing well or where he or she might deserve to achieve at least the rate of depression re-
be able to improve. mission and symptom reduction suggested by
STAR*D while also achieving gains in other areas.
Peer Review Other cases also indicate that patients progress can
One approach to evaluating ones performance is to be considered in relation to measures, outcomes,
discuss cases with peers routinely during case con- guidelines, and algorithms.
ferences, during private consultations, or in other In the cases presented in Parts II and III of this
settings. The evidential quality of the feedback will book, we asked the authors to discuss their choice of
be determined by the expertise of the group and the guidelines and algorithms and reflect on what they
type of information that is presented. Such clinical learned from the case presented that might affect
feedback groups usually focus on particular thera- how, if at all, they could do a better job next time.
peutic issues or problems rather than on outcomes.
Some practice groups may hire individuals with par- Guideline- and Algorithm-Based
ticular expertise, such as an academic psychophar- Psychiatry Practice
macologist with a focus on bipolar disorder, to With guideline-based psychiatric practice, clinicians
discuss treatment approaches. Such expert advice would begin by choosing the guidelines or combina-
may be useful, particularly if the expertise is sup- tion of guidelines most relevant to the patient being
ported by evidence. treated. Clinicians might then check off their
practices against these guidelines and perhaps at the
Measurement-Based Practice end of treatment, as illustrated in Chapters 1619
A more demanding approach is to consider how well and 34 of this volume.
a patient is doing relative to some evidence-based For example, suppose a clinician wants to evalu-
standard. Such an evaluation could focus on imple- ate her care of a patient presenting with both depres-
mentation or outcome. With an implementation- sion and substance abuse. The clinician would
based focus, clinicians would evaluate how well they identify the appropriate guidelines and outcomes
are adhering to the guidelines and algorithms they and determine how and when these outcomes would
favor. With an outcome-based focus, clinicians be assessed. In Chapter 8, I discussed how the clini-
would focus on how well they are achieving their cian can identify measures appropriate to his or her
designated outcomes. An outcome focus has the ad- practice and patients. For this case, the clinician
vantage of helping to ensure that the patients are be- would focus on depression outcomes and substance
ing provided optimal care, assuming of course that use. For instance, the clinician might choose to fol-
the outcomes are relevant to the patients needs and low the general American Psychiatric Association
that the therapies leading to these outcomes have depression guidelines but to modify the pharmacol-
been shown to be consistent. Outcome-based ap- ogy to follow the STAR*D algorithm (see Chapter
proaches, with frequent assessments linked to al- 21). In accordance with STAR*D, the clinician de-
gorithms and other stepped care approaches that cides that the patient should experience a 50% re-
delineate and/or suggest practices and decisions, duction in his depressive symptoms by 12 weeks and
may lead to improved care. This approach has been should be in remission by 6 months, as measured by
called measurement-based care (Trivedi and Daly the Quick Inventory of Depressive Symptomatol-
2007; Trivedi et al. 2007). The advantages of mea- ogy self-report version (QIDS-SR) (see Chapter 21
surement-based care are illustrated by Trivedi and for definitions of remission). The pharmacological
Kurian in Chapter 21. This case, written by one of intervention would begin with citalopram, with an
the lead investigators of Sequenced Treatment Al- increase in dose and use of alternative medications
Evidence-Based Psychiatric Practice 127
and/or cognitive-behavioral therapy (CBT) as per made progress, she reviews how the problem is be-
the STAR*D algorithm (see Chapter 21). ing approached. The clinician may decide that a dif-
For substance abuse, the clinician decides to gen- ferent approach is needed (e.g., to put more
erally follow the American Psychiatric Association emphasis on motivational interviewing or establish a
substance use guidelines but to add a time frame for new time frame to achieve this goal).
achieving the predetermined outcomes. Because the After 8 weeks of therapy, after having generally
guidelines are not very specific, the clinician uses her followed the STAR*D guidelines, she gives the pa-
own standards and experience to define the goals and tient another QIDS-SR to assess his depressive
time frame. For instance, as seen in Table 141, for symptoms. The QIDS-SR score has declined by
the goal of motivate the patient to change, the cli- more than 50% to a 5, and the depression is in re-
nician arbitrarily sets a personal standard of achiev- mission. If the patient had not improved, the clini-
ing this by 3 weeks. The clinician also believes in cian would continue down the STAR*D algorithm
abstinence and feels that this should be achieved by with dose escalation, augmentation, and use of CBT,
2 months into treatment. The clinician agrees that as appropriate and desired by the patient. With this
it is important for the patient to repair disrupted approach, STAR*D achieved an overall remission
relationships and enhance familial and interpersonal rate of 67% (Rush et al. 2006).
relationships that will support an abstinent life- Following STAR*D makes evaluation of overall
style and would hope to have the patient do so by practice relatively easy because each case is consid-
6 months and to help the patient develop social and ered relative to some standards. But many clinicians,
vocational skills, also by 6 months. For the next goal, for a variety of reasons, might prefer not to use
help the patient learn, practice, and internalize STAR*D or all aspects of STAR*D. Should clini-
changes in attitudes and behaviors conducive to re- cians using non-STAR*D approaches to treating
lapse prevention, the clinician wants to accomplish major depressive disorder be expected to achieve re-
this once the patient has become abstinent before sults similar to those with STAR*D (i.e., an overall
termination. She plans to use a relapse prevention 67% remission)? In some settings, depending on the
approach. patients being treated, this is an unrealistic target.
At week 3, the clinician evaluates how much STAR*D indicated that some patients will not ben-
progress has been made on motivating the patient to efit even from this very aggressive approach. For in-
take steps toward abstinence. If the patient has not stance, the remission rates were 37%, 31%, 14%,
and 13% for the first, second, third, and fourth acute however, if she has not been direct enough in con-
treatment steps, respectively (Rush et al. 2006). The fronting the patients denial about what she per-
clinician might take a moment to ask him- or herself: ceives as his alcohol dependence.
What are my treatment goals for depression, and am
I achieving them? Overall Practice Performance
Evaluating ones psychotherapeutic competency is If the clinician collected data on a few patients with
an even more complicated process than evaluating similar problems and presentations, she could use
pharmacological practice and outcomes. Suppose a these types of data to evaluate her overall practice,
clinician decides that the use of CBT would reduce looking for relevant standards in the scientific liter-
relapse rates in depressed patients and wants to add ature. However, this can be time-consuming, and
this to his or her therapeutic approach. CBT re- such standards may be hard to come by. Although
searchers have defined a set of skills appropriate for standards for practice seem to be a worthy goal, fig-
providing effective CBT and a criterion, representing uring out how to find and use them is a problem. In
the sum of these scores, that is arbitrarily considered the following section, I discuss some approaches, re-
to reflect competency (Trepka et al. 2004). The in- alizing that I am simplifying a very complicated issue
strument is meant to be scored by an experienced and using some relatively easy examples. Yet even
rater, but for the practicing clinician, it could be self- these examples illustrate the difficulties of doing ev-
scored. Clinicians might consider assessing them- idence-based practice evaluation.
selves on how adequately they are applying the basic For depression, the clinician might want to assess
therapeutic strategies: setting an agenda, providing how the patient is doing compared with STAR*D
feedback, being understanding, being interpersonally remission and relapse rates. As noted earlier, an
effective and collaborative, pacing the sessions, and overall target might be 67%. She decides that at
using the time efficiently. Clinicians also might con- least 10 sessions of CBT are necessary to achieve a
sider how they are teaching skills they wish patients positive outcome and establishes this as a goal. If
to acquire. For instance, Strachowski et al. (2008) fewer than half of her patients are seen for the tar-
provide an example of how they monitored their pa- geted number of 10 sessions, she might want to ex-
tients use of CBT or engagement in behaviorally ac- amine this aspect of her practice. The clinician has
tivating actions. Assessing practice competence of the established an abstinence goal at 16 weeks for pa-
more structured interventions, such as CBT, is much tients who present with alcohol abuse or depen-
simpler than evaluating ones psychotherapeutic dence and who are drinking. However, she has
competence of less well-defined strategies. difficulty finding studies that have used abstinence
For alcohol abuse, the clinicians first goal (Table as a major outcome because many recent alcohol tri-
141) was to motivate the patient to consider absti- als report measures such as percentage of days absti-
nence by week 3. Even though the clinician thought nent or days of heavy drinking (Anton et al. 2006).
that she did a good job of providing motivational in- She decides also to use the COMBINE study im-
terview techniques, the patient is still drinking and provement criteria, which enrolled more than 1,300
not convinced that he should abstain or even that he patients for a study that compared nine different al-
has alcoholism. When patients are not progressing cohol abuse treatments (Anton et al. 2006), as one
as expected, it is reasonable to review diagnosis, as- source of information to judge how she is doing. In
sessment, and treatment but also to examine the this study, the main outcomes were percentage of
therapeutic relationship. In this case, the clinician days abstinent over the 8 weeks of the study and time
evaluates her treatment according to the Working to first heavy drinking day (five standard drinks per
Alliance Inventory (Horvath and Greenberg 2008). day for men; four for women). The mean percentage
This scale measures clients views of the therapy of days abstinent was about 65%, or 2 days out of 3.
goals and tasks and of the bond between him or her The clinician thought that this was a minimal stan-
and the clinician. The clinician finds a large discrep- dard, which she defined as the number of patients in
ancy between her goals for one aspect of therapy her practice with a diagnosis of alcohol abuse or de-
abstinence from alcoholand those of the patient pendence who were sober more than 65% of the
to cut down. She finds that the patient perceives her time, in the last 2 months of this treatment. She then
as caring and understanding. The clinician wonders, looked at 10 patients she had treated in the past year
Evidence-Based Psychiatric Practice 129
and found that 3 were abstinent for the last 2 months whether they provided a timely suicide assessment
of treatment, and the rest were sober about 50% of and behavior evaluation for patients whose screen-
the time. On average, the patients were sober more ing results were positive.
than 65% of the time, meeting the criteria, and had The American Psychiatric Association Web site
reduced number of heavy drinking episodes. It was lists several mental health performance measures, as
difficult for her to know, however, if these results listed in Table 142. Links to the source documents
meant that she was doing well or how she could im- and databases are provided at this site.
prove her practice. Standards of care are often related to perfor-
Checking ones practice against guidelines or al- mance measures. Clinicians also may want to exam-
gorithms and outcomes is one of many approaches ine how they are doing relative to standards. For
to evidence-based psychiatric practice. The Ameri- instance, the American Diabetes Association, Amer-
can Psychiatric Association provides a set of tools to ican Psychiatric Association, American Association
make this easier, including a resource for measures of Clinical Endocrinologists, and North American
(Rush et al. 2008), and the guidelines themselves are Association for the Study of Obesity have created a
designed to improve practice. For illustrative pur- consensus statement of monitoring weight, blood
poses, I translated some of the guidelines into check- pressure, glucose, and lipids for patients who are
lists and measured my performance against these taking second-generation antipsychotics (American
guidelines for Chapters 16, 17, and 19. Diabetes Association 2004). Many such standards
exist relative to mental health practice.
Performance Measures
Many clinical settings have adopted standards of Mistakes and Improvement
care and performance measures. These are usually Osler urged us to learn from our mistakes, but both
used to determine how well an overall practice of cli- identifying mistakes and admitting to them are dif-
nicians is doing. For instance, The Joint Commis- ficult. Medical errors with serious consequences are
sion and the National Association of Psychiatric common. In 2000, the Institute of Medicine (IOM)
Health Systems (NAPHS), the National Association reported that 44,00098,000 people die in hospitals
of State Mental Health Program Directors (NASM- each year as the result of medical errors (Kohn et al.
HPD), and the NASMHPD Research Institute, Inc. 2000). About 7,000 people per year are estimated to
(NRI), have developed a set of core performance die from medication errors aloneabout 16% more
measures for hospital-based inpatient psychiatric deaths than the number attributable to work-related
services (www.jointcommission.org) that affect all injuries. Unfortunately, very few data exist on the
the providers within that system. For instance, inpa- extent of the problem outside of hospitals or in men-
tient psychiatric health systems need to prove that tal health practice settings. The IOM report indi-
they screen patients for violence risk, substance use, cated, however, that many errors are likely to occur
psychological trauma history, and patient strengths outside the hospital. For example, in a recent inves-
and show that a postdischarge continuing care plan tigation of pharmacists, the Massachusetts Board of
was created and transmitted to the next level of care Registration in Pharmacy estimated that 2.4 million
provider on discharge, among other activities. prescriptions are filled improperly each year in the
Such measures tend to focus on process rather state. The IOM emphasized that most of the medi-
than outcome, although they are presumably devel- cal errors are systems related and not attributable to
oped to ensure better outcomes in the domains as- individual negligence or misconduct and that the
sessed. However, they are not necessarily evidence key to reducing medical errors is to focus on im-
based. proving the systems of delivering care and not to
The Department of Veterans Affairs routinely as- blame individuals. Many performance measures are
sesses clinician performance on several measures designed to reduce errors.
with the goal of 100% compliance to the measure. In March 2001, the IOM released a second report
For instance, through chart review, clinicians may on its research into the safety of health care in the
be evaluated on the number of people they screen United States (Kohn et al. 2001). This report fo-
for alcohol use who were due to be screened or cuses on 13 specific recommendations designed to
130 How to Practice Evidence-Based Psychiatry
Resource Comments
Quality Measure Inventory. From: Center for Quality Searchable database of more than 300 mental health
Assessment and Improvement in Mental Health performance measures
(CQAIMH)
Experience of Care and Health Outcomes Survey Mental health patient experience-of-care survey
(ECHO) instrument
MDD Measures. From: Foundation for Accountability Legacy documents maintained by the Markle
Foundation
Healthcare Effectiveness Data and Information Set Health planlevel measures, including several mental
(HEDIS) 2008. From: National Committee for health measures
Quality Assurance (NCQA)
Hospital-Based Inpatient Psychiatric Services (HBIPS)
Core Measure Set. From: The Joint Commission
Health Disparities Collaboratives (HDC) Depression
Measures. From: Health Resources and Services
Administration (HRSA)
Behavioral Health Guidelines. From: Institute for MDD and ADHD guidelines, including performance
Clinical Systems Improvement (ICSI) measures
National Quality Measures Clearinghouse (NQMC). Searchable compendium of performance measures from
From: Agency for Healthcare Research and Quality many domains of health care, including mental health
(AHRQ)
Physician Consortium for Performance Improvement
MDD Measures. From: American Medical Association
Quality Measures for Schizophrenia. Compiled by New
York State Office of Mental Health
Standards for Bipolar Excellence (STABLE) Project.
Maintained by CQAIMH
VA/DoD Clinical Practice Guidelines. From: U.S. Includes guidelines and measures for MDD, psychoses,
Department of Veterans Affairs and substance use disorder
Washington Circle Substance Use Disorder Measures Core set of performance measures for alcohol and other
drug services for public- and private-sector health
plans
Note. ADHD =attention-deficit/hyperactivity disorder; MDD= major depressive disorder.
Source. Adapted from http://www.psych.org/MainMenu/PsychiatricPractice/QualityImprovement/
PerformanceMeasures/MentalHealthPerformanceMeasures.aspx.
provide a guide for organizations to use in their ef- take steps to improve ones practice, which could be
forts to improve patient safety. (An online course is seen as an admission of guilt. Among the barriers
available at www.criticalconceptsusa.com/online_ to being able to admit errors are resistance to
coursesPME/PME_UPDATE.html). change, fear of discipline, fear of licensure sanction,
Before clinicians can change practice procedures, hindsight bias, need to blame, need to rationalize a
they need to be able to identify that an error has negative event, legal system that focuses on fault-
been made and admit that one has made or contrib- finding, and exposure to liability. The issues in-
uted to an error. In this highly litigious practice volved in discussing and disclosing errors with
environment, it is frightening to admit errors, par- patients, colleagues, and others are beyond the
ticularly if they had adverse consequences, and to scope of this chapter. The reader is referred to the
Evidence-Based Psychiatric Practice 131
IOM report (Kohn et al. 2001) to consider how the Cushing H: The Life of William Osler. New York, Oxford
IOM recommendations might be used to improve University Press, 1940
ones practice. The best approach is to prevent er- Horvath AO, Greenberg LS: Working Alliance Inventory
(WAI), in Handbook of Psychiatric Measures, 2nd Edi-
rors and for the clinician to monitor practice param-
tion. Edited by Rush AJ Jr, First MB, Blacker D. Wash-
eters before having a bad outcome. ington, DC, American Psychiatric Publishing, 2008, pp
However, some minor mistakes that clinicians 187191
make in practice have no major consequences. In ad- Kohn LT, Corrigan JM, Donaldson MS (eds): To Err Is Hu-
dition to ensuring that they establish practice proce- man: Building a Safer Health System. Washington, DC,
dures to avoid serious errors, clinicians also should Institute of Medicine, Committee on Quality of Health
realize that they could probably do things a little Care in America, National Academy Press, 2000
better with almost every patient. The notion that Kohn LT, Corrigan JM, Donaldson MS (eds): Crossing the
Quality Chasm: A New System for the 21st Century.
clinicians also should be trying to improve their
Washington, DC, Institute of Medicine, Committee on
practice and outcomes is at the heart of evidence- Quality of Health Care in America, National Academy
based psychiatric practice. At the end of each case, I Press, 2001
asked the authors to reflect on what they might have Rush AJ, Trivedi MH, Wisniewski SR, et al: Acute and
learned from that case and how they might provide longer-term outcomes in depressed outpatients requir-
better care to the next patient on the basis of their ing one or several treatment steps: a STAR*D report. Am
review. When I compared my actual practice with J Psychiatry 163:19051917, 2006
those suggested by the guidelines I had chosen, I was Rush AJ Jr, First MB, Blacker D (eds): Handbook of Psychi-
atric Measures, 2nd Edition. Washington, DC, American
sometimes surprised to see how many little things
Psychiatric Publishing, 2008
I had omitted that might have made a difference in Strachowski D, Khaylis A, Conrad A, et al: The effects of di-
the outcome. rected cognitive behavior therapy on depression in older
patients with cardiovascular risk. Depress Anxiety
25:E110, 2008
References Trepka C, Rees A, Shapiro DA, et al: Clinician competence
American Diabetes Association, American Psychiatric Associ- and outcome of cognitive therapy for depression. Cognit
ation, American Association of Clinical Endocrinologists, Ther Res 28:143157, 2004
North American Association for the Study of Obesity: Trivedi MH, Daly EJ: Measurement-based care for refrac-
Consensus development conference on antipsychotic tory depression: a clinical decision support model for
drugs and obesity and diabetes. Diabetes Care 27:596 clinical research and practice. Drug Alcohol Depend 88
601, 2004 (suppl 2):S61S71, 2007
Andrews LB, Burruss JW: Core Competencies for Psychiatric Trivedi MH, Rush AJ, Gaynes BN, et al: Maximizing the ad-
Education: Defining, Teaching, and Assessing Resident equacy of medication treatment in controlled trials and
Competence. Washington, DC, American Psychiatric clinical practice: STAR(*)D measurement-based care.
Publishing, 2004 Neuropsychopharmacology 32:24792489, 2007
Anton RF, OMalley SS, Ciraulo DA, et al: Combined phar-
macotherapies and behavioral interventions for alcohol
dependence: the COMBINE Studya randomized con-
trolled trial. JAMA 295:20032017, 2006
This page intentionally left blank
15
T his chapter is intended as a brief overview for res- Why Teach Evidence-Based
idency directors and faculty who are responsible for
Medicine and Evidence-Based
teaching evidence-based medicine (EBM) to their
residents. Other useful sources of information about Psychiatric Practice?
teaching EBM include the works of Davies (1999), For more than a decade, teaching medical students
Gray (2001), Green (2000), and Sackett et al. (2000). and residents the fundamentals of clinical epidemi-
The Evidence-Based Medicine Resource Center ology and EBM has been viewed as a way of enabling
(www.ebmny.org/teach.html) sponsors a Web site them to keep up with the medical literature and of
that provides access to the Centre for Evidence- improving clinical care (Evidence-Based Medicine
Based Medicine teaching materials and presenta- Working Group 1992; Sackett et al. 1991). More
tions, a list of EBM courses on the Web, and other recently, however, it has become a required part of
materials. The Accreditation Council for Graduate residency education in the United States. The
Medical Education (ACGME) Outcome Project ACGME introduced general competencies for resi-
provides a variety of resources related to teaching dents that are to be included in the requirements
and assessing EBM and related competencies. The for all specialties (Scheiber et al. 2003). The six gen-
ACGME (2005) also has developed a booklet to pro- eral areas of core competencies are 1) patient care,
mote education in practice-based learning and im- 2) medical knowledge, 3) interpersonal and com-
provement. The booklet includes a list of resources munications skills, 4) practice-based learning and
and examples for teaching and assessing this compe- improvement, 5) professionalism, and 6) systems-
tency. The American Psychiatric Association also based practice. As seen in Table 151, the core com-
publishes a book providing overviews of the core petencies for practice-based learning and improve-
competencies and how to teach them (Andrews and ment for psychiatry are directly related to EBM and
Burruss 2004). evidence-based psychiatric practice (EBPP). For in-
stance, competency 4 states that the physician shall
demonstrate an ability to critically evaluate relevant
medical literature, and competency 5 states that the
physician shall demonstrate the ability to learn from
133
134 How to Practice Evidence-Based Psychiatry
ones practice, the subject of the previous chapter. In and diagnostic tests. At a minimum, therefore, resi-
addition, one of the systems-based practice require- dents should be taught how to formulate a clinical
ments is to be able to use practice guidelines. question (Chapter 3); perform a literature search
(Chapter 4); appraise clinical trials, systematic re-
views, guidelines, and diagnostic tests (Chapters 57
What to Teach and 9); and apply the results to their patients. A more
The ACGME general competencies require that complete course would include appraisal of articles
psychiatry residents become competent in using the on disease frequency (Chapter 10), etiology or harm
EBM process to answer questions about therapies (Chapter 11), and prognosis (Chapter 12) and learn-
Teaching EBM and EBPP to Psychiatry Residents 135
ing how to apply these results to their practice teach and assess the general competencies (www
(Chapter 13 and as illustrated in the cases in the re- .acgme.org/outcome/implement/rsvp.asp). The de-
mainder of this volume). scriptions are provided directly by the program or in-
In providing this instruction, it is important to re- stitution. The user is advised to communicate directly
alize that most residents are not interested in clinical with the contact person listed for each project for fur-
epidemiology or in learning some of the more ad- ther information. Most of the examples are not re-
vanced EBM skills (Guyatt et al. 2000). The goal in- lated to practice-based learning and do not directly
stead should be to ensure that residents are able to address psychiatry or psychiatric competencies.
find answers efficiently by using the preappraised in-
formation sources we described in Chapter 4 (Evans Seminars and Small-Group Sessions
2001; Guyatt et al. 2000) and to understand how to Some material can best be introduced in seminars or
use measures, algorithms, guidelines, and similar re- in small-group sessions. In the University of South-
sources in practice. However, at times, preappraised ern California program, the topics (e.g., critical ap-
sources will not yield an answer, or it may be neces- praisal of clinical trials) were presented to a small
sary to discuss the evidence in more detail with a col- group in the form of a brief presentation and discus-
league or patient. Under these circumstances, it is sion. This was then followed by the critical appraisal
necessary to have the kind of deeper knowledge that of an article related to the topic under discussion
is covered in an advanced course (Woodcock et al. (e.g., an article reporting the results of a randomized
2002). Furthermore, a deeper understanding of controlled trial). To do the appraisal, the residents
EBM allows clinicians to better appraise the quality were given a copy of the article along with a work-
of guidelines developed by others and to better un- sheet that incorporates the appropriate critical ap-
derstand and incorporate the results from systematic praisal guidelines. After the residents had completed
reviews into clinical practice (Doust and Silagy 2000; the worksheet, individual items on it were discussed.
Laupacis 2001). Although such sessions are useful for introducing a
One of the more important aspects of teaching topic or method, they do not provide sufficient prac-
EBM to psychiatry residents is teaching the philos- tice for the residents to become proficient; for this,
ophy of EBM and EBPP, not just the methodology. other approaches are more useful.
Residents often have some misconceptions about
EBM (Bilsker and Goldner 1999; Padrino 2002). In Computer Laboratory and Library Sessions
addition to providing an overview of what EBM is The best way to become familiar with the various
and what it is not (see Taylor and Gray, Chapter 1 in databases and how to use them is through hands-on
this volume) and discussing some of the misconcep- practice, not by reading about them or through a
tions about EBM (Straus and McAlister 2000), it lecture. Most medical schools have computer labo-
may be helpful to distribute the humorous article by ratories or library classrooms equipped with com-
Isaacs and Fitzgerald (1999), in which they describe puters that can be used for demonstrations and
alternatives to EBM, such as eminence-based medicine hands-on practice in a group setting. Most medical
(experience is worth any amount of evidence), libraries offer classes on searching MEDLINE and
vehemence-based medicine (substitution of volume other databases, and librarians will often customize
for evidence), and eloquence-based medicine. This ar- courses for the needs of particular users.
ticle is also helpful to residents in coping with situa-
tions in which the opinions of their supervisors are Evidence-Based Journal Clubs
at odds with the evidence in the literature.
Journal clubs, a staple of residency education pro-
grams, are the most common sites for teaching crit-
Methods of Teaching Evidence- ical appraisal skills (Green 1999, 2000). Sackett et al.
(2000) have described a novel approach to journal
Based Medicine and Evidence-
clubsthe evidence-based journal clubas a
Based Psychiatric Practice method for teaching the EBM process.
The ACGME Outcome Project has a Web site that In an evidence-based journal club, the starting
showcases examples of activities that may be used to point is a clinical question suggested by one of the
136 How to Practice Evidence-Based Psychiatry
Organization Address
Centre for Evidence-Based Medicine (Oxford) http://www.cebm.net/index.asp
Centre for Evidence-Based Medicine (Toronto) http://www.cebm.utoronto.ca/teach
Centre for Evidence-Based Mental Health http://www.cebmh.com
Evidence-Based Medicine Resource Center http://www.ebmny.org
sarily true for international medical graduates. Resi- Andrews LB, Burruss JW: Core Competencies for Psychiatric
dents often have some ambivalence toward EBM, Education: Defining, Teaching, and Assessing Resident
wondering if it ignores the humanistic side of psychi- Competence. Washington, DC, American Psychiatric
Publishing, 2004
atric practice (Bilsker and Goldner 1999). However,
Ball C: Evidence-based medicine on the wards: report from
as they develop a better understanding of EBM and an evidence-based minion. Evid Based Med 3:101103,
the roles of clinical judgment and patient preference, 1999
coming to realize that EBM and patient-centered Bilsker D, Goldner EM: Teaching evidence-based practice in
care are complementary, such concerns generally mental health. Evid Based Ment Health 2:6869, 1999
lessen (Bilsker and Goldner 1999; Hope 2002). Cabell CH, Schardt C, Sanders L, et al: Resident utilization
Some residents are intimidated by the quantita- of information technology: a randomized trial of clinical
tive emphasis of EBM (Bilsker and Goldner 1999). question formation. J Gen Intern Med 16:838844, 2001
Davies P: Teaching evidence-based health care, in Evidence-
This generally can be overcome by setting realistic
Based Practice: A Primer for Health Care Professionals.
goals and by remembering that the focus should be Edited by Dawes M, Davies P, Gray A, et al. New York,
on preparing users of evidence, not researchers Churchill Livingstone, 1999, pp 223242
(Guyatt et al. 2000; Sackett et al. 2000). Dhar R: Evidence-based journal clubs and the critical review
A barrier to teaching EBM and EBPP may be the paper: candidates perspective. Psychiatr Bull 25:6768,
negative opinions of some faculty members (Ball 2001
1999; Evidence-Based Medicine Working Group Dobbie AE, Schneider ED, Anderson AD, et al: What evi-
1992). Faculty development efforts may be needed dence supports teaching evidence-based medicine? Acad
Med 75:11841185, 2000
to address the negative opinions (Bilsker and Gold-
Doust JA, Silagy CA: Applying the results of a systematic re-
ner 1999; Evidence-Based Medicine Working view in general practice. Med J Aust 172:153156, 2000
Group 1992; Neale et al. 1999), although some res- Evans M: Creating knowledge management skills in primary
idents are able to educate their supervisors about the care residents: a description of a new pathway to evi-
concepts (Ball 1999). dence-based practice. ACP J Club 135:A11A12, 2001
Finally, it is important to emphasize that many Evidence-Based Medicine Working Group: Evidence-based
residents find the practice of EBM to be empower- medicine: a new approach to teaching the practice of
ing (Ball 1999; Padrino 2002). As Padrino (2002) medicine. JAMA 268:24202425, 1992
Gray JAM: Evidence-Based Healthcare: How to Make
said, I feel more confident in my medical decisions
Health Policy and Management Decisions, 2nd Edition.
when I can say the data show this or the data show New York, Churchill Livingstone, 2001
that. Even when I have to say there are no data for Green ML: Graduate medical education training in clinical
this, I feel my decision is more valid (p. 13). Being epidemiology, critical appraisal, and evidence-based
able to incorporate the best evidence from the re- medicine: a critical review of curricula. Acad Med
search literature into patient care decisions is what 74:686694, 1999
EBM is all about, and residents are quite capable of Green ML: Evidence-based medicine training in graduate
learning how to use evidence to improve their clin- medical education: past, present, and future. J Eval Clin
Pract 6:121138, 2000
ical decision making.
Guyatt GH, Meade MO, Jaeschke RZ, et al: Practitioners of
evidence-based care. BMJ 320:954955, 2000
References Hatala R, Guyatt G: Evaluating the teaching of evidence-
based medicine. JAMA 288:11101112, 2002
Accreditation Council for Graduate Medical Education: Hope T: Evidence-based patient choice and psychiatry. Evid
Practice-based learning and improvement: assessment Based Ment Health 5:100101, 2002
approaches [ACGME Outcome Project Web site]. 2001. Isaacs D, Fitzgerald D: Seven alternatives to evidence based
Available at: http://www.acgme.org/outcome/assess/ medicine. BMJ 319:1618, 1999
PBLI_Index.asp. Accessed October 29, 2002 Laupacis A: The future of evidence-based medicine. Can J
Accreditation Council for Graduate Medical Education: Ad- Clin Pharmacol 8 (suppl A):6A9A, 2001
vancing Education in Practice-Based Learning & Im- March JS, Chrisman A, Breland-Noble A, et al: Using and
p ro ve me nt: An Edu cati onal Re sou rce From the teaching evidence-based medicine: the Duke University
ACGME Outcome Project. 2005. Available at: http:// child and adolescent psychiatry model. Child Adolesc
www.acgme.org/outcome/implement/complete_PBLI Psychiatr Clin N Am 14:273296, viiiix, 2005
Booklet.pdf. Accessed June 28, 2009
Teaching EBM and EBPP to Psychiatry Residents 139
March JS, Szatmari P, Bukstein O, et al: AACAP 2005 Re- Scheiber JC, Kramer TAM, Adamowski SE: The implica-
search Forum: speeding the adoption of evidence-based tions of core competencies for psychiatric education and
practice in pediatric psychiatry. J Am Acad Child Adolesc practice in the US. Can J Psychiatry 48:215221, 2003
Psychiatry 46:10981110, 2007 Smith CA, Ganschow PS, Reilly BM: Teaching residents ev-
Mascola AJ: Guided mentorship in evidence-based medicine idence-based medicine skills: a controlled trial of effec-
for psychiatry: a pilot cohort study supporting a promis- tiveness and assessment of durability. J Gen Intern Med
ing method of real-time clinical instruction. Acad Psy- 15:710715, 2000
chiatry 32:475483, 2008 Straus SE, McAlister FA: Evidence-based medicine: a com-
Neale V, Roth LM, Schwartz KL: Faculty development using mentary on common criticisms. CMAJ 163:837841,
evidence-based medicine as an organizing curricular 2000
theme. Acad Med 74:611, 1999 Walker N: Evidence-based journal clubs and the critical re-
Padrino S: Evidence-based psychiatry: fad or fundamental? view paper. Psychiatr Bull 25:237, 2001
Psychiatr News 37(16):13, 2002 Warner JP, King M: Evidence-based medicine and the jour-
Sackett DL, Haynes RB, Guyatt GH, et al: Clinical Epide- nal club: a cross-sectional survey of participants views.
miology: A Basic Science for Clinical Medicine, 2nd Edi- Psychiatr Bull 21:532534, 1997
tion. Boston, MA, Little, Brown, 1991 Woodcock JD, Greenley S, Barton S: Doctors knowledge
Sackett DL, Straus SE, Richardson WS, et al: Evidence- about evidence-based medicine terminology. BMJ
Based Medicine: How to Practice and Teach EBM, 2nd 324:929930, 2002
Edition. New York, Churchill Livingstone, 2000
This page intentionally left blank
II
Case Studies:
Evidence-Based Medicine
Applied to Major DSM-IV Disorders
This page intentionally left blank
16
The cases presented in the remainder of this vol- Setting. Provide a brief description of your practice
ume are designed to illustrate the principles and setting, patient population/focus, and treatment ori-
practices of evidence-based psychiatric practice entation/philosophy.
(EBPP). As discussed in Chapter 1, EBPP is based
on the following: Illustration. List several applications of expert/evi-
dence-based psychiatry that will be illustrated.
1. Accurate evaluation and treatment planning
2. Consideration of treatment algorithms, guide- Chief complaint. Use present tense for statement
lines, and best practices when planning and pro- of the chief complaint.
viding treatment
3. Use of measures to determine progress of an in- Present illness. The case should be real but, for
dividual patient ethical reasons, the identity of the individuals should
4. Review of a patients progress against personal be changed so that they cannot be identified by oth-
and published standards ers (e.g., change age, sex, occupation, personal de-
5. Consideration of evidence and experts in clin- tails). While real data are ideal, it may be necessary
ical decisions to combine data from patients. Keep it brief.
6. Expertise in providing a range of therapies or in
making them available through other resources Other significant findings from assessment.
or providers Present only relevant findings (including negative
ones if they are pertinent). Keep it brief.
In addition to improving patient care, EBPP is a
method of achieving practice-based learning and Differential diagnosis (if appropriate).
improvement, one of the core competencies now ex-
pected of all graduating residents. Having directed a DSM-IV-TR assessment.
residency training program for over a decade, I have
found that this is one of the more difficult competen- Treatment plan considerations. Identify the main
cies for faculty to teach and practitioners to enact. I and secondary problems and issues. As appropriate
began this project in part to find better ways to teach for your practice and the patient, describe the guide-
residents how to learn from patients and improve lines, algorithms, measures, or other sources of
their care and found that it helped improve my own EBPP you used.
practice. These cases are presented to illustrate how
I and others have used EBPP in our practice. Treatment goals, measures, and methods. In-
I asked each of the authors to follow a general clude a time frame for measurement/improvement,
outline as follows: preferably as a table.
143
144 How to Practice Evidence-Based Psychiatry
Course. Provide a brief discussion of the course. An my work with patients, and I didnt expect the other
important aspect of these cases is to let the reader authors to. To do so would make the cases very long
into how you were thinking about the problem over and cover material familiar to most clinicians.
the course of therapy. If you deviated from expert When I first began working on this book, my ini-
practices, why? How did you use the manual, self- tial idea was to write up a dozen or so illustrative
help materials, brochures, and other sources, if at cases taken from my own practice. In the end, I de-
all? How did you consider problems that emerged cided to restrict the cases I present to anxiety, eating,
and were not covered by guidelines and algorithms? and affective disorders and comorbidities, the most
How did you coordinate care if you referred to other common problems presenting in my clinic, and to
practitioners (e.g., for marital therapy or substance invite specialists in other areas to prepare evidence-
abuse treatment)? Were there issues you researched based case reports around problems they routinely
using EBM [evidence-based medicine] methods? address so that examples of evidence-based treat-
ment would be available for many of the major
Figure/graph/table of improvement (if appropriate DSM-IV-TR (American Psychiatric Association
and available). 2000) disorders where guidelines are available. I also
felt it was important to provide examples of EBPP in
Summary (including use of guidelines/algorithms, a variety of different treatment settings.
other issues). The cases address a number of ways to undertake
EBPP. Table 161 presents an overview of the case
Ways to improve practice. What did you learn
diagnoses, the guidelines/algorithms followed, and
from this case (if anything) that might help you im-
the outcome measures. I encouraged the authors to
prove your practice?
present real cases, including those where the out-
One challenge of writing about real clinical cases,
come was not as expected. In such cases, I also asked
as mentioned earlier, is the need to protect the pri-
the authors to consider what they might have done
vacy of the individuals being discussed. For this rea-
differently, if anything. The cases are meant to be il-
son, I have asked the authors to change the age, sex,
lustrative of how to treat the cases presented. I sus-
job, revealing personal details, and, even when it was
pect the readers will have their own views as to how
not essential, the history of the patient and the
they might have approached the cases in different
course of treatment.
and perhaps better ways.
Another challenge is to make the case come
alive. In my practice I usually cover the core of the
American Psychiatric Association (2002) practice References
guidelines baseline assessment and obtain a detailed
American Psychiatric Association: Diagnostic and Statistical
history and mental status. However, in my cases, I
Manual of Mental Disorders, 4th Edition, Text Revision.
present only information relevant to the case or il- Washington, DC, American Psychiatric Association, 2000
lustrative of the issues addressed. I asked the other American Psychiatric Association: Practice Guidelines for the
authors to do the same. I also do not discuss general Treatment of Psychiatric Disorders, Compendium. Wash-
therapy issues and techniques, the focus of much of ington, DC, American Psychiatric Association, 2006
Introduction to the Cases 145
34 Tan Alcohol abuse, APAsubstance use disorders Alcohol use, alcohol craving,
depression depression
Note. ACOG =American College of Obstetricians and Gynecologists; APA= American Psychiatric Association; BPRS=Brief
Psychiatric Rating Scale; C-L= consultation-liaison; DAS=Delusional Assessment Scale; FIBSER= Frequency, Intensity, and
Burden of Side Effects Rating; Ham-D=Hamilton Rating Scale for Depression; MDD =major depressive disorder;
MDE= major depressive episode; NICE = National Institute for Health and Clinical Excellence; NOS= not otherwise specified;
OCD= obsessive-compulsive disorder; PHQ-9= Patient Health Questionnaire (nine questions); PTSD =posttraumatic stress
disorder; QIDS-C16 =Quick Inventory of Depressive SymptomatologyClinician Rating; QIDS-SR16 = Quick Inventory of De-
pressive SymptomatologySelf-Report; RANZCP =Royal Australian and New Zealand College of Psychiatrists;
STAR*D=Sequenced Treatment Alternatives to Relieve Depression; TIMA= Texas Implementation of Medication Algorithms;
VHA-DoD =Veterans Health Administration, Department of Defense; WFSBP= World Federation of Societies of Biological
Psychiatry; Y-BOCS=Yale-Brown Obsessive Compulsive Scale.
17
Panic Disorder
C. Barr Taylor, M.D.
147
148 How to Practice Evidence-Based Psychiatry
I have the patient rate it from 0 = not bad at all to the reader would benefit from my discussion about
10 =severe. Working with the patient, I may develop these deviations. I decided to turn the guidelines
some other simple measure to reflect the patients into checklists and then to examine my practice
progress toward his or her goals. For instance, if I against the guideline as a standard. I used this review
am dealing with a patient with social phobia who as one source for evaluating how I could do a better
wants to date more, I may decide to use a general job with a similar patient in the future.
measure of how comfortable he feels in dating. I may When patients are not improving as I would expect
also use a measure that focuses on satisfaction, for them to based on my experience or some other source
instance, How satisfied are you with your relation- of information, I ask myself: Is my diagnosis/assess-
ships with women you date? The data will give me, ment correct? Are my therapeutic choices appropri-
and the patient, an idea of how he is doing and help ate and/or being applied (e.g., are there adherence or
determine if I need to change treatment strategies, implementation problems)? Are there problems in
for example, if the patient is not adequately improv- the therapeutic relationship? Searches applying
ing relative to his or my expectation of what progress methods of evidence-based medicine can be useful to
would be appropriate at that point in therapy. I pro- help me determine if I have missed some useful infor-
vide examples of all these types of measures col- mation or approach that might aid the patient.
lected over time in the following cases.
There are many challenges in collecting such
Setting
data, and I believe we should use the data we collect.
One challenge is to relate the patients visit number I practice in a general outpatient clinic in a private
to the week he or she has been in therapy. To make it university medical center department of psychiatry.
easier, I attach a simple chart to the front of the case The clinic serves mostly insurance patients. I have
that looks like this: set up my office so that my computer is to my left
and my patients sit to my right in a chair at the cor-
Visit Date Week ner of my desk.
1 09/07/06 0 (baseline)
2 09/13/06 1
3 10/05/06 6 Illustration
4 10/18/06 13 This study illustrates:
(etc.)
Application of guidelines to a single disorder
The chart allows me to plot the data, by visit, in
Use of manualized treatments/self-help
real time. I usually share the information on the
Monitoring of symptoms
chart with the patient. Doing so allows me to review
Dealing with relapse
the patients goals and keeps me focused on helping
the patient achieve progress.
In truth, keeping up even this simple data system Chief Complaint
is a bit of a nuisance. Patients may resent filling out
Mr. C.W. is a 32-year-old male engineer who pre-
the forms or find them repetitive or unnecessary, a
sents with a chief complaint of panic attacks.
session may run over, or I may have limited time be-
tween sessions or other more urgent issues to attend
to. My first priority in charting is to complete the Present Illness
clinical note; the graph is optional. However, it is Mr. C.W. said that his problems had begun about
rarely necessary to keep data at each patient session. 3 months prior to presentation when he was driving
to work and crossing over a bridge. He experienced
Guidelines a sudden, intense feeling of panic that was accompa-
Having been trying to focus on evidence-based psy- nied by a sharp pain in the back of his head and a
chiatric practice for the past several years, I thought rapid heart rate. He drove himself to an emergency
I was familiar with the guidelines. However, in for- room (ER) where he received medical tests and no
mally reviewing my cases against guidelines, I find abnormalities were found. A week later he had
that I sometimes deviate more than I should. I felt another attack when he was again driving to work.
Panic Disorder 149
He returned to the ER and received a CT scan, chest moderate depression; see Chapter 21). On his base-
X ray, ECG, and other tests, which all yielded nor- line form, he rated his average level of depression
mal results. He began to find it impossible to cross over the past week as being about a 3 (moderate, on
over the bridge on the way to work without being a scale of 0 =no symptoms and 10= severe symptoms)
accompanied by a friend, and he started to avoid and his maximum depression about the same. He
work altogether, even though he had not had an- rated his average anxiety as being 5/10 with his max-
other panic attack. He also began to experience imum as 8/10. He said he experienced panic a few
severe dizziness nearly constantly. He went to his in- times a week. He rated his dizziness as a 6/10.
ternist, who told him he had anxiety and prescribed
citalopram, starting at 10 mg/day, and clonazepam
DSM-IV-TR Diagnosis
0.5 mg prn. On the day after the patient took the ci-
talopram he became severely depressed, felt like Axis I Panic disorder with agoraphobia
crying, and had suicidal thoughts. He stopped the Axis II None
citalopram on his own but stayed on the clonaze- Axis III None (cause of dizziness was not clear)
pam. He continued to be driven to work by a friend Axis IV Work stress; social isolation
and had a number of episodes when he felt his heart Axis V Global Assessment of Functioning (GAF)
was beating fast on his way to work even when not score: 50
on a bridge. He then self-referred to the psychiatry
outpatient clinic, where I first saw him. Treatment Plan Considerations
The patient had been keeping detailed notes
since the first event. For instance, his notes from one Panic Attacks/Avoidance
day were as follows: On first assessment Mr. C.W. seemed to present a
fairly straightforward case of panic disorder with ag-
6:45 A.M. heart beating fast oraphobia and secondary depression. He was having
7:30 A.M. anxiety, dizzy about two to three panic episodes every week al-
8:00 A.M. at work, dizzy though these were rarely full-blown panic attacks,
12:00 P.M. weak and faint perhaps because of his avoidance and use of benzo-
1:00 P.M. weak and faint diazepines.
7:00 P.M. feel better, dizzy
Selecting a Guideline
When asked what he thought was causing the Having reviewed both the American Psychiatric As-
problem, he suggested, Work stress, maybe chem- sociation (APA) and National Institute for Health
icals at work, or maybe I have a brain tumor. and Clinical Excellence (NICE) guidelines (and oth-
ers) for an article for BMJ (Taylor 2006), I ended up
Other Significant Findings preferring the NICE guideline, which was most
consistent with my own practice and publications.
From Assessment I provide the guideline at the end of the case and re-
The patient exercised one to two times per week view where I adhered to or deviated from the guide-
(jogging for about 40 minutes on Saturday and Sun- line (www.nice.org.uk/Guidance/CG22).
day). He was happy with his diet and weight. He re- Given that the guideline lists cognitive-behav-
ported being isolated, although he socialized with ioral therapy (CBT) as the therapy of first choice, the
people at work on Friday nights and sometimes on first major therapeutic decision for the patient was to
the weekend. He considered himself to be an agnos- determine if medications were appropriate for this
tic. He denied smoking, drinking, or taking any case and, if so, which medications to use. CBT would
over-the-counter or herbal or other nonprescribed certainly be appropriate in the long run, but would it
products or medicines. He avoided any foods or be sufficient to deal with the patients distress? The
drinks with caffeine. There were no medical prob- patient was quite impaired (GAF = 50), requiring a
lems contributing to onset of panic attacks. He re- friend to drive him to work and feeling miserable
ported moderate and increasing stress at work, with most of the day. He also had a number of depressive
long hours. His STAR*D QID-SR16 score=8 (low to symptoms (feelings of sadness, fatigue, being slowed
150 How to Practice Evidence-Based Psychiatry
down, and thoughts that life is empty or not worth ous medical problem. Should I recommend further
living). I felt he would benefit from an adequate trial medical evaluation? The patient felt that his worst
of antidepressant both for the panic and for the de- symptom was the one that seemed to interfere the
pressive symptoms. The patient also was reluctant to most with his work and that it served as a major cue
use only CBT, and his job required some flexibility as for his feeling like something was seriously wrong. I
to when I could schedule sessions. The guideline weighed the advantages and need of further medical
does not suggest that CBT be used in lieu of medi- workup against the effect that such a workup could
cation but suggests that CBT should be used first. have on reinforcing his sense that he had a medical
Having decided to use a medication, should I problem. An important aspect of care, and implied
choose a selective serotonin reuptake inhibitor in the guideline, is the need to help patients under-
(SSRI) other than citalopram or start on another stand how their symptoms might have a psycholog-
type of antidepressant? The patient had become ical rather than medical origin. I also assumed that
very depressed on the citalopram when he first tried treatment of the panic would result in reduction in
it. (I made a mental note to see what I could find out dizziness. The dizziness would be used as part of in
about using another SSRI when a patient had a de- vitro exposure therapy and in helping the patient
pressive reaction.) The patient would not try cit- learn new breathing techniques. I decided not to
alopram again, even at half the dose, so I decided to make a referral at this time but to follow up if the
start him on sertraline at a very low dose (a quarter dizziness did not diminish as expected.
of a 25 mg tablet for 3 days followed by half a tablet
for 3 days). The patient was told to stop the medica- Onset/Stressors
tion if he felt worse. As is often the case, the reason for the onset of the
From the NICE guideline perspective, the use of panic was not clear. Stress at work appeared to be a
the clonazepam was problematic. The guideline contributing factor, although the patient had had
states that benzodiazepines are not to be used, on the many times at work when he felt under intense stress
basis that outcome studies argue that patients given without feeling panicky. There were no other obvi-
benzodiazepines do worse over time. The guideline ous lifestyle habits (such as caffeine use, cessation of
would imply that I should stop the clonazepam that smoking, drug use) or medical precipitants. I won-
the patient was already on. I assumed that a combina- dered if stress management might be useful at some
tion of antidepressant medication and CBT would point, but the patient was not interested. The guide-
reduce panic, depression, and avoidance and that the line does not recommend stress management for
benzodiazepines would be stopped. However, the treating panic, but there appeared to be another rea-
patient said that the clonazepam had been helpful. son to offer it, that is, for reducing stress and improv-
The patient might feel worse if it was stopped, and ing coping.
stopping it might be associated with some rebound
or withdrawal effects. I decided to continue it for an- Avoidance
other week. I told the patient that I would consider The patient had developed significant avoidance
stopping it or cutting down at the next visit. that could eventually cost him his job. I was confi-
dent that exposure therapy would reduce his avoid-
Dizziness ance. I considered this to be my number one goal
Dizziness is a common symptom of patients with (the patient was more concerned about his dizzi-
panic, which may represent some underlying distur- ness.) As suggested in the guideline, massed expo-
bance in the vestibular system (Tecer et al. 2004) sure, that is, intensive exposure over a short time,
and can be related to hyperventilation or occur from can be used and appears as effective as more pro-
other, unknown reasons. Dizziness can also repre- longed exposure. (The focus would be on driving
sent a number of medical problems. The patients and crossing bridges.) My schedule does not permit
medical evaluation had focused on his cardiovascu- providing massed exposure and it is not available in
lar but not ear, nose, and throat (ENT) system. His the community, so I decided against using this po-
interpretation of the symptom was that he might tentially rapid treatment of his avoidance. I also felt
have a brain tumor, and if not that, some other seri- it was important to first develop a relationship with
Panic Disorder 151
the patient, to help reduce the dizziness, at which monitoring and I could provide the treatment. I also
point he might be open to more demanding inter- did in vivo exposure for dizziness and taught him
ventions such as exposure therapy. breathing exercises (per Craske and Barlow 2006).
drive to work, cross bridges, etc.) in terms of feel- for 6 months after he has been symptom free and ex-
ings/symptoms, behaviors, and cognitions. plained the rationale. He was willing to continue for
another 3 months. He was informed of how to stop
Visit 7 (Week 15) the medications and alerted to discontinuation effects.
The patient continued to do well with no depres-
sion, minimal anxiety, and no avoidance. He contin- Relapse
ued to drive to work. He had bought a ticket to go About 9 months after the last visit, the patient called
back East but was worried about having a panic at- to say that he had had another panic attack out of the
tack on the plane. I gave him instructions on breath- blue. He said that about 3 months after his last visit
ing and suggested he could use clonazepam if he was he stopped the bupropion, and because he continued
experiencing significant anxiety before the flight. I to feel very good, he also stopped the sertraline.
asked if he wanted to address the issue of dating, and About 1 week prior to his call, he had another panic
he agreed but seemed ambivalent and did not want attack and decided to restart the sertraline and clo-
to set any goals related to dating at this time. nazepam on his own. One day after restarting the
medication he became depressed and frightened. He
Visit 8 (Week 18) was worried that he would fall right back into his old
The patient continued to do well with minimal anx- patterns. I scheduled a visit within the next week,
iety, depression, and no panic. He decided he did not suggested he continue the sertraline but at a lower
want to work on dating or on stress issues at work. dose, and invited him to call me if he felt worse. I re-
We discussed moving into maintenance/relapse pre- minded him of the importance of his breathing ex-
vention after the next session. ercises, which he had stopped. At our session a week
later, he reported having had no panic attacks and
his mood was much improved (3/10; maximum dys-
Visit 9 (Week 22)
phoria 4/10). Surprisingly, he had no dizziness. He
The patient continued to do well. We discussed re- was not doing his breathing or relaxation but was
lapse prevention techniques and scheduled a follow- not avoiding. I suggested he continue the sertraline
up visit to review medication use. but decrease the clonazepam. In this instance, the
onset seemed to be related to a significant increase
Visit 10 (Week 38) in his workload and the feeling that he was falling
This was the maintenance visit. The patient contin- behind and not doing a good job. However, he did
ued to do well with no panic, depression, or anxiety. not want to discuss these issues in detail. Based on
He wanted to stop medications. I explained that the his relapse, longer-term use of the medication (at
guideline recommends that he continue medication least another year) seemed advisable. For the panic,
Panic Disorder 153
How often did you experience panic attacks/episodes in the past week?
(1 = none, 2 = once, 3 = a few times a week, 4 = a few times a day)
4
3 x x x
2 x
1 x x x x
Wk
1 2 3 4 5 6 7 8 9 10 1117 18 19 20 21 22
In the past week, what was your average level of depression or dizziness? (0 = none/no symptoms to 10 = severe)
10
9
8
7
6 o
5
4 o o o
3 x x
2 x x o
1
0 x xo xo xo
Wk
1 2 3 4 5 6 7 8 9 10 1117 18 19 20 21 22
stress reduction/coping skills might have reduced Benzodiazepines were prescribed by the patients in-
his stress at work. ternist and were continued for several weeks, which
Figures 17 1 and 1 72 show the patients would seem to go against the spirit of the guideline.
progress over the first 22 weeks of therapy. The guideline stresses that CBT should be deliv-
ered only by suitably trained and supervised people
who can demonstrate that they adhere closely to em-
Summary of Guideline Use pirically grounded treatment protocols. Treatment
Table 172 summarizes the guidelines applied to protocols are available for panic disorder (and many
this patient and whether or not the guideline was other problems), for instance, through the Treat-
followed. Although an SSRI was used as the first ments That Work series (www.oup.com/us/catalog/
medication of choice, the actual practice was more general/series/TreatmentsThatWork/?view=usa).1
complicated because the patient had had an adverse Since I have extensive experience in treating panic, it
reaction to the first drug prescribed in that class and didnt seem necessary to strictly follow such a proto-
a second SSRI was started at a unusually small dose. col. The guideline also expects CBT to be com-
1
The author is an unpaid member of the Treatments That Work Scientific Advisory Board.
154 How to Practice Evidence-Based Psychiatry
pleted in 4 months, although this was not possible could improve by ensuring that self-help manuals are
with the patients schedule. available when needed (e.g., order a supply in ad-
I find that keeping track of the patients progress is vance, sign up for a supplementary program). Al-
the most useful aspect of the guideline. Medication though I am confident in my ability to provide CBT, a
algorithms are designed so that failure to improve by manual helps to ensure that the patient is provided the
a certain period leads to other medication choices. core information. I might have focused more atten-
This is not the case with psychotherapy, where fail- tion on how the patient might cope or avoid relapse.
ure to improve leads to another set of recommenda-
tions. I would expect a patient with uncomplicated References
panic to have significantly improved by six sessions
Barlow DH, Craske HG: Mastery of Your Anxiety and Panic:
(Kenardy et al. 2003; Taylor 2006). If the patient had
Workbook (Treatments That Work). New York, Oxford
not improved, I would ask myself, as noted in the
University Press, 2006
introduction: 1) Is this the right therapy? 2) Is the Craske HG, Barlow DH: Mastery of Your Anxiety and Panic:
therapy being followed (e.g., am I doing the CBT Therapist Guide (Treatments That Work). New York,
properly, is the patient taking the medication?) or Oxford University Press, 2006
3) Am I missing something? (e.g., wrong diagnosis, Kenardy JA, Dow MGT, Johnston DW, et al: A comparison
a medical problem, secondary gain, the patients dis- of delivery methods of cognitive-behavioral therapy for
satisfaction with me or the therapy). In this case, the panic disorder: an international multicentre trial. J Con-
sult Clin Psychol 71:10681075, 2003
patient had improved as expected.
Simon NM, Emmanuel N, Ballenger J, et al: Bupropion sus-
tained release for panic disorder. Psychopharmacol Bull
Ways to Improve Practice 37(4):6672, 2003
Taylor CB: Panic disorder. BMJ 332:951955, 2006
In reviewing the guideline and my practice, I identi- Tecer A, Tkel R, Erdamar B, et al: Audiovestibular func-
fied some areas where I could improve and some tioning in patients with panic disorder. J Psychosom Res
questions where I would like more information. I 57:177182, 2004
This page intentionally left blank
18
Introduction and Setting nearly every day and had a loss of interest in her
usual activities, fatigue, feelings of worthlessness,
See Chapter 17.
and trouble concentrating but no change in weight
or sleep. She denied thoughts of suicide. Her symp-
Illustration toms had begun to interfere with her being able to
concentrate on her class work. She denied any pre-
This study illustrates:
vious episodes of depression. She had seen a thera-
Use of American Psychiatric Association (APA) pist about 3 years ago, when she was in college,
major depressive disorder guidelines around issues of her breaking up with another boy-
Use of Sequenced Treatment Alternatives to Re- friend.
lieve Depression (STAR*D) guidelines She reported bingeing two or three times a day
Reconciliation of National Institute for Health with at least one episode followed by vomiting. She
and Clinical Excellence (NICE) guidelines for said this habit had been going on for about 4 years
bulimia nervosa with APA guidelines for major and that it was her way of controlling her weight.
depressive disorder (Her weight, body mass index = 21, was well within
Use of self-help materials the normal range and had not changed since she was
Stepped care for bulimia; marginal outcome an adolescent.) Typically she would overeat or binge
at lunch or dinner and then vomit an hour or so after
the meal. She would occasionally binge and purge at
Chief Complaint night as well. When she wasnt able to vomit, for in-
Ms. S.W. is a 24-year-old female Hispanic law stu- stance, because she was at an after-dinner party in a
dent who presents with a chief complaint of depres- friends apartment, she became very anxious, almost
sion and frequent vomiting. frantic.
157
158 How to Practice Evidence-Based Psychiatry
practitioner 1 month prior to her initial visit. Phys- Does exercise help treat depression? The results
ical exam and electrolyte levels were normal. She did are summarized in Table 182. I felt there was
not have dental erosion or enlarged parotid glands. enough evidence to include exercise in this patients
Her STAR*D Quick Inventory of Depressive Symp- regimen and to add it to my guideline.
tomatologySelf-Report (QIDS-SR 16) score was An important consideration for Ms. S.W. was
13 (moderate depression). On her baseline assess- whether to use psychotherapy and/or medications.
ment, she rated her average level of depression over The patient preferred psychotherapy (including
the past week as being about a 6 or 7 (on a scale of cognitive-behavioral therapy [CBT]) but was willing
0 = no depression, 10 = moderate to severe depres- to consider medications. I was confident the patient
sion) and her maximum depression about the same. would improve on either or both. However, I felt
She rated her average anxiety as being a 6 or 7 and that a CBT approach would be necessary for her bu-
maximum at 8. (She did not consider anxiety to be a limia nervosa where medication was less likely to be
major problem.) useful. By using both medication and CBT, I felt
that I would be able to provide treatment for her de-
DSM-IV-TR Diagnosis pression (with pharmacotherapy) and to spend the
psychotherapy focusing on the eating disorder and
Axis I Major depressive episode relationship issues.
Bulimia nervosa The medication algorithm embedded in the APA
Axis II None guidelines for depression is excellent, but given the
Axis III None extensive use of the STAR*D algorithms and the
Axis IV Breakup with boyfriend definitions of response and phases, I think the latter
Axis V GAF score: 75 is preferable, in part because of its real-world ap-
proach (see Chapter 21 for a detailed presentation of
Treatment Plan Considerations STAR*D) (Gaynes et al. 2008). A critical issue in all
the guidelines is to define what represents response
Depression and Bulimia and what represents remission. STAR*D defines
The patients main problems were depression and response as a significant improvement in depressive
bulimia. She was much more concerned about her symptoms, although residual symptoms may be
depression than her bulimia but felt that she wanted present. It is generally defined as a 50% improve-
to address both issues. She felt the depression was ment or greater reduction from baseline score on a
entirely due to her breakup with her boyfriend. standard measure such as the Hamilton Rating Scale
for Depression, Beck Depression Inventory, or
Selecting a Guideline QIDS-SR 16 . Remission is considered full restora-
I considered four guidelines and algorithms: 1) the tion of a patients normal capacity for psychosocial
APA guideline for major depressive disorder and occupational function with no residual symp-
(www.psychiatryonline.com/pracGuide/pracGuide- toms, as defined by a score of 7 on the 17-item
home.aspx), 2) the STAR*D guideline (Rush et al. Hamilton Rating Scale for Depression or <5 on the
2003), 3) the APA guideline for eating disorders QIDS-SR 16 . Relapse is defined as recurrence of
(www.psychiatryonline.com/pracGuide/pracGuide- symptoms and impairment following response.
home.aspx), and 4) the NICE guideline for treating Treatment-resistant depression is defined as failure to
bulimia (www.nice.org.uk/CG009niceguideline). respond to at least two or three antidepressants
The APA general depression guidelines provide given at therapeutic doses for more than 4 weeks
an excellent overview and general principles of (see Chapter 21 and Trivedi et al. 2007 for more de-
treatment (see Table 181). I added a row to the tails on the STAR*D algorithm).
guideline to indicate the need to assess and address I debated between the APA eating disorder guide-
exercise. Clinicians should consider evaluating the line and the NICE guideline. The NICE guideline
evidence for practices they consider useful and add- is more specific than the APA guideline and is closer
ing them to their personalized guidelines. For exam- to my therapeutic approach. Furthermore, members
ple, I used the five-step approach discussed in of our clinic have written a patient treatment guide
Chapter 2 of this volume to address the question, with an accompanying manual (Agras and Apple
Major Depressive Disorder and Bulimia Nervosa 159
TABLE 181. Modified American Psychiatric Association general recommendation for major
depressive disorder through remission
Recommendation Followed
Psychiatric management Basic clinical requirements
Diagnostic evaluation (including safety, functional
impairment, etc.)
Establish and maintain a therapeutic alliance
Monitor transference/countertransference
Monitor status and safety
Provide education to patient
Provide education to families No, per patient
Enhance medication treatment adherence by emphasizing:
When and how often to take
Typical 2- to 4- week lag to benefit
Continue medication even when feeling better
Consult with medical doctor if problems arise
Review side effects
What to do if problems arise
Address early signs of relapse
Acute treatment Select initial treatment modality
Antidepressant medication or
Psychotherapy or
Psychotherapy plus antidepressant medication and
Consider ECT NA
CBT and interpersonal therapy have best-documented efficacy
Must be integrated with psychiatric management and other NA
treatments
Response to therapy should be carefully monitored
Care needs to be coordinated NA
Patients should be treated until a complete response occurs. If , used
moderate improvement or less is not achieved in 48 weeks, STAR*D
treatment needs to be reviewed. criteria
No or partial response (change medications; add or change
psychotherapy; consider ECT)
Reassess in 48 weeks
The benefits of exercise should be discussed and program initiated if Already
appropriate a exercising
Continuation phase (1620 Patients should continue on medications, generally at the dose
weeks following remission) used in the acute phase
Psychotherapy effective for relapse prevention should be used NA
(frequency of visits is not clear)
Note. CBT=cognitive-behavioral therapy; ECT=electroconvulsive therapy; NA=not applicable to patient; STAR*D=Sequenced
Treatment Alternatives to Relieve Depression.
a
Authors addition.
Source. http://www.psychiatryonline.com/pracGuide/pracGuidehome.aspx.
160 How to Practice Evidence-Based Psychiatry
TABLE 182. Using the 5-step evidence-based medicine process to evaluate the effects of
exercise on depression
Process Evaluation
Step 1. Formulate the question Does exercise help treat depression? (If yes, other important issues would
need to be considered, such as type, intensity, frequency, and setting.)
Step 2. Search for answers Several reviews suggested that regular aerobic exercise is effective in
reducing depressive symptoms (e.g. Barbour et al. 2007) but that it is not
recommended as a primary treatment, at least in older adults (Steinman
et al. 2007). An older meta-analysis (Lawlor and Hopker 2001)
concluded, The effectiveness of exercise in reducing symptoms of
depression cannot be determined because of a lack of good quality
research on clinical populations with adequate follow up.
Step 3. Appraise the evidence The advantage of searching for reviews and meta-analyses is that others
have appraised the evidence. The results and conclusions are not always
consistent, however, as suggested in the two reviews above, and I am left
to draw my own conclusions. I dont find convincing evidence that
exercise should be the primary treatment for depression. Having been
involved in a number of exercise intervention studies, I am also aware of
the time and resources required, the potential medical risks (falls,
sprains, cardiovascular events), and the generally poor adherence. I
conclude, as reflected in Table 181 (which comes not only from this
review, but my own work in the field) that the benefits of exercise should
be discussed and a program initiated if appropriate.
Step 4. Apply the results Ms. S.W. was already exercising. (My general approach to provide exercise
programs for patients is presented in Miller and Taylor 1995).
Step 5. Assess the outcome The APA guideline includes periodic assessment of depression, and I use
frequent single-item assessments. However, it is often difficult to
attribute change to any one practice when patients are being provided a
number of activities. I think it is important to assess adherence to
exercise, and I routinely ask patients to report how many times a week
they exercise as a global assessment.
2008a, 2008b) that can be used to provide the CBT Another consideration was what assessment in-
approach recommended by NICE. struments to use for bulimia nervosa. Although a
The NICE guideline for the pharmacological number of standardized instruments are available to
treatment of bulimia nervosa is not consistent with assess eating disorder attitudes and behaviors, I de-
the STAR*D and APA guidelines for major depres- cided to focus only on purging episodes as the main
sive disorder. The NICE guideline (Table 183) outcome measure.
states that fluoxetine is the medication of first
choice; STAR*D recommends citalopram (although Relationship Issues
probably any selective serotonin reuptake inhibitor The patients depression was related to the breakup
could be substituted). NICE states that the patient of a relationship, and this would be a focus of ther-
should be told to expect rapid improvement with apy. I am not aware of guidelines for treating rela-
pharmacology (based on a limited number of stud- tionships, although therapeutic practices of relevant
ies); APA emphasizes the need to inform patients of interventions such as interpersonal therapy (IPT)
more gradual improvement. NICE recommends re- have been clearly defined. I planned to use IPT tech-
assessment at 45 months (based on expected time niques to deal with the relationship issue and CBT
course for bulimia treatment); the STAR*D guide- techniques to deal with the bulimia and depression.
lines suggest reassessment at 8 weeks. Many of the core ideas of these therapies cross pa-
Major Depressive Disorder and Bulimia Nervosa 161
Recommendation Followed
Psychological interventions As a first step, encourage use of evidence-based self-help No, given
program manual
If self-help is declined, offer CBT
1620 sessions over 45 months
Reassess at 45 months
If CBT is declined or no response (per guideline), offer other
psychological treatments. IPT should be considered as an
alternative to CBT but patient should be told it may take
812 months.
Pharmacological As an alternative or additional first step, offer antidepressant
interventions
Fluoxetine is first choice. Dose for bulimia nervosa is higher Used STAR*D
than for depression.
Inform patients that long-term effects are not known; beneficial
effects will be rapidly apparent
Medical management If patient is vomiting frequently or taking many laxatives, assess No
fluid and electrolyte balance
If electrolyte disturbance is detected, focus on behavior change or NA
oral supplementation
Note. CBT =cognitive-behavioral therapy; IPT= interpersonal therapy; NICE = National Institute for Health and Clinical Ex-
cellence; NA= not applicable to patient; STAR*D= Sequenced Treatment Alternatives to Relieve Depression.
Source. http://www.nice.org.uk/CG009niceguideline.
tient issues. For instance, negative thoughts related ship issues as part of the agenda, because this was the
to body image are likely to cause both depression patients main concern, and also allow me to deter-
and excessive focus on weight and shape concerns. mine if she was making progress. From my clinical
The NICE guideline for eating disorders states that experience I would expect her relationships to im-
if IPT is used, the patient should be cautioned that it prove to a score of 3 or 4 after 6 months of therapy.
might take up to a year. But with any recommenda- With these considerations, I discussed an initial
tions derived from trials that restrict therapy to one treatment plan and approach with the patient. I
approach, the recommendation does not fit the real mentioned that I would periodically monitor how
world where we use several synergistic approaches. she was doing. She agreed to my initial treatment
Another issue was how to measure progress in the plan, listed in Table 184.
patients relationships. Relating involves a number I prescribed citalopram 10 mg, increasing to 20
of factors, including confidence, skills, interest, and mg as tolerated. I explained the side effects and told
behavior. I decided to use a very simple metric by her to stop the medication if she got worse. I sched-
asking the patient every few sessions how satisfied uled a visit in 1 week.
she was with her relationships, from 1= not at all to
4 =very satisfied, with the idea that I could explore Course
the components as it seemed appropriate. I assumed
she would need to overcome her sense of loss and Visit 2 (Week 2)
impaired self-esteem from the breakup with her The patient had no side effects from the citalopram
boyfriend before she would want to explore and de- and had increased it to 20 mg per day. About half the
velop new relationships. Routine use of even this session was spent reviewing her relationship with
simple question would remind me to keep relation- her ex-boyfriend. It appeared that he had pushed
162 How to Practice Evidence-Based Psychiatry
her away as she was trying to achieve a closer rela- so to confront, giving me more time to build a ther-
tionship. She interpreted this as I am not worthy apeutic relationship.
or attractive and Nobody will ever want me
thoughts appropriate for CBT intervention. The Visits 48 (Weeks 412)
second part of the session was spent providing an The patients mood had improved. She no longer
overview of CBT treatment for bulimia nervosa. She met criteria for depression by week 8 and would be
was provided a self-help patient treatment manual, considered in remission. She was feeling much bet-
Overcoming Eating Disorders (Agras and Apple ter about herself in general except for her bingeing/
2008a). According to the therapist guide (Agras and purging. It was evident to her that her bingeing/
Apple 2008b), following evaluation, for the first ses- purging was a factor in her break-up with her boy-
sion I should have undertaken the steps listed in Ta- friend and would be a factor in future relationships,
ble 185. I followed most of these activities although but she was not motivated to stop. She firmly be-
I knew I would need to have some flexibility in lieved that her bingeing/purging was controlling her
scheduling. weight. Overall adherence to the CBT practices was
less than 50%. She was not able to follow a pre-
Visit 3 (Week 3) scribed diet plan. Although her binge frequency, by
The patient was feeling less depressed and had no her report, had dropped by 25%50% and she had
side effects from the medication. She had not com- days when she was binge/purge free, I felt it was im-
pleted her daily food records or read the first chapter portant for me to review why the patient was not do-
of the workbook. We spent about 30 minutes on re- ing better. I didnt feel her diagnosis or assessment
lationship issues, which was what she wanted to talk was wrong, but she had very little motivation to
about. We then returned to discuss the importance change her behavior or to question her core beliefs
of keeping the food records and reading the first sev- and attitudes about bingeing/purging. We reviewed
eral chapters of the manual. In reviewing the thera- treatment options, including whether she might
pist guide (Agras and Apple 2008b), I found there want to see someone else or change or increase her
was little said about very noncompliant patients, al- antidepressant, all of which she declined.
though much has been written about this in the
CBT literature. I reemphasized the importance of Weeks 1336
keeping the records and examined her thoughts The patient remained in remission from her depres-
about doing so. The patient said that she didnt have sion for the next 4 months and wanted to stop her
time and felt too conspicuous carrying them around. medication. She was feeling much better about her-
We problem-solved ways for her to keep the records self and her relationships and had started dating.
(such as writing the items down before she went to However, she continued to binge/purge at a high
sleep) and even focused on accurate record keeping rate. I did a literature search to see if there were
for a few days but not the entire week. I had the im- some new approaches that might prove beneficial,
pression the patient was not motivated to change her following the five-step approach discussed in Chap-
bingeing/purging. I decided to wait another week or ter 2 of this volume (see Table 186). The search
Major Depressive Disorder and Bulimia Nervosa 163
TABLE 185. First session of cognitive-behavioral therapy for bulimia nervosa, therapist
activities
identified topiramate as a possible adjunct, but I felt We stopped therapy after 36 weeks. The patient
the evidence for the use of topiramate was marginal. had accepted a job as an intern at a law firm in New
I discussed the risk/benefit with the patient, and she York for the summer, and we decided this was a good
wanted to try it. After several weeks, and at a dose of time for her to take a break from therapy with the
150 mg, the patient had seen no benefit and asked to notion we would reevaluate treatment options in the
stop the medication. fall when she returned, if she wanted to.
TABLE 186. Using the 5-step evidence-based medicine (EBM) process to evaluate
pharmacological approaches to reducing bingeing/purging
Process Evaluation
Step 1. Formulate the question. Are there medications that can be used to reduce bingeing/purging (aside
from those discussed in guidelines)?
Step 2. Search for answers. After a more general search, I found some reports of the potential benefits
of topiramate (Kotwal et al. 2003; Nickel et al. 2005). I could not find the
Kotwal article online through my medical library (limited access to many
journal articles is a major problem for EBM in clinical practice). Nickel
et al. 2005 found that about 30% of the topiramate group had reduced
binge frequency by 50% or more, compared with 3% in the control
group. The medication was started at 25 mg and increased to 250 mg
over 6 weeks. No side effects were noted. I also reviewed the basic
pharmacology of topiramate.
Step 3. Appraise the evidence. The evidence for the use of topiramate was marginal. I discussed the risk/
benefit with the patient, however, and she wanted to try it.
Step 4. Apply the results. Ms. S.W. was started on topiramate at 25 mg, with the goal of increasing
the dose to 250 mg over 6 weeks.
Step 5. Assess the outcome. After 4 weeks, and at a dose of 150 mg, the patient had seen no benefit and
asked to stop the medication.
164 How to Practice Evidence-Based Psychiatry
In the past week, what was your average level of depression? (0 = none/no symptoms to 10 = severe)
10
9
8
7
6 x
5
4 x
3
2
1 x x x
0
QIDS 13 5 4 4
Wk
1 2 3 4 5 6 7 8 917 18 1935 36
Figures 181 through 183 show the patients think I became more invested in the patient not being
progress in mood and depression, purging, and rela- bulimic than she was. I was frustrated that she had not
tionships over the first 36 weeks of therapy. Her de- responded as anticipated to the manualized CBT ap-
pression and her relationships improved; there was proach. The patient responded to the first step of the
little change in her purging. STAR*D guideline. However she did not want to
continue her medication for a full 12 months.
The NICE guideline recommends self-help as
Summary of Guideline Use the first step and I provided the patient with a man-
At the end of 36 weeks I reviewed my use of the guide- ual, but since she was in therapy it seemed appropri-
lines. I followed the APA guidelines for depression ate to provide additional therapeutic guidance. I was
fairly well (see Table 181). The guidelines suggest not very successful at implementing a course of
that the therapist review transference/countertrans- CBT for bulimia via a manualized treatment. How-
ference issues. While I hope I do this routinely, I ever, I was able to have the patient use the basic skills
How often did you experience purging episodes in the past week?
(1 = none, 2 = once a week, 3 = a few times a week, 4 = a few times a day)
4 x x x x
3 x x x x
2
1
Wk
1 2 3 4 5 6 7 8 917 18 1935 36
(food monitoring, meal planning, identifying binge tients care. This would also have given me an op-
triggers) by tailoring the approach to her prefer- portunity to examine the therapeutic relationship.
ences. The NICE guideline suggests that I might Finally, I should have monitored her electrolytes pe-
have moved from CBT to IPT, if CBT was unsuc- riodically to help emphasize the potential negative
cessful. However, a focus of IPT would have been on effects of her persistent purging.
her relationships, which had improved substantially.
The NICE guideline also suggests that IPT needs to
be provided for a year, but I didnt think this was jus-
References
tified. The NICE guideline says that no medications Agras WS, Apple R: Overcoming Eating Disorders: A Cog-
other than fluoxetine should be used. As mentioned, nitive-Behavioral Treatment for Bulimia Nervosa and
Binge-Eating: Patient Manual (Treatments That Work).
I decided to use citalopram following STAR*D and
Oxford, UK, Oxford University Press, 2008a
was not convinced that fluoxetine was required. A
Agras WS, Apple R: Overcoming Eating Disorders: A Cog-
PubMed search identified topiramate as a possible nitive-Behavioral Treatment for Bulimia Nervosa and
adjunct. Alternatively, I could have increased the Binge-EatingTherapist Guide (Treatments That
dose of citalopram. The NICE guideline recom- Work). Oxford, UK, Oxford University Press, 2008b
mends review of electrolytes, which I failed to do. Barbour KA, Edenfield TM, Blumenthal JA: Exercise as a
The patients physical exam and electrolyte levels treatment for depression and other psychiatric disorders:
were normal at baseline; a reassessment would have a review. J Cardiopulm Rehabil Prev 27:359367, 2007
Gaynes BN, Rush AJ, Trivedi MH, et al: The STAR*D study:
been appropriate and would also have provided an
treating depression in the real world. Cleve Clin J Med
indication of my concern about the potential medi-
75:5766, 2008
cal consequences of her behavior. I believed I had Kotwal R, McElroy SL, Malhotra S: What treatment data
generally followed the guidelines and a stepped-care support topiramate in bulimia nervosa and binge eating
approach with benefit for her depression, self-im- disorder? What is the drugs safety profile? How is it used
age, and relationship issues but with little impact on in these conditions? Eat Disord 11:7175, 2003
her bingeing. Lawlor DA, Hopker SW: The effectiveness of exercise as an
intervention in the management of depression: system-
atic review and meta-regression analysis of randomised
Ways to Improve Practice controlled trials. BMJ 322:763767, 2001
I identified several aspects of my practice that might Miller NH, Taylor CB: Lifestyle Management for Patients
With Coronary Heart Disease. Champaign, IL, Human
have benefited this patient. First, I might have been
Kinetics, 1995
more conscientious in how I delivered the manual- Nickel C, Tritt K, Muehlbacher M, et al: Topiramate treat-
ized treatment. I might have put greater emphasis ment in bulimia nervosa patients: a randomized, double-
on the need for her to use it and examined her resis- blind, placebo-controlled trial. Int J Eat Disord 38:295
tance more effectively. Second, I might have pre- 300, 2005
sented this case to the clinical case conference where Rush AJ, Trivedi M, Fava M: Depression, IV: STAR*D treat-
other experts could present ideas relevant to the pa- ment trial for depression. Am J Psychiatry 160:237, 2003
166 How to Practice Evidence-Based Psychiatry
Steinman LE, Frederick JT, Prohaska T, et al: Late life de- Trivedi MH, Rush AJ, Gaynes BN, et al: Maximizing the ad-
pression Special Interest Project (SIP) panelists: recom- equacy of medication treatment in controlled trials and
mendations for treating depression in community-based clinical practice: STAR(*)D measurement-based care.
older adults. Am J Prev Med 33:175181, 2007 Neuropsychopharmacology 32:24792489, 2007
19
Introduction and Setting used sleep to escape, had no interest in sex, and had
fatigue and no energy. She denied any suicidal in-
See Chapter 17.
tent. She reported attending a group for cancer sur-
vivors, seeing an acupuncturist for pain control, and
Illustration using several compounds prescribed by a Chinese
herbalist. She would sometimes use the dietary sup-
This study illustrates:
plement Ensure to increase her caloric intake.
Application of guidelines to psychiatric and med-
ical comorbid problems Past Psychiatric History
Monitoring of symptoms
Ms. P.A. said she was a recovering alcoholic and had
Emergence of new problems
been abstinent for over 5 years. She attended Alco-
A threat to the therapeutic relationship
holics Anonymous (AA) for 2 years after she quit
drinking but had not been to AA since.
Chief Complaint
Ms. P.A. is a 60-year-old woman who presents with a Medical History
chief complaint of depression and being unable to eat. The patient underwent radiation and chemotherapy
for nasopharyngeal carcinoma. No nodes were
Present Illness found, and neck dissection was not recommended.
Her weight dropped from 140150 lb prior to can-
The patient said she was fine until 3 months prior to cer treatment to her current weight of 114 lb. She
admission, when she was diagnosed with nasopha- was told that she would need to have a feeding tube if
ryngeal carcinoma. She began radiation therapy fol- she did not start to gain weight.
lowed by chemotherapy that needed to be stopped
after two rounds because of side effects. About
6 weeks prior to admission she began to feel very de- Social History
pressed and was started on citalopram 20 mg but felt The patient was married for 30 years and had two
that the medication only had a mild benefit and adult children (both women). She worked at home as
caused her mouth to be drier. She said that food has a part-time accountant. The patient felt that her
no taste and that eating foods was very painful. She cancer treatment had had a very negative impact on
reported feeling sad most of the day, had no appetite her family and marriage. She had lost interest in sex-
or motivation to eat, had trouble concentrating, ual activity and worried that her husband was very
167
168 How to Practice Evidence-Based Psychiatry
frustrated (she had asked him about this and he Selecting a Guideline
didnt complain) and that she had let down her As in the case presented in Chapter 18, the Ameri-
daughters by not being stronger in simply eating at can Psychiatric Association (APA) major depressive
any cost. disorder guideline would be appropriate for general
management and the Sequenced Treatment Alter-
Other Significant Findings natives to Relieve Depression (STAR*D) guideline
would be appropriate for medication (see Chapter
From Assessment 21 for a detailed presentation of STAR*D). The
The patient used to play tennis two to three times a STAR*D guideline would call for 8 weeks of citalo-
week and play golf but now reported walking three to pram at an adequate dose; the patient had been at an
four times a week for 30 minutes. She denied tobacco adequate dose for 6 weeks. She also felt that her
or caffeine use. On the mental status examination, mouth was drier on citalopram than it had been be-
she was tearful. There was no evidence of cognitive fore she started the medication, but ensuing rounds
impairment. She scored 17 (moderate to severe de- of radiation and chemotherapy are likely to have re-
pression) on the Quick Inventory of Depressive duced her salivation. STAR*D suggests sertraline,
SymptomatologySelf-Report (QIDS-SR16 ); 4/10 venlafaxine extended release, or bupropion sus-
on the self-report of depression; and 1/10 on anxiety. tained release as an alternative if citalopram is not
Her Mini-Mental State Examination score was 29. effective or is unacceptable. I was concerned that
sertraline might cause more drowsiness without im-
proving salivation; I decided to use fluoxetine based
DSM-IV-TR Diagnosis on my clinical impression that it can be more acti-
Axis I Major depressive episode vating and has little effect on salivation (evidence:
History of ethanol abuse soft and clinical). (The use of monoamine oxidase
Axis II None inhibitors, or MAOIs, to be considered if the patient
Axis III Radiation and chemotherapy for naso- did not respond to the first three steps, would be
pharyngeal carcinoma with secondary contraindicated by her use of meperidine before eat-
pain upon swallowing, loss of taste ing to reduce the pain of swallowing.) As noted in
Axis IV Stress/trauma related to cancer, possible the APA guideline, coordination of care with her
marital discord other treatment providers would be important.
Axis V GAF score: 60 The APA guideline for depression would suggest
that cognitive-behavioral therapy (CBT) and inter-
personal therapy would be appropriate. I felt that a
Treatment Plan Considerations very structured, behavioral approach would be
Depression needed to help her with eating. I also felt that sup-
The patient presented with major symptoms of de- portive therapy would be most appropriate follow-
pression probably related to the effects of being di- ing the general principles discussed in Winston et al.
agnosed and treated for cancer, with loss of taste and (2004).
pain on swallowing, resulting in reluctance to eat
and weight loss. She felt that she had let her family Weight Loss/Food Refusal
down because she was not eating. She was desperate The patients main goal was to resume eating. Her
to begin eating because she was terrified of having a problems in eating were probably related to her de-
feeding tube placed. The use of unidentified com- pression (loss of appetite) but also to her loss of taste
pounds from the Chinese herbalist presented a and pain on swallowing. It hurt to eat. There are no
problem of potential adverse interactions among guidelines for food refusal that I could find. We de-
their use and psychopharmacology. (I made a mental cided to establish two measurement parameters:
note to do a quick search on the use of antidepres- weight gain and difficulty swallowing. I assumed,
sants and herbs and Chinese medicines when I had based on my experience with cancer patients who
time and told the patient to try to find the names of had gone through this type of treatment, that swal-
the compounds she was using.) lowing would improve, but gradually and subtly. I
Depression, Refusal to Eat, and Nasopharyngeal Carcinoma 169
felt that the patient would benefit by seeing progress I will never get better). I also encouraged her to ex-
on a graph, even if slow. If progress didnt occur, it plore foods that might be easier to swallow and rel-
would help to consider other treatment approaches. atively more satisfying. I scheduled an appointment
A note in her medical chart indicated that she had in a week.
been prescribed 45 mg of zinc sulfate tablets three
times per day with food in order to potentially pro-
vide some benefit to her taste function as previously
Course
described in the literature. Visit 2 (Week 2)
The patient reported progress in being able to eat
Stressors/Trauma of Cancer and found the logs useful. She was proud of herself
A number of clinical approaches to treating cancer when she could eat and hard on herself when she
trauma have been described (Spiegel and Classen was not able to. She found that her mood varied
2000). I have had positive experiences with online throughout the week and at times she felt normal
groups as one method of providing this service and other times felt frustrated and down. Evening
(Winzelberg et al. 2003). Encouraging the patient to meals were much harder for her. She was not prepar-
use Internet resources, such as searching for ways to ing meals for her family, in part because she resented
help treat her pain and improve her swallowing, the fact that she couldnt eat what she prepared. She
would also seem appropriate. decided it would be important for her self-esteem if
she began to prepare meals even if she wasnt able to
Relationships Issues eat them. The patients depression scores, average
The patient felt that her medical problems and de- level of eating/swallowing difficulty, and weight can
pression had adversely affected her relationships. I be seen in Figures 191 and 192.
decided to provide supportive therapy as noted
above to help her with these problems and to con- Visit 3 (Week 3)
sider referral to couples therapy (see Table 191). The patient had lost another pound and was feeling
I prescribed fluoxetine 20 mg one tablet in the discouraged. She realized that she would never be
morning and the use of a relaxation tape three times able to gain weight or even maintain her weight un-
a week. I also gave her an individualized food record less she increased her supplementation. She set a
and asked her to write down everything she ate and, goal of using enough daily nutrition supplements to
for at least one meal a day, what her thoughts were ensure weight maintenance. When discussing the
around eating (e.g., I want my food to taste better, use of supplements she said, I dont want to spend
In the past week, what was your average level of depression? (0 = none/no symptoms to 10 = severe)
10
9
8
7
6 x x x
5
4
3
2 x x
1 x x
0
QIDS 16 M M 11 M M
Wk
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1935 36
the rest of my life drinking this crap. We discussed examining negative and catastrophic cognitions (I
alternative thoughts (e.g., If I gain weight I will feel hate this food. I will always hate this food), as well as
better, I only have to do this for another few identifying activities that might give her some plea-
months, If I can hold my weight steady I wont sure or fun or even relatively more pleasure or fun.
need a tube). The patient was going to be out of
town the following week, so the next visit was sched- Visits 610 (Weeks 711)
uled for 2 weeks. (Not all visits were graphed.) The patients mood
continued to improve, and she was able to maintain
Visit 4 (Week 5) her weight at 109110 lb.
The patients mood had improved and intake was up
until 2 days before the visit when a magnetic reso- Visit 11 (Week 12)
nance imaging scan found an abnormality in her The patient developed an infection at the back of
colon. She was scheduled for a colonoscopy (and her tongue which made eating almost impossible.
would need to be NPO [nothing by mouth]) and was Her weight dropped by another 2 lb. She also said
terrified that her cancer had metastasized or that she that her husband told her that their relationship was
might have some other medical problem. We dis- unsatisfactory. Her mood worsened. She scored an
cussed this new event as being a major trauma. From 11 on the QIDS-SR16 . It would have been appropri-
her food records, she had found it useful to think of ate to consider other antidepressants, but her worse
her eating as, This is what its going to be like. If I mood seemed related to her infection and her issues
have the odd good moment, yippee. We scheduled with her husband. When I started to focus on the
a visit after her colonoscopy. food records and her weight, she became annoyed
and insisted, I need to talk about my marriage. I
Visit 5 (Week 6) dropped my agenda and listened. She was very tear-
The colonoscopy was negative and the patients ful in talking about how frightened she was that her
mood was demonstrably improved. However, she marriage might not last or that her husband was
continued to lose weight. We reviewed her food frustrated with her progress. I asked if she wanted
records, looking for strategies to improve eating and him to come to a session or if marital therapy might
Depression, Refusal to Eat, and Nasopharyngeal Carcinoma 171
In the past week, what was your average level of difculty eating and swallowing? (0 = not at all to 10 = severe)
10 x
9 x x x x x
8
7 x
6
5 x
4
3
2 x
1
0
Wt, lb 14 13 12 10 9 7 9 12
(+ 100)
Wk
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 1935 36
be appropriate. She said that she felt that their rela- would improve. Mood was normal. We scheduled a
tionship was strong and had weathered other prob- follow-up session in 3 months.
lems. A friend had invited them to spend some time
with them in the desert. If things arent better when Summary of Guideline Use
we get back, maybe we could see someone then. I
gently encouraged her to continue her food records I followed the general APA recommendations for
and weight monitoring while she was gone and major depressive disorder. I did not follow a strict
thanked her for being very assertive about what she CBT approach (use of thought records, etc.) but in-
needed to talk about. stead focused on the patients need to maintain
weight in the face of extreme discomfort.
I deviated from the STAR*D guideline as dis-
Visit 12 (Week 16)
cussed above in minor ways for initial choice of med-
The patient returned from the desert in a much bet- ication. The patient had also relapsed by week 12
ter mood. Her QIDS-SR 16 was now at 8, and her and, strictly on the basis of QIDS-SR, other inter-
weekly average mood was a 2/10. She said that she ventions should have been considered. However,
had long talks with her husband and it seemed to given the patients exacerbated medical condition
help that he could vent. They committed to con- and relationship problems, it did not seem advisable
tinuing to work on their relationship. Her weight to make a change until I had a sense of what would
was 109 lb, which she felt was acceptable given all happen to her mood, assuming these problems
that had happened. would improve.
Sometimes, I follow the guidelines and manual-
Final Visits ized procedures too closely. If the patient had not in-
The patient continued to improve over the next sev- terrupted me at week 12 to demand that we talk
eral months. Her swallowing improved dramatically about what was really on her mind, I might not have
and she was able to eat regular, although soft, foods been able to help her, could have overlooked an im-
and to consume less Ensure. Taste remained a prob- portant contributing factor to her progress, and
lem but she was optimistic; from what she had heard could have seriously impaired our therapeutic rela-
from online discussions and her support group, that tionship. It can be challenging to listen carefully to
172 How to Practice Evidence-Based Psychiatry
Anorexia, Obsessive-Compulsive
Disorder, and Depression
C. Barr Taylor, M.D.
Introduction and Setting which she did, to avoid further contact. However,
she continued to obsess about her coworker. I just
See Chapter 17.
cant get him out of my mind. She also began to feel
that there were germs in her food. The thoughts
Illustration seem to be getting worse and made her feel hopeless
and depressed.
This study illustrates:
On the Yale-Brown Obsessive Compulsive Scale
Use of obsessive-compulsive disorder (OCD) and (Goodman et al. 1989a, 1989b), she reported cur-
anorexia guidelines rent contamination, sexual, and somatic obsessions
Adaptation of guidelines and practices for a pa- and fears, and hand-washing compulsionsshe re-
tient with limited financial resources ported washing her hands about 20 times/day.
Consideration of a new guideline as a new prob- In addition, she reported a long history of food
lem emerges restriction and one episode of being hospitalized for
anorexia about 5 years ago. About 2 months prior to
assessment she began to reduce her food intake, but
Chief Complaint she said it was because of loss of appetite and not be-
Ms. C.J. is a 35-year-old married woman who is self- cause of fear of germs. Over the previous 2 months,
referred for treatment of obsessive thoughts and an- her weight had dropped from about 115 to 100 lb.
orexia. She denied laxative use, purging, or driven exercise
and said she wanted to weigh more.
One week prior to assessment her internist started
Present Illness her on sertraline 50 mg for her depression and she
Ms. C.J. said that about 4 months prior to admission said that it helped but made her very sluggish.
(PTA), she began to have sexual fantasies about
someone she worked with and also imagined that he
Other Significant Findings From
had fallen in love with her. She was terrified that she
was having these thoughts and wrote an e-mail to Assessment
the man, indicating that she was not interested. Her The patient reported no medical problems. She de-
husband was looking at her e-mail and discovered nied any alcohol or drug use. She reported multiple
the note. He became very upset and threatened to family members with depression. Her sister took
divorce her. She told her husband that there was fluoxetine with good benefit. The patient was
nothing going on and she would quit her job, married for 12 years, with 2 children ages 3 and 11.
173
174 How to Practice Evidence-Based Psychiatry
She was a high school dropout. On the mental status had the impression that she was afraid of revealing
examination, her affect was very guarded and some- too much.
what flat. There was no evidence of a thought disor-
der, and she denied hallucinations or delusions. Her Selecting a Guideline and Outcomes
baseline Quick Inventory of Depressive Symptoma- The American Psychiatric Association (APA) OCD
tologySelf-Report (QIDS-SR16) was 5, in the nor- guideline (www.psychiatryonline.com/pracGuide/
mal range. This rating seemed inconsistent with her pracGuidehome.aspx) seemed to be an appropriate
affect, which seemed sad. She reported a baseline guideline to follow, at least initially. The selection of
level of 7/10 for depression, 6/10 for anxiety, intru- the guideline was complicated by the possibility of
sive thoughts a few times per week, with the the patient having an eating disorder. The OCD
thoughts being 7/10 in terms of severity (on a 0- to treatment guideline states that treatment outcome
10-point rating scale, with 0 = no sy mptoms, targets include <1 hour/day spent obsessing and per-
10 =severe symptoms). Her weight was 100 lb. forming compulsive behaviors, no more than mild
OCD-related anxiety, an ability to live with OCD-
Differential Diagnosis associated uncertainty, and little or no interference of
OCD with the tasks of daily living. I decided to focus
The patient met DSM-IV-TR (American Psychiat- on a simple measure of frequency (In the past week,
ric Association 2000) criteria for OCD. She did not how often did you experience upsetting thoughts?
meet criteria for a current depressive episode, but rated from never to a few times a day, and In the
her answers were inconsistent as she reported signif- last week, how severe was this symptom? rated from
icant depression on a one-item scale but few symp- not bad at all to severe).
toms on the QIDS-SR 16 and attributed her 15-lb
recent weight loss to a loss of appetite. She had a his- Anorexia
tory of anorexia but denied current symptoms. How-
The APA eating disorders guideline would be rea-
ever, she was very guarded on the initial interview
sonable to consider. Initially I decide to focus on
and seemed to minimize symptoms. She was very un-
weight gain and monitor how she was doing and to
comfortable in talking about her obsessive thoughts.
get a better sense of her attitudes and behaviors re-
lated to eating.
DSM-IV-TR Diagnosis
Depression and Anxiety Symptoms
Axis I OCD
Probable current anorexia nervosa The patient did not meet criteria for a depressive
Major depressive episode? disorder but I was struck by her weight loss, which
Axis II None might have been due to depressive symptoms or an-
Axis III None orectic food refusal (she denied the latter). Her score
Axis IV Deferred on the QIDS-SR16 was in the normal range, but I
Axis V GAF score: 50 worried that she was minimizing symptoms. I de-
cided to monitor depression and anxiety weekly and
to entertain a focus on either depending on her
Treatment Plan Considerations course. Medication for her OCD would likely help
The patients main concerns related to her obsessive her depression as well.
thoughts. She felt that her depressive symptoms
were secondary to these thoughts and that she des- Treatment Plan and Initial Treatment
perately wanted them to stop. The familys limited The OCD guideline states that the first-line treat-
financial resources would be a factor in determining ments for OCD are cognitive-behavioral therapy
treatment. The patient lost her insurance coverage (CBT) and serotonin reuptake inhibitors (SRIs).
when she quit her job. Her husbands insurance had The guideline recommends that CBT focus on ex-
limited psychiatric benefits, and the familys income posure and response prevention but notes the pa-
was just above the poverty line. A major focus of the tient must be agreeable to and able to use the
initial sessions would be to build a sense of trust. I techniques. Having provided CBT to a number of
Anorexia, Obsessive-Compulsive Disorder, Depression 175
OCD patients, I was concerned that the patient tape to help reduce her anxiety and increased the flu-
would not have time to learn the techniques and that oxetine from 20 mg to 40 mg. Figures 201 and 20
we would also need our limited number of sessions 2 show the course of her depressive and OCD symp-
to deal with her eating and other problems. The an- toms and her weight.
orexia guideline recommends fluoxetine (at a higher
than usual dose). Because the patient was having un- Visit 4 (Week 6)
pleasant side effects on the sertraline, I decided to The patient reported that her mood had improved.
switch to fluoxetine. Other considerations in choos- She also felt some decrease in the frequency of her
ing fluoxetine were that her sister had done well on obsessive thoughts (not graphed in Figure 202) but
it and it is less expensive in case she needed to pur- no change in intensity of symptoms. She also re-
chase the medication herself. ported significant problems eating; she was not able
The OCD guideline recommends a course of to increase her intake as requestedin fact, she
CBT. However, the patient had a high school edu- wanted to further restrict. She did, however, report
cation and limited reading and writing skills, and her an improvement in her appetite. Her wish to re-
insurance coverage was limited to 10 sessions/year. strict, history of anorexia, and thin-body ideal sug-
The focus on therapy would need to be on medica- gested that her weight loss was related to anorexia.
tion and supportive therapy. I also mentioned that I We discussed the advantages of finding a support
would be weighing her before each session. I de- group for eating disorders. She continued to have
cided I would include CBT techniques as appropri- difficulties with her husband. We discussed seeking
ate and as I had time (see Table 201). a counselor, perhaps through her church.
The OCD guideline notes that it may take 812
Course weeks, including 46 weeks at a maximally tolerable
dose, for the pharmacotherapy to be effective. The
Visits 23 (Weeks 2 and 3) patient might have been able to tolerate a higher
The patient reported doing a little better in terms of dose of fluoxetine, and using a higher dose would be
improved mood, but her OCD thoughts remained consistent with the anorexia treatment guideline.
unchanged. I printed out the National Institute of However, as she had shown improvement, I decided
Mental Health handout on OCD to give her some not to increase the medication at this time. Adding
background on the illness. The sessions focused on CBT would be ideal but was not feasible for reasons
obtaining more information but also on providing mentioned above. I decided to start her on a low
some encouragement to eat. The patient felt that dose of risperidone (0.25 mg) to see if this might
her continued obsessive thoughts about her former help her anxiety and help her gain weight. I gave the
coworker were driving a wedge between her and her patient a self-monitoring food log to use at home.
husband, and she wanted to find ways to spend more She was asked to simply note for each meal whether
time with her husband. I also gave her a relaxation or not she ate too little or enough.
In the past week, what was your average level of depression? (0 = none/no symptoms to 10 = severe)
10
9
8
7 x
6 x
5 x
4
3
2 x x x
1 x x x x
0
QIDS 5 5
Wk
1 2 3 6 7 8 9 10 15 29 45 51
In the past week, what was your average level of severity of obsessive-compulsive thoughts?
(0 = none/no symptoms to 10 = severe)
10
9
8 x
7
6 x x x
5
4 x
3 x x x
2
1 x
0
Wt, lb 0 0 2 0.2 3 3 6 12
(+100)
BPRS 19 15
Wk
1 2 3 6 7 8 9 10 15 29 45 51
Visit 8 (Week 29) and anxious. She still had mild obsessive thoughts
The patient reported that she had been doing OK. and heard occasional voices, but they continued to
Her OCD symptoms were much less bothersome. be less troublesome. She was also able to gain an-
She said she only heard occasional voices. She had other 6 lb. The patient planned to move from the
maintained her 3-lb weight gain. I focused on issues area. We discussed options for her continued care,
related to her eating and weight and the need for her including going to a community mental health cen-
to continue taking her medication. ter when she had settled into another area.
F C
A. Psychiatric management
1. Establish and maintain a therapeutic alliance
Tailor communication style to the patients needs and abilities
Allow patients with excessive worry or doubting time to consider treatment decisions; NA
repeat explanations if necessary
Attend to transference and countertransference, which may disrupt the alliance and
adherence
Consider how the patients expectations are affected by his or her cultural and religious
background, beliefs about the illness, and experience with past treatments
2. Assess the patients symptoms
Use DSM-IV-TR criteria for diagnosis
Consider using screening questions to detect commonly unrecognized symptoms
Differentiate OCD obsessions, compulsions, and rituals from similar symptoms found in
other disorders
3. Consider rating the patients symptom severity and level of function. The following
instruments are useful:
For symptoms: Yale-Brown Obsessive Compulsive Scale
For self-rated depression: Patient Health Questionnaire (PHQ-9), Beck Depression
InventoryII, Zung Depression Scale, and the patient versions of the Inventory of
Depressive Symptoms (IDS) or Quick Inventory of Depressive Symptomatology (QIDS)
For disability: Sheehan Disability Scale No
For quality of life: Quality of Life Enjoyment and Satisfaction Questionnaire or the more No
detailed World Health Organization Quality of Life Survey
4. Enhance the safety of the patient and others
Assess for risk of suicide, self-injurious behavior, and harm to others
Consider obtaining collateral information from family members and others
Take into consideration factors associated with increased risk of suicide, including specific
psychiatric symptoms and disorders and previous suicide attempts
Evaluate the patients potential for harming others, either directly or indirectly (e.g., when
OCD symptoms interfere with parenting)
5. Complete the psychiatric assessment
See APAs (1995) Practice Guideline for the Psychiatric Evaluation of Adults
Assess for common co-occurring disorders, including mood disorders, other anxiety
disorders, eating disorders, substance use disorders, and personality disorders
6. Establish goals for treatment; goals of treatment include decreasing symptom frequency and
severity, improving the patients functioning, and helping the patient to improve his or her
quality of life
Reasonable treatment outcome targets include < 1 hour/day spent obsessing and
performing compulsive behaviors, no more than mild OCD-related anxiety, an ability to
live with OCD-associated uncertainty, and little or no interference of OCD with the
tasks of daily living; despite best efforts, some patients will be unable to reach targets
Anorexia, Obsessive-Compulsive Disorder, Depression 179
F C
7. Establish the appropriate setting for treatment
Generally choose least restrictive setting that is safe to allow for effective treatment
Is hospitalization indicated?
Is home-based treatment needed?
8. Enhance treatment adherence
Recognize that the patients fears, doubting, and need for certainty can influence his or her
willingness and ability to cooperate with treatment and can challenge the clinicians
patience
Provide education about the illness and its treatment, including expected outcomes and
time and effort required
Inform the patient about likely side effects (SEs), inquire about SEs the patient may be
unwilling to report (e.g., sexual SEs), respond quickly to concerns about SEs, and
schedule follow-up appointments soon after starting or changing medications
Address breakdowns in the therapeutic alliance NA
Consider the role of the patients family and social support system
When possible, help the patient to address practical issues such as treatment cost,
insurance coverage, and transportation
Note. The APA guidelines contain both recommended actions and areas for consideration. As in the authors example above,
you may use the columns to the right to indicate that a recommendation was followed (F) or considered (C), as appropriate. You
may also indicate NA for not applicable.
APA=American Psychiatric Association; OCD= obsessive-compulsive disorder.
Source. Adapted from http://www.psychiatryonline.com/pracGuide/pracGuidehome.aspx.
disabling symptoms and extensive anxiety. Follow- improved even when she no longer took the medi-
ing the OCD guidelines, I might have increased the cation. The APA depression guideline also provided
fluoxetine and waited several more weeks before try- useful and different information on how to manage
ing an atypical antipsychotic. this patient. Because the use of this guideline is pre-
I also considered the APA general eating disorder sented in Chapter 18, I dont go over it here. Over-
guidelines and those specific to anorexia (see Table all, I ended up selecting pieces of the guidelines,
203 for those related to anorexia). The general perhaps at the expense of not providing some impor-
guideline encourages the therapist to address a num- tant therapeutic procedures. Would I have done bet-
ber of underlying themes and correct core mal- ter, for instance, to focus on only one type of CBT
adaptive thoughts and attitudes (B.6). I did not have practice, such as thought-stopping? Would this even
time to address many of these issues. Unfortunately, have clarified the relationship between her thoughts
there is no strong evidence to guide treatment of and her hallucinations?
adult anorexia patients (Keel and Haedt 2008). I
might have done a better job in providing some sim-
ple psychoeducational materials. Overall, I dont Ways to Improve Practice
think I provided enough homework activity; more The patient did much better than I expected. As pre-
might have served as a bridge between sessions. sented, the use of the fluoxetine would seem to have
The APA schizophrenia guideline was also rele- been a major factor in her improvement, but I sus-
vant. This was not a major focus of therapy as the pa- pect other nonspecific elements may have been im-
tients auditory hallucinations seems to respond to portant, such as providing a supportive and trusting
a low dose of risperidone, and in fact they remained relationship, which allowed her to discuss a number
180 How to Practice Evidence-Based Psychiatry
TABLE 203. Specific recommendations for anorexia adapted from American Psychiatric
Association eating disorders guideline
F
a. Nutritional rehabilitation
Establish goals for seriously underweight patients
Restore weight
Normalize eating patterns
Achieve normal perceptions of hunger and satiety No
Correct biological and psychological sequelae of malnutrition NA
Help the patient to resume eating and gain weight (see guidelines for details)
Help the patient to maintain weight NA
b. Psychosocial treatments
Establish goals, including to help the patient
Understand and cooperate with nutritional and physical rehabilitation
Understand and change the behaviors and dysfunctional attitudes related to the eating disorder
Improve interpersonal and social functioning
Address comorbid psychopathology and psychological conflicts that reinforce or maintain eating
disorder behaviors
Establish and maintain a psychotherapeutically informed relationship with the patient
Provide formal psychotherapy once weight gain has started. No
c. Medications
Use psychotropic medications in conjunction with psychosocial interventions, not as a sole or
primary treatment for patients with anorexia nervosa
Whenever possible, defer making decisions about medications until after weight has been restored NA
Be aware of and manage general side effects
Consider antidepressants to treat persistent depression or anxiety following weight restoration
Consider approaches to restore lost bone mineral density No
Note. F=followed; NA= not applicable.
Source. http://www.psychiatryonline.com/pracGuide/pracGuidehome.aspx.
Kay SR, Fiszbein A, Opler LA: The Positive and Negative Maina G, Pessina E, Albert U, et al: 8-week, single-blind,
Syndrome Scale (PANSS) for schizophrenia. Schizophr randomized trial comparing risperidone versus olanza-
Bull 13:261276, 1987 pine augmentation of serotonin reuptake inhibitors in
Keel PK, Haedt A: Evidence-based psychosocial treatments treatment-resistant obsessive-compulsive disorder. Eur
for eating problems and eating disorders. J Clin Child Neuropsychopharmacol 18:364372, 2008
Adolesc Psychol 37:3961, 2008 Overall JE, Gorham DR. The Brief Psychiatric Rating Scale.
Lieberman JA, Stroup TS, McEvoy JP, et al: Clinical Anti- Psychol Rep 10:799812, 1962
psychotic Trials of Intervention Effectiveness (CATIE)
investigators: effectiveness of antipsychotic drugs in
patients with chronic schizophrenia. N Engl J Med
353:12091223, 2005
This page intentionally left blank
21
183
184 How to Practice Evidence-Based Psychiatry
which she took for 1 year with good results. She DSM-IV-TR Diagnosis
stopped the sertraline on her own because she felt
Axis I Major depressive disorder, recurrent,
she no longer needed it. In addition to sertraline,
current episode severe, without psy-
the patient stated her primary care physician also
chotic features
prescribed Ambien (zolpidem) to assist with initial
Axis II None
insomnia.
Axis III Hypertension, gastroesophageal reflux
disease, tension headaches
Medical History Axis IV Recent loss of mother
Axis V GAF score: 55
Hypertension (stable)taking hydrochlorothia-
zide 25 mg
Gastroesophageal reflux disease (stable)taking
Treatment Plan Considerations
pantoprazole 40 mg Major Depressive Disorder and
Tension headaches (stable)taking ibuprofen as Uncomplicated Bereavement
needed The patients main problem was her depression. She
Hysterectomy 16 years agonot taking hor- was concerned that if it continued, it would affect
mone replacement her new marriage. She stated that the grief sur-
rounding her mothers sudden death had improved a
Social History few months previously but that she was still de-
pressed. The patient felt guilty that she remained
The patient denied tobacco use. She drank approxi- depressed despite recently getting remarried. She
mately two to three cups of coffee daily. She re- had not had any counseling/psychotherapy regard-
ported no routine exercise. She stated that she rarely ing her recent loss and wished to first try pharmaco-
had alcohol (approximately one glass of wine per logical treatment for MDD.
month). She denied use of drugs or other pharma-
ceuticals (i.e., herbal medications). The patient lived
MDD Treatment Guideline Selection
with her husband and his teenage son. She had been
A number of treatment algorithms and guidelines are
living with her current husband for some time be-
available to clinicians considering the treatment of
fore they got married. She has one prior marriage
MDD: 1) the STAR*D guideline (Rush et al. 2004),
with two now-adult children. The patient graduated
2) the American Psychiatric Association (2000)
from high school but reported no further schooling.
guidelines for MDD, and 3) the TMAP guideline for
There was no significant family history of depres-
nonpsychotic MDD (Crismon et al. 1999).
sion or mental illness. The patients mental status
The goal of treatment for all patients with MDD,
examination was significant for a depressed affect
as outlined in Rush et al. (2006b), is to achieve remis-
with limited range of emotion. Her thought process
sion of depressive symptoms (i.e., the patient is
and content were intact, and her Mini-Mental State
symptom free). The TMAP guideline for MDD in-
Examination score=30; however, the patient subjec-
troduced the concept of using critical decision points
tively reported distress with short-term memory and
(CDPs) at defined intervals to objectively assess
concentration. Her physical exam and vital signs
symptom and side-effect burden and to adjust treat-
were within normal limits. Her baseline Quick In-
ment accordingly (Crismon et al. 1999). STAR*D
ventory of Depressive SymptomatologyClinician
further refined the objective assessments of symp-
Rated (QIDS-C16) score was 19, in the severe range
toms and side effects with the introduction of
(see below for interpretation of scores):
measurement-based care (Trivedi and Daly 2007;
QIDS-C16 scoring criteria: Trivedi et al. 2006b, 2007b).
Normal 5 MBC promotes the use of rating scales or ques-
Mild 610 tionnaires to measure symptoms, side effects, and
Moderate 1115 adherence at every visit as well as to guide tactics to
Severe 1620 modify dosage and treatment duration. In addition,
Very severe 2127
MBC integrates these objective measurements and
Major Depressive Disorder 185
targets for full symptom remission. Most clinicians such as the Patient Health Questionnaire9 (PHQ-
do not routinely use specific measures of depressive 9; Kroenke et al. 2001), Beck Depression Inventory
symptoms at patient visits; rather, they tend to use II (Steer et al. 1999), and others can be used. With
global measures (Biggs et al. 2000). Results from regard to systematically measuring side effects,
level 1 of STAR*D reveal that the use of MBC may MBC guidelines recommend using the Frequency,
lead to greater remission rates than those seen in ef- Intensity, and Burden of Side Effects Rating (FIB-
ficacy studies for patients with chronic depression SER; Wisniewski et al. 2006).
(Trivedi et al. 2006b). Table 211 reflects MBC for the acute treatment
STAR*D used the QIDS, a 16-item question- phase of MDD. Clinical status (e.g., remission, par-
naire based on DSM-IV-TR criteria for MDD, de- tial response) and side-effect tolerability at each
veloped as a measure of depressive symptom severity CDP determine the treatment plan for that visit.
(www.ids-qids.org). The QIDS is quick and easy to Remission was defined by QIDS-C 16 5, partial re-
use, with good reliability and validity. Both clinician sponse was defined as QIDS-C 16 = 68, and non-
and self-rated versions are available free of charge response essentially was defined as QIDS-C 16 9.
and have been validated and translated into other Clinic visits in STAR*D were generally recom-
languages (Rush et al. 2003, 2006a; Trivedi et al. mended at weeks 0, 2, 4, 6, 9, and 12 at each treat-
2004). To comply with the STAR*D MBC guide- ment stage (level) or until an adequate remission or
lines, we present the QIDS in this case presentation, response was obtained, with CDPs occurring at each
but we recognize that alternative symptom ratings of these visits (except week 2).
TABLE 211. Critical decision points (CDPs) and tactics for acute phase treatment of major
depression
ment. This was reflected by the FIBSER, which ing to the MBC algorithm (Figure 213), the daily
measured the frequency, intensity, and burden of dose of citalopram was increased to 60 mg, given ac-
side effects (the patient reported no side effects ceptable side effects and persistence of depressive
to all). Furthermore, the patient reported no addi- symptoms. Follow-up was scheduled in 3 weeks.
tional missed doses of medication since the last visit.
Specifically, because the patients QIDS score CDP 4 (Week 9)
remained 9 and the side-effect profile was tolera- The patient returned at week 9, after having taken
ble, the MBC algorithm dictated that the dose of citalopram 60 mg for 3 weeks. This visit was the first
citalopram be increased to 40 mg/day. Had the pa- CDP that allowed for the clinician to move to the
tients side-effect profile for citalopram been intol- next treatment level due to an inadequate treatment
erable, the algorithm does allow the clinician to go response, despite tolerable side effects (Figure 214).
to the next level of treatment (i.e., switch to another At this visit the patients depressive symptoms were
antidepressant) at week 4 and beyond. Lastly, as was virtually unchanged from the previous visit, QIDS-
done at every visit, suicidal behavior and associated C 16 = 13, and only mildly improved from baseline.
symptoms were assessed (patient reported none), The side effect of daytime somnolence resolved, and
and the patient was scheduled for follow-up visit in the patient was uncertain whether this was secondary
2 weeks. to switching the medication dosing time to evening
or whether the increase to 60 mg daily played a role.
CDP 3 (Week 6) Regardless, the patient reported no presence of side
At week 6 the patient scored a 14 on her QIDS-C16 effects, with no intensity and no functional impair-
and reported no significant improvement in depres- ment on the FIBSER, and once again the patient also
sive symptom severity. She also reported a new side had not missed any medication doses in the past
effect she believed was induced by citalopram: day- 3 weeks. However, with a QIDS 9 after 9 weeks of
time sleepiness (the patient had been taking citalo- treatment with citalopram, the clinician and patient
pram daily in the morning), most notably present at elected at this CDP to move to the next level of treat-
work. According to the FIBSER, the patient re- ment. According to the STAR*D algorithm, treat-
ported daytime somnolence as present 25% of the ment options at level 2 are divided into switch and
time with mild intensity and impairment, but still augmentation (Rush et al. 2004). The decision to
tolerable. It was suggested to the patient to try and switch or augment is determined by treatment re-
switch the time of citalopram dosing to evening to sponse and medication tolerability. For example, if a
see if this improved side effect. Once again, accord- patient has had no treatment response or has intol-
188 How to Practice Evidence-Based Psychiatry
erable side effects, a switch to another medication is At the week 9 CDP visit, augmentation treatment
recommended. According to STAR*D, switch op- options were discussed with the patient, and the only
tions for level 2 include any of the following: sertra- treatment she was unwilling to accept was cognitive
line, bupropion, venlafaxine, or cognitive therapy. therapy. According to STAR*D level 2 results, bu-
However, if a patient has a tolerable side-effect pro- spirone and bupropion are both efficacious as aug-
file and a partial treatment response, as is the case in mentation agents; however, bupropion is associated
this example, then a treatment augmentation is rec- with better tolerability and greater reduction in self-
ommended. Level 2 treatment options for augmen- reported depressive symptoms (Trivedi et al.
tation per the STAR*D algorithm include one of the 2006a). Therefore, bupropion XL (bupropion SR is
following: buspirone, bupropion, or cognitive ther- also acceptable) was chosen as the level 2 augmenta-
apy (Rush et al. 2004). Figure 215 shows the pa- tion agent, and the MBC algorithm for bupropion
tients STAR*D level 2 treatment. XL augmentation was initiated.
Treatment
SER BUP VEN CT CIT + BUP CIT + BUS CIT + CT
options
Treatment
Switch Augment
strategy
quence of not achieving remission. Paykel and col- FIBSER again revealed no side-effect frequency, in-
leagues found that patients with residual depressive tensity, or burden. Furthermore, the patient was com-
symptoms have an increased risk for and a shorter pliant with prescribed medications and reported no
time to relapse of MDD (Paykel et al. 1995). missed doses. Thus, the patient was continued on
citalopram 60 mg and bupropion XL 300 mg (Figure
CDP 3 (Week 6) 218), with a follow-up visit scheduled in 3 weeks.
The patient returned for her week 6 visit in high spir-
its. She noted feeling so much better, and this was CDP 4 (Week 9)
confirmed with a QIDS-C 16 =3. Improvements were Results from week 9 visit mirrored the findings from
noted in all domains, and the patient officially achieved week 6, in that the patient continued to remit and
remission status. She was able to tolerate the 300 mg showed acceptable tolerability. Once again, the pa-
dose of bupropion XL without side effects, and the tient denied any suicidal thoughts/behavior or asso-
ciated symptoms. Given that the patients QIDS- achieve full remission of depressive symptoms. The
C16 =2 and the FIBSER remained acceptable, she was current recommendation for the duration in which
continued on prior medication dosages (Figure 219) psychopharmacological medications are continued
and rescheduled for follow-up CDP visit in 3 weeks. in this phase of treatment is a minimum of 6 to 9
months (Keller 2002). In addition to pharmacologi-
CDP 5 (Week 12) cal treatments, increasing evidence supports the use
The patient returned for her week 12 visit on time of evidence-based psychotherapies in the continua-
(Figure 2110). The QIDS-C 16 was scored as a 2, tion phase of treatment to reduce the risk of relapse
the FIBSER revealed no side effects, and the patient (Hollon et al. 2005; Jarrett et al. 2001). Additionally,
reported 100% medication adherence. Continued Fava and colleagues (2004) showed that cognitive-
remission into week 12 represents the end of acute behavioral therapy that sequentially follows a suc-
phase treatment and signifies moving the patient cessful course of pharmacotherapy reduces the rates
into the continuation phase of treatment. of MDD relapse. With specific regard to this case,
after the patient completed participation in the re-
Continuation Phase search study, she was referred back to her primary
The continuation phase is the next stage in the phar- care physician for continued medication manage-
macological treatment of MDD. Classification in ment, and follow-up with a cognitive therapist was
the continuation phase dictates that the patient arranged to help reduce the risk of relapse.
Personalized Treatment and Disease version and a self-rated version that the patient can
Self-Management fill out in the waiting room, with the results easily
Another important component of clinical care with conveyed to the clinician. The primary goal of MBC
significant promise in the continuing treatment of is to individualize antidepressant treatment and dos-
MDD is counseling patients on disease self-manage- ing in an effort to minimize side-effect burden and
ment (Trivedi et al. 2007a). In the case described maintain safety, while enhancing the therapeutic ef-
above, the patient was given a copy of the self-report ficacy for each patient. Utilizing a treatment strategy
QIDS-SR16 (www.ids-qids.org) with instructions to such as MBC in clinical practice provides objective
routinely check for return or worsening of depres- evidence to address key antidepressant treatment
sive symptoms and contact information for follow- questions, such as: At what dose, for what duration,
up. Providing patients with the components of MBC and when do I switch or augment? In addition, MBC
are in line with the National Institute of Mental can provide ongoing monitoring of symptomatic im-
Healths (NIMH) new strategic initiative to target provement and side-effect burden in the continua-
and personalize the treatment of individuals with tion and maintenance phases of treatment.
mental illness. In the plan, Strategy 3.2 aims to
expand and deepen the focus to personalize inter- References
vention research. As a part of this strategy, it is sug-
American Psychiatric Association: Practice guideline for the
gested that traditional outcome measures used in
treatment of patients with major depressive disorder (re-
clinical efficacy studies be expanded to include func-
vision). Am J Psychiatry 157 (suppl 4):145, 2000. Avail-
tional measures and other indicators of recovery, able at: http://www.psychiatryonline.com/pracGuide/
which must include targeted symptoms and specific pracGuideTopic_7.aspx. Accessed June 20, 2009
symptom profiles. It is hoped that this more person- Biggs MM, Shores-Wilson K, Rush AJ, et al: A comparison
alized treatment will provide patients with depres- of alternative assessments of depressive symptom sever-
sion and other mental illnesses with more thorough ity: a pilot study. Psychiatry Res 96:269279, 2000
recovery. Crismon ML, Trivedi M, Pigott TA, et al: The Texas Medi-
cation Algorithm Project: report of the Texas Consensus
In conclusion, MBC converges with the NIMHs
Conference Panel on Medication Treatment of Major
initiative to personalize treatment and provides pa-
Depressive Disorder. J Clin Psychiatry 60:142156, 1999
tients with education regarding their depressive ill- Fava GA, Ruini C, Rafanelli C, et al: Six-year outcome of
ness, thereby promoting disease self-management. cognitive behavior therapy for prevention of recurrent
depression. Am J Psychiatry 161:18721876, 2004
Hansen RA, Gartlehner G, Lohr KN, et al: Efficacy and
Summary safety of second-generation antidepressants in the treat-
Results from STAR*D indicate the majority of pa- ment of major depressive disorder. Ann Intern Med
tients will not achieve full remission of depressive 143:415426, 2005
Hollon SD, DeRubeis RJ, Shelton RC, et al: Prevention of
symptoms by the end of their first treatment
relapse following cognitive therapy vs medications in
(Trivedi et al. 2006b). On the basis of our clinical ex-
moderate to severe depression. Arch Gen Psychiatry
perience, determining what subsequent treatments 62:417422, 2005
to initiate should be done systematically while pay- Jarrett RB, Kraft D, Doyle J, et al: Preventing recurrent de-
ing close attention to objective measures of symptom pression using cognitive therapy with and without a con-
severity and side-effect burden. These domains con- tinuation phase: a randomized clinical trial. Arch Gen
stitute the treatment construct known as measure- Psychiatry 58:381388, 2001
ment-based care (Trivedi and Daly 2007; Trivedi et Keller MB: Long-term treatment strategies in affective dis-
orders. Psychopharmacol Bull 36 (suppl 2):3648, 2002
al. 2006b, 2007b). In research settings, measuring
Kroenke K, Spitzer RL, Williams JB: The PHQ-9: validity of
these domains is accomplished with the aid of a re-
a brief depression severity measure. J Gen Intern Med
search assistant; however, in routine clinical practice 16:606613, 2001
the same can be done with a nurse or an administra- Paykel ES, Ramana R, Cooper Z, et al.: Residual symptoms
tive staff member. The FIBSER is a self-rated mea- after partial remission: an important outcome in depres-
sure of side effects, and the QIDS has both a clinician sion. Psychol Med 25:11711180, 1995
Major Depressive Disorder 193
Rush AJ, Trivedi MH, Ibrahim HM, et al: The 16-Item Quick C) and Self-Report (QIDS-SR) in public sector patients
Inventory of Depressive Symptomatology (QIDS), clini- with mood disorders: a psychometric evaluation. Psychol
cian rating (QIDS-C), and self-report (QIDS-SR): a psy- Med 34:7382, 2004
chometric evaluation in patients with chronic major Trivedi MH, Fava M, Wisniewski SR, et al: Medication aug-
depression. Biol Psychiatry 54:573583, 2003 mentation after the failure of SSRIs for depression.
Rush AJ, Fava M, Wisniewski SR, et al: Sequenced Treat- N Engl J Med 354:12431252, 2006a
ment Alternatives to Relieve Depression (STAR*D): ra- Trivedi MH, Rush AJ, Wisniewski SR, et al: Evaluation of
tionale and design. Control Clin Trials 25:119142, 2004 outcomes with citalopram for depression using measure-
Rush AJ, Carmody TJ, Ibrahim HM, et al: Comparison of self- ment-based care in STAR*D: implications for clinical
report and clinician ratings on two inventories of depres- practice. Am J Psychiatry 163:2840, 2006b
sive symptomatology. Psychiatr Serv 57:829837, 2006a Trivedi MH, Lin EH, Katon WJ: Consensus recommenda-
Rush AJ, Kraemer HC, Sackeim HA, et al: Report by the tions for improving adherence, self-management, and
ACNP Task Force on response and remission in major de- outcomes in patients with depression. CNS Spectr 12:1
pressive disorder. Neuropsychopharmacology 31:1841 27, 2007a
1853, 2006b Trivedi MH, Rush AJ, Gaynes BN, et al: Maximizing the ad-
Steer RA, Ball R, Ranieri WF, et al: Dimensions of the Beck equacy of medication treatment in controlled trials and
Depression InventoryII in clinically depressed outpa- clinical practice: STAR(*)D measurement-based care.
tients. J Clin Psychol 55:117128, 1999 Neuropsychopharmacology 32:24792489, 2007b
Trivedi MH, Daly EJ: Measurement-based care for refrac- U.S. Food and Drug Administration, Center for Drug Eval-
tory depression: a clinical decision support model for uation and Research: Antidepressant use in children, ad-
clinical research and practice. Drug Alcohol Depend 88 olescents and adults. March 22, 2004. Available at: http://
(suppl 2):S61S71, 2007 www.fda.gov/cder/drug/antidepressants/default.htm.
Trivedi MH, Rush AJ, Ibrahim HM, et al: The Inventory of Accessed May 2, 2007.
Depressive Symptomatology, Clinician Rating (IDS-C) Wisniewski SR, Rush AJ, Balasubramani GK, et al: Self-rated
and Self-Report (IDS-SR), and the Quick Inventory of global measure of the frequency, intensity, and burden of
Depressive Symptomatology, Clinician Rating (QIDS- side effects. J Psychiatr Pract 12:7179, 2006
This page intentionally left blank
22
195
196 How to Practice Evidence-Based Psychiatry
mania. He has a glass of wine with dinner and has Treatment Plan Considerations
another glass of wine before he goes to bed. He has
been married for 20 years, and he and his wife have Major Depression, Single Episode
two children, ages 18 and 16. He has been employed On first assessment Mr. P.W. appears to have a fairly
for 10 years with his current company, where he is straightforward case of major depressive disorder.
involved with the design and production of weapons He has many symptoms, which indicates that this is
systems for the United States military. He denied a severe episode. His depressive symptoms appear to
drug use. He said he does not exercise. Physical ex- have affected his ability to function particularly at
aminations and the results of laboratory testing in- work. However, he is still going to work. He does
cluding complete blood count, electrolytes, blood not have suicidal ideation at initial assessment and
urea nitrogen, creatinine, calcium, glucose, thyroid has no active plans for suicide.
function tests, folate, and vitamin B12 were within Because he is not actively suicidal, homicidal, or
normal limits. Mr. P.W.s primary care doctor had psychotic and is still going to work, hospitalization is
ordered a head magnetic resonance imaging scan not indicated, and I decide to treat him as an outpa-
because Mr. P.W. had thought he had a brain tumor tient. According to the American Psychiatric Asso-
and insisted that a scan be done. The scan was nor- ciations current practice guideline for the treatment
mal. On mental status examination, Mr. P.W. was of patients with major depressive disorder (Ameri-
cooperative and psychomotorically retarded. He an- can Psychiatric Association 2000b), in the acute
swered most questions with short answers, often phase the psychiatrist may choose between several
simply saying yes or no. He denied symptoms of initial treatment modalities, including pharmaco-
paranoia or hallucinations. He reported no unusual therapy, psychotherapy, the combination of medica-
thoughts or delusions. He was worried that his in- tions plus psychotherapy, or ECT. Given that this is
ability to concentrate and the poor performance re- Mr. P.W.s first episode of depression and that he is
view he received might result in his losing his job. not actively suicidal or psychotic, I do not believe
He reported that he is still going to work. that ECT is indicated. According to the guideline,
because he meets criteria for a severe episode of ma-
jor depressive disorder Mr. P.W. should be pre-
Differential Diagnosis scribed medication unless he is receiving ECT. I
Mr. P.W. meets DSM-IV-TR (American Psychiatric discuss with him the options of medication, psycho-
Association 2000a) criteria for major depressive dis- therapy, or the combination, and he declines psy-
order. He exhibits five (or more) symptoms of major chotherapy because he feels he does not have
depression (depressed mood, loss of interest or plea- enough time or interest to pursue it. He would like
sure, insomnia, weight loss, trouble concentrating, to be treated with an antidepressant.
loss of energy, psychomotor retardation, and thoughts Normally I would review with the patient the
of death), which have been present during the same previous antidepressant trials received, whether the
2-week period and represent a change from previous patient had responded, and whether he or she expe-
functioning. The symptoms are not due to a general rienced any side effects. In the case of Mr. P.W., he
medical condition. There is nothing in Mr. P.W.s has never been treated with an antidepressant, so in
history to suggest he has bipolar disorder. theory one could prescribe any number of possible
antidepressants. However, because he reported that
his brother had responded to sertraline, I suggest
DSM-IV-TR Diagnosis that he should try sertraline as well. Although there
Axis I Major depressive disorder, single epi- is no firm evidence that if a first-degree relative has
sode, severe, without psychotic features responded to a particular antidepressant, it is more
(296.23) likely that the patient will respond as well, in my ex-
Axis II None perience it does seem to increase the likelihood of a
Axis III None response, perhaps just for psychological reasons.
Axis IV Work stress Therefore, after reviewing the possible side effects
Axis V GAF score: 55 of sertraline with Mr. P.W. and discussing with him
how to take the medication, I prescribe sertraline
Major Depressive Disorder, Severe With Psychotic Features 197
50 mg/day to be taken in the morning. I advise him husbands company worked on classified informa-
to give me a phone call in 34 days to report how he tion requiring a security clearance and, in any case,
is tolerating the medication and have him schedule the cars he was worried about belonged to neigh-
an appointment to see me again in 10 days. bors. Mr. P.W. had answered in the negative to
questions regarding paranoia and unusual thoughts,
Treatment Goals, Measures, and Methods because to him, the delusional system was real and
The initial goal for Mr. P.W. is to be able to tolerate was not an example of unusual thoughts or a reflec-
the antidepressant medication so he can stay on it tion of paranoia.
long enough to have an antidepressant response.
That is the first goal, and it is an important one given Revised DSM-IV-TR Assessment
that noncompliance with antidepressant medication
After the second visit with the patient and his wife, it
is a big problem (Melfi et al. 1998). That is one of the
became clear that Mr. P.W. had major depressive
reasons I ask patients to call me a few days after start-
disorder, single episode, severe with psychotic fea-
ing the medication. Another reason is to make sure
tures (296.24). When I presented my reassessment
that the patients illness is not getting worse. I will
to Mr. P.W., he was adamant that I was mistaken. In
also be monitoring Mr. P.W.s depressive symptoms
part, this was because the word psychotic was
with the Hamilton Rating Scale for Depression
frightening to him, and I think it had pejorative con-
(Ham-D; Hamilton 1960). In some situations I may
notations for him. Thus I have found using the term
formally administer the scale; in others, I ask the
irrational worries instead of psychosis more ac-
same questions that are on the scale during my clin-
ceptable to patients and have found its use to result
ical interview. For Mr. P.W., I will use the Ham-D.
in a greater likelihood of patients telling me what is
on their mind (Rothschild 2009). Mr. P.W. felt bet-
Course ter with this description of his illness. He, himself,
began to refer to his illness as major depressive dis-
Phone Call (Day 4) order with irrational worries.
Mr. P.W. calls to report that he has had no side ef-
fects from the medication. He also reports that he Axis I Major depressive disorder, single epi-
called in sick to work today because he did not have sode, severe with psychotic features
the energy to get out of bed but plans to go to work (296.24)
tomorrow. Axis II None
Axis III None
Visit 2 (10 Days) Axis IV Work stress
Mr. P.W. returns for his second visit accompanied by Axis V GAF score: 55
his wife. She asks if she can speak to me. With Mr.
P.W.s permission, she joins the beginning of the ap- Additional Treatment Plan
pointment. Mr. P.W. reports that he is unchanged
and still feels depressed. He again denies symptoms
Considerations
of hallucinations, suicidal ideation, or unusual Mr. P.W.s main problem is major depression with
thoughts, and no delusions are noted. At this point, psychotic features (psychotic depression), a serious
his wife urges him to Tell Dr. Rothschild about the illness during which a person has the dangerous
car across the street, whereupon the patient de- combination of depressed mood and psychosis, with
scribed a parked car that he believed contained FBI the psychosis commonly manifesting itself as nihil-
agents on a stakeout who were following him every- istic delusions that bad things are about to happen.
where he went. The patient then explained a rather The American Psychiatric Associations practice
detailed delusional system that he was being tar- guideline for the treatment of patients with major
geted as part of an investigation of a foreign coun- depressive disorder (American Psychiatric Associa-
trys attempt to purchase military secrets. Although tion 2000b) recommends, with substantial clinical
this was seemingly plausible given his line of work, confidence, the use of either ECT or the combina-
his wife reported that neither her husband nor her tion of an antipsychotic and an antidepressant for
198 How to Practice Evidence-Based Psychiatry
the treatment of psychotic depression. Several algo- 4. Increase dosages to 150 mg/day of sertraline/pla-
rithms have recently been proposed, incorporating cebo and 15 mg/day of olanzapine during week 2
the current evidence base, to help guide the clinician 5. Allow dosages of 200 mg/day of sertraline/
in the use of somatic treatments for psychotic de- placebo and 20 mg/day of olanzapine for residual
pression (Hamoda and Osser 2008; Rothschild symptoms beginning in week 3
2009). Mr. P.W. and his wife were concerned about
possible side effects of confusion and memory dis- Because Mr. P.W. is already taking 50 mg/day of
ruption from ECT and stated that they preferred sertraline, I advise him to increase the dosage of ser-
medication treatment. Because Mr. P.W. was not traline to 100 mg/day for 3 days and then to take 150
suicidal, and his current clinical situation was not life mg/day. I also start him on olanzapine 5 mg at bed-
threatening, I agreed with their preference for a trial time (after reviewing possible side effects) and advise
of medication (for further discussion of the decision- him to increase the dosage to 10 mg at bedtime after
making process when deciding between ECT and 3 days. I plan to see him back in 7 days but instruct
medications for psychotic depression, see Roths- him to contact me before the appointment if he has
child 2009). trouble tolerating the medications or if his symptoms
Of the two recently published algorithms, I fol- worsen.
lowed my own (it is never a good thing not to follow In addition to the pharmacotherapy, I plan to use
your own published guidelines!), which is based on psychoeducational/cognitive therapy. I use a modi-
the evidence base of randomized controlled clinical fied version of cognitive-behavioral therapy based in
trials. In the algorithm I point out that there are four large part on the work of Gaudiano et al. (2007).
combinations of antidepressant plus antipsychotic I also advise Mr. P.W. to take a leave of absence
medications that have been studied and shown to be from work. This is in part due to the fact that his de-
effective in randomized controlled clinical trials in lusional system involves work. In addition, Mr. P.W.
patients with psychotic depression. These include himself admits that he is having trouble functioning
sertraline plus olanzapine (Meyers et al. 2009; 259 and concentrating at work and agrees that a leave of
subjects), fluoxetine plus olanzapine (Rothschild et absence is a good idea. He will use accumulated sick
al. 2004; 249 subjects), venlafaxine plus quetiapine time.
(Wijkstra et al. 2008; 122 subjects), and amitrip-
tyline plus perphenazine (Spiker et al. 1985; 51 sub- Treatment Goals, Measures, and Methods
jects). Other combinations of antidepressants and Table 221 outlines my initial treatment goals, mea-
antipsychotics have not been studied in randomized sures, and methods.
controlled clinical trials. After discussion with Mr. The initial goal for Mr. P.W. is for him to be able
P.W. (and, with his permission, his wife), we decided to tolerate the antidepressant and antipsychotic med-
to treat him with a trial of sertraline plus olanzapine. ication combination. In my experience, the psychotic
We also decided to dose the medication aggressively, symptoms in psychotically depressed patients can im-
as was done in the National Institute of Mental prove quickly, whereas the depressive symptoms may
Health Study of the Pharmacotherapy of Psychotic take considerably longer to improve. In the psychot-
Depression (STOP-PD; Meyers et al. 2009). The ically depressed patient, one can monitor the psy-
daily dosages of medications in the STOP-PD study chotic symptoms with the Brief Psychiatric Rating
(Meyers et al. 2009) were as follows: Scale (BPRS; Overall and Gorham 1962) and the De-
lusional Assessment Scale (DAS; Meyers et al. 2006);
1. Initial dosages of 50 mg sertraline/placebo and I will continue to monitor the depressive symptoms
5 mg of olanzapine as tolerated with the Ham-D. As mentioned earlier, in some sit-
2. Increase the dosage of sertraline/placebo by uations I may formally administer the scales, whereas
50 mg/day and of olanzapine by 5 mg/day every in other situations I ask the same questions that are
3 days as tolerated on the scales during my clinical interview. For Mr.
3. Attempt to achieve minimum dosages of 100 mg/ P.W., I will use the Ham-D and the BPRS.
day of sertraline/placebo and 10 mg/day of olan- Although the person with an episode of psychotic
zapine by the end of week 1 depression can expect to make a full recovery and re-
Major Depressive Disorder, Severe With Psychotic Features 199
turn to full occupational and social functioning in improving, whereas arguments for advancing to
the community, how soon that will happen is highly 15 mg/day include the following:
variable. Some patients will respond quickly to
treatment, with fast resolution of depressive and 1. He is still psychotic.
psychotic symptoms, whereas others may have only 2. The STOP-PD study used 15 mg/day of olanza-
partial improvement in symptoms, with a significant pine as a target (Meyers et al. 2009).
period of time elapsing until full recovery (Roths- 3. Other studies of psychotic depression that used
child 2009). In my experience, the patient who is olanzapine in combination with an antidepres-
likely to return to full social and occupational func- sant had a mean dosage of olanzapine between
tioning quickly is someone who meets the following 12.4 and 13.9 mg/day (Rothschild et al. 2004).
criteria: first episode, a good response to the somatic 4. The serious morbidity and mortality of psychotic
treatment prescribed (whether pharmacotherapy or depression requires more aggressive treatment.
ECT), age between 30 and 65 years, and good pre-
morbid functioning (Rothschild 2009). Mr. P.W. Visit 4 (24 Days)
meets several of the criteria for someone likely to Mr. P.W. reports that he has continued to improve.
have a full recovery quickly. He reports no side effects from the medication ex-
His Ham-D score is 30, and his BPRS score is 55. cept he experienced some morning drowsiness for a
few days after the olanzapine was increased to 15
Course (Continued) mg/day. He reports no change in appetite or weight.
He reports that the men in the cars still occasion-
Visit 3 (17 Days) ally drive by his house, but they appear to be doing
Mr. P.W. reports that he is feeling better. He reports so less frequently, and he believes they are losing
no side effects from the medication. He says he is interest in him. He still reports a number of depres-
no longer concerned about the men in the cars. sive symptoms and still feels sad. He is sleeping well.
He states that they are still present across the street, He still has no appetite. His Ham-D score is 16, and
but they are no longer that interested in him. his BPRS score is 32. He worries that his poor per-
I consider this improvement. Although he is still de- formance at work and his current leave of absence
lusional, the delusions, according to Mr. P.W., are may cost him his job. He would like to return to
losing interest in him. He reports no change in his work. I advise him that it is still premature to return
depressive symptoms. His Ham-D score is 28, and to work and that it could be counterproductive for
his BPRS score is 40. I advise him to keep the sertra- him to return to work before he is well. I reassure
line at 150 mg/day in the morning and increase the him that he will get better and that his improvement
olanzapine to 15 mg at bedtime. to date is a good prognostic sign. I advise him to
I was torn between holding the olanzapine at continue his medications at sertraline 150 mg in the
10 mg/day and making the increase to 15 mg/day. morning and olanzapine 15 mg at bedtime.
An argument for staying at 10 mg/day is that he is
200 How to Practice Evidence-Based Psychiatry
Visit 5 (31 Days) score is 9, and his BPRS score is 21. Mr. P.W. reports
For the first time since I have been seeing him, I no- that his supervisor said he could return to work with
tice that Mr. P.W. smiles appropriately. He is not a note from me. I write a note stating that he can re-
aware of this (in my experience, seeing a depressed turn to work at 50% time for 1 week and full-time
person smile for the first time when they had not after that. (My plan was to see Mr. P.W. again after
done so before is frequently a harbinger of future he had been back at work part-time for 1 week
improvement). He feels only mildly depressed. No before deciding whether he was ready to return full-
delusional thinking is noted on examination. He says time.) I advise continuation of his current medica-
that the people watching him are gone. His Ham- tion regimen of sertraline 150 mg/day in the morn-
D score is 11 and his BPRS score is 25. He com- ing and olanzapine 15 mg/day at bedtime.
plains that he has gained 2 lb since he last weighed
himself (2 weeks ago) and says that he is eating more. Visit 7 (Week 9)
He is concerned that the weight gain is related to his Mr. P.W. reports that his week back at work went
medication. I point out to him that although it is well and that his supervisor would like him to return
possible that his increased appetite and weight gain to work full-time. He denies any symptoms of de-
are related to the medication, he did lose 9 lb in the pression. His Ham-D score is 7. No delusions are
2 months prior to coming to see me and that the in- noted on examination. His BPRS score is 20. He
creased appetite and weight gain may be related to complains again about increased appetite and weight
the improvement in his depression. We will con- gain. Now up to 170 lb, Mr. P.W. has gained 9 lb
tinue to monitor his weight. He again asks about re- since I began treating him and is back to his starting
turning to work. I advise that I would prefer to see weight before he was depressed. I reassure him that
him have at least another week (2 weeks in total) of we will continue to monitor his weight. I write him a
no serious depressive symptoms and no irrational note to return to work full-time. He is to continue
worries. I suggested to him that he contact his su- on sertraline 150 mg/day in the morning and olan-
pervisor as to whether he could return part-time in zapine 15 mg/day at bedtime.
about 910 days from today (after our next appoint-
ment). I also advise continuation of his current med- Visit 8 (Week 13)
ication regimen of sertraline 150 mg/day in the Mr. P.W. is doing well. Work is also going well. He
morning and olanzapine 15 mg/day at bedtime. has had no depressive or psychotic symptoms. His
Ham-D score is 7, and his BPRS score is 20. His
Phone Call (40 Days) weight is 172 lb.
I receive a phone call from Mr. P.W.s wife to let me
know that he appears to be back to his old self. Visit 9 (Week 17)
He is still doing well. Work is also still going well.
Visit 6 (41 Days) No depressive or psychotic symptoms. His Ham-D
Improvement has continued. Mr. P.W. denies de- score is 7, and his BPRS score is 20. His weight is
pression. When I ask about the men in the cars 173 lb.
across the street he looks at me with a surprised look
and says, I now know that I had those thoughts be- Visit 10 (Week 21)
cause I was ill. I cannot believe I thought that. We He is still doing well. Work is also still going well.
then discuss the delusional thoughts, the irrational No depressive or psychotic symptoms. His Ham-D
worries, he had experienced. It becomes very clear score is 7, and his BPRS score is 20. His weight is
that Mr. P.W. is having a very hard time reconciling 174 lb.
that he has had these thoughts. This is a very good
sign. When a patient with psychotic depression has Visit 11 (Week 25)
insight that the unusual thoughts were part of the ill- He is still doing well. Work is also still going well.
ness and almost has a cognitive dissonance that they No depressive or psychotic symptoms. His Ham-D
had once believed them, I am confident that they are score is 7, and his BPRS score is 20. His weight is
in the process of making a full recovery. His Ham-D 174 lb.
Major Depressive Disorder, Severe With Psychotic Features 201
Hamilton M: A rating scale for depression. J Neurol Neuro- Rothschild AJ, Williamson DJ, Tohen MF, et al: A double-
surg Psychiatry 23:5662, 1960 blind, randomized study of olanzapine and olanzapine/flu-
Hamoda HM, Osser DN: The psychopharmacology algo- oxetine combination for major depression with psychotic
rithm project at the Harvard South Shore Program: an features. J Clin Psychopharmacol 24:365373, 2004
update on psychotic depression. Harv Rev Psychiatry Rothschild AJ, Winer J, Fratoni S, et al: Missed diagnosis of
16:235247, 2008 psychotic depression at 4 academic medical centers.
Melfi CA, Chawla AJ, Croghan TW, et al: The effects of ad- J Clin Psychiatry 69:12931296, 2008
herence to antidepressant treatment: guidelines on re- Spiker DG, Weiss JC, Dealy RS, et al: The pharmacological
lapse and recurrence of depression. Arch Gen Psychiatry treatment of delusional depression. Am J Psychiatry
55:11281132, 1998 142:430436, 1985
Meyers B, English J, Gabriele M, et al: A delusion assessment Wijkstra JJ, Burger, D, van den Broek WW, et al: Pharmaco-
scale for psychotic major depression: reliability, validity logical treatment of psychotic depression: a randomized,
and utility. Biol Psychiatry 60:13361342, 2006 double-blind study comparing imipramine, venlafaxine
Meyers BS, Flint AJ, Rothschild AJ, et al: A double-blind ran- and venlafaxine plus quetiapine. Presented at the annual
domized controlled trial of olanzapine plus sertraline vs meeting of the American Psychiatric Association, Wash-
olanzapine plus placebo for psychotic depression: the ington, DC, May 2008
Study of Pharmacotherapy of Psychotic Depression
(STOP-PD). Arch Gen Psychiatry 66:838847, 2009
Overall JE, Gorham DE: The Brief Psychiatric Rating Scale. Patient and Family Resources
Psychol Rep 10:799812, 1962 Families for Depression Awareness (www.familyaware .org)
Rothschild AJ (ed): Clinical Manual for the Diagnosis and Rothschild AJ (ed): Clinical Manual for the Diagnosis and
Treatment of Psychotic Depression. Washington, DC, Treatment of Psychotic Depression. Washington, DC,
American Psychiatric Publishing, 2009 American Psychiatric Publishing, 2009
23
203
204 How to Practice Evidence-Based Psychiatry
esteem to more prominent and functionally dis- These hypomanic episodes were present beginning
abling depressive episodes. in her mid-20s but have decreased in intensity over
Approximately 6 years after the onset of these the years.
episodes, Ms. M.S. first sought psychiatric care, and She has described more recent periods of in-
she was diagnosed with double depression (major creased irritability with difficulty sitting still for very
depressive disorder plus dysthymic disorder). Ci- long and thoughts jumping between different goals
talopram was used for 2 months without significant she felt she needed to pursue. During these times,
change in mood but with intolerable nausea and she sleeps a normal amount of 78 hours. These
agitation. Sertraline remained ineffective after a periods intersperse the long periods of depression
2-month trial and was associated with nausea and and last only 2 to 3 days.
irritability. Duloxetine was effective within days of Ms. M.S. has no significant medical problems.
use, and the patient began to feel as if her whole life She used marijuana between the ages of 15 and 18
had been abnormally depressed until therapy with but has not used any other illicit drugs or alcohol.
duloxetine. She began to see that there were many Ms. M.S. does report a family history of depres-
new opportunities for her life, and colors appeared sion in a brother, her mother is on divalproex and
brighter. After 2 months of treatment with duloxe- paroxetine for bipolar disorder, and her maternal
tine, however, her depression symptoms returned. grandmother received electroconvulsive therapy af-
The patient lost confidence in treatment and did not ter a postpartum depression.
see a psychiatrist for another 2 years. On returning Ms. M.S. had a Bipolarity Index score of 60:
to psychiatric care, the patient was started on bupro- Episode Characteristics = 10 points, Age of Onset=
pion, which caused intolerable irritability and agita- 15 points, Course of Illness= 5 points, Response to
tion. Due to the inefficacy of prior antidepressant Treatment = 10 points, Family History= 20 points
medication trials, a consultation was sought. (Figure 232).
Therapy
Stage 1 Lamotrigine + antimanic agent or Lamotrigine monotherapy
(optimize lithium if already on lithium)
Stage 2 Quetiapine or olanzapine-fluoxetine combination (OFC)
Stage 4 Any of the following: lithium, lamotrigine, quetiapine, OFC, valproate, carbamazepine
combined with any of the following: selective serotonin reuptake inhibitor, bupropion, venlafaxine
or
Electroconvulsive therapy
(Calabrese et al. 1999). The combination therapy is not until the fourth stage of treatment that antide-
recommended for patients with history of severe pressant medications are suggested.
manic episodes, because lamotrigine is only mod-
estly preventive of manic episodes (Goodwin et al. Use of Antidepressant Medications
2004) and has no acute antimanic efficacy (Bowden in Bipolar Disorder
et al. 2000). For patients already receiving lithium Whereas first-line treatment of major depressive
therapy, optimizing the lithium dose to target a disorder is antidepressant medication, bipolar disor-
blood level of 0.8 mEq/L is also a first-line recom- der treatment guidelines suggest mood stabilizer
mendation (Nemeroff et al. 2001). medications such as lithium, lamotrigine, and que-
At the next stage of treatment, two U.S. Food and tiapine (Suppes et al. 2005). Despite the available
Drug Administrationapproved treatments are sug- literature demonstrating efficacy of such mood sta-
gested, including olanzapine plus fluoxetine and bilizers for bipolar depression, the community stan-
quetiapine monotherapy, based on robust placebo- dard is still antidepressant medications. In fact, about
controlled trials (Calabrese et al. 2005; Thase et al. one-half of patients with bipolar disorder are initially
2006; Tohen et al. 2003). Despite the faster onset of prescribed an antidepressant medication, whereas in
action and more robust studies, both of these medi- stark contrast less than one-quarter were prescribed
cations have greater adverse effects burden and so mood stabilizers (anticonvulsants 17% and lithium
are recommended at the second stage of treatment. 8%) (Baldessarini et al. 2007). Adjunctive antide-
A more clinically understandable and useful way to pressant medications have not been adequately stud-
understand this balance between efficacy and risk ied in bipolar depression, and some studies do not
data is to use number-needed-to-treat (NNT) and suggest efficacy beyond mood stabilizer treatment
number-needed-to-harm (NNH) calculations (Ket- alone (Nemeroff et al. 2001; Sachs et al. 2007). Anti-
ter 2010). Thus, although olanzapine and quetiapine depressant medications also have been implicated in
had NNTs for acute bipolar depression response, inducing mania or accelerating mood cycle recur-
compared with placebo, of 4 and 6, respectively, they rences in patients with bipolar disorder. Up to two-
had NNHs for at least 7% weight gain (olanzapine) thirds of mood episodes in patients with bipolar dis-
and sedation (quetiapine), compared with placebo, order may be antidepressant-associated mood epi-
of 6 and 5, respectivelymeaning that side effects sodes (Altshuler et al. 1995). Some studies suggest
were about as likely as was response, making these that among the classes of antidepressant medica-
agents lower-priority treatment options (Ketter tions, the dual-acting (serotonin-norepinephrine
2010). reuptake inhibitors, e.g., venlafaxine) may be worse
The third stage of treatment combines therapies at inducing mood cycling than either selective sero-
from the first and second stages of treatment. It is tonin reuptake inhibitors or bupropion (Post et al.
212 How to Practice Evidence-Based Psychiatry
2006). Coupled with these potential risks, antide- tion may worsen such clinical states, whereas mood-
pressant medication use for bipolar depression in the stabilizing medications have had more consistent ev-
community may be excessive. idence suggesting treatment efficacy. Mood charting
may more accurately capture rapid cycling than pa-
Cognitive-Behavioral Therapy tient recall alone.
for Bipolar Disorder
Intensive psychotherapy (CBT, Family-Focused Anxiety Symptoms
Therapy [FFT], or Interpersonal and Social Rhythm Approximately one-third of patients with bipolar
Therapy) has been shown to be superior to a short disorder also have comorbid anxiety. Antidepressant
course of psychoeducation in augmenting pharma- medications, the mainstay of treatment for anxiety
cotherapy to stabilize bipolar disorder symptoms disorders, may be counterproductive for treatment
(Miklowitz et al. 2007). CBT with psychopharma- of bipolar disorder; therefore, anxiety symptoms are
cology has been shown to be specifically superior to frequently treated only if remaining after adequate
medication management alone for maintaining bi- mood stabilization and first targeting mood cycling
polar disorder stability (Lam et al. 2003). For this and depression. CBT, on the other hand, may be
case, CBT was selected for psychotherapy due to the used without the liability of antidepressant medica-
availability of therapists trained in manualized CBT tions. Thus, the high comorbidity of anxiety symp-
compared with the other therapies. toms with bipolar disorder may be another reason to
An important tool used in CBT for bipolar disor- preferentially use CBT as the intensive psychother-
der is mood charting (see Figure 233 for example) apy of choice for bipolar disorder.
(Denicoff et al. 1997). The mood chart is a focal
point for collaboration between the patient, the
psychiatrist, and the therapist. Mood is tracked Course
prospectively so that pharmacological treatment de- Ms. M.S. was started on lamotrigine, following the
cisions are not based on state-dependent memory. recommended slow titration. The risk of rash was
Therapists can use the mood changes and noted psy- discussed. At 200 mg/day of lamotrigine, she began
chosocial stressors to more accurately recall cogni- to feel improvement in her mood. Mood improve-
tionmoodbehavior interactions. Patients, as more ment was tracked with the Clinical Monitoring
active participants in their own care, may have Form, noting a generally steady improvement in
greater treatment compliance. overall symptoms even though depressed mood did
not improve until approximately 45 weeks after
Rapid Cycling Course of Illness starting lamotrigine. It was useful to have a standard-
Approximately one-third of patients with bipolar ized list of symptoms to monitor at each visit to show
disorder have a rapid cycling course of illness the patient that her mood is more than the single
(Schneck et al. 2008). Documenting at least four full symptom of depressed mood or anhedonia. CBT was
DSM-IV-TR mood episodes per year (at least 4 days concurrently started and continued on a weekly basis
of pervasive hypomanic symptoms and at least initially. Mood charting was introduced during the
2 weeks of depressive symptoms) can be challeng- initial consultation with the psychiatrist and was re-
ing. Using a semistructured interview for the initial inforced and discussed in depth at each CBT ses-
intake and subsequent clinical follow-up improves sions. The psychiatrist and the therapist used the
the documentation of such episodes. Oftentimes, patient-generated mood chart as the focus of collab-
patients can only recall mood cycling as a constel- oration. Anxiety symptoms remained, but at a lower
lation of depressive and hypomanic symptoms with- level of severity. Medication or CBT were offered as
out consideration of daily pervasiveness or meeting treatment options, and the patient chose CBT based
full duration criteria. In these situations, patients are on the risk-benefit discussion.
often treated for depression as the prevailing presen- The patient remained in euthymic mood for ap-
tation, whereas subsyndromal (by time and symp- proximately 2 years. During that time, her visits to
tom count criteria) mixed episodes may be the the psychiatrist decreased to approximately every
relevant clinical syndrome. Antidepressant medica- 3 months. Her visits with her therapist continued at
Acute Bipolar Depression
Mood Chart: M.S. Month: Sept 2007
Severe
Elevation
Moderate High
Moderate Low
Mild
01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
Mild
Depression
Moderate Low
Moderate High
Severe
Sleep 9 9 9 9 8 7 6 6 8 7 6 7 7 8 6 7 7 6 7 8 7 7 8 8 9 8 9 10 10 9
Lamictal 200 mg 0 1 1 1 1 0 1 1 1 1 0 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1
Ambien 10 mg 1 1 1 1
Medications
OCP 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Imitrex 2 1
Neg comment from boss
Overwhelmed at work
Migraine headache
Migraine headache
Hiking with family
Life Events
01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
FIGURE 233. Mood chartingcorresponds approximately to Clinical Monitoring Form, time point D.
213
HA= headache; OCP= oral contraceptive pill.
214 How to Practice Evidence-Based Psychiatry
twice per month, then decreased to once per month. Even prior to using a specific treatment guide-
During the first year of euthymic mood, the patient line, for bipolar disorder it is even more imperative
had a slight, subsyndromal mood elevation around to make an accurate diagnosis. Bipolar disorder is an
Labor Day, which was noticed only as the minor de- important consideration in a patient who presents
creased sleep noted on the mood charting (Figure with a major depressive episode, due to differences
233). The therapist asked the patient to call the in evidence-based treatment preferences. Utilizing
psychiatrist to discuss a medication reevaluation. collateral sources of information serves dual pur-
Reinitiating weekly CBT sessions was chosen in- poses of providing more objective clinical history
stead of increasing the lamotrigine. Symptoms never and establishing a collaborative care model.
reached DSM-IV-TR syndromal level and resolved Clinical monitoring of patient with bipolar disor-
within 3 weeks. The patient then returned to her der requires a collaborative approach involving fam-
quarterly psychiatric and monthly therapist visits. ily and peer supports, and therapists as well. TIMA
The patient then became interested in becoming advocates combined pharmacotherapy and psycho-
pregnant. She had tried to decrease lamotrigine dos- therapy but does not indicate a preference for any
age for the planned pregnancy, but she returned to specific psychotherapy, owing to a lack of direct
200 mg/day when some irritability returned. When comparisons between psychotherapies. CBT is usu-
she did become pregnant, the pregnancy was other- ally chosen in our setting due to the availability of
wise unremarkable. She returned to twice-monthly therapists in our community with specialized train-
therapy and monthly psychiatric visits. Within 1 ing in CBT.
month postpartum she had a major depressive epi- Mood charting played a pivotal role in identifying
sode, despite arranging weekly therapist and twice- the subsyndromal mood elevation during a period in
monthly psychiatric visits. Mood stabilized after la- this patients follow-up when symptoms had remit-
motrigine was increased to 225 mg/day, and she re- ted for many months and the frequency of clinical
mained stable for another 15 months until the birth visits with psychiatrist and therapist were decreas-
of her second child. She had another major depres- ing. Collaboration with the therapist clearly closed
sive episode within 1 month of delivery, but she has the information loop for having the patient inform
since been stable for 3 years after lamotrigine was in- the psychiatrist about the mood elevation symp-
creased to 300 mg/day. toms. Tracking specific symptoms at each visit with
the Clinical Monitoring Form improved sensitivity
for noting clinical improvement early in treatment
Summary of Guideline Use and some mood destabilization later in ongoing
For this patient with bipolar depression, we used the clinical management.
TIMA guidelines suggesting an initial trial with ei- Based on treatment guidelines, we could have ei-
ther lamotrigine or lithium. Given the better toler- ther increased lamotrigine or added lithium or an
ability profile of lamotrigine compared with lithium, atypical antipsychotic medication for this noted sub-
we started this patient on a trial of lamotrigine, syndromal mood elevation. Instead, to control this
which led to improvement at the target dosage of mood recurrence, we offered these medication op-
200 mg/day given as a single daytime dose. Although tions or increasing psychotherapy frequency to
quetiapine is listed as a second-stage treatment op- improve sleep hygiene and medication compliance
tion due to greater adverse effects burden, it may be and decreasing external stimulus. Based on the col-
considered as an initial treatment based on a faster laborative care model, patient input is equally im-
onset of action. Lamotrigine is slower to onset of portant, so the decision was made to increase psy-
improvement but better tolerated, whereas quetia- chotherapy sessions. In addition, we scheduled a
pine may show benefit by the first week of treatment follow-up visit within 2 weeks to ensure that phar-
but generally has more tolerability challenges. It macological interventions were always available.
should also be considered that quetiapine has bene-
fits for anxiety symptoms, which were present in this
patient. This patient was not overburdened by a se-
Ways to Improve Practice
verely functionally disabling illness, so lamotrigine Patients and families often would like to investigate
was chosen for its greater tolerability. their illness on their own. The Internet is a vast but
Acute Bipolar Depression 215
sometimes too unregulated resource. We have of- Bowden C, Calabrese J, Ascher J, et al: Spectrum of efficacy
fered various consumer-oriented books on bipolar of lamotrigine in bipolar disorder: overview of double-
disorder, but a resource list compiled by consumers blind placebo-controlled studies. Paper presented at the
39th annual meeting of the American College of Neu-
may be more effective.
ropsychopharmacology, San Juan, Puerto Rico, Decem-
CBT is an effective adjunctive treatment for pa- ber 2000
tients with bipolar disorder, and it is broadly appli- Calabrese JR, Bowden CL, Sachs GS, et al: A double-blind
cable to many patients. However, the main reason placebo-controlled study of lamotrigine monotherapy in
that FFT and Interpersonal and Social Rhythm outpatients with bipolar I depression. Lamictal 602
Therapy were not used was the lack of reliable refer- Study Group. J Clin Psychiatry 60:7988, 1999
ral options. A better understanding is needed of the Calabrese JR, Keck PE Jr, Macfadden W, et al: A random-
availability of community resources for these evi- ized, double-blind, placebo-controlled trial of quetiapine
in the treatment of bipolar I or II depression. Am J Psy-
dence-supported therapies.
chiatry 162:13511360, 2005
Patients frequently benefit from peer-support Denicoff KD, Smith-Jackson EE, Disney ER, et al: Prelimi-
groups as a further adjunct to treatment. However, nary evidence of the reliability and validity of the pro-
most clinicians only have a basic understanding of spective life-chart methodology (LCM-p). J Psychiatr
the workings of local peer-support groups. We have Res 31:593603, 1997
started to serve as medical advisors to several local Derry S, Moore RA: Atypical antipsychotics in bipolar disor-
groups in order to extend the concept of collabora- der: systematic review of randomised trials. BMC Psychi-
tive care further. atry 7:40, 2007
Geller B, Zimerman B, Williams M, et al: Bipolar disorder at
Family involvement is greatest at the initiation of
prospective follow-up of adults who had prepubertal major
care due to the acuity of illness. However, over time, depressive disorder. Am J Psychiatry 158:125127, 2001
with longer periods of euthymic mood and pro- Goldberg JF, Harrow M, Whiteside JE: Risk for bipolar ill-
longed normality, family involvement diminishes. ness in patients initially hospitalized for unipolar depres-
We cannot help but wonder whether continuing to sion. Am J Psychiatry 158:12651270, 2001
actively involve family and/or peer supports would Goodwin GM, Bowden CL, Calabrese JR, et al: A pooled
have caught the subsyndromal mood elevation ear- analysis of 2 placebo-controlled 18-month trials of la-
lier. Involving family and peer supports throughout motrigine and lithium maintenance in bipolar I disorder.
J Clin Psychiatry 65:432441, 2004
the acute and stable periods may somewhat destig-
Hasin DS, Goodwin RD, Stinson FS, et al: Epidemiology of
matize coming to the psychiatrists office. We will major depressive disorder: results from the National Ep-
consider regularly inviting family and/or peer sup- idemiologic Survey on Alcoholism and Related Condi-
ports to attend office visits. tions. Arch Gen Psychiatry 62:10971106, 2005
Hirschfeld RM, Calabrese JR, Weissman MM, et al: Screen-
ing for bipolar disorder in the community. J Clin Psychi-
References atry 64:5359, 2003
Akiskal HS: The dark side of bipolarity: detecting bipolar de- Ketter TA (ed): Handbook of Diagnosis and Treatment of Bi-
pression in its pleomorphic expressions. J Affect Disord polar Disorders. Washington, DC, American Psychiatric
84:107115, 2005 Publishing, 2010
Altshuler LL, Post RM, Leverich GS, et al: Antidepressant- Lam DH, Watkins ER, Hayward P, et al: A randomized con-
induced mania and cycle acceleration: a controversy re- trolled study of cognitive therapy for relapse prevention
visited. Am J Psychiatry 152:11301138, 1995 for bipolar affective disorder: outcome of the first year.
American Psychiatric Association: Diagnostic and Statistical Arch Gen Psychiatry 60:145152, 2003
Manual of Mental Disorders, 4th Edition, Text Revision. Miklowitz DJ, George EL, Richards JA, et al: A randomized
Washington, DC, American Psychiatric Association, study of family focused psychoeducation and pharmaco-
2000 therapy in the outpatient management of bipolar disor-
American Psychiatric Association: Practice guideline for the der. Arch Gen Psychiatry 60:904912, 2003
treatment of patients with bipolar disorder. Am J Psy- Miklowitz DJ, Otto MW, Frank E, et al: Psychosocial treat-
chiatry 151 (12 suppl)136, 2002. Available at: http:// ments for bipolar depression: a 1-year randomized trial
www.psychiatryonline.com/pracGuide/pracGuideTopic from the Systematic Treatment Enhancement Program.
_8.aspx. Arch Gen Psychiatry 64:419426, 2007
Baldessarini RJ, Leahy L, Arcona S, et al: Patterns of psycho- Mitchell PB, Goodwin GM, Johnson GF, et al: Diagnostic
tropic drug prescription for U.S. patients with diagnoses guidelines for bipolar depression: a probabilistic ap-
of bipolar disorders. Psychiatr Serv 58:8591, 2007 proach. Bipolar Disord 10:144152, 2008
216 How to Practice Evidence-Based Psychiatry
Nemeroff CB, Evans DL, Gyulai L, et al: Double-blind, Suppes T, Dennehy EB, Hirschfeld RM, et al: The Texas im-
placebo-controlled comparison of imipramine and par- plementation of medication algorithms: update to the al-
oxetine in the treatment of bipolar depression. Am J Psy- gorithms for treatment of bipolar I disorder. J Clin
chiatry 158:906912, 2001 Psychiatry 66:870886, 2005
Post RM, Altshuler LL, Leverich GS, et al: Mood switch in bi- Thase ME, Macfadden W, Weisler RH, et al: Efficacy of que-
polar depression: comparison of adjunctive venlafaxine, bu- tiapine monotherapy in bipolar I and II depression: a
propion and sertraline. Br J Psychiatry 189:124131, 2006 double-blind, placebo-controlled study (the BOLDER II
Sachs GS, Nierenberg AA, Calabrese JR, et al: Effectiveness study). J Clin Psychopharmacol 26:600609, 2006
of adjunctive antidepressant treatment for bipolar de- Tohen M, Vieta E, Calabrese J, et al: Efficacy of olanzapine
pression. N Engl J Med 356:17111722, 2007 and olanzapine-fluoxetine combination in the treatment
Schneck CD, Miklowitz DJ, Miyahara S, et al: The prospec- of bipolar I depression. Arch Gen Psychiatry 60:1079
tive course of rapid-cycling bipolar disorder: findings 1088, 2003
from the STEP-BD. Am J Psychiatry 165:370377; quiz
410, 2008
24
Obsessive-Compulsive Disorder
Bibi Das, M.D.
Lorrin M. Koran, M.D.
217
218 How to Practice Evidence-Based Psychiatry
feels either guilty or stupid all the time and has Family History
had feelings of worthlessness. She denies any hope-
Motor tics in a maternal cousin
lessness, suicidal ideation, and symptoms of mood
A maternal aunt with major depressive disorder
elevation. Appetite and memory are normal. She has
and anxiety disorder (the specific type was un-
had problems falling asleep but denies any mid-cycle
known to the patient), who responded well to
awakening, nightmares, early morning awakening,
escitalopram
or daytime sedation. She also complained of prob-
A brother with generalized anxiety disorder who
lems with focus and distractibility. Ms. D.B. has had
had been treated successfully with escitalopram
free-floating anxiety but denied any panic attacks.
10 mg/day
She has had no impulse-control problems.
DSM-IV-TR Diagnosis
Past Psychiatric History
Axis I Obsessive-compulsive disorder
Ms. D.B. has no history of substance abuse. Major depressive disorder, currently mod-
Her compulsions began in childhood, when her erate severity
little brother was born. She went to the store and
bought three candies even though they were four
siblings. She remembers feeling like a monster be- Treatment Plan Considerations
cause I wanted one of them to die. As a child she 1. CompulsionsY-BOCS score 16
could not talk about this to anyone and controlled 2. ObsessionsY-BOCS score 16
her anxiety by creating rituals that would neutralize 3. DepressionHamilton Rating Scale for De-
the bad thoughts. pression (Ham-D; Hamilton 1960) score 24
She denies any history of depression before the
current episode. At age 17, she sought treatment A gold standard OCD severity measure is the
from her pediatrician. She had tried several medica- Y-BOCS. A score of 32 (16+ 16) falls in the severe
tions (Table 24-1) prescribed by her pediatrician range (Goodman et al. 1989).
with little help. I verified her medication history
by asking her pharmacy to fax me records. All med- Secondary Points in the Plan
ications had been refilled on time, indicating that Psychoeducation will emphasize understanding that
Ms D.B. adhered to treatment. She had not had a the cause of the disorder is unknown and that it rep-
trial of psychotherapy. resents a chemical problem in the brain and is not a
weakness of character and cannot be willed away, has
a waxing and waning course that seems influenced
Medical History
by stress, is treatable and responds to both medica-
Euthyroid (checked in the previous year during tions and to CBT, and usually does not go away
her annual physical) completely. We will emphasize the need for adher-
No history of head injury, seizures, loss of con- ence to treatment in order to reap the benefits, and
sciousness, sexually transmitted disease, or any we will set a realistic expectation of recovery in
risk factor for HIV terms of symptom relief and the time needed to
No known drug allergies reach this goal.
Obsessive-Compulsive Disorder 219
Treatment Goals et al. 2006), and encouraged her to add 800 g/day
of folic acid to help treat her depression, again based
Compulsions: Less than 30 minutes a day and not
on studies suggesting possible benefit (Alpert et al.
interfering with functioning
2002; Coppen and Bailey 2000).
Obsessions: Less than 30 minutes a day and not
I provided Ms. D.B. with a reading list and asked
interfering with functioning.
her to procure The OCD Workbook (Hyman and
Depression: Remission
Pedrick 2005) and Brain Lock (Schwartz 1996). Her
assignment for the first week was to make an Anxiety/
Treatment Goal Measures
Exposure List and to grade the severity of anxiety
Y-BOCS: Score less than 8 (Simpson et al. 2006) aroused in different fear-provoking situations using
Ham-D: Score less than 7 the Subjective Units of Distress Scale (SUDS), with
each item rated from 1 to 100 points.
Course Before initiating CBT, I explained the nature of
the treatment, including its here-and-now focus, the
Week 1 rationale of underlying treatment procedures, and
The options of using medications alone, CBT with what she would be required to do.
ERP alone, or a combination of these two treatments At the start of therapy, I used the Y-BOCS symp-
were discussed (Simpson and Liebowitz 2005). tom checklist (Goodman et al. 1989) to help her cre-
I (Dr. B.D.) prefer to meet my patients once a ate a list of target symptoms, including obsessions,
week if I am providing medication management to- compulsions, and items or situations that are
gether with CBT. The literature and expert opinions avoided because of OCD concerns. The patient
suggest that CBT sessions should be scheduled at ranked the listed items from least to most anxiety
least once weekly (March et al. 1997; Whittal et al. provoking.
2005). The number of treatment sessions, their In CBT consisting of ERP, patients are taught to
length, and the duration of an adequate trial have not confront feared situations and objects (i.e., expo-
been established, but expert consensus recommends sure) and to refrain from performing rituals (i.e., re-
1320 weekly sessions for most patients (March et sponse prevention). Exposures may include in vivo
al. 1997). I share these data with my patients so that confrontations (e.g., setting the dials of the thermo-
they can have a realistic expectation of when they can stat to the wrong number, wearing unlucky clothes)
expect to start feeling better. Also, this helps them and imagining feared consequences. Exposures that
decide whether they are willing to make the time and provoke moderate anxiety are prescribed first, fol-
the emotional and financial commitment required to lowed as quickly as tolerable by exposures of increas-
fully participate in the therapy process. ing difficulty. Patients must face their fears for a
Ms. D.B. was started on escitalopram 5 mg/day. prolonged period without ritualizing, allowing the
She had tried two other SSRIs that had not brought anxiety or discomfort to dissipate on its own (habit-
significant symptom control and had caused some uation). The goal is to weaken the connections be-
side effects. Although clinical trials indicate that all tween feared stimuli and distress and between
SSRIs are equally efficacious in treating both depres- ritualizing and relief from distress.
sion and OCD (Koran et al. 2007), I decided to start She was also encouraged to visit the Obsessive
her on escitalopram because her brother had re- Compulsive Foundation Web site, www.ocfoundation
sponded to this drug. The common side effects were .org, to learn more about OCD and to look for a local
discussed. In some patients, drug-drug interactions, OCD support group sponsored by the foundation.
particular unwanted side effects, and insurance cov- Unfortunately, she was unable to join a group because
erage are important additional factors to consider, of time constraints.
but in Ms. D.B.s case these factors were not relevant.
I also asked Ms. D.B. to take 1,000 mg/day of Week 2
eicosapentaenoic acid (EPA), an omega-3 fatty acid Ms. D.B. came back after having taken escitalopram
(available in fish oil capsules), in view of studies sug- 5 mg/day for a week. She had tolerated the medication
gesting that at this dosage it may be a beneficial aug- with no side effects but reported no symptom im-
mentation strategy in depressive disorders (Freeman provement. I increased the dosage by 5 mg to 10 mg/
220 How to Practice Evidence-Based Psychiatry
day, because 5 mg/day was far lower than the dosage aimed at changing these dysfunctional beliefs. Even
(20 mg/day) demonstrated quite effective in a con- though data comparing ERP alone to CBT alone re-
trolled clinical trial (Stein et al. 2007). In contrast to main inconclusive (Koran et al. 2007), many experts
improvement in depression, OCD improvement takes suggest that a combined approach is most fruitful.
longer and often requires higher SSRI dosages (often Dysfunctional beliefs that are common in OCD in-
above U.S. Food and Drug Administrationapproved clude magical thinking (e.g., a bathing ritual will
maximum dosages) (Koran et al. 2007). Many articles keep my family safe), an inflated sense of responsi-
suggest waiting 812 weeks before increasing the bility for unwanted events, overestimation of the
SSRI dosage or considering a switch. However, I tend probability of feared events, the assumption that
to increase the dosage faster for two reasons: thoughts are morally equivalent to actions or inevi-
tably lead to action (thought-action fusion), per-
1. Delay in initial response often leads to noncom- fectionism, the belief that anxiety/discomfort will
pliance. Also, because it appears that higher dos- persist forever, and the need for control.
ages are more effective than lower dosages in We decided that we would start with the OCD
treating OCD (Koran et al. 2007), slow titration symptom that caused least anxiety and then move up
wastes precious time before the patient can expe- the anxiety ladder. Thus we started with the patients
rience relief of symptoms. anxiety about pirates.
2. SSRI side effects tend not to be strongly dose de- Table 243 shows Ms. D.B.s mini-list for her pi-
pendent, so once we reach remission with favor- rate anxiety. Because a SUDS level of 20 was not dis-
able tolerability, I slowly back off on the dosage tressing enough, we started with writing the word
over several months while being vigilant for pirate. We worked on trying to spell the word,
returning symptoms. The goal is to obtain max- which Ms. D.B. did with little anxiety. Then, we
imum symptom control with minimum medica- wrote the word in the air, and finally, on paper. We
tion.
TABLE 243. Pirate anxiety and subjective
Ms. D.B. had prepared an inventory of some of
distress levels
her OCD symptoms, as shown in Table 242. She
reported that her obsessions revolved around fears Activity SUDS level
that if she did not do her rituals, a member of her
family would get into an accident and die or some Thinking about pirates 10
natural calamity would befall that person. She re- Hearing someone talk about pirates 20
ported that even though she knew that this made no Writing the word pirate 25
logical sense, I am a prisoner to my thoughts.
Seeing a picture of a pirate 30
While I am working on ERP, I like to also work
on the cognitive distortions that underlie OCD and Seeing a movie with pirates 35
try to teach the patient formal cognitive techniques Note. SUDS=Subjective Units of Distress Scale.
Obsessive-Compulsive Disorder 221
obtained several pictures of pirates from the Inter- to pay attention to ones inner dialogue and talk back
net, and I asked Ms. D.B. to look at them. The feared to the intrusive thoughts with logical and directive
consequence of ritual prevention that cropped up statements rather than giving in to them (Table 244).
was my family will get hurt by bad guys. We decided to target the next OCD symptom,
We decided that Ms. D.B. would try to do the locking the front door and checking it. We made a
writing/looking at the picture exercise when with mini-list, breaking down the locking and checking
her family. behavior (Table 245).
The mini-list was used to do the ERP in the fol-
Week 3 lowing steps:
Ms. D.B. was now taking 10 mg/day of escitalopram.
She reported a 40% decrease in her sad mood and 1. Choose the item that produces at least moderate
overall anxiety. She also reported that she was get- anxiety by bringing it on and confronting it with
ting better-quality sleep and waking up feeling more an adequate level of anxiety.
refreshed. She had some constipation, however, for 2. Allow the discomfort to rise and tolerate it rather
which she was taking Metamucil. than trying to neutralize it.
Her Ham-D score reflected the improvement in 3. Practice ritual prevention while doing the expo-
her depressive symptoms, having decreased from 23 sure (i.e., do not pray under your breath).
to 12. Her Y-BOCS score remained almost the same 4. Repeat the task again and again till the SUDS
(15 obsessions + 16 compulsions). As expected, her decreases to 20 or less.
depressive symptoms responded earlier than her
OCD symptoms. We also increased Ms. D.B.s escitalopram dosage
Ms. D.B. reported that she was able to do her to 20 mg/day, the dosage demonstrated more effec-
ERP exercise in spite of increased anxiety. She was tive in OCD (Stein et al. 2007), because she had tol-
so excited by her success that she rented Pirates of the erated 10 mg/day quite well.
Caribbean and was able to watch 30 minutes of it.
We looked at self-talk strategies that she could Week 4
use in order to plow through the exposure. We re- Ms. D.B. came back the following week reporting that
viewed the concept of being an impartial observer she was able to cut down her checking behavior to
as outlined in Brain Lock (Schwartz 1996). The idea is three times that week. However, the anxiety had been
TABLE 245. Locking and checking behaviors and subjective distress levels
so intense that she had had her mother check the door scores dropped from 30 to 20. However, when we
for her and reassure her that the door was safely reached her bathing ritual, we hit a roadblock. At
locked. I learned that her family had often helped her this point she was unable/unwilling to do any of the
out when she was unable to get started or move on. exposure. She reported severe anxiety and terrible
I explained to her that this help would be coun- feelings of guilt. She thought that if the rituals are
terproductive to her improvement. We decided to for my familys safety, I cannot let them go. I feel I
have her family come in for the next session (Ren- am a bad daughter /sister if I challenge the rituals.
shaw et al. 2005). We tried to use the strategy of relabeling as out-
lined in Brain Lock (Schwartz 1996). When relabel-
Week 5 ing, she would try to identify these thoughts as OCD
During the family meeting I explained how family/ thoughts and say to herself, Its not me, its my
caregivers could inadvertently act in ways that are OCD. This would allow her to not regard the
counterproductive to the patients recovery. Partici- thoughts as part of her normal thinking and to get
pating or enabling is a familys way to protect the perspective on how absurd they are.
loved one in the face of suffering, thus offering im- From week 11 to week 13 Ms. D.B. appeared to
mediate relief from OCD distress. I elaborated some reach an impasse in confronting her remaining
typical ways that the family was vicariously partici- OCD symptoms (Figure 241). We tried to aug-
pating in OCD behavior: ment the effect of escitalopram by adding clon-
azepam 0.5 mg as needed (not to exceed 1 mg/day)
Assisting with checking rituals for anxiety. She had a history of experiencing anxiety
Reassuring the patient that things are safe relief with clonazepam, so I tried it first. We could
Trying to reason the OCD away by recounting have tried other augmentation strategies, for exam-
endless reasons and facts that show how unrea- ple, atypical antipsychotics, clomipramine, or bus-
sonable the OCD fears are. (In the process, the pirone (Koran et al. 2007), but it seemed to me that
family may be counterproductively neutralizing she just needed a little help in doing her exposure,
the obsessive thought, giving it credence and per- via relief from heightened anxiety.
petuating the cycle.)
Week 14
I asked the family to come up with examples of Ms. D.B. returned with worsening depressive symp-
how they had fallen into any of these traps. We then toms (Figure 242). She reported that her inability
did some role-playing regarding how the family to do the ERP was making her feel like a failure,
members could be helpful by being coaches and yet trying to do the exposure just makes me way too
cheerleaders for Ms. D.B. The following guidelines guilty. She wanted a guarantee that nothing will
were established: happen to my family if I try. She also said that,
deep down I must really want them dead if I have
1. Anticipate that Ms. D.B. will notice an increase this OCD.
in anxiety before it finally subsides We tried to address the cognitive distortions that
2. Decrease participation gradually to reach com- were getting in the way of her recovery. Prominent
plete disengagement at an agreed-upon time, among them were the following:
which is non-negotiable
3. Expect resistance and possibly anger Magical thinking/thought-action fusion: If I think of
4. When demands are made for reassurance, the a pirate, bad things will happen to my family.
family member should calmly remind Ms. D.B. All-or-nothing thinking: If I do not shower prop-
that, because I love you, I cannot participate in erly, I am totally dirty.
harmful OCD behavior. Perfectionism: It is intolerable until I do it per-
fectly.
Weeks 613 Overresponsibility: I must at all times be on alert so
From week 6 to week 13 Ms. D.B. moved down the that I do not harm any innocent person.
OCD symptom target list carrying out ERP. She What-if thinking: What if I make a mistake? it is
continued to keep her ERP log, and her Y-BOCS not OCD? Dr. Das is wrong?
Obsessive-Compulsive Disorder 223
The exclusivity error: All bad things will happen to Weeks 1620
my loved ones. Ms. D.B. was able to go forward with her ERP with
renewed vigor. Her Y-BOCS total score came down
Ms. D.B. was to try to keep a thought log and to to 4. She continued escitalopram 20 mg/day. By
try to recognize any of these cognitive distortions if week 19, she had stopped using clonazepam. We dis-
they occurred. We also decided that it would be a cussed the importance of medication adherence.
good idea to have a second family meeting. Ms. D.B. was to start college. I encouraged her to
find a clinician to work with when she moved and
Week 15 gave her names of psychiatrists in the new city. I also
At the family meeting I had two agenda items: First, had her sign a release of information so that I could
I wished to address Ms. D.B.s guilt. I told her that transfer records and facilitate continuity of care.
maybe her OCD revolved around her familys safety
because that was the dearest thing to her heart rather
than the other way around. There were no data to
Ways to Improve Practice
suggest that this was a fact, but I pointed out that one Obtain Previous Records
can only feel intense anxiety when it involves some- Obtaining records from the previous treating clini-
thing dear. Second, I asked all the family members if cian is a good idea. In this case, Ms. D.B. knew what
they would give Ms. D.B. permission to do her ex- medications she had taken, including how long she
posure. They unanimously agreed. We also agreed took each one and whether it was effective. Her
that if a harmful event did happen in the next few mother had kept records of when she had started
weeks, the family (and, it is hoped, Ms. D.B.) would each medication, the dosage, and how long Ms. D.B.
regard it as having occurred independent of her ex- had taken it. However, patients often do not remem-
posure therapy. ber such details, and time may be lost trying some-
thing that has already proved ineffective.
224 How to Practice Evidence-Based Psychiatry
FIGURE 242. Patients Hamilton Rating Scale for Depression scores by week.
Recognize Resistance Koran LM, Hanna GL, Hollander E, et al: Practice guideline
for the treatment of patients with obsessive-compulsive
In hindsight, when I looked at Ms. D.B.s Ham-D
disorder. Am J Psychiatry 164(suppl):153, 2007. Avail-
graph, it was obvious that she had gotten more de-
able at: http://www.psychiatryonline.com/pracGuide/
pressed as she faced some of the challenges with pracGuideTopic_10.aspx. Accessed June 18, 2009
ERP. The spike seen from week 6 to week 13 was March JS, Frances A, Carpenter D, et al: The Expert Con-
due to an increase in the way she rated her guilt. If sensus Guideline Series: treatment of obsessive-compul-
I had paid more careful attention to the ratings and sive disorder. J Clin Psychiatry 58(suppl):372, 1997
to the symptom subgroups, I could have helped her Renshaw KD, Steketee G, Chambless DL: Involving family
conquer her fears about doing the exposures. members in the treatment of OCD. Cogn Behav Ther
34:164175, 2005
Schwartz JM: Brain Lock: Free Yourself From Obsessive-
References Compulsive Behavior. New York, HarperCollins, 1996
Simpson HB, Liebowitz MR: Combining pharmacotherapy
Alpert JE, Mischoulon D, Rubenstein GE, et al: Folic acid
and cognitive-behavioral therapy in the treatment of
(Leucovorin) as an adjunctive treatment for SSRI-refrac-
OCD, in Concepts and Controversies in Obsessive-
tory depression. Ann Clin Psychiatry 14:3338, 2002
Compulsive Disorder. Edited by Abramowitz J, Houts A.
Coppen A, Bailey J: Enhancement of the antidepressant ac-
New York, Springer, 2005, pp 359376
tion of fluoxetine by folic acid: a randomized, placebo
Simpson HB, Huppert JD, Petkova E, et al: Response versus
controlled trial. J Affect Disord 60:121130, 2000
remission in obsessive-compulsive disorder. J Clin Psy-
Freeman MP, Hibbeln JR, Wisner KL, et al: Omega-3 fatty
chiatry 67:269276, 2006
acids: evidence basis for treatment and future research in
Stein DJ, Andersen EW, Tonnoir B, et al: Escitalopram in
psychiatry. J Clin Psychiatry 67:19541967, 2006
obsessive-compulsive disorder: a randomized, placebo-
Goodman WK, Price L, Rasmussen S, et al: The Yale-Brown
controlled, paroxetine-referenced, fixed-dose, 24-week
Obsessive Compulsive Scale (Y-BOCS), part I: develop-
study. Curr Med Res Opin 23:701711, 2007
ment, use, and reliability. Arch Gen Psychiatry 46:1006
Whittal ML, Thordarson DS, McLean PD: Treatment of
1011, 1989
obsessive-compulsive disorder: cognitive behavior ther-
Hamilton M: A rating scale for depression. J Neurol Neuro-
apy vs. exposure and response prevention. Behav Res
surg Psychiatry 23:5662, 1960
Ther 43:15591576, 2005
Hyman BM, Pedrick C: The OCD Workbook: Your Guide to
Breaking Free From Obsessive Compulsive Disorder, 2nd
Edition. Oakland, CA, New Harbinger Publications, 2005
25
Schizophrenia
A Family Psychoeducational Approach
The current American Psychiatric Association gave rise to family-centered interventions that, in
(APA) practice guidelines for the treatment of tandem with psychopharmacology advances, reduce
schizophrenia (Lehman et al. 2004) offer a striking patient relapse rates and psychiatric symptoms, en-
example of how family interventions have returned hance medication compliance, and contribute to im-
to the mainstream in contemporary psychiatric proved patient and family coping and quality of life
practice. Indeed, as Heru (2008) has pointed out, (Cohen et al. 2008; Kaplan and Rait 1993; McFar-
APA practice guidelines already recommend early lane et al. 2003; Pitschel-Walz et al. 2004).
couple and family involvement as well as family- Expressed emotion, perhaps the most well-
based interventions for Axis I disorders, including, known of these dimensions, is characterized by high
but not limited to, schizophrenia, bipolar disorder, levels of criticism, hostility, and overinvolvement on
major depression, panic disorder, and eating disor- the part of family members. Research has shown
ders. The familys role in the treatment of schizo- that high expressed emotion is a robust predictor of
phrenia has certainly come full circle in that the very relapse not only in schizophrenia but also in many
roots of the family therapy field can be found in the psychiatric illnesses (that create caregiver burden),
schizophrenia research conducted more than half a such as depressive disorders, bipolar disorder, and
century ago by the fields founders. alcoholism (Hooley and Teasdale 1989; Miklowitz
These early efforts hypothesized unidirectional et al. 1988; OFarrell et al. 1998; Rait and Glick
parentchild causal effects that, at the time, were 2008). At the same time, caregiver research has iden-
thought to possibly explain the etiology of schizo- tified the high emotional and practical burdens of
phrenia. However, the focus of family researchers in caring for relatives with psychiatric illnesses
schizophrenia gradually shifted to looking at family (Chakrabarti et al. 1992; Drapalski et al. 2008; Ferro
processes that maintain the disorder (Kaplan and et al. 2000).
Rait 1993; Lehman et al. 2004; McFarlane et al. Family psychoeducation, multiple family therapy
2003). They identified a host of family factorssuch psychoeducational groups, behavioral interventions,
as expressed emotion, stigma, isolation, and care- psychosocial rehabilitation, and self-help advocacy
giver burdenimplicated in the ongoing mainte- groups (e.g., the National Alliance on Mental Illness
nance of serious psychiatric illness (Butzlaff and [NAMI]) specifically address areas of family func-
Hooley 1998; Kavanaugh 1992). These findings tioning that can accelerate illness progression or,
225
226 How to Practice Evidence-Based Psychiatry
follow-up after Nicks second hospitalization for the The family reported that about the time Nick an-
exacerbation of paranoid schizophrenia. Nick is cur- nounced that he was going to move out, days after he
rently being treated with 15 mg/day of olanzapine was discharged from the hospital, the parents long-
a second-generation rather than a first-generation standing quarreling intensified. The mother went to
agentalthough his compliance with the medica- her family doctor seeking medication for her own
tion is inconsistent. He complains of side effects, anxiety, and she considered finding her own individ-
primarily weight gain and sedation. ual therapist because her husband simply would not
listen to her. Upon discharge, Meghan had also
tried to convene a family meeting to develop a plan.
Present Illness
She was unable to find a time when all family
What Is the Current Family Problem? members would agree to meet (How will talking
Nick has both positive psychotic symptoms, charac- help? He just needs to do something!), and she re-
terized by auditory hallucinations, paranoid think- quested additional family sessions with the family
ing, and worries about being attacked by strangers, therapist to formulate next steps. She was joined in
and negative symptoms that include apathy, flat af- these sentiments by her daughter and, eventually, her
fect, and inability to seek or hold a job. He also has younger son. However, she felt that nobody would
moderate cognitive impairment. Following his sec- help her and that she could not get any cooperation
ond brief inpatient stay, he was restarted on olanza- from the family members in supporting Nick, not to
pine 15 mg/day and referred back to his psychiatrist mention in doing regular household chores.
for follow-up. At the same time, family therapy was
also recommended due to intensified family conflict, What Is the Background of the
and the family met with a psychologist/family ther- Family Problem?
apist. Stressors at home prior to that hospitalization Nick began to develop paranoid symptoms during
included increased conflict around Nicks failure to high school. Rob has worked in high-tech sales for
show up at work, sibling conflicts, and parental con- different companies over an extended period of time.
flict about whether to force him to go to work or Although he had been steadily employed, there were
allow him to stay at home and reorganize himself. extended periods where he lost jobs, engaged in a job
Given his spotty academic and employment history, search, and found new work opportunities. Although
his father strongly advocated Nicks going to work this boom/bust cycle has been a common fact of life
even if he didnt always like it. His mother believed in their area, his wife felt increasingly worried about
this approach was counterproductive, and she urged finances and the poor role model my husband is of-
her husband and son to ease up on Nick because he fering to the children. Throughout this time,
could not deal with the heightened stress. As a result, Meghan worked as a middle-school English teacher
heated conflict between the mother and father, with and managed most of the household duties. The
increasing criticism leveled at Nick, ensued. children were all good students, although Nick was
thought to have a learning disability for reading (di-
Why Does the Family Come for Treatment agnosed in middle school) that had served as an ex-
at This Time? planation for his increased apathy in class.
Following the second hospitalization, Meghan felt it Family support had become more of an issue be-
was time to intensify treatment in order to develop a cause the parents of both Rob and Meghan had had
strategy that would address the chronic and mount- serious health problems while the children were still
ing family conflict surrounding Nicks condition, in the local public school. Following the death of
the stresses undermining Nicks recovery, and the Meghans father due to a stroke, Meghans mother
question of whether he should move out on his own. developed dementia. The mother lived nearby and
The family had already been referred by the inpa- was residing in a nursing facility. Although there is
tient team to NAMIs family-to-family support pro- no documented history of schizophrenia in the fam-
gram, and they had received individual and family ily, an uncle on Meghans mothers side and two
psychoeducation on the unit through lectures and cousins on Meghans fathers side were similarly de-
group meetings. scribed as odd, eccentric, and difficult to spend time
228 How to Practice Evidence-Based Psychiatry
with. Both of Robs parents were in poor health and volvement (one of his parents occasionally accom-
lived in the Midwest near his brother and sister. panied him to monthly appointments), it was
determined during his recent inpatient admission
Current Interactional Patterns that a more consistent family intervention might be
The situation at home had progressively worsened helpful in preventing relapse and future inpatient
during the 2 months prior to Nicks rehospitaliza- hospitalizations. The family had already been re-
tion. Nick began to skip days at work, stay up all ferred to NAMI, but they had never attended a meet-
night, and show increased irritability. His parents ing, nor had they attended any outpatient family
engaged in intensifying conflict, with Rob accusing support meetings offered through the clinic. Al-
Nick of being the cause for all the familys misery though Nick and his family accepted that schizo-
while Meghan defended Nick, claiming that he was phrenia is a brain disorder, his functional and
sick, that Rob was insensitive and out of control, behavioral dysfunction created ample opportunities
and that he (Rob) was the reason her level of stress for family members to continue to debate whether
was unmanageable. As the young adult children en- Nick was lazy or sick.
tered the conflict, Pam first joined Rob in criticizing Given the fact that this family had not previously
Nick, whereas Dave loyally allied with his mother. participated in any organized family intervention
This pattern of alliances, with Rob and Pam in co- program, developing an alliance and shared set of
alition against Nick, Meghan, and Dave, had been goals was crucial. Family members reported feeling
pointed out to the family many times in their family alone with the problems they were experiencing,
sessions in the hospital. As Robs complaints about frustrated with Nicks unwillingness to take positive
Nick and the indulgent attitude shown by Meghan steps on his own behalf, and tired of the arguments
increased, however, Pam eventually joined Meghan and family strife. Because each family member had a
in her defense, saying that although she agreed with busy life, with the exception of the patient, sched-
her fathers point about Nicks laziness, pot smoking, uling appointments where everyone could meet
and unwillingness to take responsibility, it isnt fair invariably presented a challenge. This practical
to attack Mom. challenge was addressed by setting up a loose sched-
ule, after the initial set of intensive sessions, where
meetings were scheduled monthly well in advance,
Differential Diagnosis with the option of meeting more frequently during
The patient met the criteria for schizophrenic disor- periods of particular stress.
der, paranoid type. In addition, his marijuana use
met the criteria for substance abuse, rule out sub- Treatment Goals, Measures, and Methods
stance dependence. Finally, due to family conflict,
The principal components of family psychoeduca-
parentchild problem was also diagnosed.
tion outlined by Kaplan and Rait (1993) and McFar-
lane et al. (2003) include 1) coordinating all elements
DSM-IV-TR Diagnosis of treatment and rehabilitation so that everyone is
Axis I Schizophrenic disorder, paranoid type. working toward the same goals in a collaborative
Substance abuse. Parentchild problem. fashion; 2) paying attention to the social as well as
Axis II None the clinical needs of the patient; 3) providing optimal
Axis III None medication management; 4) assessing and support-
Axis IV Deferred ing family strengths while acknowledging family
Axis V GAF score: 30. limitations in dealing with the patient; 5) improving
Familys score on the Global Assessment communication and resolving family conflict; 6) ad-
of Relational Functioning Scale: 45. dressing feelings of grief and loss; 7) providing rele-
vant information for family members at appropriate
times; 8) developing an explicit crisis plan and re-
Treatment Plan Considerations sponse; 9) encouraging family members to expand
Although Nick had been treated individually for their social systems of support to combat stigma,
nearly 2 years without much organized family in- caregiver burnout, and social isolation; and 10) in-
Schizophrenia, Family Psychoeducation 229
creasing agency and competence and instilling hope rating scales and self-report instruments are avail-
in the face of extreme psychosocial challenges. able. Looking at potential measurable outcomes of
Specific treatment goals for Nick and his family family psychoeducation interventions, Cohen et al.
were to increase knowledge about schizophrenia; re- (2008) proposed the following: greater rates of on-
duce expressed emotion and family conflict; normal- going contact between family and patients treat-
ize family members feelings and reduce emotional ment team; increased empowerment for family
burnout; reduce social isolation and increase family members; increased knowledge about psychiatric
support; increase family problem-solving skills and illness, treatment, and resources for family mem-
communication; encourage the patients functioning bers; an improved subjective recovery trajectory
in work, social, and family contexts; and support the (such as perceived control and well-being) of the pa-
patients medication compliance. tient participating in family-based services; en-
Medication goals included decreasing positive hanced perceptions of family support by patients
symptoms of schizophrenia, over the long run, and participating in family services; and improved cop-
improving the negative symptoms and cognition. ing and reduced stress and conflict among all in-
Here, a second-generation antipsychotic, olanzapine, volved family members. Consistent with their
was used because it has somewhat better efficacy over emphasis on evidence-based care, they also identi-
time and causes fewer extrapyramidal effects. Olan- fied specific instruments to assess each of these di-
zapine can produce weight gain, so metabolic param- mensions (Cohen et al. 2008).
eters would have to be constantly monitored. In
addition, given Nicks marijuana use, an additional Course
treatment goal was to refer Nick to a substance abuse
program, because comorbid substance abuse drasti- Early Stage
cally lowers prognosis (Dickey et al. 2002). In the initial family meetings, family members were
In this particular case, no formal measures were introduced to the family psychoeducational ap-
used to track the problem areas or treatment goals. proach (Heru 2008; Lehman et al. 2004). Informa-
General progress was assessed with treatment notes tion was shared about the etiology and various
in the desired areas for improvement, and estimates presentations of the illness, the importance of med-
of progress are provided in Table 251 in order to ication compliance, including the pros and cons of
show how treatment progress could be charted. different medications, and the range of services and
In a case in which the clinicians are using formal extrafamilial social supports that were available to
assessment measures to track progress, a range of them. Initial goals also included recognizing and
230 How to Practice Evidence-Based Psychiatry
normalizing family members emotional reactions members thoughtfully reexamined their roles and
of anger, shame, guilt, stigma, and isolation. Finally, alliances with one another. During the session, Nick
family members learned about the structure of the admitted that he felt he should leave because his fa-
family psychoeducational meetings that would serve ther no longer wanted him at home. Rob reassured
as a format for subsequent sessions. his son, yet he disclosed how hopeless and frustrated
These psychoeducational meetings for the family he was that Nick was not taking more responsibility.
followed a predictable series of steps. After a brief After all, this had been an enormous strain for ev-
period of socialization and reconnecting at the ses- eryone. Nicks mother and siblings were able to un-
sions outset, family members were asked to identify derstand Robs feelings, and they shared their
what they would like to gain from the session. Fol- concern that Nick would deteriorate more if he lived
lowing this go-round, a particular problem would alone and that he might smoke marijuana to excess,
be selected for the family to address. Then, the ther- avoid working, and avoid taking care of himself.
apist would guide the family through a process of
problem solving in which the problem would be de- Mid-Stage
fined and elaborated, solutions would be entertained
Over time, Nicks positive symptoms decreased, and
and discussed, and a plan would then be adopted.
communication within the family improved. The
This process, repeated from meeting to meeting,
family was able to find common ground when Nick
became a reliable format that family members could
agreed that he would stay at home, return to his job,
use. Problems they identified included focusing on
and attend support groups focusing on his marijuana
the familys pattern of alliances or teams, the level
abuse. This concrete plan was ratified, and the fam-
of criticism and anger directed toward Nick, a de-
ily agreed to continue meeting to evaluate progress
bate over whether to return to the hospital, how to
in each of the areas and to consider the longer-term
handle problems and disappointments at work, the
question of whether Nick might find his own living
question of whether Nick should find his own apart-
situation. Feelings on the part of both siblings were
ment, how to get Nick into a substance abuse pro-
addressed, and the parents reported feeling relieved
gram, ways to handle the stress of the grandmothers
that they had an agreement that was comfortable
dementia, strategies for reducing burnout and de-
for everyone. During periods of extreme stress and
moralization, the issue of whether the mother
increased positive symptoms, both individual and
should continue to teach, and how to ensure that
family appointments were more frequent (as was the
Nick was taking his psychiatric medications. Skills
collaboration between the clinicians in the case).
for problem solving and communication were also
Both patient and family were engaged in treatment
addressed and modeled in every meeting, and the
consisting of family psychoeducation, individual
familys continuing involvement with self-help ad-
supportive psychotherapy and medication manage-
vocacy and support groups was reinforced. In col-
ment with the psychiatrist, and social support
laboration with his psychiatrist, Nick complied with
though the family-to-family groups at the local
medication changes and had regular follow-up visits
chapter of NAMI.
at increasingly spaced intervals. He followed a diet
and exercised two to three times a week.
Individual supportive psychotherapy and medica- Late Stage
tion management were started on a weekly basis Family meetings continued on an intermittent basis,
during the acute phases and gradually increased to and regular follow-up was maintained with the psy-
monthly sessions as Nick stabilized and his positive chiatrist. Nick continued to refuse to deal directly
symptoms decreased. Family sessions were initially with his marijuana use, and neither the family sessions
conducted every other week (with more frequent nor the psychiatrists urging resulted in his locating a
meetings during periods of particular crisis). After treatment program that he would commit to attend-
Nicks hospitalization, the family convened to dis- ing. Nicks problem-solving and social skills im-
cuss whether Nick should move out of the family proved. At the same time, his attendance and
home. Robs disappointment and irritation because performance at his job improved, as he switched (be-
Nick had stopped going to work regularly was cause of his cognitive impairment) to a more suitable
identified as the first problem to solve, and family position in the stockroom instead of on the sales floor.
Schizophrenia, Family Psychoeducation 231
Butzlaff R, Hooley J: Expressed emotion and psychiatric re- Kaplan F, Rait D: Partnerships for schizophrenia: reconciling
lapse. Arch Gen Psychiatry 55:547552, 1998 professional models. Workshop presented at the 51st an-
Chakrabarti S, Kulhara P, Verma S: Extent and determinants nual conference of the American Association of Marriage
of burden among families of patients with affective disor- and Family Therapy, Anaheim, CA, October 1993
ders. Acta Psychiatr Scand 86:247252, 1992 Kavanaugh D: Recent developments in expressed emotion
Cohen AM, Glynn SM, Murray-Swank AB, et al: The family and schizophrenia. Br J Psychiatry 160:601620, 1992
forum: directions for the implementation of family psy- Lehman AF, Lieberman JA, Dixon LB, et al: American Psy-
choeducation for severe mental illness. Psychiatr Serv chiatric Association Steering Committee on Practice
59:4048, 2009 Guidelines: practice guideline for the treatment of pa-
Dickey B, Normand SL, Weiss R, et al: Medical morbidity, tients with schizophrenia, 2nd ed. Am J Psychiatry
mental illness, and substance use disorders. Psychiatr 161(suppl):156, 2004
Serv 53:861867, 2002 McFarlane W, Dixon L, Lukens E, et al: Family psycho-
Dixon L, Goldberg R, Iannone I, et al: Use of a critical time education and schizophrenia: a review of the literature.
intervention to promote continuity of care after psychi- J Marital Fam Ther 29:223246, 2003
atric inpatient hospitalization. Psychiatr Serv 60:451 Miklowitz D, Goldstein M, Nuechterlein K, et al: Family
458, 2009 factors and the course of bipolar affective disorder. Arch
Drapalksi A, Marshall T, Seybolt D, et al: Unmet needs of Gen Psychiatry 45:225231, 1988
families of adults with mental illness and preferences re- OFarrell T, Hooley J, Fals-Stewart W, et al: Expressed emo-
garding family services. Psychiatr Serv 59:655662, 2008 tion and relapse in alcoholic patients. J Consult Clin Psy-
Ferro T, Verdeli H, Pierre F, et al: Screening for depression chol 66:744752, 1998
in mothers bringing their offspring for evaluation or Patterson JE, Miller RB, Carnes S, et al: Evidence based
treatment of depression. Am J Psychiatry 157:375379, practice for marriage and family therapists. J Marital Fam
2000 Ther 30:183195, 2004
Glick ID: Adding psychotherapy to pharmacotherapy: data, Pinsof W, Wynne L: The efficacy of marital and family ther-
benefits, and guidelines for integration. Am J Psychother apy: an empirical overview, conclusions, and recommen-
58:186208, 2004 dations. J Marital Fam Ther 21:585613, 1995
Glick I, Berman E, Clarkin J, et al: Marital and Family Ther- Pitschel-Walz G, Leucht S, Buml J, et al: The effect of fam-
apy, 4th Edition, Washington, DC, American Psychiatric ily interventions on relapse and rehospitalization in
Press, 2000, pp 647648 schizophrenia: a meta-analysis. Focus 2:7894, 2004
Glynn SM, Dixon LB, Cohen AM, et al: The family member Rait D, Glick I: Reintegrating family therapy training in psy-
provider outreach program. Psychiatr Serv 59:934, 2008 chiatric residency programs: making the case. Acad Psy-
Heru A: Family psychiatry: from research to practice. Am J chiatry 32:7680, 2008
Psychiatry 163:962968, 2008 Rolland J, Walsh F: Systemic training for healthcare profes-
Hooley J, Teasdale J: Predictors of relapse in unipolar depres- sionals: The Chicago Center for Family Health ap-
sives: expressed emotion, marital distress and perceived proach. Fam Process 44:283301, 2005
criticism. J Abnorm Psychol 3:229235, 1989 Sackett DL: How evidence-based medicine will change the
way you practice. Med Econ 76:120128, 1999
26
Keith Humphreys was supported by grants from the Veterans Affairs Health Services Research and Development Service and the
Robert Wood Johnson Foundation.
233
234 How to Practice Evidence-Based Psychiatry
has not experienced an elevated mood in the past cific days using the Timeline Followback method is,
3 weeks. in our opinion, a very effective way to begin assess-
Based on her self-report narrative, Ms. R.D. ap- ment. The TLFB method charts the amounts and
pears to meet full criteria for bipolar disorder, char- patterns of substance use in the preceding 12 weeks,
acterized by periods of depression alternating with independent of consequences or compulsivity of use
periods of mania/hypomania. Her mood at the time (Sobell and Sobell 1995). This method often results
of presentation is depressed for 3 weeks, with in a more valid assessment of actual substance use
thoughts of suicide but no specific intent or plan. than if the interviewer simply asks: How much do
Her recent behavior has put her at risk for sexually you drink in a given week? By keeping to specifics
transmitted diseases. and a timeline, there is a markedly decreased chance
Ms. R.D. does not mention substances in her of the patient minimizing consumption, mixing up
chief complaint or opening narrative. This is not drinking occasions, or mentally averaging drinking
atypical, even when substances are a prominent over the period of interest.
problem in the patients life. The reasons for this We ask the patient to begin with the day prior to
omission are manifold, having to do with but not our encounter and move backward, remembering
limited to clinical inattention, stigma, and unwill- how much alcohol he or she consumed on each day
ingness to surrender the rewarding aspects of sub- in the preceding 12 weeks. Where appropriate, we
stance use. Therefore it falls upon the treatment offer concrete events to stimulate memory, for exam-
provider to screen for substance use, a task that is all ple, Lets start with Monday, that was the first day of
too frequently neglected by psychiatrists (Daniels- the week before midterm exams. When asking
son et al. 1999; Himelhoch and Daumit 2003). about alcohol, it is vital to ask about the type of alco-
holic beverage consumed and the size of the drink
(see Table 261 for definitions). By knowing the type
Other Significant Findings From
and exact amounts, we can calculate the number of
Assessment standard drinks consumed in a week. Hazardous
Screening for Substance Use Disorders drinking for men is 14 or more standard drinks in a
With all of our patients, we introduce substance use week or 5 or more standard drinks in a sitting. Haz-
screening early in the evaluation process and docu- ardous drinking for women is 7 or more standard
ment our findings in a separate section just after the drinks in a week or 4 or more in a sitting (see Table
History of Present Illness. We usually label it 261). The TLFB method was developed and vali-
Substance Use Patterns and History. We priori- dated primarily for alcohol, but we also find it a use-
tize substance use screening for several reasons. Ep- ful means for other substances. It is important to
idemiological studies, corroborated by our clinical remember when screening for other substances that
experiences, tell us that 30%40% of individuals there are no unequivocal quantity or frequency risk
with a lifetime mood disorder will meet criteria for a thresholds for hazardous use, and nearly all daily nic-
substance use disorder (Kessler et al. 1996). Like- otine users are nicotine dependent (Veterans Health
wise, many individuals dependent on nicotine, alco- Administration/Department of Defense 2001).
hol, or illegal drugs will also have a depressive Using the TLFB method with Ms. R.D., we as-
disorder (Kessler et al. 2003). If substance use is de- sess amounts and patterns of alcohol use:
tected as a problem early on, this discovery informs
Interviewer: Do you drink alcohol?
the rest of the interview process. It becomes neces-
R.D.: Yes.
sary to delineate what relationship the presenting Interviewer: Today is Wednesday. How much, if
psychiatric symptoms have with the substance use. anything, did you drink last night?
Substance use can mimic many psychiatric symp- R.D.: Nothing.
toms and disorders. Interviewer: How about Monday night?
Many individuals, addicted or not, are poor at re- R.D.: Nothing.
calling substance use accurately, even if they are Interviewer: And Sunday nightthat was when
comfortable disclosing it candidly to the clinician. the Oscars were on.
Therefore, asking about specific amounts and spe- R.D.: Yes, I always watch. I didnt drink anything.
Substance Use Disorder Presenting as a Mood Disorder 235
Interviewer: O.K., How about Saturday night? Psychiatric Association 2000) criteria for abuse and
That was the night after the presidential de- dependence, which primarily have to do with conse-
bate. quences of substance use and the compulsive drive
R.D.: Well, my sorority gave a party, so of course to use.
I drank a lot.
Interviewer: How much?
Substance Use Patterns and History
R.D.: Oh, I dont know. Maybe four or five
drinks. Ms. R.D. first began using substances at age 15,
Interviewer: What kinds of drinks did you have? when she started smoking marijuana two or three
R.D.: Well, I started with a couple glasses of wine, times per month. At age 17 she began to drink alco-
and then I had some tequila shots. And then hol heavily and at age 18 began snorting cocaine. For
some vodka shots. the past 4 or 5 months, she reports drinking much
Interviewer: About how many ounces do you more than usual for her, drinking on average three
think were in each glass of wine? times a week, typically consuming between five and
R.D.: An average size glass. seven drinks in a single sitting. As the TLFB method
Interviewer: About 5 ounces in each glass? (ges-
revealed, she had consumed 18 standard drinks in the
turing with hand to mark size)
week preceding the interview. She reports drinking
R.D.: That looks about right.
even more if there are parties in the dormitories.
Interviewer: And how many ounces in the tequila
and vodka shots? She has tried to cut back on her own in the pre-
R.D.: I guess about an ounce. ceding couple of months but has been unable to do
Interviewer: And how many shots total? so. She also reports that once she begins drinking,
R.D.: Wellmaybe fiveor six. even if she only intends to have one or two, she finds
she is not able to stop drinking. She admits she plans
By using this method, we discover that Ms. R.D. her entire day, and even her week, around going out
drank eight standard drinks on the preceding Satur- to drink and that it is the only thing she looks for-
day night, as opposed to the four or five she orig- ward to all day long. She states that she lives in a so-
inally quoted. By continuing the TLFB method for rority and that her entire social life revolves around
the remainder of the week, we discover that Ms. going out and partying with her friends.
R.D. had consumed 18 standard drinks in the week When asked about other drugs currently used,
preceding the interview. Even she is surprised by the she endorses habitual cocaine use for 3 months, up
actual amounts once it is all added up. Clearly her until 3 weeks ago, when she stopped cold turkey.
level of consumption is in the hazardous range (see Prior to 3 weeks ago, she snorted one to two lines
Table 261) and alerts us (based on amounts and pat- during the week, and up to four or five lines per
tern of use alone) to the probability of a substance night on the weekends. She smokes approximately
use disorder. With that information we put more five cigarettes a day but can smoke up to a pack in a
time and emphasis on eliciting a detailed substance single sitting if she has been drinking heavily: Then
use history, now focused on DSM-IV-TR (American I smoke until my throat hurts.
236 How to Practice Evidence-Based Psychiatry
Differentiating Primary From Focusing on more recent events, Ms. R.D. de-
scribes extreme euphoric moods alternating with
Secondary Psychiatric Symptoms
depression, her primary reason for presenting to our
After gathering a detailed substance use history, we clinic. Her high moods generally coincide with co-
obtain a detailed mood history with the intention of caine intoxication, and the low moods with cocaine
sorting out the relationship, if any, between the psy- withdrawal. She has been persistently depressed in
chiatric symptoms and the substance use. This the 3 weeks prior to presenting in our clinic, after
method creates a more objective view of the rela- her abrupt discontinuation of cocaine. Before begin-
tionship between substance use and psychiatric ning heavier cocaine use 34 months ago, her mood
symptoms than if we asked the patient Which came would fluctuate, but not to such an extreme.
first, the depression or the drinking? In our experi- With this information, we are now ready to make
ence, a question asked in that way will more likely a preliminary diagnosis.
than not get a response that attributes substance use
to the psychiatric illness (the self-medication hy-
pothesis), even when the actual pattern is not con- DSM-IV-TR Diagnosis
sistent with this explanation. This is not always Axis I Substance-induced mood disorder; rule
because patients are intentionally duplicitous, but out primary mood disorder (major de-
rather because the human brain is seeking to ascribe pressive disorder vs. bipolar disorder); al-
a rational cause to an irrational behavior (i.e., sub- cohol dependence, binge type; nicotine
stance abuse) and because framing substance use as a dependence; cocaine dependence; mari-
side effect of illness may alleviate shame in the pa- juana abuse; cocaine withdrawal
tients mind. Axis II Deferred
In obtaining this history, we are particularly in- Axis III At risk for sexually transmitted diseases
terested in periods of sustained sobriety when we Axis IV Compromised role functioning, trouble
might analyze the patients mood patterns free of the with schoolwork
cycle of intoxication and withdrawal. We also focus Axis V GAF scale score: 50, moderate to severe,
on time of onset, although both mood disorders and with role impairment and passive suicidal
substance use disorders tend to progress insidiously, ideation
making differentiation between primary and sec-
ondary mood disorders difficult (Mueser et al.
1998). Due to retrospective bias, clarification of pri-
Differential Diagnosis
mary versus secondary psychiatric symptoms is best We do not make a diagnosis of mood disorder at this
done with prospective charting of mood during a pe- time, because we feel based on her history and pre-
riod of confirmed abstinence. senting symptoms that all of Ms. R.D.s problems
Ms. R.D. reports that her mood swings started in may be substance induced. Her euphoric moods
high school, fluctuating wildly up and down, but that may be entirely explained by cocaine intoxication,
she never sought or received professional treatment and her recent persistent depression by cocaine
for this problem and that it never impaired her func- withdrawal. Her more remote history of mood fluc-
tioning. She states that her mood problems predated tuations is so intertwined with substance use, with-
her substance use problems and that she began out any clear antecedent or sustained period of
drinking to self-medicate her depression, although sobriety (greater than 1 month), that we are unable
this information is at odds with the substance use to differentiate substance-induced mood fluctua-
history she gave earlier in the interview, in which she tions from mood disorder. Ms. R.D.s recent anxiety
stated that alcohol and marijuana use began at age and insomnia are certainly also attributable to her
15, around the same time her mood problems began. ongoing hazardous alcohol use and daily cigarette
When asked to clarify, she reports that she would go smoking. Nonetheless, we are not ruling out the
for a month at a time without drinking or using mari- possibility that she has an independent mood dis-
juana in high school and still had mood problems, al- order, and we will use prospective analysis during a
though she has had no period of abstinence longer period of sobriety to make a more definitive conclu-
than a month since matriculating high school. sion.
Substance Use Disorder Presenting as a Mood Disorder 237
TABLE 262. VHA/DoD clinical practice guideline for the management of substance use
disorders for patient R.D.
FIGURE 261. Rates of alcohol consumption, based on standard drinks, for women in the
United States ages 1825 years and for patient R.D.
Source. Kenneth R. Weingardt, Center for Health Care Evaluation, VA Palo Alto Health Care System and Stanford University
School of Medicine; National Survey on Drug Use and Health (SAMHSA 2008).
and out-of-control nature of her use but is not able principles, in suggesting an abstinence trial we do
to clearly state any negative consequences. We help not label her as alcoholic. Rather, we ask her to
her identify some of the negative consequences, in- conduct an experiment, so to speak, to help her and
cluding exposing herself to sexually transmitted dis- us understand how serious her drinking is.
eases; doing poorly at school; and possibly causing We revisit Ms. R.D.s specific chief complaint:
depression, anxiety, and insomnia, in the short-term mood swings, insomnia, and anxiety and feeling
and liver and lung damage in the long term. We talk very sad in the 3 weeks prior to her appointment.
about the cognitive and emotional problems that We reiterate that dysphoria, insomnia, and anxiety
can result as a direct response to substance use. are the most common and pervasive symptoms of
When the patient reports that substances feel withdrawal from any addictive substance, no matter
good in the short term, no effort is made to argue. the type, and although substances may help with
Following the precepts of the evidence-based treat- these symptoms in the short term, they will create
ment known as motivational interviewing, we do not these symptoms once the individual is in the cycle of
try to argue patients out of what they perceive as the intoxication and withdrawal. Many patients present-
positives of their behavior. Rather, we attempt to ing to our clinic insist that their depression, insom-
balance these immediate rewards with information nia, anxiety, and so on cause them to use substances
about longer-term costs. Ms. R.D. is able to tolerate and that if we would only cure their psychiatric
hearing this information, but she responds with I problems, their substance use would disappear. We
really dont think I am an alcoholic. If I really wanted know based on evidence in the literature and our
to, I could stop drinking. Here is our opportunity own clinical experience that treating the mood or
then, to ask her to do just that (see Recommendation anxiety disorders seldom if ever resolves the sub-
#2). Again following motivational interviewing stance use disorder and that psychiatric symptoms
240 How to Practice Evidence-Based Psychiatry
are in general very resistant to treatment in the con- R.D. who do not self-identify as having a substance
text of a co-occurring substance use disorder. Numer- use disorder and who present for treatment of psy-
ous studies treating mood problems prospectively in chiatric problems other than substance use, we typ-
patients with co-occurring substance use problems ically begin by suggesting an agreed-upon period of
demonstrate that substance use problems do not abstinence as a test of the patients control over sub-
generally resolve when mood issues are treated stances and as a means by which to better evaluate
(Nunes and Levin 2004). Addiction appears to have their presenting psychiatric problems. We also let
an illness course independent of mood outcomes them know that even if they are unable to adhere to
and needs its own treatment strategy. For an excel- the contract, they may want to consider the possibil-
lent review addressing the question of which came ity that they do not have the control they thought
first, the substance use or the mood problems, please they had, in which case we might need a more spe-
see Dual Diagnosis: A Review of Etiological The- cific and extended intervention for a substance use
ories, by Mueser et al. (1998). It is our very impor- disorder, such as Alcoholics Anonymous. Practice
tant job to educate patients that even if relief from guidelines recommend referral of all serious cases of
negative emotions is what causes them to initiate drinking problems to Alcoholics Anonymous or
substance use, the pattern of abuse and dependence other self-help groups, and both research literature
is a disorder distinctly its own and needs and de- and our clinical experience support this suggestion
serves to be treated as well. (Humphreys 2004).
Less commonly appreciated in cases like that of
Ms. R.D., self-help groups can actually benefit pa-
Recommendation #2 tients who never attend them, because for the aver-
age person, needing to go to Alcoholics Anonymous
Inform the patient about safe consumption limits
meetings is a common-sense sign that their alcohol
and offer advice about change.
problem is indeed quite serious. This may be quite
We inform Ms. R.D. that hazardous alcohol use motivating during a trial of abstinence (e.g., I
for an adult woman is more than seven drinks in a sin- would rather quit on my own than have to admit that
gle week, and more than four drinks in a single sit- I need Alcoholics Anonymous).
ting, and that all-cause morbidity and mortality is We also ask our patients to consider stopping
lowest for women who consume fewer than two stan- smoking. Psychiatrists tend to defer smoking cessa-
dard drinks per week (Swift 1999). However, in the tion treatment to a time when the patient is not in
context of out-of-control and compulsive use, absti- acute crisis. However, there is mounting evidence
nence from all substances may be the best alternative, that depressed smokers are both willing and able to
primarily because individuals with alcohol depen- quit smoking at rates similar to nondepressed smok-
dence have great difficulty limiting their use. Absti- ers and that the risk of depression in the wake of
nence is also a recommended course of action when smoking cessation is much less than previously be-
psychiatric symptoms are prominent, in order to help lieved. Furthermore, stopping smoking may im-
clarify what fraction of the patients symptoms is sub- prove psychiatric symptoms over the life course.
stance induced and what fraction represents another Our approach to this issue is discussed in detail later
Axis I disorder, such as major depression or panic dis- in this chapter.
order. We tell Ms. R.D. that smoking even a single
cigarette a day adversely impacts her lifetime mor- Recommendation #3
bidity and mortality and possibly contributes to her
symptoms of depression and anxiety. Offer to involve family members in this process to
After challenging Ms. R.D.s misperception about educate them and solicit their input (consent is
normal substance use, discussing the criteria for a required).
substance use disorder, educating her about the ad-
verse consequences of substance abuse, and offering We typically ask patients to involve family mem-
information about safe consumption, we make our bers, as long as the specific family member is clearly
first suggestions for change. For outpatients like Ms. a positive influence and understands the process of
Substance Use Disorder Presenting as a Mood Disorder 241
recovery from addiction. In Ms. R.D.s case, her fa- As mentioned earlier, we recommend that Ms.
ther is an active alcoholic and her mother a chronic R.D. identify individuals and activities that might
bulimic, not to mention that they are both living on help her avoid substance use. We discuss triggers for
the other side of the country from our patient. In substance use, such as sorority parties, and talk
cases like these, we do not involve family members about whether she could avoid the parties altogether
but instead embark on a discussion of the environ- or, if not, develop strategies to abstain from sub-
mental factors contributing toward a patients sub- stance use while attending the parties. We recom-
stance use. An ecological approach to addiction mend getting rid of all substances and substance
treatment underscores the importance of context paraphernalia, including running water over her re-
and social relations in the cycle of addiction. maining cigarettes before disposing of them in her
Ms. R.D. lives in a sorority with a reputation for garbage can, and so on. Importantly, we emphasize
partying and has a circle of friends, including a boy- to Ms. R.D. that whether or not she is successful in
friend, with whom she habitually drinks to get drunk. this 4-week trial of abstinence, we want to see her,
In other words, the network of people at the center we want to hear from her, we are here to care for her.
of her life use substances. It is essential to explore We give her our contact information and carte
with substance usedisordered patients how the rela- blanche to call us with any questions or concerns.
tionships in their lives will be affected if they stop us- We warn her again that initially her symptoms of
ing substances. Not uncommonly, removing the low mood, anxiety, and insomnia may get worse be-
major shared activityand one that at least part of fore they get better, due to early withdrawal, but that
the time is quite rewardingcan threaten the foun- if she is able to remain abstinent or even substan-
dation of the relationship. We try to acknowledge tially reduce her use, we believe she will begin to feel
that stopping substances may have a destabilizing ef- better in 24 weeks. If at that time, with abstinence,
fect on the patients social milieu. Likewise, we ask she continues to have psychiatric symptoms, we as-
patients to identify who in their lives might help sure her that we will proceed with treatment for a
them stop using substances and encourage them to mood disorder. We warn her about more serious
seek out settings in which substances are not used, withdrawal symptoms, such as delirium tremens and
which may range from religious organizations to cul- seizure, although we do not feel she is at risk for
tural/civic clubs to athletic teams or study groups. these. Although withdrawal risk is not extremely
Depending on the arrangements available on the high in Ms. R.D.s case, it is worth mentioning that
campus, another possibility when necessary is to shift in many cases, particularly those that are more se-
living arrangements to a dry floor in a dormitory. vere, we often refer to the Clinical Institute With-
drawal Assessment for Alcohol (Sellers et al. 2008).
This instrument screens medical and surgical pa-
Recommendation #4 tients for the risk of developing alcohol withdrawal
syndrome and is published in the Handbook of Psychi-
Assess patients degree of readiness for change
atric Measures by Rush et al. (2008). It can also be
(e.g., How willing are you to consider reducing
found on the Internet.
your use at this time?).
TABLE 263. Indications for using naltrexone and disulfiram for alcohol dependence,
according to VHA/DoD guidelines
Naltrexone Disulfirama
Alcohol dependence with: Alcohol dependence with:
Ability to achieve at least 35 days of abstinence to Abstinence >24 hours and blood alcohol level= 0
rule out the need for detoxification
Drinking within the past 30 days and/or reports of Combined cocaine and alcohol dependence
craving
Most effective when the patient is engaged in Failure of or contraindication to naltrexone
addiction-focused counseling
Previous response to disulfiram
Patient preference
Capacity to appreciate risks and benefits and to consent
to treatment
Note. VHA/DoD= Veterans Health Administration/Department of Defense.
a
Most effective with monitored administration (e.g., in clinic or with spouse or probation officer).
Source. Veterans Health Administration/Department of Defense 2004.
dependence is not extremely advanced, her readi- of reduced or abstinent substance use. If the patient
ness for change, and the lack of any recent prior quit is not able to reduce or abstain from substances,
attempts, we decide to bypass addiction pharmaco- their shame often leads them to consciously or un-
therapy, at least initially. However, we do offer low- consciously forget their appointment with us.
dose trazodone, an antidepressant which is an effec- Therefore it becomes essential for us to initiate con-
tive, nonaddictive sleep aid. She declines. tact and reemphasize our involvement in their treat-
ment, no matter their current substance use. In our
Recommendation #7 experience, a phone call like this usually brings the
patient in. If the clinician does not call the patient,
Schedule an initial follow-up appointment in 24 the patient will likely not return to treatment.
weeks. We call Ms. R.D., and she states that she had for-
gotten the appointment but says she is doing better,
Given the severity of Ms. R.D.s substance use, in- has drastically reduced her alcohol consumption,
cluding a severe binge drinking pattern and the use and is not using any other substances except for oc-
of illicit drugs as well as her passive suicidal ideation, casional nicotine. She is unable to be specific as to
we feel it is important to see her back within a week the precise amounts of substances consumed, al-
and to establish a safety contract for her to call us if though we believe her report of substantial reduc-
she gets much worse in the interim. Ms. R.D. agrees tion. We emphasize how important it is for her to
to this plan, yet she does not appear for her next ap- come in and see us, and indeed the next week she
pointment. comes to her appointment. Her mood seems upbeat,
We frequently experience this phenomenon: A and she reports that she is sleeping better than she
patient expresses willingness to a trial of reduced has in years, and her mood is much steadier. She has
substance use or abstinence and then does not ap- decided to tell everyone in her sorority, and her boy-
pear at the follow-up appointment. It represents an friend, that she has had to stop drinking and using
important juncture in the treatment of addicted pa- drugs, and to her great surprise, they are very sup-
tients. It is essential that we call the patient at this portive. Her boyfriend apparently comments that he
time and emphasize to them that we want to see likes her better off drugs because she isnt so
them, that we care about them, and that this is true loopy. Life is looking up, and we continue the same
even if they were not able to adhere to the contract treatment plan, encouraging her to try to further re-
Substance Use Disorder Presenting as a Mood Disorder 243
duce her alcohol consumption down to nothing and and continues to be abstinent from cocaine and mar-
to even try to abstain from cigarettes, which she is ijuana. We immediately call her back and suggest
now smoking at the rate of three or four per week. she stop the bupropion until further discussion at
We schedule an appointment for 2 weeks from now. her next visit, scheduled for the next week.
Recommendation #8 Recommendation #9
Offer and recommend smoking cessation treat- Monitor changes at follow-up visits by asking pa-
ment to every patient who is dependent on nico- tient about use, health effects, and barriers to
tine. Use the VHA/DoD Clinical Practice Guide- change.
line for the Management of Tobacco Use (Veterans
Health Administration/Department of Defense When Ms. R.D. presents for her fourth appoint-
2004). ment, 5 weeks from her initial presentation, she re-
ports that her sleep has continued to be poor, even
Nicotine dependence is a diagnosis that is too of- after stopping the bupropion, although still not as
ten ignored and minimized by mental health care bad as before she initially presented. She also reports
providers (Himelhoch and Daumit 2003). We feel that her mood is consistently low nearly all day, 23
strongly that nicotine dependence should be included days a week. She is not suicidal, she has continued to
in the diagnoses and aggressively treated, and this abstain from marijuana and cocaine, and her alcohol
viewpoint is supported by the VHA/DoD guideline consumption has gone down to zero for the past
as well as most other guidelines. Although most clini- week, in the hope that complete abstinence would
cians would have stronger concern about alcohol and buoy her mood. Despite these efforts, she finds her-
cocaine use in cases like that of Ms. R.D., the epide- self getting progressively more depressed. She is still
miologic reality is that, on average, nicotine is far smoking, and even increased her cigarette use to five
more likely to result in death over the lifespan of such or six per week, or approximately one per day. Al-
individuals. Nicotine addiction is the highest contrib- though we are of course concerned about Ms. R.D.s
utor toward morbidity and mortality in this country, downturn in mood, we are very encouraged that she
taking up to 350,000 lives every year. It is important called us about it and that she continues to refrain
for mental health care providers to identify nicotine from hazardous substance use, because it suggests
dependence as a health care issue and to discuss treat- we have been successful in making a strong thera-
ment options, lest they covertly communicate that peutic alliance, despite a somewhat rocky start.
smoking is not a problem (Lembke et al. 2007).
Ms. R.D. is initially able to reduce her daily ciga- Recommendation #10
rette consumption but not cut cigarettes out alto-
gether. We take time at her third visit to address Treat concurrent psychiatric disorders, including
nicotine again and to encourage her to stop smoking concurrent pharmacotherapy.
completely. We offer a U.S. Food and Drug Admin-
istrationapproved smoking cessation remedy, There is no evidence base by which to judge how
namely bupropion (Wellbutrin or Zyban) and nico- long a patient needs to abstain from substances be-
tine replacement therapy, and encourage her to set a fore one can determine whether psychiatric symp-
specific quit date, both interventions that have been toms are substance induced or represent a forme
associated with the best outcomes. Ms. R.D. accepts fruste mental illness other than a substance use dis-
a smoking cessation trial intervention with bupro- order. DSM-IV-TR recommends a minimum of
pion; however, 3 days into treatment with bupro- 4 weeks, and in working in our clinic, we like to see a
pion, prior to quitting smoking, she calls to report minimum of 4 weeks of abstinence (or at worst, min-
she is feeling very jittery and amped and is unable imal use) before we make the diagnosis. Every case is
to sleep. Her mood is euthymic with brief period of different, however, and there is no hard-and-fast
feeling down, lasting less than half a day. She has rule that can eliminate the need for clinical judg-
maintained a lower level of alcohol consumption ment when one is making these difficult determina-
244 How to Practice Evidence-Based Psychiatry
tions. In the case of Ms. R.D., we feel that her months into treatment, the patients mood and func-
downturn in mood after 45 weeks of significant tioning is significantly improved, and she has largely
substance reduction and abstinence from many sub- eliminated all substance use, except for the occa-
stances she had previously been abusing, along with sional alcoholic beverage and cigarette. She contin-
her long history of mood instability, is enough to ues to do well for the entirety of the academic year
convince us that she probably has a mood disorder as but is lost to treatment after the summer break.
well. Given her predominantly depressed mood
with prominent anxiety and insomnia, and her poor
reaction to bupropion, we decide to start her on the
Ways to Improve Practice
selective serotonin reuptake inhibitor citalopram. We made a significant error in this case by not work-
She responds well, with improvements in sleep, ing out a system for the patient to track her con-
mood, and anxiety. She remains largely abstinent sumption during treatment. We were thus left to
from substances, and when she does use alcohol and/ accept her account of substantial reduction in al-
or nicotine she does so in moderation. She continues cohol consumption and occasional use of nicotine
to struggle with affect regulation and self-esteem, without knowing the exact meaning of these terms.
and for these issues we refer her to psychotherapy Careful monitoring is desirable in several respects
and a skills training group, which emphasizes dis- (Kanfer and Scheft 1988). First, monitoring reduces
tress tolerance and mindfulness meditation. She the behavior through reactance. Second, it allows
does well for 8 months and then completely disap- both the patient and provider to see change over
pears from treatment after the summer break from time, which can be motivating and informative for
school. We have not seen her in several years. care planning. Patients like Ms. R.D. who drink in
social situations are often averse to monitoring, and
in such cases it is useful to develop a covert strategy,
Summary for example, moving a coin from the right pocket to
The patient presents with a chief complaint of mood the left for each drink that is taken.
instability marked most recently by depression with
fleeting suicidal ideation, but no imminent threat to
References
herself or others. A careful screening for alcohol
consumption, focusing initially on amounts and fre- American Psychiatric Association: Diagnostic and Statistical
Manual of Mental Disorders, 4th Edition, Text Revision.
quency in the past week using the TLFB, reveals a
Washington, DC, American Psychiatric Association, 2000
level of alcohol consumption far above what is con-
Danielsson PE, Rivara FP, Gentilello LM, et al: Reasons why
sidered safe and well within the hazardous range. trauma surgeons fail to screen for alcohol problems. Arch
This discovery prompts an in-depth substance use Surg 134:564568, 1999
screening and history, which in turn reveals nicotine Himelhoch S, Daumit G: To whom do psychiatrists offer
dependence, cocaine dependence, marijuana abuse, smoking-cessation counseling? Am J Psychiatry 160:2228
and probably cocaine withdrawal. Keeping the pa- 2230, 2003
tients chief complaint in mind, we give feedback Humphreys K: Circles of Recovery: Self-Help Organizations
for Addictions. Cambridge, UK, Cambridge University
about the substance use screening results, educate
Press, 2004
her about safe levels of drinking, challenge normal-
Kanfer FH, Scheft BK: Guiding the Process of Therapeutic
ization of her substance use, and negotiate strategies Change. Champaign, IL, Research Press, 1988
for change, using her chief complaint as incentive to Kessler RC, Nelson CB, McGonagle KA, et al: The epide-
target substance use. Four to five weeks after the pa- miology of co-occurring addictive and mental disorders:
tient commits to change and markedly reduces her implications for prevention and service utilization. Am J
substance use, she still experiences symptoms of de- Orthopsychiatry 66:1731, 1996
pression, at which point we begin treatment with an Kessler RC, Berglund P, Demler O, et al: The epidemiology
of major depressive disorder: results from the National
antidepressant medication, even as we continue to
Comorbidity Survey Replication (NCS-R). JAMA
assess and intervene in the substance use problems.
289:30953105, 2003
We also offer a psychotropic agent for smoking Lembke A, Johnson K, DeBattista C: Depression and smok-
cessation treatment, but the patient does not toler- ing cessation: does the evidence support psychiatric prac-
ate the medication and discontinues it. Four to five tice? Neuropsychiatr Dis Treat 3:17, 2007
Substance Use Disorder Presenting as a Mood Disorder 245
Mueser KT, Drake RE, Wallach MA: Dual diagnosis: a review Swift RM: Drug therapy for alcohol dependence. N Engl J
of etiological theories. Addict Behav 23:717734, 1998 Med 340:14821490, 1999
Nunes EV, Levin FR: Treatment of depression in patients U.S. Preventive Services Task Force: Guide to Clinical Pre-
with alcohol or other drug dependence: a meta-analysis. ventive Services, 2nd Edition. Washington, DC, Office
JAMA 291:18871896, 2004 of Disease Prevention and Health Promotion, 1996
Rush AJ, First MB, Blacker D (eds): Handbook of Psychiatric Veterans Health Administration/Department of Defense:
Measures, 2nd Edition. Washington, DC, American Psy- Clinical Practice Guideline for the Management of Sub-
chiatric Publishing, 2008 stance Use Disorders. VA Office of Quality and Perfor-
Sellers EM, Sullivan JT, Somer G, et al: Clinical Institute mance. Washington, DC, Department of Veterans
Withdrawal Assessment for Alcohol (CIWA-AD), in Affairs/Department of Defense, 2001
Handbook of Psychiatric Measures, 2nd Edition. Edited Veterans Health Administration/Department of Defense:
by Rush AJ, First MB, and Blacker D. Washington, DC, Clinical Practice Guideline for the Management of To-
American Psychiatric Publishing, 2008, pp 460461 bacco Use. Management of Tobacco Use Working
Sobell LC, Sobell MB: Alcohol Timeline Followback Users Group. Washington, DC, Department of Veterans Af-
Manual. Toronto, ON, Canada, Addiction Research fairs, 2002. Available at: http://www.healthquality.va
Foundation, 1995 .gov/tuc/tuc_fulltext.pdf
Substance Abuse and Mental Health Services Administration Veterans Health Administration/Department of Defense:
[SAMHSA]: Results from the 2007 National Survey on Clinical Practice Guideline for the Management of Sub-
Drug Use and Health: national findings (NSDUH Series stance Use Disorders: Guideline Summary, v.2.0. Man-
H-34, DHHS Publ No SMA 084343). Rockville, MD, agement of SUD Working Group. Washington, DC,
Substance Abuse and Mental Health Services Adminis- Department of Veterans Affairs, 2009. Available at: http:/
tration, Office of Applied Studies, 2008 /www.healthquality.va.gov/sud/sud_sum_v2_0.pdf
This page intentionally left blank
27
A Complex Personality
Disorder Case
James Reich, M.D.
247
248 How to Practice Evidence-Based Psychiatry
general, the medications had been given during pe- The obsessive symptoms were also clearly a major
riods of significant exacerbation of symptoms at rel- problem. Here we follow the American Psychiatric
atively high dosages and then tapered off. At the Association guidelines for treatment (Koran et al.
time he presented to me he was on a very low dose of 2007).
a selective serotonin reuptake inhibitor (SSRI) and a
medication for sleep as needed. Secondary Problems and Issues
Of concern is Mr. Xs episodic binge drinking. Al-
Other Significant Findings though not frequent, it could have significant life
From Assessment consequences. Another secondary issue is his de-
pression, which although not current would repre-
Mr. X had had periods of depression that were sent a potential future problem.
treated with antidepressants, raising the possibility
of major depressive disorder. Treatment Goals, Measures,
His binge drinking, although not frequent, could and Methods
involve as many as 10 drinks in an evening and result
Table 271 shows the treatment goals, measures,
in risky behavior.
and methods for Mr. Xs case.
His lack of structure and his anxiety had resulted
in a somewhat reversed sleep-wake cycle.
Course
Differential Diagnosis The guidelines for borderline personality disorder
Most of the diagnostic issues were fairly straightfor- and OCD, cited earlier, emphasize the formation of
ward. The only real question was whether some of a good therapeutic relationship with the patient,
the personality symptoms were due to state effects stressing psychotherapy. Mr. X and I set up weekly
that would be reduced by treatment of the comorbid meetings and decided on a cognitive-behavioral ap-
Axis I disorder(s) (Reich 2007). proach, which fit both the treatment guidelines for
borderline personality disorder and OCD and the
patients own preferences. Initially we made no
DSM-IV-TR Diagnosis changes to his medications, but we spent time un-
Axis I OCD derstanding Mr. Xs symptoms and establishing a re-
Alcohol abuse lationship.
Rule out major depression It became clear that Mr. X had such overwhelm-
Axis II Borderline personality disorder ing anxiety that we would need to proceed with
Avoidant personality disorder some medication relief to allow him to be calm
Axis III No significant medical problems enough to make progress. He had had sexual side ef-
Axis IV Unemployment, lack of structure fects on increased SSRI dosage in the past and was
Axis V GAF score: 52 reluctant to try another antipsychotic, which he also
had tried in the past. Benzodiazepines were con-
Treatment Plan Considerations traindicated by the borderline personality disorder
treatment guidelines because they could exacerbate
Primary Problems and Guideline Selection impulsive behavior and might not be helpful for
Personality pathology was clearly a major problem binge drinking. The World Federation of Societies
for this patient. There are no algorithms for the of Biological Psychiatry guidelines (www.wfsbp.org/
treatment of personality disorder in general, but the treatment-guidelines.html) indicated that avoidant
American Psychiatric Association does have guide- personality disorder might be treated similarly to
lines for the treatment of borderline personality dis- generalized social phobia, which would respond to
order (Oldham et al. 2001). In addition, the World benzodiazepines (Reich 2009). Ultimately we tried a
Federation of Societies of Biological Psychiatry has combination of clonazepam 0.5 mg in the morning
guidelines for the biological treatment of personal- and alcohol education, alcohol counseling, and very
ity disorders (Herpertz et al. 2007) careful alcohol and drug intake monitoring.
A Complex Personality Disorder Case 249
Establish a treatment relationship to work Attendance and treatment Weekly cognitive and behavioral
together in psychotherapy (ability to compliance psychotherapy
communicate difficulties and
collaboratively work out plans to
approach them)
Reduce personality symptoms Ability to follow through in feared Medication and cognitive and
characterized by avoidance situations such as job interviewsa behavioral therapy
Reduce personality symptoms Episodes of socially inappropriate Medication and developing
characterized by impulsivity and anger anger or impulsive behavior alternate strategies to deal with
uncomfortable feelings
Reduce obsessive symptoms Level of obsessive thoughtsa Medication and cognitive and
behavioral therapy
Reduce frequency of episodic binge Episodes of binge drinking Alcohol education and counseling
drinking
a
Measured on a nonstandardized 010 scale.
The use of a benzodiazepine in a patient with im- some point (not then). He tried limiting his drinking
pulse-control problems and binge drinking was in social situations but was not very successful. He
clearly a difficult risk management decision. I chose made an attempt at abstinence that failed. Later, he
a longer-acting benzodiazepine to reduce addictive made a second attempt at abstinence that went better
potential and used this medication in small regular and that he thought helped his overall mental health.
doses. There were to be no as needed doses, and His functional status improved somewhat, and he
Mr. X understood that any escalation in dosage or signed up for education classes to bolster his areas of
change in drinking patterns would result in stopping expertise, but progress was not as fast as we hoped.
the clonazepam. To ensure compliance, prescription Very far into the therapy Mr. X brought up a sexual
amounts and dates were closely monitored. Also, at trauma that he had experienced as a teenager, which
least at first, each session would involve discussion of seemed to have a connection with his impulsivity
alcohol and/or use and relevant education. and anger. The therapy then focused on this area,
Mr. Xs anxiety was reduced enough to focus on which is ongoing.
some of the OCD symptoms. Following medication The goals to establish a relationship with a signif-
treatment consistent with both borderline and OCD icant other and return to the workplace are works in
guidelines we increased his SSRI incrementally to progress.
100 mg (where side effects precluded going higher)
and ultimately added the antipsychotic quetiapine Tables of Improvement
50 mg at night. The quetiapine helped both his Tables 272 through 276 describe the patients im-
OCD symptoms and his reversed day/night cycle provement during the course of treatment.
and was consistent with borderline personality dis-
order guidelines. The medication was combined
with behavioral and cognitive techniques, which he Ways to Improve Practice
was able to apply reasonably well. We used these There are real challenges to using guidelines when a
same techniques to work on his social avoidance. I patient has multiple significant problems. These
felt this was an area in which progress could be made challenges include lack of guidelines (i.e., treatment
and that would give Mr. X more self-confidence. of avoidant personality disorder or a mixture of per-
The alcohol treatment started with Mr. X coming sonality disorders); the possibility of conflicting ad-
to the conclusion he would want to stop drinking at vice as to the use of a particular technique (e.g., use
250 How to Practice Evidence-Based Psychiatry
Weeks 010 Weeks 1120 Weeks 2130 Weeks 3140 Week 41 onward
Trials and discussion Some successful Cognitive and Continued use of all Specific discussions
of different adjustment of behavioral of the earlier of sexual obsessions
medications (many current medications techniques with techniques Score=2
of which did not (selective serotonin much emphasis on Score=3
work or could not reuptake inhibitor) exposure and
be tolerated) and addition of new response prevention
Score= 9 medications Score=4
(atypical
antipsychotic)
Score=6
A Complex Personality Disorder Case 251
Bulimia Nervosa
Joanna M. Marino, M.A.
James E. Mitchell, M.D.
253
254 How to Practice Evidence-Based Psychiatry
age 15 but arent as intense as they were when they Allison reported eating quickly and feeling as if
first occurred. She denied past psychological treat- she blacked out when she had a binge eating epi-
ment for any mental health concerns. sode. She stated, I know what Im doing, bingeing
At age 15, Allison began to gain weight. Her high- on all that food, I just cant stop. She became over-
est weight was 140 lb. She then began to diet, reduc- whelmed with a sense of guilt after her eating epi-
ing her intake to 1,200 calories per day. She reported sodes and then vomited several times. The vomiting
that this dieting lasted about a month and that she decreased her anxiety and clears my head I dont
lost approximately 8 lb. On a Saturday when her par- have to worry when Im binge eating and I can then
ents were away, she experienced a binge eating epi- just get rid of the food. Allison related her de-
sode. She then developed a pattern of binge eating pressed mood to her inability to control her food in-
every weekend and then restarting her dieting pat- take and feeling fat. She desired to weigh 110 lb
tern every Monday. After about 2 months in this pat- (BMI= 18.9).
tern, Allison experienced a binge eating episode that
was larger than her prior episodes. She felt the urge Social History
to vomit in order to feel just a little less stuffed.
Vomiting came easily to Allison and she thought she Allison reported three or four close friends through-
could be successful at losing more weight if she vom- out her schooling and several acquaintances. She
ited after each dinner. Allisons binge/purge cycle had been involved in soccer and tennis during eighth
then became more frequent and was occurring at grade; however, she quit both teams to pursue her
least once per day by the time she was 17. interest in playing piano, drawing, and painting. At
the time of her evaluation she had very few friends.
History of Substance Abuse She denied involvement in a romantic relationship.
The patient reported drinking one or two alcoholic
drinks once monthly. She smoked marijuana on Educational and Occupational
three occasions in tenth grade and related this to History
peer pressure. She denied use of any other sub-
The patient completed the twelfth grade and at-
stances.
tained her associates degree in graphic design at a
local community college. She worked at a fast food
Exercise, Diet, and Stress Management
restaurant during high school and then began work-
Allison exercised five times weekly for 1.5 hours ing at a well-known local graphic design studio after
during each episode. Her exercise routine included meeting the owner through an acquaintance.
running for 60 minutes and a weight-lifting routine
lasting 30 minutes. She reported exercising even
though on most days she felt fatigued. She had had Family History
some dizziness when running. Her meal plan was Allison was raised by her biological mother and fa-
also quite stringent, including a diet of 1,500 calories ther. She had one older brother who was studying
per day and limited fat intake. However, on most medicine. She reported that her upbringing was
days she reported being unable to follow her diet goodjust typical, I guess. Her father was em-
and feeling ravenous when arriving home from ployed as an executive at a local grocery store, and
work at 6 P.M. She did not experience the urge to her mother was an administrative assistant. She re-
binge eat during the day; however, when leaving ported a good relationship with her brother and
work she became anxious about her performance parents but suggested her mother was sometimes
during the day. She reported intrusive thoughts of critical of her, accepting only A grades as good.
binge eating on her drive home from work and feel- Allison was on the B honor roll, and this was often
ing compelled to stop at the grocery store for a few a point of contention with her mother. Her mother
items to prepare for dinner. Her binge eating epi- was often concerned about what other members of
sodes always involved high-fat food items such as her church thought about the family and was fo-
pizza, cookies, chocolate milk, and chips. cused on appearing worry-freeor perfect.
Bulimia Nervosa 255
important variable in determining treatment out- and a primary physician. The team of providers had
come. There is also literature to suggest that inter- worked together for several patients and had a
personal therapy may be effective, although the data strong history of good communication about patient
are more limited and the treatment response seems needs and progress. This open communication was
to be somewhat delayed. In addition, there is some an essential component, especially when she became
indication that dialectical behavior therapy can be resistant to normalizing her eating out of fear of
helpful for some patients. gaining weight. The dietitian communicated with
The question often arises as to whether anti- the therapist through a hospital-wide computer sys-
depressant therapy and CBT should routinely be tem about progress and topics to address in therapy.
used in combination in the initial treatment of pa- Allison was referred to a dentist outside of the hos-
tients. Studies that have examined this question have pital system to address dental erosion secondary to
found some modest benefit for the addition of anti- her purging behavior.
depressants to CBT, but it is not clear that this out- Allisons initial assessment revealed comorbid
weighs the added costs and risks involved. Many anxiety and depression, which is common in eating
practitioners recommend beginning with CBT and disorder patients. Medication use can be imple-
adding antidepressant treatment if there is no evi- mented at the beginning of treatment or as treat-
dence of a fairly prompt response, demonstrated by ment progresses, depending on the severity of the
reductions in the frequency of targeted behaviors, comorbid psychological condition. It is important to
early in treatment. consider that mood and anxiety symptoms, espe-
As mentioned, individual and group psychothera- cially depression, can remit as binge/purge episodes
peutic interventions have been helpful in treating pa- subside, providing one reason for delaying the use of
tients with bulimia nervosa. Dietary consultation is pharmacological agents.
also beneficial in combination with psychotherapy. In addition to her psychological assessment, Alli-
Family-based interventions are especially useful for son was seen by a primary practice physician. Results
adolescents because interpersonal issues can be dis- of her medical assessment were largely within nor-
cussed in the context of eating-disordered behavior. mal limits. Given her medical stability, Allison was a
Self-help and support groups are also being studied good candidate for outpatient treatment. She was
for their effectiveness. followed monthly by the primary physician to en-
The American Psychiatric Association guidelines sure medical stability.
suggested aims for the treatment of individuals with
bulimia nervosa are incorporated into Table 281. Treatment Goals, Measures,
Note that the treatment interventions utilized target and Methods
pharmacological, medical, and psychological inter-
ventions. A team approach to treating patients with The goals, measures, and methods for this treatment
bulimia is valuable, especially when considering the are outlined in Table 281.
need for continued medication management and
psychological interventions. Additionally, patients
with medical or psychology comorbidities will need Course
continued assessment to determine the appropriate Allison met with the therapist twice weekly for the
level of care, especially if the patient fails to respond first 4 weeks of therapy, as is often indicated in CBT
to outpatient treatment. The treatment guideline for bulimia nervosa. The beginning of psychother-
provides detailed information regarding the appro- apy was marked by a focus on developing a thera-
priate level of care for eating disorder patients based peutic alliance. The therapist validated the role the
on several factors, including age, control over eating eating disorder behaviors served for Allison and pro-
disorder behaviors, medical status, and location. vided a supportive and open environment to discuss
The outpatient clinic where Allison received her concerns about the treatment course. This allowed
psychological treatment was composed of psycholo- for an environment in which Allison would feel
gists and psychiatrists. After the initial assessment, comfortable disclosing her eating and weight con-
the importance of a treatment team was discussed cerns. The therapist provided Allison with psycho-
with Allison. She was given referrals to a dietitian education regarding the hypothesized model that
Bulimia Nervosa 257
TABLE 281. Treatment goals, measures, and methods for a patient with bulimia nervosa
diagrammed the development and continuation of information about the pattern of eating Allison
her eating disorder as a means of helping Allison un- experienced during the day. In addition to the mon-
derstand the impact emotions, cognitions, social set- itoring logs, psychoeducation regarding the im-
tings, and behaviors can have on her eating disorder. portance of normalized eating was incorporated
The therapist also worked with Allison to create a throughout the sessions. Allison was quite resistant
treatment plan, which was a way to help her feel in to accepting the idea that eating throughout the day
control of her treatment and think of herself as a would not lead her to become fat, and she con-
member of a collaborative relationship. The practi- tinued to have episodes of morning restricting
tioner also suggested to Allison that use of a self- throughout the first half of treatment. Targeted be-
help guide could be a valuable aid understanding havioral interventions such as preplanning and pack-
eating disorders. Notably, the American Psychiatric ing meals was somewhat helpful in addressing her
Association treatment guideline provides a recom- restricting behavior, although her beliefs that feeling
mended list of readings that are beneficial to specific full meant she was fat likely hindered her ability to
patient groups and for families of those with eating change her eating patterns. Figure 282 depicts the
disorders. A practitioner may also consult the treat- reduction in Allisons binge/purge episodes. As
ment guideline for a list of recommended reading shown, her binge/purge episodes decreased steadily,
about the CBT treatment manuals and guides. but she continued to have periodic episodes. We be-
Allison was provided with monitoring logs to de- gan discussing alternative behaviors and coping
tail her eating episodes throughout the day (see Fig- skills that Allison was able to implement when she
ure 281). These monitoring logs provided valuable had urges to binge eat and purge. Allison, unlike
258 How to Practice Evidence-Based Psychiatry
Date: / /
some patients, enjoyed monitoring her eating be- environment. Relaxation techniques and coping
havior. Some patients feel that monitoring eating skills were used to target these anxiety symptoms.
behaviors makes them focus too much on their con- Allison was referred to a dietitian to address her
sumption habits. This tends to resolve in many pa- concerns regarding safe foods and to gain addi-
tients when they begin to see the benefit of analyzing tional information about nutrition. Allison contin-
their eating behavior during the session. ued to have bad or unsafe foods in her diet,
In the case of Allison, her binge/purge episodes which at times would trigger a binge episode. She
persisted and her mood remained depressed during was comfortable avoiding these foods during ther-
the first 4 weeks of therapy. A selective serotonin re- apy. As the eating patterns began to stabilize over the
uptake inhibitor (SSRI) was then added at week 4, second half of the treatment course, Allison was able
and a steady decrease in symptoms resulted. Various to expose herself to these feared foods and then uti-
pharmacological interventions have been effective lize her distraction behavior until the foods became
in treating bulimia symptoms, and an SSRI was cho- more tolerable.
sen because of its general tolerability by many pa- The final steps of Allisons treatment involved
tients. Allison reported decreases in her depression discussing a relapse prevention plan. Allison and the
and overall level of anxiety; however, she continued therapist worked on identifying triggers to a lapse in
to experience anxiety related to her strenuous work eating-disordered behavior and the use of problem-
solving skills to avoid a full relapse. Allison became Ways to Improve Practice
aware that minor setbacks were likely. Figure 282
In the case described, two improvements to treat-
displays the continued trouble Allison had in fully
ment could be considered. Allisons frequency of
stopping her binge eating episodes. The therapeutic
binge eating and purging decreased more slowly
relationship and collaboration that was established
when compared with most reports in the literature
in the beginning of treatment remained helpful in
regarding response patterns of bulimia nervosa pa-
motivating Allison to continue to journey toward re-
tients being treated with CBT. The use of antide-
mission of binge/purge episodes.
pressants was indicated here and was implemented in
In treating adolescents with eating disorders, fam-
Allisons case. The addition of a third therapy session
ily therapy is an important component because of the
per week could also have been very helpful in reduc-
continuous interaction with parents and food in the
ing the frequency in these behaviors. A relapse pre-
home. In adults, involving relationship partners in
vention plan that included follow-up visits would also
adjunct therapy sessions can be beneficial, especially
have been beneficial. Literature has suggested that
to aid in the monitoring of behavior or supporting
patients with bulimia may not necessarily pursue fol-
behavioral changes. Treatment manuals are available
low-up treatment if they experience relapses after a
for family-based therapy, and recommended read-
successful CBT intervention (Mitchell et al. 2004).
ings are listed in the treatment guideline.
Developing a schedule of monthly follow-up sessions
Allison was uninterested in involving her parents
could be helpful in preventing full-blown relapse.
in the therapy process, even with continued discus-
sion about the benefits of additional family therapy.
Allison was very hesitant about disclosing her behav- References
ior to her family. Her situation did, however, present American Psychiatric Association: Practice Guideline for the
Treatment of Patients With Eating Disorders, 3rd Edition.
an ideal opportunity for the involvement of parents,
Washington, DC, American Psychiatric Association, 2006.
especially because Allison has limited social support.
Available at: http://www.psychiatryonline.com/prac
She recognized that some of her anxiety and beliefs Guide/pracGuideTopic_12.aspx. Accessed June 18, 2009
about weight were likely related to her mothers dis- Beck AT, Steer RA, Brown GK: Beck Depression Inventory-
torted beliefs about appearance and perfection. If II Manual. San Antonio, TX, Psychological Corporation,
Allison had been willing to involve her family in 1996
therapy, supplemental sessions would have occurred Fairburn CG: Cognitive Behavior Therapy and Eating Dis-
to address the role of families in eating disorder eti- orders. New York, Guilford, 2008
Garner DM: Eating Disorder Inventory-3 (EDI-3) Profes-
ology and treatment.
sional Manual. Lutz, FL, Psychological Assessment Re-
sources, 2004
Summary/Conclusion Mitchell JE, Agras WS, Wilson GT, et al: A trial of a relapse
prevention strategy in women with bulimia nervosa who
The challenges in treating eating disorder patients respond to cognitive-behavior therapy. Int J Eat Disord
are the necessities of a multidisciplinary team ap- 35:549555, 2004
proach, continued assessment of medical symptom-
atology, and the risk of chronicity of the disorders. Suggested Readings
The treatment guideline provides valuable, explicit Fairburn CG: Overcoming Binge Eating. New York, Guil-
information regarding treatment settings and level ford, 1995
of care (i.e., inpatient versus outpatient), medical as- Mitchell JE, Wonderlich S, Agras S: The treatment of bu-
sessments, and targets of psychotherapy. Unfortu- limia nervosa: where are we and where are we going? Int
nately, not all patients are motivated for treatment, J Eat Disord 40:94101, 2007
Mitchell JE, Peterson CB: Assessment of Eating Disorders.
and attrition in therapy can be high. Additionally,
New York, Guilford, 2007
the preponderance of eating disorder cases seem National Institute for Clinical Excellence: Eating Disorders:
to fall into the Eating Disorder Not Otherwise Core Interventions in the Treatment and Management of
Specified category, highlighting the importance of Anorexia Nervosa, Bulimia Nervosa and Related Eating
developing a treatment plan tailored to the needs of Disorders: Clinical Guideline 9. London, National Insti-
the patient. tute for Clinical Excellence, 2004
This page intentionally left blank
III
Case Studies:
Evidence-Based Psychiatric Practice
in Different Settings
This page intentionally left blank
29
263
264 How to Practice Evidence-Based Psychiatry
Mr. B.H. states that after being assaulted in the group psychotherapies and weekly contact with a
military, he began to drink heavily in order to cope case manager but provides no PTSD-specific treat-
with his intense psychological reaction to the ment.
trauma. The veteran is living in a residential treat-
ment program for homeless veterans with substance
abuse problems. Although he has been clean and so-
Other Relevant Findings
ber for 6 months, he continues to struggle with Mr. B.H. reports two suicidal gestures in his life. He
PTSD symptoms. He has PTSD reexperiencing once played Russian roulette with a loaded gun and
symptoms that include nightmares about his assault, once lay in a bathtub with a broken bottle while
daily intrusive thoughts and images about the rape strongly considering cutting his wrists.
and his earlier molestation, and significant physical Mr. B.H. is the youngest of four children, with
and emotional reactions in response to trauma-re- two brothers and one sister. For the last 20 years he
lated cues (e.g., psychotherapy groups with other has been disconnected from his family until he re-
men in the program, news stories about rape, having cently reconnected with his sister and her children.
to share a room with a man). He also has avoidance/ He denies having any friends or a support system
numbing symptoms including significant avoidance with which he feels connected, finding it difficult to
of trauma-related activities (e.g., talking about his trust people. He has no significant medical prob-
rape, touch/sex, close relationships with men), as lems, and his medical exams have all been normal.
well as numerous obsessive safety behaviors (e.g.,
showering five times a day, cleaning sheets multiple DSM-IV-TR Diagnosis
times a week). He also describes emotional numbing
and severe social isolation from both friends and Axis I Posttraumatic stress disorder
family. In the hyperarousal domain of PTSD symp- Alcohol dependence, early full remission
toms, Mr. B.H. reports that he struggles with signif- Axis II None
icant sleep difficulties (e.g., sleeping 23 hours per Axis III None
night), hypervigilance, irritability, and an exagger- Axis IV Social isolation, unemployment, recent
ated startle response. His score on the PTSD homelessness
ChecklistCivilian Version (PCL-C) is 70. Axis V GAF score: 40
It was important to consider how to help the veteran cation and group therapy into interventions. Given
develop additional coping skills to decrease his reli- these recommendations, I decided immediately to
ance on alcohol as the primary means of coping with refer Mr. B.H. for medication management with one
PTSD symptoms. In addition, it was essential to of the psychiatrists on the PTSD team. In addition,
consider how to provide relapse prevention work I decided on a plan for stress inoculation, exposure
while also addressing his PTSD symptoms. Lastly, therapy, and cognitive therapy with this veteran.
considerations of how to adjust traditional PTSD I decided against providing EMDR because the re-
treatments to increase the likelihood of sustained so- search suggests that exposure therapy and EMDR
briety were critical. have similar outcomes, and dismantling studies sug-
gest that the active ingredient in EMDR is the expo-
sure (Davidson and Parker 2001). Furthermore, I
Selecting a Guideline
have had extensive training in exposure therapy, and
I (G.L.) began by reviewing the available guidelines my clinical experience is that this is an extremely ef-
for the treatment of PTSD, including the American fective treatment for PTSD.
Psychiatric Association (2004) practice guidelines for Although these seemed like appropriate treat-
the treatment of patients with acute stress disorder ment considerations for someone with PTSD, I also
and posttraumatic stress disorder, the Expert Con- had questions about how to ensure that I was ad-
sensus Guideline for treatment of posttraumatic dressing treatment of his substance abuse in my
stress disorder (Foa et al. 1999), Effective Treatments plan. The VA/DoD guideline does not provide rec-
for PTSD: Practice Guidelines From the International ommendations about what additional treatments, if
Society for Traumatic Stress Studies (Foa et al. 2000), any, should be provided when treating a veteran with
and the VA/DoD Clinical Practice Guideline for the comorbid substance abuse problems. As such, I went
Management of Post-Traumatic Stress (VA/DoD Man- back to the research literature to identify any studies
agement of Post-Traumatic Stress Working Group specifically addressing how to treat individuals with
2004). My predominant impression from reviewing comorbid PTSD and substance abuse. Although tra-
these multiple sources was that the majority of the ditionally the model for treatment of this population
recommendations are similar across treatment guide- has been to first treat the substance abuse problems
lines and relied on the same body of literature. I de- and then treat the PTSD problems (Brady et al.
cided to use the VA/DoD guideline in my treatment 2004), researchers have shown the effectiveness of a
of this veteran because this guideline seemed the new manualized group-based treatment called Seek-
most appropriate given that I was working in a VA ing Safety (Najavits 2002) that addresses both sub-
setting. This guideline also encapsulated many of the stance abuse and PTSD issues simultaneously. This
treatment recommendations highlighted in the other 25-session group-based protocol is present centered
guideline. (See Table 291 for a summary of the VA/ and builds additional coping skills through cogni-
DoD guidelines and the ways in which I adhered to or tive, behavioral, and interpersonal modules. It is ex-
made changes in the recommendations.) plicitly designed as a first-phase treatment of PTSD
The VA/DoD guideline strongly recommends and substance dependence with a goal of increasing
several psychotherapy treatments that have been stabilization and safety. Given the research support
shown to have significant benefit for PTSD symp- for this treatment, I thought it would be appropriate
toms, including cognitive therapy, exposure therapy, to add this to my treatment plan.
stress inoculation training, and eye movement de- Another issue during treatment planning was
sensitization and reprocessing (EMDR). In addi- whether the PTSD interventions needed to be ad-
tion, the guideline recommends using medication justed in order to treat safely those with comorbid
management as a first-line treatment for PTSD, substance abuse problems and minimize the chances
strongly recommending the use of a selective sero- of relapse. Although it is clear that exposure therapy
tonin reuptake inhibitor (SSRI), which has been is one of the most efficacious treatments for PTSD
shown to be effective for reducing symptom severity (Institute of Medicine 2007), the guideline gives no
for all three PTSD symptom clusters, although less advice about the possible risks for those with sub-
so in VA populations. The guideline also encourages stance abuse problems. When I was talking with
practitioners to consider incorporating patient edu- treatment team members about providing exposure
266 How to Practice Evidence-Based Psychiatry
TABLE 291. Summary of VA/DoD clinical practice guideline for the management of
posttraumatic stress disorder (PTSD)
therapy with this veteran, many people voiced con- available group openings at the time of treatment
cerns about the high probability of relapse upon en- planning. We therefore planned to enroll him in
gagement in imaginal exposure. I again turned to the Seeking Safety as soon as there was an opening. De-
literature to see what the research suggests about pending on his response to these interventions, I
whether the risks for relapse are too high with expo- also considered exposure therapy as a follow-up
sure therapy. There generally was a paucity of re- treatment if his symptoms persisted despite skill
search in this area; however, four nonrandomized building and cognitive interventions.
controlled trial studies showed support for the bene-
fit of exposure therapy for PTSD patients with sub- Treatment Goals, Measures, and Methods
stance dependence (Brady et al. 2001; Donovan et al. Table 292 summarizes our treatment goals, mea-
2001; Najavits et al. 2005; Triffleman et al. 1999). A sures, and methods for this patient.
clinical observation article by Najavits and colleagues
(2005) summarizes the positive results of combining
Seeking Safety and exposure therapy with dual diag- Course
nosis patients. In this article they provide explicit The course of our therapy is best described as having
recommendations for how to adjust exposure ther- occurred in two phases. The first phase of treatment
apy techniques when working with someone who has consisted of Mr. B.H. seeing me for individual ther-
a history of substance abuse. The authors suggest apy focused on skill building, relapse prevention,
creating an explicit, extensive, written set of safety and cognitive therapy. The veteran also concur-
parameters, as well as allowing patients to process rently participated in a 12-week stress management
more fluidly multiple events. They also suggest en- group co-led by me and a psychology trainee. In this
couraging patients to process both trauma and sub- phase of treatment I also referred the veteran for
stance use memories. Lastly, the authors indicate that medication management with a PTSD team psychi-
it is important to conduct the exposure more flexibil- atrist and coordinated care with him throughout
ity and to decide collaboratively on pacing and quan- treatment. In the second phase of treatment, when
tity of exposure. The summary of clinical experiences the veterans PTSD symptoms remained elevated,
and research articles encouraged me to employ expo- the veteran participated in individual exposure ther-
sure therapy with this veteran, but with significant apy with me as well as a Seeking Safety group co-led
modifications as delineated previously. by myself and another psychology fellow.
The last major issue that arose around treatment
planning was identifying the order in which the mul-
Phase 1: Individual Psychotherapy and
tiple treatments should be delivered. Again, the VA/
Stress Management Group
DoD guidelines do not provide explicit instructions.
Thus, I used my clinical intuition and experience to Individual Skill-Based Psychotherapy
help me answer this question. Because Mr. B.H. was The first step in treatment was beginning an individ-
early in sobriety, I decided that it would be most ap- ual, skill-based, weekly psychotherapy. Mr. B.H. and
propriate to start with treatments that were present I met together 22 times before we decided to begin
centered and skill based. In addition, the veteran in- exposure therapy. The first two sessions consisted of
dicated a preference for starting with skill building PTSD assessment and treatment planning. After our
and then transitioning to trauma-focused work if the second session, I also spoke to the veterans case
first-line interventions were not effective. There- manager from the residential treatment program to
fore we began with individual therapy that addressed ensure coordination of care. She indicated that she
both his PTSD and substance abuse issues, utilizing was providing him unstructured, supportive meet-
cognitive therapy, stress inoculation/skill building, ings, and as such his participation in a structured,
and relapse prevention interventions. In addition, I PTSD-specific treatment with me would not repre-
referred him to a 12-week stress management for sent a conflict or overlapping treatment.
PTSD group that I was co-leading based on stress During the subsequent 19 sessions, I utilized cog-
inoculation and cognitive-behavioral models. I would nitive-behavioral interventions to help the veteran
have preferred to send him directly to a Seeking build additional relapse prevention skills (e.g., iden-
Safety group for skill building, but there were no tifying triggers, developing coping plans, encour-
268 How to Practice Evidence-Based Psychiatry
aging attendance at Alcoholics Anonymous [AA] relapsing to alcohol. I used a more process-oriented,
meetings); engaged in stress inoculation training, nondirective approach in helping the veteran pro-
helping the veteran to enhance his coping resources cess his feelings of grief, fear, and anger around this
(e.g., grounding, affect regulation); and employed incident.
cognitive interventions to help Mr. B.H. identify his
automatic thoughts and thinking patterns and chal- Psychopharmacology
lenge his cognitive distortions. I also utilized basic Mr. B.H. was referred to the PTSD team psychia-
interpersonal therapy interventions to build a strong trist after the second session. The primary com-
therapeutic alliance and encourage engagement plaint of the patient was frequent and intense
with the veteran. This became especially important nightmares related to the trauma in the military. He
during times of increased stress that occurred near reported that the nightmares occurred almost every
the beginning of therapy. For example, during the night and were frightening, awakened him from
fourth session the veteran reported that a good sleep, and were increasing over the last 2 months.
friend of his was murdered in a dangerous area after He had also been feeling more depressed, although
Dual Diagnosis/VA Health Facility 269
he did not meet the criteria for major depression. Evaluation After Phase 1
Because he was reluctant to try medication, it was After Mr. B.H. had participated in 22 individual
decided to take a focused approach to treating his sessions and 12 stress management group sessions,
nightmares with the off-label use of prazosin (listed we decided to reevaluate his symptoms and discuss
in the guideline as a secondary treatment option additional treatment considerations. The veteran in-
with some limited evidence-base support). Mr. B.H. dicated that he was sleeping significantly better, av-
was taking hydrochlorothiazide for his hypertension eraging 56 hours of unbroken sleep per night. In
and was warned about possible orthostatic hypoten- addition, the veteran reported that he felt stronger in
sion. He was started on prazosin 1 mg qhs for 3 days, his sobriety, now having maintained sobriety from al-
then 2 mg qhs for 5 days, then 4 mg qhs. He re- cohol for 11 months. He described having signifi-
turned to his psychiatrist 2 weeks later stating his cantly more coping resources that he utilized to cope
sleep was better, a solid 3 hours. He was taking with both urges to drink and PTSD symptoms. He
only 3 mg qhs and was instructed to increase to 4 mg was practicing his breathing exercises daily and find-
qhs and then 6 mg qhs. Upon returning another ing these very helpful in decreasing his overall level
2 weeks later, he stated that he had felt nauseous and of anxiety. However, he stated that he continued to
uncomfortable on 6 mg and reduced the dose back experience significant PTSD symptoms, especially
to 4 mg. The veteran had noticed a decrease in intrusive thoughts/images, social isolation, numbing,
nightmares and more restful sleep. He did not re- hypervigilance, and irritability. He also described
turn for further psychopharmacology appointments continuing to feel socially isolated from others in the
but remained at the same dose of prazosin for the re- treatment program, friends, and family. His PCL-C
mainder of this treatment period. score at this point in therapy was 62, indicating a de-
crease from his baseline score of 70 but still a clini-
Stress Management Group cally significant level of PTSD symptoms.
Mr. B.H. began to participate in the stress manage- I proposed exposure therapy as a next step, and
ment for PTSD group after our ninth session of the veteran stated that he felt ready to engage in this
individual therapy and participated in all twelve treatment. I again contacted both his psychiatrist
75-minute classes. We used an unpublished manual- and his case manager to let them know about the
ized treatment that is utilized in multiple VA PTSD change in the treatment plan and the potential
programs. The group consisted of Mr. B.H. and short-term increase in his anxiety when first starting
seven other veterans, all of whom had PTSD symp- exposure therapy. I also encouraged the veteran to
toms and many of whom also struggled with sub- let others in his life know that he might need addi-
stance abuse issues. The group always began with a tional support for the next few months (e.g., room-
brief check-in, followed by 45 minutes of psychoed- mate at program, sister, AA sponsor). Additionally, a
ucation about stress and stress management tech- new Seeking Safety group was starting at the same
niques. It ended with a 15- to 20-minute experiential time, and so the veteran decided to participate in this
stress reduction technique (e.g., diaphragmatic group co-led by myself and another psychology fel-
breathing, progressive muscle relaxation, guided im- low. The veteran reported feeling excited to have a
agery, meditation). Veterans were asked to practice place to continue to discuss and build coping skills.
these relaxation techniques between sessions and re-
port on their experience in the check-in process.
Phase 2: Exposure Therapy and
Throughout the course of therapy the veteran par- Seeking Safety
ticipated actively in group and practiced the stress-
reduction techniques between sessions. He was able Individual Exposure Therapy
to identify two particular relaxation techniques, dia- Mr. B.H.s exposure therapy consisted of 30 individ-
phragmatic breathing and guided imagery, that ual sessions over a 5-month period, typically meet-
worked best for decreasing his anxiety. However, he ing twice weekly. Of the individual sessions, 16 were
did not report feeling connected to other group 90-minute sessions in which the veteran participated
members and overall did not feel that participating in imaginal exposure. The other 14 were shorter ses-
in the group reduced his PTSD symptoms. sions (typically 60 minutes) where the veteran pro-
cessed the feelings that arose for him while retelling
270 How to Practice Evidence-Based Psychiatry
the story of his trauma or listening to his trauma counting of the trauma. During much of the retelling
tapes. In each of the 16 imaginal exposure sessions he was clenching his body, and he made absolutely
the veteran audio taped his trauma retelling and no eye contact. In addition, at the most difficult part
then listened to it once or twice during the following of the story the veteran became extremely anxious
week. As such, the veteran listened to his trauma and vomited. During the processing time after the
tapes 30 times during the course of therapy. trauma account the veteran described feeling signif-
The first session was spent providing psychoedu- icant sadness, anxiety, fear, and anger. He felt shame
cation about exposure therapy and creating a thor- about what had happened and for having shared it
ough safety plan for potential increases in anxiety with me and continued to have difficulty making eye
and alcohol cravings. I spent time explaining the contact. Given his reactions in this first session, it be-
structure of the therapy and the rationale for expo- came clear that part of the goal of exposure would be
sure. We identified 10 ways of coping with anxiety to help the veteran relax his body while recounting
and urges that might arise during the course of ex- the trauma and to move toward more eye contact af-
posure and wrote them down on a coping card ter the retelling. In addition, we decided to monitor
that he carried with him at all times. We also dis- his vomiting and the number of daily showers to en-
cussed that he could call me during VA hours if he sure that these decreased over time.
needed to check in or listen to my voice mail after During the third through sixth sessions the vet-
hours in order to become grounded. Lastly, we iden- eran recounted the trauma two more times and also
tified the primary trauma that would be the focus of spent time discussing the strong emotional reactions
exposure therapy. Because most of his nightmares he was having both in and out of session. He shared
and intrusions were related to his MST, as opposed that he was experiencing a significant increase in
to his childhood molestation, we decided to focus on anxiety as well as urges to use alcohol. It therefore
this as the primary event for the trauma retelling. became extremely important for me to adjust the ex-
Between the first and second sessions the veteran posure therapy protocol and allow additional time
decided to begin the process of exposure by creating for processing his feelings of anxiety, sadness, anger,
a written account of the trauma and its impact on and shame, and every week to discuss coping strate-
him. The following is an excerpt from his writing, gies for dealing with his urges to use. At the end of
which highlights the strong link between his PTSD the sixth session the veteran completed the PCL-C
and substance use: and his score was 60, indicating that his PTSD
symptoms had not yet improved.
I was so afraid of being asked what was going on In the seventh session (the fourth in-session re-
with me that I cut all my friends off and became a
counting of the trauma), the veteran remembered
loner. I would go off alone and drink. I dont know
what people thought and I did not care. Nobody and shared an additional piece of information about
was going to find out the truth. Nobody. You dont the trauma that was particularly difficult for him to
tell the army you were raped. Not if youre a say aloud. Although he had been able to recount
man . .. . I could not go home . .. . I kept stuffing having been raped with objects, this was the first
what happened to me by drinking. . . the more I time that he was able to share the whole rape story,
drank the more I could be who I wanted to be,
which included having been raped by another man.
cause I did not want to be me. .. . I felt at fault for
everything bad that happened then and now. . . . This felt like the first whole recounting and the
I deserved it cause I did not fight back enough.... veteran was extremely sad and angry throughout the
I drank to forget and to be anyone but me. I had so retelling. We spent additional time at the end of the
much shame and guilt that I just could not let any- session ensuring that his anxiety decreased by 50%
one know me, because they might find out my se- prior to ending the session and ensuring that we de-
cret. I need to know who I am because I have not
veloped an explicit safety plan for him that day.
known since that night.
In sessions 8 through 30 the veteran continued to
During the second session of exposure therapy, recount his trauma and to listen to the tapes between
the veteran spent 55 minutes telling the story of his sessions. Each week his trauma recounting became
rape for the first time while being audio taped. Mr. easier, and he described progressively less anxiety.
B.H. connected to his affect readily during session Although decreasing the tensing of his body was very
and was extremely tearful throughout the entire re- hard for him at first, because he reported that he felt
Dual Diagnosis/VA Health Facility 271
as if clenching was the only protection he still had, Question: What did you do that you should be
by the final retelling his whole body was relaxed able to feel good about? Can you allow yourself
to feel that?
when recounting the trauma. In addition, after the
sixth recounting of the trauma the veteran no longer
The only thing I feel good about is that I crawled
experienced vomiting and his showering stabilized at out of there and survived. No!!!
three times per day, as opposed to the previous rate
of five times per day. In addition, in the final re- I do feel relief that Im not running away right
counting the veteran was able to tell the whole story now.
while also looking at me, representing a significant
I came here and took risks to trust others with this.
decrease in his feelings of shame. In the processing
Its too heavy for me to carry alone.
sessions in which the veteran explored his affective
and cognitive reactions to the trauma, Mr. B.H. dis- I feel good that I can listen to the tapes and relive
cussed further the ways that retelling his trauma the evil without walking out and killing someone.
story also affected his feelings and thoughts toward
his childhood molestation. Thus, the processing of- I lived and made it back to the U.S. I feel good
about where I am at right now in my life. Maybe
ten occurred for both traumas, even though the re-
by going through all that, thats how I got here!!
counting only occurred around the MST.
After every in-session and between-session imag- In addition to these significant shifts in his affec-
inal exposure the veteran filled out a form asking tive and cognitive reactions to the trauma, Mr. B.H.
him about his thoughts and feelings. In the process- also experienced a significant decrease in his PTSD
ing sessions we would discuss the information on symptoms. His PCL-C score at the end of the expo-
these sheets at length. The following quotes exem- sure therapy was 42, representing a significant de-
plify the progression of his responses during the crease in PTSD symptoms and falling below the 50-
course of treatment, representing a significant and point recommended cutoff for PTSD in veterans. In
meaningful shift in his relationship to the trauma: addition, during the course of exposure therapy the
veteran obtained a job, moved into his own apart-
Question: What are your feelings and thoughts ment, and began reconnecting with family members.
right now?
He also developed a friendship with a man at the res-
I feel sorry and sad for that guy on the tape. What idential treatment community and at the end of
those fucking bastards did to him changed his life treatment decided to share the story of his rape with
forever. I feel anger and rage and sick to my stom- this male friend. The veteran maintained his sobri-
ach. I have to go throw up. ety throughout the course of the exposure therapy.
I feel pretty helpless right now. I dont believe that Seeking Safety Group
anyone could do that to me. I want them to pay for
During the same time that Mr. B.H. participated in
this.
the exposure therapy, he also participated in a Seek-
My feelings are confused. I still have some anger, ing Safety group that consisted of the patient and
but not as much. Mostly sadness. I feel alone. three other veterans. He participated in all 25 ses-
sions of this 60-minute group over a 6-month period.
I am not feeling as bad as I have. I know whats Seeking Safety is a manualized, group-based treat-
coming and know that I have to deal with it. ment for individuals with comorbid PTSD and sub-
stance abuse/dependence. Each of the groups began
I must be getting better cause my thoughts are
with a check-in process and the review of a topic-
pretty clear. What happened, happened. As much
as I want to change it, that doesnt change. So, Im relevant quote. Veterans then spent 3045 minutes
in therapy getting healthy and dealing with it. reviewing psychoeducation/skill-building handouts
that are provided and discussing how the topic is rel-
Ive had a positive week, so right now I feel sadness evant to their own experience with PTSD and sub-
and empathy, not just for myself but kind of for the stance abuse. The group then ends with a checkout
assholes that did that to me. How sick they must be.
in which veterans identify a committed action that
272 How to Practice Evidence-Based Psychiatry
they will take before the next group. Mr. B.H. par- Safety) as well as noncontrolled clinical observa-
ticipated actively in this group and reported that he tions. Based on these reports from outside the
found the topics extremely beneficial. The most no- guideline, a treatment plan was established that in-
table difference between his participation in this cluded the addition of a set of safety parameters
group and the stress management group is that here, while conducting exposure therapy and the concur-
the veteran connected very well with other group rent application of Seeking Safety group therapy.
members. They would often meet up before group These additional interventions allowed for the safe
or stay after group to continue the social process. In and successful application of exposure therapy.
addition, midway through group, group members Although the VA/DoD guideline strongly recom-
shared their telephone numbers with each other and mended initiating pharmacological treatment with
often had out-of-group contact with one another. an SSRI, Mr. B.H. was resistant to trying medica-
tions, despite having agreed to a consult. The vet-
Evaluation After Phase 2 eran agreed on a targeted approach with prazosin for
After Mr. B.H. completed exposure therapy and nightmares. Thus, patient preference resulted in a
while he finished the Seeking Safety group, we met deviation from the guideline. The dosing of prazosin
for a final eight sessions to evaluate progress, discuss was below that in the guideline (which recommends
the course of treatment, identify lessons learned, 612 mg) because of side effects experienced at doses
and process termination. My fellowship was ending, above 6 mg. Verbal communication with researchers
and thus the veteran was going to be transferred to involved in investigating prazosin suggested that
another treatment provider. We discussed at length lower dosages can be efficacious. Because the tar-
his multiple areas of progress over the course of the geted symptom of nightmares improved and the vet-
year, including maintaining his sobriety, decreasing eran was engaged in exposure therapy, no further
his PTSD symptoms, improving his sleep, enhanc- pharmacological treatments were attempted.
ing his social network, and increasing his psychoso- The focal treatment intervention in this case, ex-
cial functioning (e.g., obtaining employment and posure therapy, also deviated somewhat from that
independent living). We also spent significant time described in the literature because of the veterans
discussing his feelings about the end of the thera- significant history of substance dependence. The
peutic relationship, because he felt very connected number of sessions was able to be titrated in part be-
to me given the emotional intensity of the work that cause of the primary authors more flexible schedule
we did together. It represented growth that the vet- as a trainee. This flexibility is not available in many
eran was able to process and discuss his feeling of treatment settings but may have improved the
grief about saying goodbye. Lastly, we discussed chances of successful treatment response with this
next steps in therapy, including engaging in in vivo veteran.
exposure to address a few continued avoidance be-
haviors and continuing to challenge trauma-related
cognitive distortions.
Ways to Improve Practice
Although this veteran was treated as part of an inte-
grated treatment team, it was still difficult to inte-
Summary of Guideline Use grate fully the psychotherapy and pharmacotherapy
Table 291 summarizes the guideline recommenda- interventions into a uniform treatment plan. This
tions that applied to this patient and whether the was in part because of Mr. B.H.s reluctance to take
recommendations were followed or adjusted. The medications. In an ideal setting, an evidence-based
major complication in applying the VA/DoD treat- pharmacological intervention would be given that ei-
ment guideline to this case was the lack of guidance ther would work synergistically with the psychother-
in treatment options and adjustments for veterans apy or even pharmacologically enhance the exposure
with a long history of alcohol dependence. A partic- therapy, as has been proposed by some researchers.
ular concern was whether exposure therapy could be As stated, because this case occurred while the
employed without increasing the odds of relapse to primary author was a trainee, there was the ability to
alcohol. This was addressed by turning to the liter- provide more sessions than is described generally in
ature for an evidence-supported treatment (Seeking the literature. It is possible the same level of effec-
Dual Diagnosis/VA Health Facility 273
tiveness could have been accomplished with a de- Davidson PR, Parker KC: Eye movement desensitization and
creased number of sessions, but because the number reprocessing (EMDR): a meta-analysis. J Consult Clin
of sessions was not a significant limitation in this Psychol 69:305316, 2001
Donovan, B, Padin-Rivera E, Kowaliw S: Transcend: ini-
case, the greater number of sessions increased the
tial outcomes from a posttraumatic stress disorder/
probability the interventions could be applied safely. substance abuse treatment program. J Trauma Stress
The primary outcome measure used was the 14:757772, 2001
PCL-C. This is a cumbersome measure to apply in a Foa EB, Davidson JRT, Frances A: The expert consensus
normal clinic setting in which time is a limiting fac- guideline series: treatment of posttraumatic stress disor-
tor. The lack of validated briefer measures of PTSD der. J Clin Psychiatry 60 (suppl 16), 1999
is a significant limitation in monitoring treatment Foa EB, Keane TM, Friedman MJ (eds): Effective Treat-
responses while administering evidence-based treat- ments for PTSD: Practice Guidelines From the Interna-
tional Society for Traumatic Stress Studies. New York,
ments. This case could have benefited from more
Guilford, 2000
measures aimed at monitoring improvements in so- Institute of Medicine: Treatment of Posttraumatic Stress
cial functioning, sense of well-being, and interper- Disorder: An Assessment of the Evidence. Washington,
sonal interactions. DC, National Academies Press, 2007
Najavits LM: Seeking Safety: A Treatment Manual for PTSD
and Substance Abuse. New York, Guilford, 2002
References Najavits LM, Schmitz M, Gotthardt S, et al: Seeking Safety
American Psychiatric Association: Practice Guideline for plus exposure therapy: an outcome study on dual diagno-
the Treatment of Patients With Acute Stress Disorder sis men. J Psychoactive Drugs 37:425435, 2005
and Posttraumatic Stress Disorder. 2004. Available at: Triffleman E, Carroll K, Kellogg S: Substance dependence
h tt p :/ / w w w.p s y c hi at ry o n l i ne .c o m / p ra cG u i d e / posttraumatic stress disorder therapy: an integrated cog-
pracGuideTopic_11.aspx. Accessed March 4, 2009 nitive-behavioral approach. J Subst Abuse Treat 17:314,
Brady KT, Dansky BS, Back SE, et al: Exposure therapy in 1999
the treatment of PTSD among cocaine-dependent indi- VA/DOD Management of Post-Traumatic Stress Working
viduals: preliminary findings. J Subst Abuse Treat 21:47 Group: VA/DoD clinical practice guideline for the man-
54, 2001 agement of post-traumatic stress. Washington, DC, Vet-
Brady KT, Back SE, Coffey SF: Substance abuse and post- erans Health Administration/Department of Defense,
traumatic stress disorder. Curr Dir Psychol Sci 13:206 2004. Available at: http://www.healthquality.va.gov/ptsd/
209, 2004 ptsd_full.pdf. Accessed July 18, 2009
This page intentionally left blank
30
As practitioners, we are aware that despite imple- These systems would need to allow for regular mon-
menting evidence-based treatment plans with our itoring of patient compliance and side-effect burden
patients, many will not adhere to treatment and will as well as measurement of treatment response.
cease treatment prematurely as a result of intolera- The case study we present here outlines the use of
ble side effects (Nemeroff 2003). Furthermore, the HealthSteps (www.healthsteps.net.au) Internet-
large-scale clinical trials of antidepressant medica- based system, developed by Sentiens, to deliver care
tions indicate that remission may be difficult to and monitor remotely a depressed patient from a ru-
achieve even in medication-compliant depressed pa- ral and isolated town in Australia. The patient was
tients (Rush et al. 2006). Also, relapse rates are rela- seen by the first author (D.T., hereafter referred to in
tively high (i.e., 67%) in the long term for patients the first person) in his private practice in early 2002.
with severe depression even when they are compli- The patient agreed to be managed remotely using an
ant with medications and achieve remission in the emergent version of the e-health system developed
acute stage of treatment (Kennedy et al. 2003). To by Sentiens. This example is somewhat of a depar-
ensure that the maximum number of patients ture from typical practice, in which the patient would
achieve remission and maintain this state in the long be seen via face-to-face consultation, or occasionally
term, there need to be systems in place that supple- via telepsychiatry, and the HealthSteps system would
ment the work we can physically do as practitioners. be employed as an adjunct to regular treatment.
To the best of our knowledge, elements of the HealthSteps system developed by Sentiens are already existent in commercial dis-
ease management systems in the United States, but the outcome data for these systems is rarely available for public scrutiny.
275
276 How to Practice Evidence-Based Psychiatry
the Australian market.) Fluoxetine was not success- needed to visit me in Perth without sustaining signif-
ful. Mr. P.J.s condition deteriorated rapidly, and he icant financial loss because he had no cover for him-
required inpatient admission. self in his newly developing business. He was also
In the hospital, he was started on dothiepin, a tri- caring for his now ex-wife, who was chronically ill and
cyclic antidepressant (TCA) that was still commonly unable to care for herself. He requested I manage him
prescribed in Australia during the early 1990s. The by telephone and advise his local GP on treatment.
patient made a rapid recovery on dothiepin at 150 The primary aim of treatment was to achieve a re-
mg/day and returned to work after 4 weeks. mission in the patients symptoms and maintain this
After 4 months, he ceased the medication without progress so that the patient could function well and
discussing it with me, claiming he was well. make a success of his life. The patient previously had
I thereafter saw Mr. P.J. on an intermittent basis a satisfactory response to a TCA, namely dothiepin,
for approximately 10 years. During this time he fre- but this antidepressant gave rise to side effects that
quently ceased taking his medication without prior he complained about and was prepared to tolerate
consultation and would subsequently relapse. only because he was unable to achieve success on an-
other medication. His treatment adherence had not
been persuasive, as he had lowered and ceased his
Other Significant Findings medication only to subsequently relapse on a num-
From Assessment ber of occasions. In order to achieve and maintain a
The online assessment battery completed by Mr. P.J. remission of symptoms in this patient, it was essen-
indicated that he was struggling to cope with his tial that he be treated with an antidepressant that
day-to-day activities. was associated with a lower side-effect burden. The
American Psychiatric Association (APA) released
their revised guideline on the treatment of major
DSM-IV-TR Diagnosis depression in 2000. This guideline provided ample
Axis I Major depression with comorbid panic information regarding the side-effect profiles of
disorder newer antidepressants, and there were many newer-
Axis II None generation antidepressants available in Australia
Axis III None that had a lower side-effect profile than TCAs (see
Axis IV Work stress Mant et al. 2004).
Axis V GAF score: 50 However, given the patients prior history of se-
vere and recurrent depressive episodes, he would be
considered at high risk for relapse. The patient was
Treatment Plan Considerations going to require regular monitoring as well as early
My current assessment of this patient indicated that intervention in not only the acute phase of treatment
the primary problem was major depression with co- but also in the long term, particularly with regard to
morbid anxiety associated with low-intensity and managing side-effect burden. Although the APA
low-frequency panic attacks. Although the patients (2000) practice guideline did not specify a minimum
anxiety and panic symptoms had been relieved length of time required for continuation and main-
somewhat by the paroxetine prescribed 3 weeks ear- tenance therapy with patients who had recurrent
lier by his GP, he was still experiencing severe levels and severe episodes of depression, there was evi-
of depression and this was affecting his day-to-day dence available at the time to suggest that this pa-
functioning. He had a poor level of functioning tient would benefit from maintenance therapy using
(GAF =50) that was affecting his ability to work, so- pharmacotherapy for at least a 2-year period (Ellis
cialize, and even self-care. and Smith 2002).
The patient had recently moved to a small town
some distance from Perth and was managing a small Treatment Goals, Measures, and Methods
business. His poor level of functioning was placing his The primary aim of treatment was to improve the pa-
developing business at risk, and hence the patient rec- tients mood and function with an antidepressant that
ognized he needed treatment. However, he was lim- has a tolerable side-effect burden and provide ther-
ited in his ability to leave his workplace for the time apy to help him return to and maintain an optimal
278 How to Practice Evidence-Based Psychiatry
level of function. I discussed the medication options years (SD=12.35). The DSS demonstrated a high de-
with Mr. P.J., and he agreed to remain on the parox- gree of internal consistency, with a Cronbach's alpha
etine prescribed by his GP in the interim. Paroxetine for the total scale of 0.94 (n=141). Factor analysis us-
was an accepted SSRI in the treatment of both major ing generalized least squares with oblique rotation
depression and comorbid anxiety and panic disorder supported a three-factor solution: general depression
(American Psychiatric Association 2000). Moreover, symptoms, self-harm, and mood symptoms. The
SSRIs are typically associated with a lower side-effect convergent validity for the DSS was demonstrated
profile than older-generation antidepressants (Amer- using the 42-item version of the Depression Anxiety
ican Psychiatric Association 2000), and the patient Stress Scales (DASS; Lovibond and Lovibond 1995)
reported in the interim that he was tolerating the side as a benchmark measure of depression, wherein the
effects. Medications were to be prescribed and mon- DSS total score (r=0.86) and DSS mood symptoms
itored by his local GP, who was happy to monitor the scale (r=0.80) had good convergent validity with the
patient weekly. I discussed this with the patients GP DASS depression scale (P <0.01). The DSS self-harm
via telephone, and she agreed to take primary re- subscale demonstrated low convergence with the
sponsibility for the patients care. DASS depression scale (r =0.54, P<0.01), which was
I discussed the option of using the HealthSteps to be expected given that the DASS depression scale
online program for depression with Mr. P.J., and he does not assess self-harm/suicidal ideation. The dis-
agreed to enroll in this program. I wanted my pa- criminant validity of the DSS was not well supported,
tient to use this program because it would allow me as moderate correlations were obtained between
to monitor remotely his progress, provide him with the DSS total score and the DSS mood symptoms
relevant psychoeducational material, and communi- subscale and the DASS anxiety and stress scales
cate with him via a secure e-consultation facility. (P<0.01). However, there were also moderate to high
The program allows both the patient and practitio- correlations between the DASS depression scale and
ner to access and print out a progress report that the anxiety and stress scales (P <0.01), thus demon-
provides a graph of the patients progress on the key strating the commonality of underlying causes and
measures over time and details the patients medica- characteristics of these constructs.
tion chart and self-reported medication compliance. The QOL was designed by Sentiens as a brief
This HealthSteps program would measure the pa- screening scale comprising 8 items that measure the
tient's progress on three measures developed by degree to which the patient's symptoms are having a
Sentiens: the Depression Severity Scale (DSS), the negative impact on quality of life. The QOL is used
Quality of Life (QOL) measure, and the Side Effects simply to detect changes in impairment associated
Scale (SES). As opposed to using validated measures with symptoms and was not intended as a tool for
that were freely available in the public domain, we determining clinically defined levels of functioning.
chose to construct our own measures for use in Although the psychometric properties of the QOL
HealthSteps to avoid the possibility of future royalty have not been established, this measure was de-
claims or liabilities. signed to be representative of the constructs com-
The DSS is a 20-item measure developed by Sen- monly measured in such scales. Respondents rate
tiens to assess severity of depressive symptoms. Re- the extent to which their symptoms have affected
spondents rate the frequency with which they have various aspects of their lives on a 4-point Likert scale
experienced each listed symptom on a 4-point Lik- (not at all, a little, very much so, severely). This mea-
ert scale (never, sometimes, often, most of the time). sure yields a total score as well as four subscale scores
From this measure, three subscale scores (general (relationships, risk behaviors, social, work and
depression symptoms, self-harm, mood symptoms) money) with high scores indicating that symptoms
and a total score may be derived, with higher scores are having a greater negative effect on quality of life.
indicative of greater depressive symptoms. Finally, Sentiens developed the Side Effects Scale
The psychometric properties of the DSS were to measure the level of medication side effects expe-
demonstrated in an unpublished report by Ree in rienced by patients completing pharmacotherapy.
2002. The DSS was administered to a sample of 169 This scale was designed specifically for descriptive
psychiatric patients of Sentiens clinic, the majority of purposes to gauge the level and type of side effects
whom were male (57.4%), with a mean age of 42.17 reported, and thus its psychometric properties have
Severe Depression/Remote Care Via Internet 279
not been evaluated. Respondents rate the extent to in paroxetine dosage to 60 mg resulted in minimal
which they have been experiencing 30 items relating improvement in depressive symptoms (Figure 301)
to medication side-effects on a 4-point Likert scale and quality of life (Figure 302), and he was still
(not at all, a little, very much so, severely). From the scoring in the severe range for depression. During
SES, a total score may be derived as well as six sub- this time, there was a noticeable improvement on
scale scores (akathisia, attention and mood, involun- the SES (Figure 303) that indicated the medication
tary movements, parkinsonism, physical difficulties, side effects were dissipating.
and sexual problems). Higher scores are indicative However, the patient subsequently and abruptly
of a greater side-effect burden. ceased taking the paroxetine without consultation.
With regard to the treatment schedule, the patient He reported he was experiencing significant sleep
was willing to complete monitoring questionnaires disturbances, which included episodes of nocturnal
on a once-weekly basis for 6 weeks or until a satisfac- sleepwalking. When the patient ceased taking the
tory response was achieved. The patient also agreed paroxetine there was a noticeable worsening in his
to communicate with me regularly via e-consultation quality of life, as demonstrated in Figure 302. By
and telephone as necessary. It was agreed that after a this time point, the patient had been taking paroxe-
satisfactory improvement, the frequency of monitor- tine for a total of 8 weeks, having commenced this
ing questionnaires and e-consultations could be re- medication 3 weeks prior to our consultation, and I
duced gradually provided the patient remained had now been monitoring him for 5 weeks. The
compliant and continued to improve. The primary APA (2000) guideline recommends that it is appro-
aim was to continue treatment with antidepressants priate to undertake a review of the treatment plan
until the patients depressive symptoms were reduced and medications if a moderate improvement in
to a normal range and were consequently having symptoms is not observed after 68 weeks of phar-
minimal impact on his quality of life. I would then macotherapy.
maintain the patient with pharmacotherapy for at Thus, approximately 8 weeks into pharmacother-
least 12 months. A secondary aim was to greatly re- apy, the patient was recommenced on paroxetine at
duce the side-effect burden of the medications he 40 mg/day. I decided to continue the patient on this
was taking because this would in turn greatly en- lower dose of paroxetine rather than switch to an-
hance the patients likelihood of adherence and re- other antidepressant, because of the effectiveness of
mission in the long term. this SSRI in treating symptoms of both depression
and anxiety. The difficulty was that paroxetine at
40 mg as a monotherapy would not produce a suffi-
Course cient response for this patient and the patient was
I monitored the patients progress closely on the experiencing significant sleep disturbances. I was
DSS, QOL, and SES for a period of 46 weeks. After aware that in this instance, where a partial response
this time, I primarily monitored and communicated was obtained, the APA practice guideline would rec-
with the patient via e-consultation and telephone for ommend the addition of an augmenting agent such
an additional 12 months. The progress graphs for as lithium, thyroid hormone (namely triiodo-
the DSS, QOL, and SES are presented in Figures thyronine: T3), or buspirone (a 5-HT1A receptor an-
301, 302, and 303, respectively. Plotted against tagonist) in addition to the SSRI. However, these
the scale scores in each of these three figures is the augmentation strategies were unlikely to alleviate
patients medication chart, as well as events of inter- the insomnia experienced by the patient.
est that arose during our e-consultations. It should Hence, mirtazapine, a norepinephrine-serotonin
be noted that the patient had been taking paroxetine modulator, at 45 mg/day, was added for its additive
for 3 weeks prior to commencement of this 46-week antidepressant effect and to alleviate the patient's
period of monitoring. problems with sleep. In support of this choice, the
Initially, paroxetine at 40 mg/day did not result in current Texas Medication Algorithm for major de-
any noticeable change in symptoms (see Figure 30 pression supports the switch to a sedating antide-
1). The patients quality of life was worsening (Fig- pressant medication such as mirtazapine to address
ure 302), and the SES (Figure 303) indicated he insomnia as a side effect (Suehs et al. 2008). Further-
was experiencing substantial side effects. An increase more, there was also evidence available at the time to
280
How to Practice Evidence-Based Psychiatry
FIGURE 301. Total Depression Severity Scale scores, e-consultation events, and medication chart for 46 weeks of treatment.
Severe Depression/Remote Care Via Internet
FIGURE 302. Quality of Life scores, e-consultation events, and medication chart for 46 weeks of treatment.
281
282
How to Practice Evidence-Based Psychiatry
FIGURE 303. Side Effects Scale scores, e-consultation events, and medication charts for 46 weeks of treatment.
Severe Depression/Remote Care Via Internet 283
suggest that the addition of mirtazapine might be interesting to observe that these improvements in
particularly helpful given its dual serotonergic and the patients depressive symptoms (see Figure 301)
noradrenergic action (Fava et al. 2003). occurred at a somewhat tumultuous time during which
In addition, venlafaxine, a serotonin-norepineph- the patient was experiencing significant psychosocial
rine reuptake inhibitor (SNRI), at 225 mg/day, was stressors, such as the death of a family pet, as well as
added because of its strong antidepressant action a further deterioration in his ex-wifes condition that
and suitability as a relatively safe adjunct medication was resulting in substantial family conflict. These
to SSRIs. I was aware that the combination of mir- significant stressors also, surprisingly, had little bear-
tazapine and venlafaxine was the final step of treat- ing on the patients quality of life (see Figure 302),
ment in the STAR*D trials for those patients who as he was able to maintain an acceptable level of func-
had demonstrated relatively high levels of treat- tioning during this time. These improvements de-
ment-resistant depression (Fava et al. 2003). Fur- spite adversity indicated to me that the medications
thermore, this combination was associated with a were having the desired effect.
lower side-effect profile and higher adherence rates During this time of substantial progress, it is
than alternatives for treatment-resistant depression noteworthy that the patient, without consultation,
such as tranylcypromine, which is a monoamine ox- commenced a self-prescribed dosage of S-adenosyl-
idase inhibitor (McGrath et al. 2006). I was also L-methionine (SAMe). At the time of my consulta-
aware that mirtazapine and venlafaxine had superior tions with this patient, there were no guidelines con-
safety indices when compared with MAOIs (Kent cerning the use of SAMe as an alternative treatment
2000). It was therefore reasonable to assume that for major depression. There was relatively sparse
this powerful combination of antidepressants would and inconclusive evidence regarding the efficacy of
be tolerated by the patient and would result in a this naturally occurring psychotropic substance, and
rapid improvement in symptoms and functioning. studies were typically limited by methodological
Upon commencing the combination of mirtaz- issues such as small sample size. However, there
apine, venlafaxine, and paroxetine, the patient ini- was some evidence to suggest that this substance ex-
tially experienced an increase in depressive symptoms hibited antidepressant effects and that its use was
(see Figure 301), which could largely be attributed associated with acceptable levels of safety and toler-
to a sudden increase in medication side effects (see ability in patients (Agency for Healthcare Research
Figure 303). However, this initial increase in symp- and Quality 2002; Pancheri et al. 2002). Given that
toms and side effects was to be expected with this the patient believed in the efficacy of this substance
powerful combination of medications. The patient and I could see no harm in its use as an adjunctive
thereafter progressively improved, although progress treatment, I was happy for the patient to remain on
was slower than anticipated. Within 18 weeks of com- SAMe. In fact, although I could not rule out the pos-
mencing these new medications, the patients depres- sibility of a placebo effect, given the inclusive evi-
sive symptoms (see Figure 301) had decreased from dence regarding use of SAMe, the patients recent
the very severe range to within the moderate range. improvements did appear to coincide with the com-
This was a marked improvement, indicating that the mencement of SAMe.
trial was in part a success. However, the ultimate aim It is noteworthy that the patient was willing to
was to achieve a full remission in symptoms, as indi- continue treatment despite adverse effects until a
cated by a score on the DSS within the normal range. substantial improvement had been obtained. Once
Coinciding with this reduction in depressive symp- these gains in symptoms and functioning had been
toms over the 18 weeks was a marked improvement in achieved, the patient was no longer willing to toler-
the patients quality of life (see Figure 302), particu- ate the medication side effects. About 30 weeks after
larly with regard to work and money, and the medi- commencing the combination of mirtazapine, ven-
cation side effects had lessened considerably (see lafaxine, and paroxetine, the patient reported he was
Figure 303). experiencing substantial difficulties with weight
Further improvement in symptoms, quality of gain and morning tiredness, and hence requested a
life, and side effects were gained over the next change in medications.
3 months, to the point where the patients depressive At that point in time, newer generation antide-
symptoms were scored in the normal range. It was pressants associated with lower side-effect profiles
284 How to Practice Evidence-Based Psychiatry
who had read widely on the available antidepres- Ways to Improve Practice
sants. He believed that the side effects of reboxetine
This case study has demonstrated the utility of online
would be better tolerated than the weight gain asso-
disease management systems in monitoring patients
ciated with the current medications he was taking.
with longer-term health conditions. The Health-
Although I discussed the issue of efficacy versus side
Steps system developed by Sentiens was designed as
effects of this medication, the patient was willing
an adjunct tool to monitor and manage large num-
and motivated to tolerate these effects. As was pre-
bers of patients over long periods of time. The system
dicted given available guidelines (American Psychi-
facilitates the evaluation of different strategies to
atric Association 2000), the reboxetine resulted in
maintain patients in treatment through monitoring
complaints of insomnia, but these were ameliorated
of symptoms, quality of life, and side-effect burden.
with the amitriptyline. This combination was clearly
As this case study illustrates, patients typically require
successful in the long term because the patient was
frequent monitoring to ensure medication compli-
able to tolerate the side effects and maintained a re-
ance. However, it is often the case that practitioners
mission in symptoms.
experience barriers, such as heavy caseloads, that pre-
This case clearly illustrates the importance of
clude frequent and detailed monitoring of patients.
compromise because for many patients the side ef-
Although the system developed by Sentiens can ad-
fects can outweigh the efficacy of many antidepres-
dress many of these barriers, it is evident that practi-
sant medications, and many patients are only willing
tioners may require additional support to effectively
to maintain pharmacotherapy if a low level of side-
monitor and manage large numbers of patients. To
effect burden can be achieved. It would be beneficial
address this issue, recently we have begun to explore
for future guidelines to outline the processes a prac-
the possibilities for utilizing the time and expertise of
titioner may follow to minimize side-effect burden
allied health professionals. Allied health professionals
and dropout while also improving quality of life and,
may take on the role of case manager and can facili-
hence, achieving the best results for a given popu-
tate practitioners by regularly monitoring patients
lation.
using the online system and may contact patients who
This case study also highlights the importance of
are not progressing well.
the capacity to monitor patient progress, as outlined
In conclusion, developments in information and
in the guidelines developed for treating depression
communication technologies, as evidenced by the
(American Psychiatric Association 2000; National In-
emergent HealthSteps system, offer infrastructures
stitute for Health and Clinical Excellence 2007; Royal
that may be used by practitioners to improve their
Australian and New Zealand College of Psychiatrists
management of patients. These infrastructures en-
Clinical Practice Guidelines Team for Depression
able us to better monitor and maintain patients so
2004). Despite these guidelines, practitioners typi-
that we may break the iterant cycle of relapse and
cally find it practically difficult to monitor patients
achieve our long-term goal of remission.
frequently and in great detail. Through the use of the
HealthSteps online system, I was able to respond to
my patients concerns regarding side effects in a References
timely manner and quickly detect any changes in Agency for Healthcare Research and Quality: S-Adenosyl-L-
symptoms or quality of life. I believe this capacity to methionine for treatment of depression, osteoarthritis, and
monitor and intervene early was the key to success liver disease (Evidence Report/Technology Assessment,
with this patient because previous to this my patient No 64). August 2002. Available at: http://www.ahrq.gov/
often ceased medications without consultation and clinic/epcsums/samesum.htm. Accessed March 5, 2009
experienced multiple episodes of relapse. Also, and American Psychiatric Association: Practice guideline for the
equally important, the HealthSteps system enabled treatment of patients with major depressive disorder (re-
vision). Am J Psychiatry 157 (suppl 4):145, 2000
me to develop rapport and establish a working rela-
Australian Bureau of Statistics: Western Australian Statistical
tionship with my patient in the absence of face-to-face Indicators (cat no 1367.5). June 2003. Available at: http://
contact. The system enabled us regularly to discuss www.abs.gov.au/ausstats. Accessed March 7, 2009
and review such issues as medication efficacy versus Australian Bureau of Statistics: Western Australia at a Glance
side effects, and together we decided on the best (cat no 1306.5). 2008. Available at: http://www.abs
course of action. .gov.au/ausstats. Accessed March 7, 2009
286 How to Practice Evidence-Based Psychiatry
Barnes C, Harvey R, Mitchell P, et al: Evaluation of an online National Institute for Health and Clinical Excellence:
relapse prevention program for bipolar disorder: an over- Depression (amended): management of depression in
view of the aims and methodology of a randomised con- primary and secondary care (clinical guideline 23). April
trolled trial. Disease Management and Health Outcomes 2007. Available at: http://www.nice.org.uk/guidance/
15:215224, 2007 CG23. Accessed March 7, 2009
Ellis PM, Smith DA: Treating depression: the beyondblue Nemeroff CB: Improving antidepressant adherence. J Clin
guidelines for treating depression in primary care. Med J Psychiatry 64:S25S30, 2003
Aust 176:S77S83, 2002 Pancheri P, Scapicchio P, Delle Chiaie R: A double-blind,
Fava M, Rush AJ, Trivedi MH, et al: Background and ratio- randomized parallel-group, efficacy and safety study of
nale for the Sequenced Treatment Alternatives to Relieve intramuscular S-adenosyl-L-methionine 1,4-butanedis-
Depression (STAR*D) study. Psychiatr Clin N Am ulphonate (SAMe) versus imipramine in patients with
26:457494, 2003 major depressive disorder. Int J Neuropsychopharmacol
Harvey R, Smith M, Abraham N, et al: The Hurricane 5:287294, 2002
Choir: remote mental health monitoring of participants Phillips MA, Bitsios P, Szabadi E, et al: Comparison of the
in a community based intervention in the post Katrina antidepressants reboxetine, fluvoxamine and amitrip-
period. J Health Care Poor Underserved 18:356361, tyline upon spontaneous papillary fluctuations in healthy
2007 human volunteers. Psychopharmacology 149:7276,
Kennedy N, Abbott R, Paykel ES: Remission and recurrence 2000
of depression in the maintenance era: long-term out- Royal Australian and New Zealand College of Psychiatrists
come in a Cambridge cohort. Psychol Med 33:827838, Clinical Practice Guidelines Team for Depression: Aus-
2003 tralian and New Zealand clinical practice guidelines for
Kent JM: SNaRIs, NaSSAs, and NaRIs: new agents for the the treatment of depression. Am J Psychiatry 38:389
treatment of depression. Lancet 355:911918, 2000 407, 2004
Lovibond SH, Lovibond PF: Manual for the Depression Rush AJ, Trivedi MH, Wisniewski SR, et al: Acute and
Anxiety Stress Scales, 2nd Edition. Sydney, Psychology longer-term outcomes in depressed outpatients requir-
Foundation, 1995 ing one or several treatment steps: a STAR*D report. Am
Mant A, Rendle VA, Hall WD, et al: Making new choices J Psychiatry 163:19051917, 2006
about antidepressants in Australia: the long view 1975 Suehs B, Argo TR, Bendele SD, et al: Texas Medication
2002. Med J Aust 181:S21S24, 2004 Algorithm Project Procedural Manual: major depressive
McGrath PJ, Stewart JW, Fava M, et al: Tranylcypromine disorder algorithms. Austin, Texas Department of
versus venlafaxine plus mirtazapine following three State Health Services, 2008. Available at: http://www
failed antidepressant medication trials for depression: a .dshs.state.tx.us/mhprograms/pdf/TIMA_MDD_MDD
STAR*D report. Am J Psychiatry 163:15311541, 2006 AlgoOnly_080608.pdf. Accessed November 3, 2008
31
Postpartum Depression
Treated in Private Practice
Matthew H. May, M.D.
Margaret F. Reynolds-May, B.A.
287
288 How to Practice Evidence-Based Psychiatry
Present Illness screening for suicide risk, infanticide risk, and psy-
chosis was paramount for the success of this case.
The patient attempted suicide by suffocation on
three separate occasions, all within 1 year of the birth
Treatment of Postpartum Depression
of her child. There were elements of impulsivity and
desperation in her attempts. She was hospitalized on There is limited evidence for a variety of modalities
each occasion and treated with antidepressants, in the treatment of postpartum depression, both bi-
including high doses of sertraline, escitalopram, ological and nonbiological (Dennis 2004; Dennis
bupropion, and duloxetine both alone and in combi- and Stewart 2004). In light of the limited data, we are
nation. She reported little improvement in her forced to rely on expert consensus guidelines (Alt-
symptoms with these medications. shuler et al. 2001). The consensus for initial treat-
During her third hospital stay, while being ment of nonpsychotic, severe postpartum depression
treated with bupropion, escitalopram, and duloxe- is to combine psychosocial interventions with phar-
tine, she was observed to have some increased mood macotherapy (antidepressants). Preferred antide-
lability and impulsivity. The question of bipolarity pressants include sertraline followed by paroxetine
was raised, and she was tapered off of antidepres- (safety during pregnancy and lactation is frequently a
sants and treated with olanzapine for mood stabili- concern, as discussed later in this section). In terms of
zation and clonazepam for anxiety. She responded psychotherapy, experts preferred CBT and interper-
well to this regimen for several days, although she sonal therapy (IPT). In the case of failure to respond
struggled with somnolence. Modafinil was added to to medication or in the presence of psychotic fea-
alleviate this problem. She also had difficulty with tures, ECT was agreed upon as an acceptable treat-
weight gain and glucose metabolism while on olan- ment modality, although no randomized controlled
zapine and was transitioned to aripiprazole. Her trials exist (Forray and Ostroff 2007; Rabheru 2001).
mood continued to decline. Having failed standard Most experts agreed that providing support in the
antidepressant treatment modalities, the patient was home for the mother was appropriate and encour-
offered ECT. After a total of seven ECT treatments, aged including the spouse in the psychotherapy.
the patient had significant improvements in mood In the case presented here, trials of antidepressants
(Montgomery-sberg Depression Rating Scale had either failed or appeared to pose the threat of a
[MADRS] score fell from 45 to 9 during this 6-week switch to mania (Altshuler et al. 1995), hence the
hospitalization). Once stabilized, she was discharged choice of ECT and atypical antipsychotics for their
to my outpatient practice with maintenance ECT. mood-stabilizing effects. I decided to use a CBT
model developed by Dr. David Burns (TEAM), as it
is a flexible model with many interpersonal compo-
DSM-IV-TR Diagnosis nents. In addition, it incorporates meaningful scales
Axis I Major depressive disorder, recurrent, to measure the efficacy of each therapy session and
severe, with postpartum onset; consider progress over the long-term course of therapy. The
bipolar affective disorder inpatient team had arranged for support in the home
Axis II None (a full-time professional nanny), and the patient was
Axis III None to attend a partial hospitalization program.
Axis IV Problems with social environment (child The specific treatment goals for this patient are
care), problems with primary support outlined in Table 311.
group, occupational problem
Axis V GAF scores: 3540 Treatment of Depression in
Bipolar Disorder
Treatment Plan Considerations There is good evidence for the use of mood stabiliz-
ers, especially lithium, in the treatment of bipolar de-
Suicide and Infanticide Risk pression (Baldessarini et al. 2003). Although there is
The patient was clearly at high risk for completing evidence that tricyclic antidepressants may increase
suicide (Appleby et al. 1998) and at some increased the risk of causing mania or hypomania, several stud-
risk for infanticide (Taguchi 2007). Reliable early ies suggest that treating bipolar depression acutely
Postpartum Depression/Private Practice 289
FDA pregnancy
Medication type risk category Lactation risk category
Benzodiazepines (e.g., clonazepam, diazepam, D L3 (diazepam=L4 if used
lorazepam) chronically)
Benzodiazepines for insomnia (e.g., estazolam, X L2/L3
flurazepam, temazepam)
Nonbenzodiazepine anxiolytics and hypnotics
Buspirone and zolpidem B L2/L3
Eszopiclone and zaleplon C
Tricyclic and heterocyclic antidepressants (e.g., C (maprotiline= B) L2/L3 (doxepin =L5)
amitriptyline, clomipramine, desipramine)
Selective serotonin reuptake inhibitors (e.g., C (paroxetine= D) L2/L3
citalopram, fluoxetine, sertraline)
Other antidepressants (e.g., bupropion, venlafaxine, C (bupropion= B) L3 (nefazodone=L4)
mirtazapine, nefazodone)
Atypical antipsychotics (e.g., olanzapine, risperidone, C (clozapine=B) L2: olanzapine
quetiapine) L3: aripiprazole, clozapine,
risperidone
L4: quetiapine, ziprasidone
Note. U.S. Food and Drug Administration (FDA) pregnancy risk categories: A= controlled studies show no risk;
B =no evidence of risk in humans; C = risk cannot be ruled out; D= positive evidence of risk; X= contraindicated in pregnancy.
Lactation risk categories: L1= safest; L2 =safer; L3 =moderately safe; L4 = possibly hazardous; L5= contraindicated.
Source. Adapted from ACOG Practice Bulletin Number 92, April 2008; see original publication for greater detail.
Breastfeeding and Psychotropic Medication who are tempted to forego treatment should know
The American College of Obstetricians and Gyne- that untreated depression is associated with its own
cologists (ACOG) regularly updates its safety guide- risks. In the April 2008 Practice Bulletin, ACOG
lines for the use of psychotropic medications during summarizes this concern concisely:
pregnancy and lactation. For women with bipolar Maternal Psychiatric Illness, if inadequately
illness who are pregnant or in the puerperium, the treated or untreated, may result in poor compli-
risks and benefits of psychopharmacological treat- ance with prenatal care, inadequate nutrition,
ment must be balanced for the individual and the exposure to additional medication or herbal rem-
specific agent (Dodd and Berk 2006). All psychotro- edies, increased alcohol and tobacco use, deficits
in mother-infant bonding and disruptions within
pic medications enter breast milk, and none have
the family environment.
been proved conclusively to be safe to the child.
Some of these medications are more safe than oth- Hence the decision is complicated by the neces-
ers, and there are several options among antidepres- sity to weigh several options simultaneously: the
sants in the L2 category (with L1 being safest and pros and cons of breastfeeding with or without med-
L5 contraindicated; see Table 312) (ACOG Com- ication and bottle-feeding with or without medica-
mittee on Practice BulletinsObstetrics 2008). tion. This is complicated further by emerging
Although mothers with depression frequently evidence that breastfeeding may be quite beneficial
would prefer not to expose their child to any risk, to the childs health (Ip et al. 2007). In this case, the
most physicians concur that depression itself poses a patient decided against breastfeeding, which af-
threat to the child (ACOG Committee on Practice forded a wider array of options pharmacologically.
BulletinsObstetrics 2008; Murray et al. 1996; Foregoing breastfeeding may be interpreted as a
OHara et al. 2000). Mothers with severe depression sign of inadequacy in women with depression.
Postpartum Depression/Private Practice 291
FIGURE 311. Brief Mood Survey depression scores over time pre and posttherapy session.
292 How to Practice Evidence-Based Psychiatry
FIGURE 312. Brief Mood Survey anxiety scores over time pre and posttherapy session.
FIGURE 313. Brief Mood Survey anger scores over time pre and posttherapy session.
FIGURE 314. Brief Mood Survey relationship satisfaction scores over time pre and post
therapy session.
Postpartum Depression/Private Practice 293
Empathy Visit 2
One thing I like about the TEAM model is that if I We discussed her medication regimen, and she ex-
forget what I am supposed to be doing or get stuck pressed an interest in discontinuing aripiprazole be-
somewhere, I can often simply repeat the acronym cause she was noticing increased appetite on this
and discover where I went wrong. Usually it is some- medication and, despite regular exercise, was strug-
where in the middle, either empathy or agenda set- gling to lose the weight from her pregnancy. I was
ting. One of those instances, when I felt like a deer in concerned about taking her off of a mood-stabilizing
the headlights, was when my patient said, Im a bad agent and suggested adding a different mood stabi-
mother. My family would be better off without me. lizer before discontinuing aripiprazole, to which she
This was no cocktail conversation. It will seem easy agreed. Lithium was perhaps the best choice for
if you just read along at this point, so in some ways it mood stabilization, especially in the presence of sui-
is better if you imagine what you might say to a pa- cidal ideation. However, with ongoing ECT treat-
tient in that situation or write down what you would ments, this was not an option in the short term
say after they say Im a bad mother. My family (Baldessarini et al. 2006b). I considered lamotrigine
would be better off without me. Of course there to be a reasonable alternative based on evidence that
would be no right or wrong answer; much is depen- this drug prevented relapse (Calabrese et al. 2003).
dent on the relationship with the patient and the After discussing risks/benefits and alternatives, she
setting. I tried to resist the urge to offer advice or was started on 25 mg/day.
reassurance, which is almost never effective and of- We worked briefly on communication strategies
ten sounds patronizing. Instead I tried to express my to improve her relationship with her husband and
understanding and my own feelings in a curious and family. This later became a focus of our work, al-
respectful manner: though it will not be described further in this chapter.
A gradual improvement in her relationship satisfac-
My heart goes out to you, Jane. You believe you tion scores can be seen throughout the therapy.
are a bad mother and that your family would be
better off without you. I can imagine that youre
feeling inadequate and defective as well as discour- Visit 3
aged and frustrated. I admire you for telling me We used a daily mood log to begin to identify her
that and for how much you care about your family. negative cognitions. The situation we identified was
Do I understand the situation correctly? a time at home when she, her nanny, and her child
were together. She felt 100% inferior and inade-
Meanwhile, I noted to myself (for later use in
quate, 100% hopeless, 100% ashamed, 100% sad,
agenda setting) that one possible piece of resistance
90% upset and disappointed with herself, and 75%
to overcoming depression is that she may believe
resentful. She had the following thoughts:
that her depression is necessary to prevent harm
from befalling her family and that recovery would Im a bad mom.
mean greater exposure to the child and hence Ill always be a bad mom.
greater damage to the child. I am not saying this is Im a failure.
objectively true, just that it might be true from the My friends will be disappointed in me.
patients perspective. I will lose my friends.
I should never have had a child.
Safety
If I hadnt had a child, Id still be happy.
I have to admit that this patient made me a little ner- I shouldnt think that.
vous, considering the number of recent suicide at- I deserve to suffer.
tempts she had made. However, she convinced me
that she would not attempt suicide again and that She chose to work on the thought I should never
she would be accountable for her own safety, includ- have had a child because this resulted in extreme
ing going to the hospital if necessary. She had never amounts of shame and self-directed anger and re-
had thoughts of harming her child but agreed to sentment.
share any such thoughts if they were to occur rather
than acting on these thoughts.
294 How to Practice Evidence-Based Psychiatry
Decision Point problems, who was there, what happened, and so on.
The patient had identified a disturbing negative Agenda setting is also about understanding the type
thought with which she would like help. CBT is rife of problem being faced so we can avoid resistance by
with methods to defeat negative cognitions, and I anticipating and paradoxically aligning ourselves
wanted to help the patient. I decided to apply a tech- with it. In essence, we become the voice of their re-
nique called identify the distortions. We searched sistance. The patient can then choose to argue
for logical errors in the structure of the negative against his or her own resistance or he or she can
thought. For example, her thought I should never agree with us and accept him- or herself proudly.
have had a child is using harsh language or should This is a win-win situation for the therapist. It can
statements that are inflicting unnecessary suffering; sometimes be difficult to imagine the advantages of
she is fortune telling because only in hindsight believing a negative thought, however. Often I sim-
could she possibly know that having a child would ply ask my patient whether he or she can think of any
cause her such suffering; she is applying meaningless reason to maintain his or her negative thought and
labels to herself such as bad mom; she is blaming make a list with them of advantages to believing in
herself for factors outside her control; she is reason- the negative thought. Can you imagine any advan-
ing emotionally by telling herself that because she tages to believing I should never have had a child?
feels bad she is bad, and so on. In fact, when we looked Here are a few that the patient came up with:
closely, we found elements of every cognitive distor-
tion in this thought and its supporting thoughts. Advantages to Believing
Upon identifying the distortions, I switched to an I Should Never Have Had a Child
externalization of voices model in which I played It allows me to recall and fantasize about the
the role of the patients negative thoughts, attacking good old days, prior to having a child.
her with these thoughts, and giving her the opportu- This will remind me to be more careful in the fu-
nity to defeat or revise themwith which she did ture so I can avoid such errors. It motivates and
fairly well. I was about to pat myself on the back for facilitates self-improvement.
being a brilliant therapist when I discovered that she It feels morally correct to use such punishing lan-
was not feeling any better and was even a little upset guage on myself, since I made an error.
with the way the session was going...then I realized I I can insist on being better, rather than having to
had made a huge agenda-setting error! accept being an average mom or one who makes
To better understand agenda setting, by way of mistakes.
analogy, imagine coming across a friend who is flog- It prevents me from being angry with my child or
ging his or her own back with a whip. You might be my husband, focuses the blame on me, sparing
tempted to point out how illogical this is or try to them.
take the whip away, apply some soothing ointment If I blame myself and punish myself, other people
to the wounds, and so on. This would be the equiv- cant. They will have to take pity on me and help
alent of applying one of the many different Methods me.
in the TEAM model without having the appropriate I can avoid the stress of being a mother and con-
framework in place. The problem is that intervening tinue to feel the safety of being taken care of by
without permission can result in resistance. The in- my family.
dividual who is self-flagellating must have, in his or If I accept defeat early, then I dont have to try and
her mind, at least one good reason to be inflicting I cant fail.
such punishment. To avoid forcing the patient to dig
in his or her heels when we try to help, we use Examples of Agenda Setting:
Agenda setting (TEAM). That means asking How to Discuss Resistance With a Patient
whether the patient wants help or just need us to un-
Jane, I think youre right that this thought is
derstand what they are feeling. If he or she wants
causing some of your shame and hopelessness, and
help, rather than chasing our tail talking about every I think we could defeat this thought and lift your
moment the patient had that problem, we narrow spirits today. Im a little hesitant to do that, how-
the scope to one specific time they were having ever, because Ive noticed that this thought reflects
Postpartum Depression/Private Practice 295
positively on you as a person. Youve chosen to expect to be perfect. I would challenge this, saying,
blame yourself rather than be upset with your hus- Im feeling a bit better, but are you just telling
band or your child for all that has happened to
me what I want to hear? This was our first break-
you. This thought is an example of your love and
willingness to self-sacrifice. Why change this?
through in therapy, and her mood improved signif-
If we were to defeat this thought and your de- icantly over the course of those two sessions. I stored
pression went away entirely, would you be con- away this technique, reminding myself that what
cerned about what others might expect of you? works once will probably work again.
Wouldnt you be even more stressed than you are
now with the responsibilities and demands of
Visit 5
motherhood?
Are you certain that you would be willing to Focus shifted away from her mood, which was in-
feel good about yourself considering the fact that creasingly less of an issue for her, and onto her rela-
you sometimes regret having had a child? Isnt it tionship, especially tension between herself and her
appropriate for you to feel ashamed of thoughts
husband. She seemed to expect that her husband
like that? What would be the moral basis of our
eliminating your shame?
should be doing more in the relationship to be kind to
and respectful of her, that he should be less critical of
her and be more respectful toward her family. She was
Visit 4
disappointed and angry with him but reluctant to ex-
I realized my error in the latter part of visit 3 and
press these emotions because of a conflict phobia (fear
dropped back to empathy and agenda setting. After a
that expressing her feelings would make the problem
few agenda-setting questions, the patient was ready
worse and there would be no solution). She was un-
to apply techniques and motivated to overcome her
willing to work individually on this problem because
self-defeating thoughts, which we did in that session
she felt he should be doing more of the changing. She
and the following sessions.
agreed to have her husband come in to the next visit.
Methods
Visit 6
The reason we have over 50 techniques in CBT is
that we often need to fail at 5 or 10 or 15 before As planned, her husband came to this visit. He spoke
coming upon the technique that is effective. In this with me individually, giving his perspective on Janes
case we used many different techniques in rapid suc- illness. He had noticed her perfectionism and nega-
cession, each with the understanding that they were tive self-talk when goals were not met. He wanted
unlikely to be effective and we were eliminating op- Jane to express more caring and compassion for him.
tions until we could find the right tool for her. For He felt betrayed and thought that Jane had favored
example, we tried identifying the distortions with a her family over him.
straightforward technique, a downward arrow tech-
nique, a cost-benefit analysis technique, and so on. Visit 7
The most helpful technique ended up being a Between sessions the patient experienced a compli-
role-play called the double standard, which al- cation with ECT, possibly due to insufficient paral-
lowed her to be a good mother to herself. In this ysis. She described unilateral myalgias that were
exercise, I pretended to be a clone of her, someone so intense that she could not walk normally. The
who was exactly the same in every way and had ex- patients pain had not responded entirely to nonste-
perienced everything she had, made all the same de- roidal anti-inflammatory drugs. I called in a pre-
cisions, and felt and thought the same as well. I told scription for four tablets of Vicodin and four tablets
my story, how Id been through a painful and diffi- of clonazepam. The patient responded well and was
cult pregnancy, how Id developed a deep depression feeling better by the time I saw her. We discussed
that required hospitalizations, and how I was sure ECT during this visit and she said she disliked going
I had made a mistake by having a child. The patient back to the hospital because it was a painful re-
readily spoke to me (her clone) in an incredibly sup- minder of where she had been and the severity of her
portive way. She would say, No, youre a fantastic illness. She was afraid to discuss her discontent with
mom, youve just been through a lot and you cant the physician providing ECT, however.
296 How to Practice Evidence-Based Psychiatry
Visit 8 Visit 10
Jane was essentially euthymic at this point. She was Relapse! The patient was clearly deeply depressed
very happy to be home full-time after completing again. She was convinced that she was a horrible
day treatment, although she was still disappointed mother and had an assortment of other negative
with her husband. We decided that we could not thoughts. Her affect was constricted, and there was
work on that problem because she felt it was mostly psychomotor retardation. She continued to have a
his fault. She had selected a new nanny and had some rash on her arms that was itchy. There still was no
negative thoughts that she brought in to work on, es- mucosal involvement, but we decided to have her
pecially the thought that, because she had to have a discontinue the drug for the time being. She cried
nanny, this meant she was defective and inadequate. during the session, which she found cathartic, but
We did some brief agenda setting and then tried a we did not have time to do any cognitive exercises,
few techniques. Not surprisingly, it was the double and she left feeling horrible. We scheduled another
standard technique that was able to beat the thought. visit in 2 days, the day after her ECT.
Her mood improved immediately in session.
Visit 11
Visit 9 The patient was feeling a bit better after receiving
Jane was doing well, but one day after increasing her ECT the day before. Her depression score had
dosage of lamictal to 100 mg/day, she developed a fallen from 15 to 11 on the Brief Mood Survey. We
rash on her arms. There was no mucosal involve- worked hard in this session and added several tech-
ment and no lymphadenopathy, myalgia, fever, niques, including be specific, examine the evi-
chills, or lethargy. She was aware of what to look for dence, and acceptance paradox, to our favorite
in terms of Stevens-Johnson rash, and we decided to double standard. We worked systematically, using
continue with lamictal at the 100 mg dose and see if a double column with negative thoughts on one side
her body would adjust to the drug. She was moti- being replaced with positive thoughts on the other
vated by the fact that she was still having trouble los- (Table 313). After this session, her depression score
ing weight (and therefore did not want to revert to fell to a 4 on the Brief Mood Survey.
aripiprazole, which she felt had increased her appe-
tite). We again worked on her negative thoughts; as Subsequent Visits
she engaged more and more in the role of mother, It turned out that the patients depression, when in
she developed new concerns and new negative full force, required several different techniques
thoughts. After we wrote those thoughts down, we working in tandem. She used the four techniques
again applied the double standard technique: described in visit 11 several times on her own and to-
gether in session with me to overcome relapses that
Example of Double Standard Technique came up in the next 30 weeks. She became increas-
Negative thought (expressed by the therapist): ingly self-sufficient. She convinced me that she was
I should have been around and not so fearful. able to discontinue her medication and did so with-
Then my child would be running to me.
Im her mom. My child should be just as
out event. I monitored her for some time, but her
bonded if not more to me because I carried her in- depression continued to improve. She lost the
side me for so long and I breastfed her, and above weight and her relationship improved as well. She
all else she should be bonded to me the most. created an emergency worksheet that she kept in a
safe place that contained the list of techniques and
Positive thought (expressed by the patient):
how to use them in case of relapse. We did relapse
You were sick for so long that your child needs
some time to be more bonded with you. It just
prevention. She decided there wasnt much need
takes more time; it doesnt happen overnight. for her to visit me anymore, and I told her I would
be available in the future if she wanted to meet with
Aside from the patients rash, I was feeling quite me. We terminated and I have not heard from her
confident that this therapy was going to be a success. since.
Postpartum Depression/Private Practice 297
298
Area Recommendation
Screening and evaluation
Screening and diagnostic tools Depending on setting, specific screening tools (Edinburgh Postnatal Depression Scale, Postpartum
Depression Screening Scale) or standard depression instrument (e.g., Beck Depression Inventory, Brief
Mood Survey) may be useful.
Exclude medical causes Exclude medical causes for mood disturbance such as thyroid dysfunction, anemia, and Sheehans
syndrome. Initial evaluation should include a thorough history, physical examination, and routine
laboratory tests.
Information gathering If necessary, seek additional information from other providers of patient (e.g., primary care, obstetrics,
pediatrics).
Evaluate risk for bipolarity and psychosis It is important to assess the risk of bipolarity (current and previous symptoms, past manic or hypomanic
episodes, family history), and postpartum psychosis to devise treatment plan and avoid switch to mania
with use of antidepressants.
Evaluate suicidality Treatment strategy (modalities and setting) will depend in part on risk of suicidality.
Treatment
Shared decision making Includes review of both pharmacological and nonpharmacological therapies and discussion that inadequate
treatment increases the risk of morbidity in both mother and infant. Preferably occurs before pregnancy
commences.
299
TABLE 314. General recommendations for postpartum depression (continued)
300
Area Recommendation
Monitoring
Use of monitoring tools Self-report questionnaires (e.g., Brief Mood Survey) can be used before and after each therapy session.
Baseline assessment
Session assessments
12-week review
Record response to and satisfaction with therapist/therapy
Response to evaluation Therapist should respond to evaluations of performance and therapy direction/goals.
Prevention
Relapse prevention Therapy work should address potential methods of relapse prevention and identification.
Early screening and identification Women at risk for postpartum illness should be identified prior to delivery; use of screening tools (listed
previously) may aid identification.
Prophylactic treatment There is limited and divided evidence both for and against prophylactic pharmacological treatment in
postpartum depression; sertraline may be efficacious at preventing relapse during subsequent postpartum
periods. Antidepressants may be started during pregnancy (see Table 312).
Note. CBT =cognitive-behavioral therapy; ECT= electroconvulsive therapy; IPT= interpersonal therapy; RCT= randomized controlled trial; SNRI=serotonin-norepinephrine
reuptake inhibitor; SSRI=selective serotonin reuptake inhibitor.
beginning and end of each therapy session to track mal risk to appropriate patients they may prove
efficacy of therapy modalitiesboth in the immedi- helpful adjunct options.
ate sense and also over the long-term course of the
therapy. These forms have been used in a number of
studies and have undergone both reliability and va-
Ways to Improve Practice
lidity testing where applicable (Burns and Eidelson Considering the history of suicide attempts and the
1998; Burns and Nolen-Hoeksema 1992; Burns et possibility of bipolarity, I was even more interested
al. 1994). than usual in the topic of safety (Baldessarini et al.
As described in this patients treatment consider- 2006a). Despite this concern, I believe I relied too
ations, a combination of medication and psycho- heavily on information provided by the inpatient
therapy modalities, as well as an at-home interven- team during my initial risk assessment. Not surpris-
tion (full-time nanny) was used. These and other ingly to veterans of our profession, it is a sad truth
recommendations for postpartum depression are that some patients who are depressed often speak
presented in Table 314. In general, recommenda- less of suicide and experience a brightening of their
tions emphasize combining pharmacological and affect as the date of discharge approaches, knowing
psychotherapy treatments to achieve the best re- that soon they will be free to kill themselves without
sults. However, because of the lack of randomized interruption. Sadly, I covered only a fraction of the
placebo-controlled trials of medications in this spe- information in a structured suicide risk interview,
cific subpopulation, expert consensus guidelines and relying instead on signs. For example, she seemed
practices are limited in the scope of their evidence. to have an interest in the future and in scheduling
For example, only three placebo-controlled trials of appointments, and she denied suicidal urges at the
antidepressants for postpartum depression have time of our meeting. To my credit, I did ask, and she
been published. The first showed that prophylactic agreed to meet with me before acting on any suicidal
treatment of postpartum depression with nortrip- urges that might develop in the future.
tyline in women at risk did not prevent recurrence In retrospect, I would have preferred to have used
any greater than placebo (Wisner et al. 2001). Using a detailed, structured suicide risk assessment instru-
the same study design, the second trial did show a ment such as that created by Dr. David Burns (Burns
significant benefit of sertraline in preventing recur- 2007). Topics to cover in assessing patients suicide
rence (Wisner et al. 2004). In yet another controlled risk include, but are not limited to, the following:
trial in which fluoxetine with CBT was compared to
placebo with CBT in women diagnosed with post- History of prior attempts, including whether the
partum depression, the authors found no difference attempt(s) were planned or impulsive, whether a
between fluoxetine with one CBT session and pla- note was left and what it said, whether a will was
cebo with six CBT sessions. This finding suggests created, how long the individual had been feeling
that CBT may be as effective as an SSRI interven- suicidal before the attempt, the situation sur-
tion (Appleby et al. 1997). Despite the lack of strong rounding the attempt (where they were, who was
evidence for treatment with antidepressant medica- with them, who said what, what they were drink-
tions, many physicians still consider this approach a ing), what means were used and some crude sense
standard of care. of how lethal this method might be and how le-
Other treatment modalities are based purely on thal it seemed from their own perspective at the
small observational trials or case studies, such as the time, any conscious or potential unconscious mo-
use of estrogen therapy alone or in conjunction with tive or intent, the reason the attempt did not
antidepressants (Ahokas et al. 1999, 2001; Dennis succeed, and the effects on them physically and
2004; Gregoire et al. 1996). Similarly, bright light psychologically (e.g., did they quit work or file for
therapy has been endorsed in two case studies but disability)
remains to be examined in a randomized controlled General attitudes toward death and suicide in
trial (Corral et al. 2000; Dennis 2004; Oren et al. particular, including a listing of all possible rea-
2002). These should be considered experimental sons they may want to end their life as well as rea-
treatment modalities, but because they pose mini- sons not to end their life, what they expect the
302 How to Practice Evidence-Based Psychiatry
process to feel like and the moment of death to be viduals who participate in psychotherapy homework
like, and their sense of what might come after are more likely to improve than those who simply
Identification of specific situations in which they talk about their problems (Cowan et al. 2008;
would be tempted to end their life Legeron 1991). Unfortunately, there are many good
Current, recent, and lifetime history of de- reasons why someone might not want to do psycho-
pressive symptoms, especially the intensity of therapy homework. Some patients might say I
hopelessness, anger, and anxiety and patterns of didnt feel like it, others, I just knew it wouldnt
substance use work, and so on. Before reading the next para-
Current desire to end their life and what plans graph, imagine what you would say to a patient who
they have and whether they intend to act on those made such a statement.
plans Most of us would try to convince the patient to do
Their attitudes toward being hospitalized, homework. We might try logic and reason, threats
whether they would be willing to go to the hospi- of never getting better, begging, and groveling.
tal if they became suicidal or if this would not be Most of this will either not work or backfire and re-
acceptable sult in even greater resistance because the patient
Their attitudes toward communicating suicidal- will feel that he or she is not accepted as is. Another
ity to the provider, including how trustworthy approach is to agree with them that they have a right
they seem to be, whether they would agree to call not to do homework and respect their decision, ob-
if they felt suicidal, whether they would prefer to serving that this might not be a problem they want
retain the right to end their life to work on right now and is there something else
Other factors that might place them at higher or they want help with? The Buddhists had it right all
lower risk (e.g., primary diagnosis, reports of pain along: true power comes from letting go. When we
or debilitation, troubles with insomnia, family do this, the patient will lead the way.
history of suicide, religious beliefs, significant re- This has been one of the hardest lessons for me to
lationships, future events they look forward to, learn as a therapist, especially a psychiatrist trained
their support network) in the medical model. I have a strong desire to help
Would they be willing to make an absolute guar- those who are suffering and I am sometimes tempted
antee of their safety in the future, regardless of to believe that I can fix people without their coop-
how hopeless or desperate they feel? eration or make lasting changes in only an hour per
week of talking. It has been humbling to discover
Along these same lines, my initial intake could otherwise.
have been strengthened by inquiring more about the One major problem in this patients therapy had
patients expectations and motivations. Many pa- to do with medication management. As I mentioned,
tients have unrealistic expectations at the outset of I chose lamotrigine because of the evidence available
therapy that lurk like hidden icebergs in the North to me that this medication increased the interval be-
Atlantic. Having experienced my fair share of disap- tween depressive episodes. One flaw with the refer-
pointments in therapy, I now use psychoeducational enced study on lamotrigine, however, was selection
memos and surveys to assess motivation and the risk bias. The research, funded by the manufacturer, had
of premature termination. The best source that I included in the treatment group only individuals
have found for surveys that provide information who had already tolerated and responded to lamo-
about motivation for, resistance to, and attitudes to- trigine. It was later revealed that they had not pub-
ward therapy that are likely to result in early termi- lished results of five negative studies of lamotrigine
nation and failure if not addressed early are found in for depression (Calabrese et al. 2008).
Therapists Toolkit, available from David Burns online As I developed more experience with the patients
at www.feelinggood.com. depression, I came to realize that it might not be pri-
An example of a common misconception among marily chemically mediated. For example, the pa-
patients is the notion that all progress will be con- tient responded much more robustly, when at the
fined to the time spent with the therapist, and little height of her depressive episode, to a single 2-hour
change or effort will be required on their part. psychotherapy session than to a session of ECT she
Meanwhile, there is substantial evidence that indi- received a few days before. In my practice, I have
Postpartum Depression/Private Practice 303
Burns DD, Sayers SL, Moras K: Intimate relationships and Goldberg JF, Perlis RH, Ghaemi SN, et al: Adjunctive anti-
depression: is there a causal connection? J Consult Clin depressant use and symptomatic recovery among bipolar
Psychol 62:10331043, 1994 depressed patients with concomitant manic symptoms:
Calabrese JR, Bowden CL, Sachs G, et al: A placebo-con- findings from the STEP-BD. Am J Psychiatry 164:1348
trolled 18-month trial of lamotrigine and lithium main- 1355, 2007
tenance treatment in recently depressed patients with Gregoire AJ, Kumar R, Everitt B, et al: Transdermal oestro-
bipolar I disorder. J Clin Psychiatry 64:10131024, 2003 gen for treatment of severe postnatal depression. Lancet
Calabrese JR, Huffman RF, White RL, et al: Lamotrigine in 347:930933, 1996
the acute treatment of bipolar depression: results of five Harlow BL, Vitonis AF, Sparen P, et al: Incidence of hospi-
double-blind, placebo-controlled clinical trials. Bipolar talization for postpartum psychotic and bipolar episodes
Disord 10:323333, 2008 in women with and without prior pregnancy or prenatal
Cho HJ, Kwon JH, Lee JJ: Antenatal cognitive-behavioral psychiatric hospitalizations. Arch Gen Psychiatry 64:42
therapy for prevention of postpartum depression: a pilot 48, 2007
study. Yonsei Med J 49:553562, 2008 Ip S, Chung M, Raman G, et al: Breastfeeding and maternal
Corral M, Kuan A, Kostaras D: Bright light therapys effect and infant health outcomes in developed countries. Evid
on postpartum depression. Am J Psychiatry 157:303 Rep Technol Assess (Full Rep):1186, 2007
304, 2000 Leahy RL: Bipolar disorder: causes, contexts, and treatments.
Cowan MJ, Freedland KE, Burg MM, et al: Predictors of J Clin Psychol 63:417424, 2007
treatment response for depression and inadequate social Legeron P: [Predictive factors of a good response to cogni-
supportthe ENRICHD randomized clinical trial. Psy- tive therapies in depression]. Encephale 17:405409,
chother Psychosom 77:2737, 2008 1991
Cox JL, Holden JM, Sagovsky R: Detection of postnatal de- Leverich GS, Altshuler LL, Frye MA, et al: Risk of switch in
pression. Development of the 10-item Edinburgh Postna- mood polarity to hypomania or mania in patients with bi-
tal Depression Scale. Br J Psychiatry 150:782786, 1987 polar depression during acute and continuation trials of
Dennis CL: Treatment of postpartum depression, part 2: a venlafaxine, sertraline, and bupropion as adjuncts to
critical review of nonbiological interventions. J Clin Psy- mood stabilizers. Am J Psychiatry 163:232239, 2006
chiatry 65:12521265, 2004 McKenna MT, Michaud CM, Murray CJ, et al: Assessing the
Dennis CL, Hodnett E: Psychosocial and psychological in- burden of disease in the United States using disability-
terventions for treating postpartum depression. Coch- adjusted life years. Am J Prev Med 28:415423, 2005
rane Database Syst Rev (4):CD006116, 2007 McQueen K, Montgomery P, Lappan-Gracon S, et al: Evi-
Dennis CL, Stewart DE: Treatment of postpartum depres- dence-based recommendations for depressive symptoms
sion, part 1: a critical review of biological interventions. in postpartum women. J Obstet Gynecol Neonatal Nurs
J Clin Psychiatry 65:12421251, 2004 37:127136, 2008
Dodd S, Berk M: The safety of medications for the treatment Miklowitz DJ, Otto MW: Psychosocial interventions for bi-
of bipolar disorder during pregnancy and the puerpe- polar disorder: a review of literature and introduction of
rium. Curr Drug Saf 1:2533, 2006 the systematic treatment enhancement program. Psy-
Forray A, Ostroff RB: The use of electroconvulsive therapy chopharmacol Bull 40:116131, 2007
in postpartum affective disorders. J ECT 23:188193, Mojtabai R, Olfson M: National trends in psychotherapy by
2007 office-based psychiatrists. Arch Gen Psychiatry 65:962
Frank E: Treating Bipolar Disorder: A Clinicians Guide to 970, 2008
Interpersonal and Social Rhythm Therapy. New York, Murray L, Fiori-Cowley A, Hooper R, et al: The impact of
Guilford, 2005 postnatal depression and associated adversity on early
Gaynes BN, Gavin N, Meltzer-Brody S, et al: Perinatal de- mother-infant interactions and later infant outcome.
pression: prevalence, screening accuracy and screening Child Dev 67:25122526, 1996
outcomes, AHRQ Evidence Report No 119 (AHRQ Newham JJ, Thomas SH, MacRitchie K, et al: Birth weight
Publ No 05-E006-2). Rockville, MD, Agency for of infants after maternal exposure to typical and atypical
Healthcare Research and Quality, 2005 antipsychotics: prospective comparison study. Br J Psy-
Ghaemi SN, Wingo AP, Filkowski MA, et al: Long-term an- chiatry 192:333337, 2008
tidepressant treatment in bipolar disorder: meta-analyses Oberlander TF, Warburton W, Misri S, et al: Effects of tim-
of benefits and risks. Acta Psychiatr Scand 118:347356, ing and duration of gestational exposure to serotonin re-
2008 uptake inhibitor antidepressants: population-based
Gijsman HJ, Geddes JR, Rendell JM, et al: Antidepressants study. Br J Psychiatry 192:338343, 2008
for bipolar depression: a systematic review of random- OHara MW, Stuart S, Gorman LL, et al: Efficacy of inter-
ized, controlled trials. Am J Psychiatry 161:15371547, personal psychotherapy for postpartum depression. Arch
2004 Gen Psychiatry 57:10391045, 2000
Postpartum Depression/Private Practice 305
Oren DA, Wisner KL, Spinelli M, et al: An open trial of Sachs GS, Nierenberg AA, Calabrese JR, et al: Effectiveness
morning light therapy for treatment of antepartum de- of adjunctive antidepressant treatment for bipolar de-
pression. Am J Psychiatry 159:666669, 2002 pression. N Engl J Med 356:17111722, 2007
Peindl KS, Wisner KL, Hanusa BH: Identifying depression Taguchi H: [Maternal filicide in Japan: analyses of 96 cases
in the first postpartum year: guidelines for office-based and future directions for prevention] (in Japanese).
screening and referral. J Affect Disord 80:3744, 2004 Seishin Shinkeigaku Zasshi 109:110127, 2007
Rabheru K: The use of electroconvulsive therapy in special Turner EH, Matthews AM, Linardatos E, et al: Selective
patient populations. Can J Psychiatry 46:710719, 2001 publication of antidepressant trials and its influence on
Ramos E, St-Andre M, Rey E, et al: Duration of antidepres- apparent efficacy. N Engl J Med 358:252260, 2008
sant use during pregnancy and risk of major congenital Wisner KL, Perel JM, Peindl KS, et al: Prevention of recur-
malformations. Br J Psychiatry 192:344350, 2008 rent postpartum depression: a randomized clinical trial.
Rychnovsky JD, Brady MA: Choosing a postpartum depres- J Clin Psychiatry 62:8286, 2001
sion screening instrument for your pediatric practice. Wisner KL, Perel JM, Peindl KS, et al: Prevention of post-
J Pediatr Health Care 22:6467, 2008 partum depression: a pilot randomized clinical trial. Am J
Psychiatry 161:12901292, 2004
This page intentionally left blank
32
307
308 How to Practice Evidence-Based Psychiatry
father had been showing manic symptoms for cut family history of bipolar and perhaps other affec-
2 years, with decreased sleep, euphoria, irritability, tive disorders, and a full-blown manic episode of
impulsiveness, anger, and anxiety. He did not use al- psychotic proportion for his first entry into the psy-
cohol or drugs, and had never received any psychi- chiatric care system. One wonders why the family
atric treatments. His father and paternal grandfather did not pressure him to come for consultation before
had both committed suicide. His mother had a diag- the mania reached psychotic levels.
nosis of bipolar disorder and had been on lithium for He arrived at my office with the first decisions hav-
many years. He had a stable marriage with three ing already been made by the treating psychiatrist at
children. Medically he only had mild hypertension, the hospital. Because he presented with psychotic fea-
treated with hydrochlorothiazide. He was active in a tures, the use of olanzapine and lithium was correct by
Protestant church and did not use tobacco or caf- both guidelines, although the TMAP suggests olan-
feine. He was by all measures a successful business- zapine as an alternate stage 1 choice because of safety
man and citizen. concerns (stage 1 agents listed by TMAP are lithium,
At the time of admission to the outpatient service depakote, aripiprazole, quetiapine, risperidone, and
he completed the Patient Health Questionnaire9 ziprasidone; stage 1b choices are olanzapine and car-
(PHQ-9) and scored 8 of a possible 27, placing him bamazepine, with metabolic and hematologic con-
in the mildly distressed range. He did not claim any cerns). The treating psychiatrist noted that his family
anhedonia or depression, only indicating some history included successful treatment with lithium.
sleep, energy, and concentration problems. He de- Lithium levels were monitored several times during
nied any suicidality. his 2-week stay, reaching a maximum of 1.5 mm/L,
which prompted a reduction of dose to 900 mg/day.
He was started on olanzapine 20 mg/day, which was
DSM-IV-TR Diagnosis
raised to 40 mg/day after 1 week. Zolpidem 10 mg
Axis I Bipolar I disorder, most recent episode was given to improve his sleep pattern. The APA
manic with psychotic features guideline mentions short-term use of a benzodiaz-
Axis II None epine as sometimes useful, and TMAP suggests use of
Axis III Hypertension, mild hypnotics for insomnia. His manic and delusional be-
Axis IV Conflicts with wife haviors gradually quieted.
Axis V GAF score (at time of discharge from Mr. E.S. had been treated in the past with hydro-
hospital): 55 chlorothiazide for hypertension; this was discontin-
ued because of the interaction of the diuretic with
Treatment Plan Considerations lithium excretion, and he was placed on clonidine,
which effectively managed this issue. TMAP sug-
Selecting a Guideline gests clonidine as adjunctive treatment for agitation
Kaiser Permanente of Northern California pro- or aggression as well. He also had some constipa-
motes the use of the Texas Medication Algorithm tion, which was treated with docusate sodium.
Project (TMAP) guideline (Suppes et al. 2005) for Although he remained hyperverbal and not en-
medication treatment of bipolar disorder. The more tirely convinced that his beliefs were delusional, he
comprehensive American Psychiatric Association improved enough to be discharged to home and out-
(APA) practice guideline (2006) uses nearly identical patient follow-up.
algorithms for medications for the manic, mixed,
and depressed phases of this illness. In the discussion Posthospital Management in the
to follow in this chapter, I compare and contrast any Kaiser System
differences between the two sets of guidelines as ap- Mr. E.S. was now entering the more difficult part of
plied to this case. his recovery, that of adapting to new realities and
regaining function, hopefully at a level equal to or
Manic Episode better than his premorbid functioning. The APA
Mr. E.S. did not present any diagnostic challenges, guideline stresses the need to establish a therapeutic
coming in with a straightforward history of premor- alliance, educate the patient and family about the ill-
bid hypomanic traits, no drug or alcohol use, a clear- ness, monitor symptoms, ensure safety, promote
Bipolar Disorder/Kaiser Permanente System 309
awareness of stressors and regular patterns of activ- taking olanzapine 40 mg/day, lithium 900 mg/day,
ity and sleep, and manage functional impairments. zolpidem 10 mg at bed, and clonidine for his hyper-
In the Kaiser system of psychiatric care, nearly all tension. Weight was 182 lb (body mass index= 28),
patients who are discharged from inpatient stays are slightly below his normal weight of 190 lb. My as-
enrolled in a short course of day treatment, labeled sessment of him was that he was probably always hy-
intensive outpatient (IOP). At the South San Fran- pomanic, but never truly manic until this episode. I
cisco Clinic where this gentleman was enrolled, the believed he was responding fairly well to the lithium
day treatment meets for 3 hours every Monday, and olanzapine, but likely would need to switch to
Wednesday, and Friday mornings, in a group room. another neuroleptic soon, because of metabolic issues
The format is interactive group didactic lectures and of weight gain and altered glucose metabolism. His
videos, with training given in relaxation techniques, fasting blood sugar was mildly elevated on repeated
stress and anger management, cognitive-behavioral checks.
therapy (CBT), dialectical behavior therapy (DBT), He attended IOP every Monday, Wednesday, and
substance abuse issues and recovery, and psychotro- Friday mornings as requested, participating actively.
pic medications. Social workers, psychologists, a I saw him for 10 to 20 minutes individually during
registered nurse, and a physician meet with the 8 to most of these mornings, with his wife often present
20 patients in various combinations. Each patient is for the interviews with me. He seemed to be clearing
assigned to a staff member who meets with him or up steadily at first, becoming more normal in ap-
her individually at least once a week. The normal pearance and speech. He began to complain of feel-
course is 24 weeks of attendance, sometimes more. ing weak, which he blamed on the olanzapine. I
During their IOP course the patients meet with the elected to lower the olanzapine dosage to 30 mg/ day
psychiatrist on their case one or more times per to address this complaint. Serum lithium level was
week of attendance. This format of care allows for 0.6 mEq/L.
meeting all the recommendations published in the By 2 weeks after discharge from the hospital he re-
APAs sensible guideline. ported feeling ready to return to work but continued
to complain of side effects, this time complaining of
Treatment Goals, Measures, and Methods erectile dysfunction. He and his wife met with me to
report that they had unilaterally decided to stop the
1. Achieve euthymia within 2 months, as reported olanzapine 2 days earlier. At that time he looked
by patient and family, scored on the PHQ-9, and improved, with no return of manic symptoms, so
observed by treatment staff, using pharmaco- I reluctantly agreed with their decision, in order
therapy, psychoeducation, CBT, and group and to maintain our developing therapeutic alliance. I
family support. The PHQ-9 (Spitzer et al. 1999) scheduled a follow-up appointment in 2 weeks.
is a nine-item instrument used in the Kaiser sys- Unfortunately he deteriorated rapidly, develop-
tem for a quick assessment of depression. ing suicidal ideation 8 days after stopping the olan-
2. Return to full functioning in his work within zapine. He had also by this time stopped taking the
2 months, measured by self-report of satisfactory lithium, a medication that he feared. He rarely took
performance, using pharmacotherapy and sup- any medications, even aspirin. His father had com-
portive therapy for patient and his wife. mitted suicide after being recommended to take
lithium. His wife brought him in for an urgent ap-
pointment, and they resumed lithium 900 mg/day at
Course my prompting.
Mr. E.S. presented to IOP and his initial outpatient A week later he returned looking very sad, talking
evaluations as disheveled, fidgety, with loud voice and of guilt and failure in his career, complaining of not
pressured rambling speech, though he was generally sleeping, feeling hopeless, acting withdrawn, sitting
logical. He seemed to understand that he had been motionless. He denied ongoing suicidality at this
delusional but would occasionally offer rationaliza- visit. I diagnosed a switch into the depressed phase of
tions, which hinted that he was unsure. He was coop- the illness, and resumed his olanzapine at 20 mg/day.
erative with the treatments outlined, but somewhat TMAP calls for raising the lithium level to 0.8 mEq/
reluctant. He attended dutifully, however. He was L or above, continuing the second antimanic agent,
310 How to Practice Evidence-Based Psychiatry
and adding lamotrigine. I delayed starting the la- standard dosages of medications, given the vocal op-
motrigine because of the earlier good response to position to medications both the patient and his wife
lithium and olanzapine, hoping he would respond to expressed.
resumption of those medications. I planned to see
him two or three times a week, so I could change Week 9
treatments rapidly as indicated. Over the weekend the patient had done poorly, be-
ing observed to stand in one place and stare. His wife
Second Hospitalization thought he was responding to internal stimuli. In the
Two days later he came to the emergency depart- Monday morning group he looked worse, appar-
ment of the hospital, where the on-call psychiatrist ently slipping back into catatonic behaviors. He ex-
diagnosed a severe depression, near catatonic level. pressed extreme guilt feelings, worrying about
He presented as disheveled, with poor hygiene, psy- exhausting his wife and letting his employees down.
chomotor retardation, blunted depressed affect, and He was very pessimistic about getting better. In my
tangential thoughts; he was preoccupied with poor office he was moving somewhat stiffly and showed a
business decisions made while manic and with his fine tremor of his hands and tongue, but had no cog-
current inability to work. The doctor placed him in a wheeling or dyskinetic movements. I had him in-
psychiatric unit again, on a legal hold for grave dis- crease his ziprasidone to 40 mg bid again and added
ability, potential suicide risk, and treatment non- clonazepam 0.5 mg to 1 mg bid-tid for anxiety and
compliance. sleep. TMAP supports use of benzodiazepines tar-
The hospital psychiatrist found an elevated ran- geted to anxiety and hypnotics for sleep. I also added
dom glucose level of 156. That, combined with his bupropion 100 mg/day for 2 days, then to increase
complaints of fatigue and weakness on olanzapine, to 200 mg/day. This is listed as a stage 4 maneuver
prompted the doctor to change his olanzapine to by TMAP. For stages 2 and 3, TMAP suggests using
ziprasidone 40 mg bid. The doctor also started la- lithium and lamotrigine plus quetiapine or olanza-
motrigine 25 mg bid for the depression, and contin- pine/fluoxetine combination, which I was avoiding
ued his lithium. Within 5 days he was noticeably because of the metabolic issues here. By Friday,
better and was discharged to home. 4 days after making these medication changes, he
was beginning to look somewhat better, with better
color in his face and describing being more able to
Return to Outpatient Setting
take care of some chores at home. He had a deter-
Week 8 mined attitude by then, relaying the impression that
Mr. E.S.s wife called to report he was very de- he would soldier ahead through his ordeal.
pressed, with little interest in doing anything. She
asked for help with ideas on how to lift him out of his Discussion
depression. She was reminded to bring him in for his This sequence of events shows the importance of
appointments the next day. She was noncommittal not lowering medications too soon because of both-
about family support group sessions. He came in for ersome side effects. Perhaps we could not have per-
IOP and psychiatric visits, looking quite depressed, suaded this couple to continue the dosages he was on
saying my thoughts are locked up, like my mind has when he came out of the hospital, but he probably
erased itself. would have had a smoother course of recovery from
At this point he had been on the lamotrigine for his psychotic episode if the olanzapine and lithium
2 weeks. He had come out of the hospital on ziprasi- had not been lowered and stopped. He might have
done 40 mg bid, but it had been lowered to once slipped into depression anyway, but one suspects
daily by the on-call psychiatrist when he called in that the second hospital stay could have been
and complained of feeling too tired. He was taking avoided. And when he did end up hospitalized again,
zolpidem at the 20 mg level and was free of suicidal the ziprasidone was lowered almost immediately af-
ideation and delusions. When he came to my office I ter discharge, and he suffered an apparent worsen-
let the lower ziprasidone level remain and increased ing of his depression after that. He responded within
his lamotrigine to 75 mg/day for 2 weeks. Again I 5 days of returning it to 80 mg (40 mg bid), plus hav-
felt constrained against loading up this man with ing bupropion and clonazepam added.
Bipolar Disorder/Kaiser Permanente System 311
assisting with the sexual issues, using it instead of slow down their attempts at withdrawing the medi-
prn clonazepam for sleep. I e-mailed his internist to cations. Since sexual performance problems proved
ask for clearance to use sildenafil as an aid. to be a major concern later, perhaps they were caus-
ing some of the early resistance to the medications,
Week 47 and discussing sexual issues earlier would have been
PHQ-9 =1 (no depression). Again the patient and his helpful.
wife reported he was doing well, continuing to walk Also, I will more quickly return to the same levels
and lose weight, sleeping well, able to socialize com- of medicines that were working before, and not be as
fortably even in large groups. He continued to have hesitant to perhaps cause a few extra side effects. I al-
erectile dysfunction, with incomplete erections and ready move quite slowly and deliberately when with-
infrequent intercourse. Serum lithium level was 0.8 drawing such people from medications, if they
mEq/L on 900 mg, weight was down to 172 lb. His permit me to guide them thusly.
affect had improved to be quite relaxed and natural, I will also be much more likely to consistently use
no longer with a flattened quality. I had him take all measurement tools such as the PHQ-9. The Young
his lamotrigine at bedtime and reduced the traz- Mania Rating Scale also would have been useful af-
odone to prn use only. He took a sildenafil prescrip- ter his first hospital stay, as he was recovering from
tion with him, pending approval by his internist. the manic episode. The act of completing the scale
could serve as an important educational moment for
Week 55 the patient and his wife.
PHQ-9 = 2 (no depression). He continued to do Perhaps most importantly, the work of writing up
well. They had gone on another cruise and reported this case has illustrated to me the value of referenc-
that the sexual issues had resolved with the use of ing the published treatment guidelines from time to
sildenafil. He discussed some guilt at things that had time in order to reduce uncertainty for the clinician
transpired between himself and his son during his and speed recovery for the patient.
initial hospitalization. His weight and lab values re-
mained stable, within normal limits except for a
mildly elevated fasting blood sugar level of 94.
References
American Psychiatric Association: Practice Guidelines for
Tables 311 and 312 list the TMAP algorithms for the Treatment of Psychiatric Disorders, Compendium.
bipolar disorder, manic and depressed phases, and Washington, DC, American Psychiatric Publishing,
2006
summarizes how closely they were followed in this
Spitzer RI, Kroenke K, Williams JBW: Validation and utility
case. of a self-report version of PRIME-MD: the PHQ pri-
mary care studyPrimary Care Evaluation of Mental
Ways to Improve Practice Disorders, Patient He alth Questionnaire . JAMA
282:17371744, 1999
This case illustrates the danger of lowering thera- Suppes T, Dennehy EB, Hirschfeld M, et al: The Texas Im-
peutic medications too early and too rapidly in the plementation of Medication Algorithms: update to the
bipolar individual. In retrospect, I would have spent algorithms for treatment of bipolar disorder. J Clin Psy-
more time with this patient and his wife in trying to chiatry 66:870886, 2005
Bipolar Disorder/Kaiser Permanente System 313
Recommendation Followed
Stage 1 Monotherapy with lithium, valproate, aripiprazole, Inpatient physician put him on stage 2
quetiapine, risperidone, ziprasidone, or Stage 1b, treatment immediately
olanzapine or carbamazepine, plus targeted adjunctive
treatments
Stage 2 Two-drug combination of lithium, valproate, or atypical Yes. Lithium plus olanzapine and
antipsychotic, plus targeted adjunctive treatments such as zolpidem
benzodiazepines, hypnotics
Stage 3 Try another two-drug combination of lithium, valproate, Not needed
atypical antipsychotics, carbamazepine, oxcarbazepine,
typical antipsychotics, plus targeted adjunctive treatments
Stage 4 Electroconvulsive therapy or add clozapine or Not needed
lithium+ valproate or carbamazepine or
oxcarbazepine+atypical antipsychotic
TABLE 322. TMAP algorithm for the treatment of bipolar disorder, currently depressed
Recommendation Followed
Stage 1 Antimanic + lamotrigine. If lithium, increase dose Patient was on lithium and olanzapine for
to 0.8 mania before switching to depressed
phase.
Stage 2 Antimanic + lamotrigine + quetiapine or Lamotrigine was started at the second
olanzapine/fluoxetine combination (OFC) hospital stay (for depression).
Stage 3 Combination from lithium, lamotrigine, quetiapine, or Ziprasidone replaced olanzapine because
OFC of metabolic and other side effects.
Stage 4 Lithium, lamotrigine, quetiapine, OFC, valproate, or Bupropion was added.
carbamazepine+SSRI, bupropion, or venlafaxine; or ECT
Stage 5 MAOIs, tricyclics, pramipexole, other atypical Clonazepam, zolpidem, and trazodone
antipsychotics, oxcarbazepine, other were used.
Note. ECT=electroconvulsive therapy; MAOIs=monoamine oxidase inhibitors; SSRI= selective serotonin reuptake inhibitor.
This page intentionally left blank
33
Consultation-Liaison Psychiatry
Anthony J. Mascola, M.D.
Setting Illustration
The psychiatric consultation-liaison service provides This study illustrates:
psychiatric care and support to patients admitted to
the medical and surgical services of the medical cen- Common biases affecting our diagnostic methods
ter. It is a unique practice environment that provides Importance of the first step in the EBM cycle
many opportunities to apply the tenets of the evi- assessment:
dence-based medicine (EBM) model. Disturbances Importance of, and methods for generating, a
of mood and behavior in the setting of serious med- reasonable differential diagnosis for the pa-
ical illness might reasonably be considered psycho- tients symptoms
logical reactions to the extreme stressors present in Importance of carefully considering the pre-
such an environment. They could represent exacer- test probabilities of the conditions in the dif-
bations of a preexisting psychiatric illness. There ex- ferential diagnosis
ists also the possibility of a much broader differential Making use of the operating characteristics of
diagnosis of potential causative factors given the tests, including those describing diagnostic
high pretest probability of medical, pharmacologi- accuracy (likelihood ratios) and reliability
cal, and surgical conditions associated with psychiat- (kappa)
ric symptoms in these settings. Teasing these factors Combining pretest probability estimates with
apart and assigning a diagnosis that might optimally likelihood ratios to estimate the posttest prob-
assist the clinician in easing the suffering of the pa- ability of a given diagnosis in the differential
tient can be challenging. The focus of this case is on
Asking focused, answerable clinical questions to
using an evidence-based approach to diagnosis.
search the medical literature
Acquiring information
Recommended Prior Knowledge Appraising information on diagnostic tests for va-
lidity and relevance
If you are unfamiliar with the evidence-based diag-
Applying information using a shared decision-
nostic process, it is highly recommended that you
making model that incorporates published evi-
read the introductory chapters in part I of Steven
dence, clinical judgment, and patient and family
McGees excellent text on evidence-based physical
preferences
diagnosis (McGee 2007) or the introductory article
Assessing both patient outcomes and the process
by Sackett (1992) before proceeding.
of decision making used
315
316 How to Practice Evidence-Based Psychiatry
anxiety. His ECG showed atrial fibrillation with a documented to be alert and oriented 3 and to be
rate of 110 bpm but was otherwise not significantly responding to commands in the notes. His exam
changed. His QTc was 470 msec. Repeated assays of was documented as being nonfocal. On postopera-
his cardiac troponin I and creatine kinase-MB were tive day 3, however, he appeared to be anxious,
within normal limits. He was started on metoprolol, depressed, and tearful. The nurse informed the
and his amlodipine, benazepril, aspirin, and atorvas- team that she felt the patient was growing increas-
tatin were continued. His heart rate returned to the ingly upset, possibly as a result of having to deal
90s to low 100s, and his blood pressure ranged in the with several of the previously mentioned medical
previous 24 hours of our consultation from 124/80 problems that were developing and were complicat-
to 136/90 mm Hg. ing his recovery.
A percutaneous gastrostomy tube had been in- He continued to be oriented 3 and able to re-
serted, as the patient would need to remain on a spond to commands and continued to be described
nothing by mouth (NPO) regimen for several as denies pain. In the evening before our consul-
months as a result of the procedure performed. The tation on postoperative day 3, the patient was noted
patient developed abdominal pain with feeding as having become increasingly tearful, upset, and
through the tube and was taken back to the operat- anxious, gesticulating tremulously with his hands in
ing room for exploratory laparoscopy and replace- a manner that appeared to the nursing staff to be in-
ment after peritoneal extravasation was noted with a sisting that he was thirsty and wanted to drink
contrast study. His medications were switched to in- water. He was receiving intravenous fluids as well
travenous equivalents wherever possible. After the as nutrition through his gastrostomy tube. He was
tube was replaced, the patient was able to receive his NPO and had been instructed repeatedly not to
medications and nutritional support via the gastros- drink. Despite this, he repeatedly reached for water
tomy tube. He continued to take omeprazole. He on the nursing tray at the bedside that was intended
had bowel movements daily or every other day, and to flush his gastrostomy tube. He attempted to drink
there was no evidence of impaction. this several times despite repeated instructions to re-
The patient was febrile on postoperative day 2 to main NPO before the water was removed from the
38.6C despite receiving clindamycin, which was bedside by the nursing staff. He was tearful and was
documented as being prescribed for prophylaxis not consolable. Shortly afterward he was adminis-
during the surgery. His surgical site appeared unre- tered lorazepam and hydromorphone intravenously,
markable; his skin was examined and no pressure and he became more sedate.
sores or ulcers were noted. His pulmonary exam and The nursing staff described feeling frustrated that
diagnostic tests, as described previously, were not he was acting in an anxious and irrational manner,
felt to be consistent with pneumonia. Blood, spu- which might complicate his recovery. He was de-
tum, and urine cultures were sent for analysis. Lum- scribed as being restless overnight and did not
bar puncture was not performed. He was started on sleep well. He would not participate in the trache-
ciprofloxacin for what appeared possibly to be a con- ostomy care and tube feeding training exercises rec-
sideration for peritonitis from the extravasation of ommended by his nursing staff the following day,
the gastrostomy tube. On postoperative day 3 the and he appeared withdrawn from communication.
ciprofloxacin was written as being prescribed for a On the same day he was later described as appearing
presumed urinary tract infection as 2+ leukocyte es- panicky at times. The team, noting the anxiety
terase was noted on his urinalysis. that had been mentioned in the preoperative consul-
From a neurologic and psychiatric perspective, tation notes, asked the patient if he was feeling de-
the patient was noted immediately postoperation to pressed, and he seemed to nod yes in agreement to
be heavily sedated with midazolam and fentanyl. He this and to questions about whether he felt like life
received additional intermittent hydromorphone hy- was not worth living anymore, although he would
drochloride for pain. His pain was documented as be- not elaborate. The psychiatry consult was then re-
ing well controlled and 0/10 in the nursing notes. quested to better assess the patients worsening
On postoperative day 2 he was extubated, the midaz- anxiety and depressed mood, which were interfer-
olam was stopped, and he was started on patient-con- ing with his ability to participate in tracheostomy
trolled analgesia with morphine. At that time he was and gastrostomy self-care instruction and training.
318 How to Practice Evidence-Based Psychiatry
A specific question asked of the team was should an knowledge and experience with these syndromes al-
antidepressant be initiated? low us to make educated guesses as to the options
most likely to achieve optimal outcomes for our cur-
rent patient. The more closely our clinical setting
Other Significant Findings
and diagnostic methods are to those of clinicians
From Assessment who have previously conducted carefully controlled
Being called to assess a patient in a scenario similar clinical research trials on these syndromes, and the
to that presented previously is a relatively common closer our patients experiences are to the syndromes
and challenging task requested of the consultation- described within these trials, the more confidently
liaison team. This patient appeared to be upset with we might be able to make inferences from the
his care and to be suffering from anxiety and de- knowledge gained. Where these things are very dis-
pression to the primary team. He was known to be similar we are unlikely to be able to confidently fore-
in a chronic state of poor health and to have been ad- cast future outcomes. A person experiencing a
mitted for treatment of his recurrent laryngeal can- depressive syndrome highly similar to the symptoms
cer. He had suffered a series of complications after reported by persons described as having major de-
his procedure. He was unable to speak but appeared pressive disorder in a high-quality randomized con-
tearful and to endorse symptoms of depressed trolled trial conducted in a similar setting might
mood, anhedonia, and hopelessness. He appeared at benefit from the treatments that this research has
times to be anxious and to have difficulty sleeping. found helpful. A person whose pattern of symptoms
He had thoughts of death and seemed to endorse and signs are more similar, however, to those exhib-
that his life was not worth living. He initially ap- ited by the group whom we conceptualize as having
peared to be actively refusing reasonable inter- bipolar depression might respond differently to
ventions such as remaining NPO to improve his these same interventions. Those whose depressive
outcome and was then observed to be sullen and symptoms are associated with additional symptoms
withdrawn and to refuse physical therapy and reha- and signs suggesting profound hypothyroidism, or
bilitation. The psychological stress and existential alcohol use or amphetamine withdrawal, or obstruc-
issues in dealing with severe medical illness and the tive sleep apnea or hypoactive delirium, and so on,
complications of treatment were high. The medical might respond differently still. Thus, where treat-
team felt these symptoms were causing sufficient in- ment options exist that might result differentially in
terference with his recovery and wondered whether better or worse outcomes for the patient, it is impor-
an antidepressant should be initiated. tant to consider carefully the diagnostic process used
Before we proceed further, take a moment to to assign an accurate, reproducible diagnosis so that
briefly write down three to five diagnoses you might we can better guide our decision making (Pauker
consider in this patient. We will return to this later and Kassirer 1980).
as an exercise in discussing hindsight bias (Bornstein
and Emler 2001). Please write these down now. Common Diagnostic Biases Leading to
Errors in Assigning Diagnoses
Diagnosis The procedures that we use to assign a diagnosis
vary. An approach often taken by clinicians is to as-
Importance of Assigning an Accurate, sign a diagnosis based on the clinical gestalt sug-
Reproducible Diagnosis gested by the pattern of symptoms observed in
Clinicians assign diagnoses in their attempts to examination of the patient. This has the advantage of
search for relevant past experiences that might per- being rapid and can be quite accurate when applied
mit them a better inductive forecast of the future by experienced clinicians (Chunilal et al. 2003).
and guide their decision making to improve patient There are situations, however, in which this ap-
outcomes. We see a patient today and consider how proach is susceptible to a number of biases that can
well their circumstances and pattern of symptoms lead to assigning diagnoses very different from those
might be conceptualized as part of one or more pre- using more optimal examination methods (Bornstein
viously operationalized diagnostic syndromes. Our and Emler 2001). One of the most common biases
Consultation-Liaison Psychiatry 319
that can occur resulting in assigning an incorrect di- differential diagnosis is a method that we use to
agnosis is failing to account for how common a given combat these biases.
diagnosis might be in a given setting. This error of In this case, many diagnoses possibly were consis-
ignoring the pretest probability or base rate of a tent with this patients symptoms and circumstances.
given diagnosis and being susceptible to being overly Numerous serious medical conditions were present,
influenced by the patients clinical presentation or and multiple medications were being prescribed to
test findings is a violation of a mathematical theorem this patient in the intensive care unit (ICU) in which
of probabilistic reasoning called Bayes theorem. This the delirium syndrome is known to be quite preva-
bias, sometimes referred to as the representativeness lent (Ely et al. 2004). Delirium can present with pro-
bias, is a well-documented source of diagnostic error found anxiety and depressive symptoms and is often
(Bornstein and Emler 2001; Casscells et al. 1978; overlooked (Farrell and Ganzini 1995). Treatments
Ghosh et al. 2004; Kahneman et al. 1982; Lyman and for delirium would involve actively seeking and cor-
Balducci 1993, 1994). In medicine we use the phrase recting the medical causes of these symptoms, and
when you hear hoofbeats, think of horses, not ze- this would differ markedly from an approach recom-
bras as a reminder to ourselves not to forget to in- mended for major depressive disorder. Persons with
corporate the base rates of a given diagnosis in a preexisting dementia, anxiety disorders, mood dis-
particular setting. Applying this clinically, however, orders, or multiple other psychiatric conditions
is challenging even with training (Steurer et al. might have increased difficulty coping with the ex-
2002). Knowing how to combine estimates of the treme stresses present in this case. We knew nothing
pretest probability of a given diagnosis in a particular of this patients prior history and whether the symp-
setting together with the clinical features that distin- toms observed were acute or chronic. Substance-
guish this diagnosis from others in the differential is and medication-related effects as well as their with-
part of the art of practicing evidence-based medicine drawal could cause or exacerbate the symptoms ex-
that we will illustrate with this case. hibited. Any number or combination of factors
potentially could be contributing to the symptoms
Differential Diagnosis that our patient was exhibiting.
A diagnostic testing threshold (Pauker and Kassirer
When Should a Differential Diagnosis and 1980) had therefore been reached. The treatment
Further Diagnostic Testing Be Considered? recommendations varied widely for the conditions
In psychiatry, our clinical trials most often use the that could be present, and we were not convinced
procedures suggested by DSM-IV-TR (American that major depressive disorder was the best or the
Psychiatric Association 2000) to assign diagnoses. only diagnosis consistent with this patients symp-
The patient in this case certainly did appear to have toms. We had not yet crossed a testtreatment thresh-
many symptoms similar to the pattern described as old in which we could feel confident in our making
being present in a DSM major depressive episode. treating recommendations. This prompted us to ex-
This diagnosis appeared to be a good snap fit to pand the differential diagnosis beyond the diagnosis
the primary team. Would there be any point in gen- of a major depressive episode and to conduct further
erating a differential diagnosis? Major depressive diagnostic assessment. In general, as per Pauker
disorder was certainly a possibility. The pattern was (Pauker and Kassirer 1980), treatment should be
clearly not an exact match, but similar features cer- withheld if the probability of disease is smaller than
tainly were present. the diagnostic testing threshold, and treatment
A second bias often affecting clinical decision should be given without further testing if the prob-
making is called the confirmation bias. This occurs ability of disease is greater than the testtreatment
when we selectively gather and interpret evidence threshold. Further diagnostic testing should be con-
that confirms a diagnosis and ignore evidence that sidered (with treatment depending on the test out-
might disconfirm it. Another bias that often occurs come) only if the probability of disease is between
affecting the validity of a diagnosis is called the avail- the two thresholds.
ability bias. This bias occurs when we overestimate How might a differential diagnosis be generated?
the probability of a diagnosis when instances of that A final bias that must be considered in diagnostic de-
diagnosis are relatively easy to recall. Generating a cision making is called regret bias. This occurs when
320 How to Practice Evidence-Based Psychiatry
we overestimate the probability of a diagnosis with a those causes that cannot be missed (prognostic ap-
severe possible outcome because of anticipated re- proach) as well as those that are highly likely in that
gret if such a diagnosis were missed (Bornstein and practice setting (probabilistic approach) that can be
Emler 2001). We can consider an approach that bor- treated resulting in better patient outcomes (prag-
rows elements of several potential strategies that a matic approach).
reasonable clinician might use to form a differential The DSM-IV-TR Handbook of Differential Diagno-
diagnosis (Richardson et al. 1999) that minimizes sis (First et al. 2002) is a resource that we might con-
the risks of the various biases introduced previously. sider consulting to help us form and focus our initial
We might consider a broad differential diagnosis differential diagnosis. It includes decision trees (see
(possibilistic approach) that weights more heavily Figure 331) that help the psychiatric clinician to use
Consultation-Liaison Psychiatry 321
FIGURE 331. DSM-IV-TR decision tree for differential diagnosis of anxiety (continued).
procedures to assign diagnoses consistent with those Occurrence rates of delirium in hospitalized medical
of the formal procedures described in the text of the patients range from 11% to 42% of all admitted pa-
DSM used in randomized controlled trials. It is or- tients (Siddiqi et al. 2006) on general medical units.
ganized somewhat consistently with the pragmatic Estimates are much higher for those in the ICU,
strategy described previously, weighting those con- where our patient consultation occurred. For exam-
ditions such as disorders commonly caused by med- ple, a well-designed prospective study using vali-
ical or substance-related etiologies as diagnoses to dated methods for detecting delirium found that
examine prior to assigning other diagnoses because 81.7% of mechanically ventilated patients in the
these syndromes might have important treatment ICU were delirious (Ely et al. 2004). Despite the
implications. The clinician must use this tool care- high prevalence rates, clinicians are often led astray
fully because many nuanced factors must be consid- by the clinical presentation of delirium. Delirious
ered together with this resource, as we will see. patients often endorse anxious and depressive symp-
Delirium, dementia, and anxiety secondary to a toms, such as low mood (60%), worthlessness
general medical condition or pharmacological sub- (68%), and frequent thoughts of death (52%) (Far-
stance intoxication/withdrawal are the diagnoses rell and Ganzini 1995), as part of the delirium syn-
that appear at the top of the list from the DSM-IV- drome. Patients who are alert, easily aroused, able to
TR Handbook of Differential Diagnosis. Delirium is an make eye contact, and able to follow commands are
extremely prevalent state of acutely altered mental often presumed by clinical staff to have normal cog-
status that occurs in patients who are seriously ill. nitive functioning, but 40% of these patients have
322 How to Practice Evidence-Based Psychiatry
been found to be delirious when examined by more TABLE 331. DSM-IV-TR diagnostic criteria
rigorous examination methods (Ely et al. 2001a). for delirium due to multiple
Acute changes in mental status in elderly patients in etiologies
medical settings frequently are misattributed to pri-
A. Disturbance of consciousness (i.e., reduced clarity
mary psychological causes such as anxiety or depres-
of awareness of the environment) with reduced
sion (Boland et al. 1996; Farrell and Ganzini 1995; ability to focus, sustain, or shift attention.
Nicholas and Lindsey 1995; Swigart et al. 2008), if
B. A change in cognition (such as memory deficit,
they are diagnosed at all (Gustafson et al. 1991; In-
disorientation, language disturbance) or the
ouye 1998; Inouye et al. 2001). Delirium is an im- development of a perceptual disturbance that is
portant risk factor for increased mortality in both not better accounted for by a preexisting,
general medical (Siddiqi et al. 2006) and ICU set- established, or evolving dementia.
tings (Ely et al. 2004) and has very different treat- C. The disturbance develops over a short period of
ment implications than the other diagnoses consid- time (usually hours to days) and tends to fluctuate
ered in the differential. Delirium can be a marker of during the course of the day.
serious substance withdrawal syndromes and other
D. There is evidence from the history, physical
acutely unfolding medical conditions and thus be- examination, or laboratory findings that the
came a very important diagnosis for us to consider in delirium has more than one etiology (e.g., more
our differential diagnosis. than one etiological general medical condition, a
DSM-IV-TR diagnostic criteria for delirium ap- general medical condition plus substance
pear in Table 331. intoxication or medication side effect).
Source: American Psychiatric Association 2000, p. 147.
Narrowing the Differential Used with permission.
The patient at the time of our examination was un-
fortunately unable to speak to us as a result of his re- different treatment than we would for a patient agi-
cent laryngectomy. There was little information tated from Alzheimers disease. Thus a diagnostic
available in the chart record about any past psychi- testing threshold had been reached to tease these
atric history, cognitive impairment, dementia, or apart. The absence of dementia would make our
substance use, and no family members were present search for underlying reversible physiologic causes
at the bedside. We did not know if the patient lived much more important. The presence of dementia of
independently or in an assisted living facility or if he course would not exclude a delirium upon dementia
had caregivers at home. This is a common scenario and would result in a much more careful and detailed
that can make assessment more challenging. Often examination before we felt comfortable in excluding
in these cases attempting to collect information this possibility. Unfortunately, detection of dementia
from collateral historians and conducting a thor- in clinical settings is difficult (Ardern et al. 1993;
ough physical and mental status exam are the only Boustani et al. 2003; Chodosh et al. 2004; Holsinger
sources of information available. et al. 2007; Olafsdottir et al. 2000; Pisani et al. 2003b;
DSM-IV-TR diagnostic criteria for delirium re- Roca et al. 1984; Valcour et al. 2000). The absence of
quire that a preexisting dementia be excluded as be- mention of dementia in the medical record was un-
ing better able to account for the disturbances ob- likely to exclude this as a diagnostic concern.
served. Because delirium was the most critical
diagnosis in our differential, evaluating for preexist-
Distinguishing Dementia and Delirium From
ing dementia thus became important. Treatment rec- Other Diagnoses in the Differential
ommendations for agitation in dementia could be
considerably different from those recommended for An Introduction to Likelihood Ratios, Pretest
delirium, which focus much more intensely on iden- Probability, and Evidence-Based Diagnosis
tifying and primarily correcting underlying physio- In an ideal scenario, the clinical judgment of the ex-
logic processes and secondarily on pharmacothera- perienced physician is informed by the pretest prob-
pies to help manage agitation. If the patient were abilities of some of the more important potential
delirious from alcohol or benzodiazepine withdrawal, causes in the differential diagnosis that might occur
for example, we would recommend a substantially in that specific practice setting (Richardson et al.
Consultation-Liaison Psychiatry 323
1999, 2000a, 2000b, 2003). Diagnostic procedures Does the Patient Have Dementia?
with operating characteristics derived from high- We knew from a well-designed prospective study us-
quality diagnostic studies conducted in similar set- ing validated methods for detecting delirium that
tings (Bossuyt et al. 2003b) might be used to assist more than 80% of mechanically ventilated patients
the clinician in sorting through the differential. in the ICU were delirious (Ely et al. 2004) The prev-
Likelihood ratios are the operating characteristics of alence of dementia is not well studied in inpatient
various clinical findings (including items in the his- medical settings. Our previous exploration of the
tory, physical exam, or diagnostic tests) that we use medical literature had yielded only one study that we
in combination with pretest probabilities to estimate felt provided a reasonable estimate of the prevalence
the posttest probability of a given condition being rate of preexisting (nondelirious) cognitive impair-
present (Deeks and Altman 2004; Sackett 1992). ment in the ICU (Pisani et al. 2003a). This study es-
Rarely are these findings capable of ruling in or timated the pretest probability to be 42%. If we
ruling out a diagnosis by themselves. Likelihood ra- make the assumption for the time being that this es-
tios are weighting factors that tell us how strongly timate was a reasonable one, we then are faced with
the presence or absence of a given finding is in influ- the task of identifying and implementing further di-
encing our estimate of the probability of a given dis- agnostic procedures with known operating charac-
order being present. Understanding these operating teristics by which to modify our pretest probability
characteristics is important in assisting us in over- estimates.
coming representativeness bias. Several studies sug- Examining a nonverbal patient in the ICU under
gest that we often grossly overestimate the findings medical duress for dementia is not an easy task. We
of the clinical presentation and diagnostic tests in hoped to find diagnostic procedures using collateral
our decision making (Ghosh et al. 2004; Lyman and historians as informants to assist us in our task. Be-
Balducci 1993, 1994; Rothman and Kiviniemi 1999; cause this situation arises so often and has important
Sackett 1992; Steurer et al. 2002; Streiner 2003). A diagnostic implications, we previously have con-
likelihood ratio greater than 1 indicates that a given ducted a focused search of the literature to find an
finding is associated with the presence of the disease, answer to the PICO question below (see Chapter 3
whereas a likelihood ratio less than 1 indicates that a of this volume and Richardson et al. 1995).
given finding is associated with the absence of dis-
ease. The further likelihood ratios are from 1, the Ask
stronger the evidence for the presence or absence of
Patient/population: Medically ill elderly hospital-
disease. Likelihood ratios above 10 and below 0.1
ized patients suspected of having dementia.
are considered to provide strong evidence to rule in
or rule out diagnoses, respectively, in most circum-
Intervention: Brief, structured, informant-based in-
stances; however, the pretest probability must al-
terview.
ways be considered. Diagnostic procedures for
which likelihood ratios are available include assess- Comparison: Much more intensive gold standard
ment of the symptoms endorsed in the patients his- reference examination integrating information from
tory, mental status exam, or conducting structured collateral historians, prehospital cognitive perfor-
bedside assessment inventories such as the Folstein mancebased measures, and expert clinical evalua-
Mini-Mental State Examination (McGee 2007). tion.
Likelihood ratios are easily calculated from the same
information used to calculate sensitivity and speci- Outcome: Accuracylikelihood ratios (positive and
ficity. The Rational Clinical Exam series in JAMA negative) of the brief measure compared against the
(Sackett 1992) has dozens of articles dating back gold standard. Precisionmeasures of interrater re-
over a decade presenting likelihood ratios and pre- liability such as kappa or intraclass correlations.
test probabilities for many of the most common
medical problems that we encounter clinically, al- Acquire
though the quality of many of the available diagnos- There are unfortunately no organized repositories of
tic studies remains an ongoing source of concern high-quality preappraised systematic reviews of the
(Bandolier 2002; Richardson 2007). medical literature pertaining to diagnosis available for
324 How to Practice Evidence-Based Psychiatry
<3.44 on this instrument would be likely to greatly re- review bias, in which interpretations of diagnostic
duce the probability of a diagnosis of dementia in a procedures become more accurate by providing ad-
patient being examined. These are impressive operat- ditional clinical information to interpreters. The
ing characteristics for a brief test conducted in a chal- methods section of the study describes that a single
lenging clinical setting. We thus wanted to appraise person, the author mentioned previously, performed
the Harwood study to see if the estimates of these op- the Confusion Assessment Method (Inouye et al.
erating characteristics were likely to be valid and gen- 1990) to detect delirium, the Abbreviated Mental
eralizable to our clinical setting. Test (Hodkinson 1972), and the 16-item version of
In our critical appraisal we felt that this study fell the IQCODE as well as further standard psychiat-
short of optimal STARD criteria and included ap- ric assessment.. .[which] included further cognitive
preciable risk for bias, which could result in the test assessment, obtaining a history from the informant
characteristics appearing much better than they and/or nursing staff and scrutinizing clinical notes.
might actually be at discriminating demented from The additional clinical information provided by
nondemented patients. We present the most impor- each test was likely to influence the findings of the
tant concerns we had from our appraisal using other tests performed.
STARD below. Our comments correspond to the The author stated that all patients with some ev-
item numbers on that checklist. We focus, because idence of abnormal cognitive functioneither a pos-
of space constraints, on those items that, to our read, itive screening test or a note indicating abnormal
conferred a significant risk for bias. cognitive status in the clinical recordswere as-
Items 8, 9, and 10 from the STARD checklist (Ta- signed a DSM-III-R diagnosis, or if not meeting
ble 332) regarding the reference standard diagnosis DSM criteria, a clinical diagnosis of their cognitive
were of concern to us. The final process by which the impairment. It appeared from this description that
reference standard diagnosis (DSM diagnosis of de- results of the IQCODE influenced whether the gold
mentia or clinical diagnosis of other cognitive impair- standard diagnostic procedures were performed and
ment) was assigned in this study was difficult to whether a DSM-III-R or clinical diagnosis was as-
determine. The qualifications, expertise, and training signed, a source of bias referred to as verification bias
of the person executing and reading the index (IQ- (item 16), that could increase the estimate of diag-
CODE) and reference standard tests were not speci- nostic accuracy (Bossuyt et al. 2003b). The person
fied in the body of the manuscript. The qualifications assigning the criterion standard diagnosis was not
of the author cited as doing the assessment could be blinded (item 11) to the findings of the index test,
searched on the Internet, and he appeared to be an which were included in the gold standard diagnosis
accomplished authority in his field. One challenge, reached. The same person was assigning both diag-
despite the authority of the author, was to understand noses. This results in both test review bias and diagnos-
the process that he used to come to the gold standard tic review bias, both of which are likely to inflate the
diagnosis so that we could understand how accurate estimates of diagnostic accuracy. No confidence in-
the estimate of the tests performance in agreement tervals about the point estimates for sensitivity and
with this diagnosis was likely to be. STARD reminds specificity were provided (item 21), nor was a cross-
us that this process should be clearly specified and re- tabulation of the results of the index tests by the re-
producible so that the results of the research are rep- sults of the reference standard given (item 19). The
licable and the procedures used to reach a gold operating characteristics provided used optimal post
standard diagnosis do not introduce bias into the es- hoc estimates, which were unlikely to be replicated.
timate of test accuracy. The procedures used in the However, cutoff points suggested by the authors as
study listed the tests performed for the reference the maximally discriminative values obtained from
standard but included sources of history and proce- previous outpatient validation studies of the test with
dures for gathering information that were poorly more rigorous designs had similar accuracy (test
specified and would be difficult to reproduce with the score cutoff >3.38 had a sensitivity of 100%, specific-
potential for introducing significant bias. ity 84%). There were no estimates of the variability
For example, in appraising the study for STARD of diagnostic accuracy or reproducibility provided.
item 11 we felt the procedures used introduced the Overall we felt that further study of this test with
possibility of a form of bias referred to as clinical respect to a gold standard test using a more rigor-
326 How to Practice Evidence-Based Psychiatry
TITLE/ABSTRACT/ 1 Identify the article as a study of diagnostic accuracy (recommend MeSH heading sensitivity
KEYWORDS and specificity).
INTRODUCTION 2 State the research questions or study aims, such as estimating diagnostic accuracy or
comparing accuracy between tests or across participant groups.
METHODS Describe:
Participants 3 The study population: The inclusion and exclusion criteria, setting and locations where data
were collected.
4 Participant recruitment: Was recruitment based on presenting symptoms, results from previous
tests, or the fact that the participants had received the index tests or the reference standard?
5 Participant sampling: Was the study population a consecutive series of participants defined by
the selection criteria in item 3 and 4? If not, specify how participants were further selected.
6 Data collection: Was data collection planned before the index test and reference standard were
performed (prospective study) or after (retrospective study)?
Test methods 7 The reference standard and its rationale.
8 Technical specifications of material and methods involved including how and when
measurements were taken, and/or cite references for index tests and reference standard.
9 Definition of and rationale for the units, cut-offs and/or categories of the results of the index
tests and the reference standard.
10 The number, training and expertise of the persons executing and reading the index tests and
the reference standard.
11 Whether or not the readers of the index tests and reference standard were blind (masked) to
the results of the other test and describe any other clinical information available to the
readers.
Statistical methods 12 Methods for calculating or comparing measures of diagnostic accuracy, and the statistical
methods used to quantify uncertainty (e.g. 95% confidence intervals).
13 Methods for calculating test reproducibility, if done.
RESULTS Report:
Participants 14 When study was performed, including beginning and end dates of recruitment.
15 Clinical and demographic characteristics of the study population (at least information on age,
gender, spectrum of presenting symptoms).
16 The number of participants satisfying the criteria for inclusion who did or did not undergo the
index tests and/or the reference standard; describe why participants failed to undergo either
test (a flow diagram is strongly recommended).
Test results 17 Time-interval between the index tests and the reference standard, and any treatment
administered in between.
18 Distribution of severity of disease (define criteria) in those with the target condition; other
diagnoses in participants without the target condition.
19 A cross tabulation of the results of the index tests (including indeterminate and missing results)
by the results of the reference standard; for continuous results, the distribution of the test
results by the results of the reference standard.
20 Any adverse events from performing the index tests or the reference standard.
Estimates 21 Estimates of diagnostic accuracy and measures of statistical uncertainty (e.g. 95% confidence
intervals).
22 How indeterminate results, missing data and outliers of the index tests were handled.
23 Estimates of variability of diagnostic accuracy between subgroups of participants, readers or
centers, if done.
24 Estimates of test reproducibility, if done.
DISCUSSION 25 Discuss the clinical applicability of the study findings.
Note. MeSH=Medical Subject Heading; STARD =Standards for Reporting of Diagnostic Accuracy.
Source. Bossuyt et al. 2003a. Available at: http://www.stard-statement.org.
Consultation-Liaison Psychiatry 327
ously controlled design would be likely to result in a spirits prior to the admission and he seemed to be
change in the estimate of diagnostic accuracy and dealing fairly well with the knowledge that his cancer
that the estimate provided in this study was likely to had returned. He had expressed hopefulness and con-
be inflated. The study performed in the ICU to es- fidence in the surgical approach recommended by his
timate the prevalence of preexisting cognitive im- doctors, although he was anxious as to whether his
pairment (Pisani et al. 2003a) indicated that there heart would tolerate the procedure. After receiving
was substantial agreement between the IQCODE the diagnosis he seemed to still be able to enjoy visit-
and the Modified Blessed Dementia Rating Scale ing with friends and family as he had before. He still
another informant interview validated in outpatient paid the bills for the household and was quite active.
settingswith a kappa of 0.69. This study was lim- He had been productively employed as an engineer at
ited by the difficulty in establishing a gold standard a local technology company until about 8 years be-
diagnosis against which to estimate the operating fore he was admitted. He had slowed down somewhat
characteristics of the test. after his heart surgery in 1991, but he still managed to
enjoy his activities and to manage his affairs without
Apply difficulty. Neither she nor her daughter had noticed
These studies appeared to be the only recent studies any significant decline in his memory or ability to
looking at methods to determine whether a patient take care of things around the house in the years pre-
might have a preexisting, nondelirious form of cog- ceding his current admission. They described him as
nitive impairment, such as dementia, in the setting being as sharp as ever before his hospitalization.
in which we found our patient. For our purposes we We went through each item on the 16-item IQ-
decided that despite the limitations, the IQCODE CODE together, comparing his cognitive abilities
remained the best-studied instrument available for 1 month prior to his admission to his performance
our purpose and that the point estimates derived 10 years before as was done in Pisani et al. (2003a).
from this limited study would represent our best es- The final score was 3.1, which was a negative result
timate as to this tests accuracy. We felt that the ac- using the cut point of 3.44 suggested by the authors.
curacy estimate was likely to be biased in favor of Remember that the Bayes theorem tells us that
greater accuracy than was warranted, and thus we the findings of the test must be considered together
made a mental note of this in our interpretation. with the pretest probability of the condition before a
We thus contacted the patients family to obtain diagnosis is assigned. Remember representativeness
their impression of the patients mental state at base- bias. This is the clinical error that occurs when we
line prior to admission and to administer the IQ- assume that test results rule in and rule out diag-
CODE. The patient had been married for 53 years. noses without considering the probability of the di-
His wife was in her early 70s and was a retired admin- agnosis and the fact that each test has false positives
istrative assistant for the local technology company and negatives and is not perfect. We use information
where the patient had worked for many years. She from the pretest probability of dementia together
had been with the patient daily prior to the hospital- with the negative findings of this test to estimate our
ization. He also had a daughter in her mid-40s who posttest probability of dementia.
was a schoolteacher in the local area. Both appeared We assumed a pretest probability of dementia for
to be good historians and had spent a minimum of hospitalized patients in the ICU of 42% from the
4 hours per week with the patient for at least 10 years best estimate we had available (Pisani et al. 2003a).
as was suggested by the IQCODE procedure. We had an optimistic estimate of the operating char-
They were contacted for interview over the tele- acteristics of the IQCODE from the Harwood et al.
phone. They informed us that they had just the left (1997) study, which provided a negative likelihood
the hospital and were going to get something to eat ratio of 0.1. We combined these pieces of informa-
after being at the bedside for many hours that day as tion to estimate the posttest probability of dementia
they had each day since admission. They were quite using an adaptation of Fagans nomogram (Fagan
concerned about the patients mental state. They had 1975; Glasziou 2001). See the introductory chapters
never known the patient to be depressed or anxious from McGee (2007) or the article by Sackett (1992)
previously, and he had never before seen a psychia- for more on how to do this if this is confusing to you.
trist for any reason. His wife felt that he was in good This approach resulted in an estimate of the posttest
328 How to Practice Evidence-Based Psychiatry
FIGURE 332. Likelihood ratio (LR) nomogram for posttest probability of dementia.
probability of dementia as being fairly unlikely, in assessment included in the IQCODE were likely to
the range of 5%10%, as plotted in Figure 332. have prompted us to consider more carefully symp-
(An online automated version of Fagans nomogram toms that we might not otherwise have assessed for
can be found at www.cebm.net/index.aspx?o=1161.) without a structured questionnaire. We decided to
Because we had previously appraised this litera- continue to investigate for the possibility of delirium
ture and had this information easily available to us, being present in our patient.
our rough estimate of the probability of dementia
took less than 10 minutes to acquire, including our Does the Patient Have Delirium?
conversation with the patients wife, which took the Given the frequency with which we encounter delir-
bulk of the time, and the previous calculations using ium in our practice setting we also hoped to have a
the nomogram, which took approximately 10 sec- soundly validated procedure with known operating
onds. While the precision of the quantitative esti- characteristics that we might use together with esti-
mate of the probability of dementia was somewhat mates of pretest probability to provide an accurate
uncertain given the biases likely to be present in the assessment of the probability of delirium being
validation of the test, we were confident in our clin- present in our patient. We had thus formed and
ical judgment at this point that the history pointed sought an answer to the following PICO question.
to a much more acute change in the patients mental
status that would be much more consistent with de- Ask
lirium than with dementia. The results certainly had Patient/population: Patients in intensive care unit
clinical face validity, and the focused questions in the settings.
Consultation-Liaison Psychiatry 329
Intervention: Brief, bedside diagnostic methods for interval [CI] 2077) and >100 (95% CI 21 to >100).
assessing for delirium. The negative likelihood ratio was not reported. Us-
ing the sensitivity and specificity data we estimated
Comparison: More extensive expert clinical consen- point estimates for the LR to be 0 and 0.07, respec-
sus diagnosis using DSM criterion. tively. It had excellent interrater reliability, with a
kappa of 0.96 (95% CI 0.920.99). We were more
Outcome: Outcome measures as beforelikelihood confident in the estimates provided by the validation
ratios positive and negative, estimates of interrater report of this test than in those provided by the IQ-
reliability such as kappa. CODE as a result of the stronger design and report-
ing of the study.
Acquire
In our previous searches of the medical literature we Apply
found a handful of studies addressing this question. Training information (www.icudelirium.org) was
One method developed for the ICU for assessing available that led our team to feel confident in our
mechanically intubated, nonverbal patients is the ability to use the CAM-ICU in our setting. We have
Confusion Assessment Method for the Intensive thus adopted this instrument into our routine assess-
Care Unit (CAM-ICU) (Ely et al. 2001a, 2001b). ment of mechanically ventilated patients in the ICU
We encourage the reader to stop here and obtain for delirium, but do note that this test has not been
a copy of the article in JAMA for the validation of this validated in patients with preexisting cognitive or
study (Ely et al. 2001a), if fortunate enough to have neurologic impairment and that its operating char-
full-text access. Please also print out the STARD acteristics in these populations are likely to be sig-
checklist and critically appraise this and see if you nificantly less strong.
agree with our summary below. No peeking! The patients wife and daughter described having
visited with him daily since the operation. They
Appraise noted that shortly after the surgery they had noticed
The validation study for this instrument in our opin- a marked change in his emotions and behavior that
ion was quite strong with respect to the STARD cri- were very troubling to them. At times the patient
teria (Ely et al. 2001a). By going through the seemed to be frightened, suspicious, and confused.
checklist we detected very little risk for bias in the At other times he seemed to be very tearful. He was
methods used. The validation study did exclude as- often inattentive and would nod off to sleep. He was
sessment of patients with a previous history of psy- trembling and sweaty. They were quite con-
chosis and neurologic disease (limited challenge cerned to see him crying and nodding his head when
bias), of which we made note. The study did not pro- the doctors asked him if he was depressed and hope-
vide a cross-tabulation of the results of the index less, because he had always been a very optimistic
tests by the results of the reference standard, report- man. When they tried to console him and talk to
ing the summary operating characteristics only. him about how he was feeling they found that he
Overall, however, the study addressed each of the seemed to be confused and agitated, which appeared
major threats to validity for studies of diagnostic ac- very out of character for him. They had never pre-
curacy. The use of the CAM-ICU appeared to be viously noticed that he had any problems with his
significantly more rapid (a mean of 2 minutes, with a memory, but he seemed to be unable to recall impor-
standard deviation of 1 minute) than the gold stan- tant information or to be confused, although it was
dard assessment (3045 minutes) using usual clinical never easy to know because he was unable to speak.
methods of arriving at a DSM-IV-TR diagnosis. The nursing staff from the night shift prior to our
Overall our critical appraisal by the STARD criteria consultation had noted that the patient attempted to
suggested future studies of this instrument would be drink water at the bedside despite being NPO. The
unlikely to result in a significant change in the oper- patients wife and daughter described this behavior
ating characteristics reported. The positive likeli- as being very out of character for him. The vigor-
hood ratio for this test was quite strong, with point ousness of his attempts to obtain water and get out of
estimates for each assessor at 50 (95% confidence bed had appeared to prompt his receiving lorazepam
330 How to Practice Evidence-Based Psychiatry
and hydrocodone. At other times, according to the AGREE Collaboration 2003) was consulted for
records provided by the physical therapist, he ap- guidance (British Geriatrics Society 2006). Our as-
peared sullen, apathetic, and withdrawn. sessment process was not yet complete because the
In performing the CAM-ICU (Figure 333) we most important action for the management of delir-
noted that the Richmond Agitation-Sedation Scale ium is the identification and treatment of potential
(RASS) score ranged between + 3 on the evening underlying reversible causes (British Geriatrics So-
prior to our examining the patient when he at- ciety 2006). The differential diagnosis of the many
tempted to get out of bed and to obtain water to 1 at suspected causes of delirium is quite lengthy and
the time we initially came to see him in which he was poorly studied, and a detailed discussion is beyond
drowsy but able to open his eyes to verbal stimulation the scope of the space we have. Many risk factors
and keep them open for more than 10 seconds. This, have been described for the development of delir-
together with the history obtained by the patients ium (mostly from non-ICU cohorts), although none
wife and daughter, satisfied the acute onset or fluctu- has been proved with a strong association or definite
ating course criterion for us. He exhibited marked causality (Devlin et al. 2007; Kraemer et al. 1997).
difficulty with attention and had markedly disorga- The pretest probabilities of these risk factors are
nized thinking on these items of the CAM-ICU, an- poorly defined, making workup challenging.
swering inappropriately to questions such as Are The underlying cause of delirium is often consid-
there fish in the sea? Does a stone float on water? ered to be multifactorial. Common contributory
Can you use a hammer to pound a nail? He also ex- medical causes of delirium include (British Geriat-
hibited difficulty in following the command. Thus we rics Society 2006):
felt the CAM-ICU overall was positive and we were
then able to proceed to estimate a quantitative prob- Infection (e.g., pneumonia, urinary tract infec-
ability of delirium being present in this patient. tion)
Pretest probability estimates of delirium in stud- Cardiac illness (e.g., myocardial infarction, heart
ies using the CAM-ICU excluding patients with failure)
neurologic illness and psychosis range between 22% Respiratory disorder (e.g., pulmonary embolus,
and 87%, with most of the estimates being closer to hypoxia)
the high end of the range (83%, 87%, 47%, 22%) Electrolyte imbalance (e.g., dehydration, renal
(Devlin et al. 2007). Assuming even the most con- failure, hyponatremia)
servative pretest probability estimate of 22% and the Endocrine and metabolic disorder (e.g., cachexia,
more conservative of the two-point estimates of the thiamine deficiency, thyroid dysfunction)
likelihood ratio positive of 50, the posttest probabil- Drugs (particularly those with anticholinergic
ity for delirium is >90% (Figure 334). side effects [e.g., tricyclic antidepressants, anti-
We thus felt that it was extremely likely that our parkinsonian drugs, opiates, analgesics, steroids])
patient was in fact delirious and that the cognitive, Drug (especially benzodiazepine) and alcohol
emotional, and behavioral symptoms should not at withdrawal
this time be assumed to be secondary to depression Urinary retention
as the primary team had been considering prior to Fecal impaction
our consultation. We felt that the depressive symp- Severe pain
toms were more likely to be those that are often dis- Neurological problem (e.g., stroke, subdural he-
played in conjunction with the delirium syndrome matoma, epilepsy, encephalitis)
that had been previously reported (Boland et al. Multiple contributing causes
1996; Farrell and Ganzini 1995; Nicholas and Lind-
sey 1995; Swigart et al. 2008). In Mr. C.K.s case, several of these possible risk
factors were known to be present. We anticipated
What is the Differential Diagnosis that identification of a single culprit that caused his
of the Delirium Syndrome? delirium might be unlikely, but we felt it could be
A recent guideline on delirium written consistently important to see if potential causes could be identi-
with the conventions established by AGREE (Ap- fied, for which treatment had not been initiated, that
praisal of Guidelines Research and Evaluation; if treated might reduce his risk for harm.
Consultation-Liaison Psychiatry 331
CAM-ICU Worksheet
Feature 1: Acute Onset or Fluctuating Course Positive Negative
Positive if you answer yes to either 1A or 1B.
1A: Is the pt different than his/her baseline mental status? Yes No
Or
1B: Has the patient had any uctuation in mental status in the past 24 hours as
evidenced by uctuation on a sedation scale (e.g. RASS), GCS, or previous delirium
assessment?
Feature 2: Inattention Positive Negative
Positive if either score for 2A or 2B is less than 8.
Attempt the ASE Letters rst. If pt is able to perform this test and the score is clear, re-
cord this score and move to Feature 3. If pt is unable to perform this test or the score
is unclear, then perform the ASE Pictures. If you perform both tests, use the
ASE Pictures results to score the Feature.
2A: ASE Letters: record score (enter NT for not tested) Score (out of 10): ______
Directions: Say to the patient, I am going to read you a series of 10 letters. Whenever
you hear the letter A, indicate by squeezing my hand. Read letters from the following
letter list in a normal tone.
SAVEAHAART
Scoring: Errors are counted when patient fails to squeeze on the letter A and when the
patient squeezes on any letter other than A.
2B: ASE Pictures: record score (enter NT for not tested) Score (out of 10): ______
Directions are included on the picture packets.
Feature 3: Disorganized Thinking Positive Negative
Positive if the combined score is less than 4
3A: Yes/No Questions Combined Score (3A+3B):
(Use either Set A or Set B, alternate on consecutive days if necessary): _____ (out of 5)
Set A Set B
1. Will a stone oat on water? 1. Will a leaf oat on water?
2. Are there sh in the sea? 2. Are there elephants in the sea?
3. Does one pound weigh more than 3. Do two pounds weigh more than one
two pounds? pound?
4. Can you use a hammer to pound 4. Can you use a hammer to cut wood?
a nail?
Score ___ (Patient earns 1 point for each correct answer out of 4)
3B: Command
Say to patient: Hold up this many ngers (Examiner holds two ngers in front of
patient) Now do the same thing with the other hand (Not repeating the number of
ngers). *If pt is unable to move both arms, for the second part of the command ask patient Add
one more nger.
Score___ (Patient earns 1 point if able to successfully complete the entire command)
FIGURE 333. Worksheet from the Confusion Assessment Method for the Intensive Care Unit
(CAM-ICU) training manual
ASE= Attention Screening Examination; GCS= Glasgow Coma Score; pt=patient; RASS= Richmond Agitation-Sedation Scale.
Source. Ely EW: The Confusion Assessment Method for the Intensive Care Unit (CAM-ICU): Training Manual. Copyright 2002, E.
Wesley Ely, M.D., M.P.H. and Vanderbilt University, all rights reserved. Used with permission.
332 How to Practice Evidence-Based Psychiatry
FIGURE 334. Likelihood ratio (LR) nomogram for posttest probability of delirium.
The possibility of medication-induced mental and inferior wall hypokinesis, and mildly thickened
status changes as a result of the opiates and intermit- mitral valve with mild mitral regurgitation. The
tent benzodiazepines that he was receiving appeared right ventricle was of normal size, with normal ejec-
likely. The possibility of alcohol use and withdrawal tion fraction. Both atria were severely dilated. Find-
were especially of concern because his alcohol and ings were unchanged compared with the prior study
substance use had not been well documented in the from 6 months prior to admission. He was no longer
record, and he was noted to have been trembling and tachypneic, his oxygen saturation and arterial blood
diaphoretic by his family. He had several possible gas were unremarkable. He had no unilateral lower
reasons for tachycardia, but his pulse remained ele- extremity edema or pain with palpation of his deep
vated despite correction of these factors and he con- leg veins, he had no hemoptysis, and his acute hy-
tinued to exhibit tremor and diaphoresis. poxia seemed to be better accounted for by conges-
Worsening of his cardiac and respiratory function tive heart failure than by a pulmonary embolus.
was a possible contributor, given his previous smok- However, he was recently immobilized and had sur-
ing history and known cardiac disease, the tachy- gery for his cancer, and he was tachycardic, which
arrythmias noted, and his pulmonary congestion. did indicate a moderate pretest probability by the
His atrial fibrillation was now more optimally rate simplified Wells criteria for a pulmonary embolus
controlled, his breathing and chest X ray were im- (Chunilal et al. 2003).
proved, and his ECG and cardiac enzymes were un- The possibility of infection was present given his
remarkable. He had an echocardiogram performed, recent fever. Several possible sites could be consid-
which had shown normal left ventricular (LV) size ered. He had recently had his procedure on his larynx,
with LV systolic function at lower limits of normal he also had complications of his gastrostomy tube
Consultation-Liaison Psychiatry 333
extravasation into his peritoneal space, and he had management of the patient, and treatment decisions
respiratory difficulties and abnormal urinalysis. His were being made accordingly.
fever, together with his having been ventilated, with We discussed our impression with the team and
new infiltrates on chest X ray, could suggest a pulmo- the patients family. The patient was assessed as lack-
nary infection. The absence of a white count or shift ing the capacity to understand his current condition,
and the absence of purulent sputum could not exclude the treatment recommendations, and alternatives,
the possibility of infection (Klompas 2007). He did including the consequences of not receiving treat-
have other reasons to have a pulmonary infiltrate and ment, and thus we felt he could not provide informed
did seem to be responding well to treatment. The consent for his care. We thus recommended that the
bladder catheter and central venous catheters were patients wife act as a surrogate for her husband. We
other possible sources of infection. Blood, sputum, discussed the general guidelines suggested for the
and urine cultures had been sent to the lab, and the management of delirium (British Geriatrics Society
patient had been started on antibiotics. 2006), noting that the patient was hyperactive at
A cerebrovascular accident was possible given his times and at risk for falls. Shortly after we were con-
recent unanticoagulated atrial fibrillation; however, sulted he had attempted to pull out his intravenous
his neurologic exam was unremarkable, with the lines. We felt that this hyperactive delirium and the
exception of his altered mental state, and a head risk for the complications of alcohol withdrawal were
computed tomographic image obtained prior to our going to require pharmacological intervention. We
consultation by the medical service was unremark- advised this in addition to the environmental inter-
able. We felt this was less likely. ventions suggested by the guideline. This guideline
The patients family denied he had any significant did not cover alcohol withdrawal, and thus treatment
visual or hearing impairment or any history of de- recommendations for the pharmacologic manage-
pression, dementia, or other psychiatric illnesses. ment of alcohol withdrawal were made in reference
The most important possibility that did not seem to a previously appraised systematic review of rea-
to have been adequately considered was alcohol sonable quality (Mayo-Smith et al. 2004) on alcohol
withdrawal. We thus asked the family if the patient withdrawal delirium. It was noted that injudicious
consumed alcohol, and they indicated that he did not use of symptom-triggered withdrawal protocols
like to talk about this because he knew the doctors could be associated with harms in patients unable to
did not approve of this given his throat cancer. They communicate well who had alternative causes of
did acknowledge, when informed that this could their symptoms that might be consistent with those
have important and possibly life-threatening conse- symptoms produced by alcohol withdrawal (Hecksel
quences, that he had consumed alcohol in addition to et al. 2008). Making treatment recommendations for
cigarettes for many years and that he continued up this type of case is more challenging than for the typ-
until the night prior to hospitalization to consume at ical alcohol withdrawal delirium case. The Clinical
least three to four cocktails every evening, and he was Institute Withdrawal Assessment for Alcohol was
known at times to have more. This had not previ- not considered an appropriate instrument for follow-
ously been noted in the history. The patient re- ing the patients progress given his inability to com-
mained tachycardic, which had reasonably been at- m u n i c a t e w e ll a n d w a s n o t re c o m m e n d e d .
tributed to the many factors cited previously plus Treatment of delirium with benzodiazepines has
postoperative pain and discomfort. His recent trem- been considered to be a risk factor for worsening de-
ulousness and disturbance in mental state had been lirium by one small randomized controlled trial of
attributed to anxiety and emotional upset. Alcohol modest quality in hospitalized AIDS patients (Breit-
withdrawal delirium rose to be included as a possible bart et al. 1996) and is often cited as a possible causal
contributing factor that would be likely to require a risk factor based upon observational studies of vary-
change in the management of the patient. We con- ing quality in general medical patients (British Geri-
sidered it difficult to determine, however, whether all atrics Society 2006).
of the symptoms of autonomic hyperarousal could be We opted to recommend that the team follow the
because of alcohol withdrawal but felt that the risk patients vital signs and CAM-ICU ratings each shift
was high enough that it should be considered. The and to use intravenous lorazepam with the goal of
other factors were being carefully considered in the attaining light sedation to the point of a Richmond
334 How to Practice Evidence-Based Psychiatry
Agitation-Sedation Scale score of 1 during the day, (Bornstein and Emler 2001). Things often appear
with sleep the goal overnight, consistent with the quite obvious in looking backwards at a case. We
recommendations in the systematic review by hope that the previous case presentation was helpful
Mayo-Smith (Mayo-Smith et al. 2004). We felt that in discussing some of the common biases affecting
despite the CAMs dichotomous nature, the RASS our judgment and decision making and that you find
score would be valuable along with the vital signs some things in the discussion of use in your practice.
and other signs of autonomic hyperactivity in con-
tinuing to guide our approach, which was focused on
reducing the risks of hyperactive delirium (line pull-
Summary
ing, getting out of bed, taking things orally despite Selecting a treatment intervention strongly sup-
NPO status) and the effects of alcohol withdrawal. ported by high-quality randomized controlled tri-
Because other possible causes of delirium were als is unlikely to benefit the patient and may cause
present, we discussed additional use of a neuroleptic harm if the diagnosis is incorrect. Treating this pa-
agent (Lonergan et al. 2007) if the intervention with tient for major depressive disorder or even for de-
the benzodiazepine was ineffective and the patient lirium with a neuroleptic agent given his cardiac
remained severely agitated and at risk for pulling history, prolonged QTc, and likely alcohol with-
lines or falling from his bed. We opted for a watchful drawal could have resulted in a poorer outcome.
waiting approach given the patients prolonged QTc The EBM approach to diagnosis is still in its in-
of 470 msec (Ray et al. 2009) and opted to see if he fancy. The literature is sparse, and there are not
might respond to the benzodiazepine protocol first. yet large repositories of systematic reviews of di-
The patients wife provided informed consent, and agnostic accuracy or precision available to the cli-
treatment along these lines was initiated. nician.
The patients course gradually improved. The re- Various approaches to generating a differential di-
mainder of his medical course was relatively unre- agnosis can be considered. One might consider
markable. He suffered no obvious motor seizures or combining approaches to avoid common biases
worsening of his medical condition. He was inter- that result in diagnostic error: a broad differential
mittently hypoactively delirious by CAM-ICU cri- diagnosis can be generated (possibilistic ap-
teria for several more days. He was no longer proach) that weights more heavily those causes
hyperactively delirious, however, and was signifi- that cannot be missed (prognostic approach) as
cantly calmer, with markedly decreased agitation, well as those that are highly likely in that practice
tremor, diaphoresis, and tachycardia. He required setting (probabilistic approach) that can be treated
no neuroleptics. His mental status improved signif- resulting in better patient outcomes (pragmatic
icantly to being CAM-ICU negative consistently af- approach).
ter 1 week, although residual cognitive symptoms The DSM-IV-TR Handbook of Differential Diagnosis
remained at 2 weeks, at which time the patient had (First et al. 2002) can be used to quickly generate
been completely titrated off of all benzodiazepines a differential diagnosis likely to be consistent with
and had recovered medically sufficiently to be dis- those considered in randomized controlled trials
charged from the hospital. We recommended that in psychiatry.
he be discharged home with additional in-home Carefully considering estimates of the pretest prob-
nursing support made available to him. We noted, ability of conditions that are pertinent in the differ-
on the basis of the limited literature in this area, that ential diagnosis in the setting in which the patient is
his prognosis could possibly include longer-term encountered is important in making a valid diagno-
cognitive difficulties that might be significant and sis and avoiding representativeness bias.
that might require continued supportive resources Preappraisal of bedside diagnostic procedures
for him and his wife (Gordon et al. 2004). important in clinical settings for the common di-
Now take a moment to review the list of three agnoses encountered may increase the speed and
to five diagnoses that you wrote down at the start of confidence in the diagnoses assigned in those set-
the case presentation. Hindsight bias occurs when we tings.
overestimate the probability of a given diagnosis The STARD checklist or other structured ap-
when that diagnosis has been established previously praisal tools for diagnostic quality can be used to
Consultation-Liaison Psychiatry 335
Inouye SK: Delirium in hospitalized older patients: recogni- Ray WA, Chung CP, Murray KT, et al: Atypical Antipsy-
tion and risk factors. J Geriatr Psychiatry Neurol chotic Drugs and the Risk of Sudden Cardiac Death.
11:118125; discussion 157158, 1998 N Engl J Med 360:225235, 2009
Inouye SK, van Dyck CH, Alessi CA, et al: Clarifying confu- Richardson WS: We should overcome the barriers to evi-
sion: the confusion assessment method. A new method for dence-based clinical diagnosis! J Clin Epidemiol 60:217
detection of delirium. Ann Intern Med 113:941948, 1990 227, 2007
Inouye SK, Foreman MD, Mion LC, et al: Nurses recogni- Richardson WS, Wilson MC, Nishikawa J, et al: The well-
tion of delirium and its symptoms: comparison of nurse built clinical question: a key to evidence-based decisions.
and researcher ratings. Arch Intern Med 161:24672473, ACP J Club 123:A12A3, 1995
2001 Richardson WS, Wilson MC, Guyatt GH, et al: Users
Jorm AF: The Informant Questionnaire on Cognitive De- guides to the medical literature: XV. How to use an arti-
cline in the Elderly (IQCODE): a review. Int Psychoge- cle about disease probability for differential diagnosis.
riatr 16:275293, 2004 Evidence-Based Medicine Working Group. JAMA
Kahneman D, Slovic P, Tversky A (eds): Judgment Under 281:12141219, 1999
Uncertainty: Heuristics and Biases. Cambridge, UK, Richardson WS, Glasziou P, Polashenski WA, et al: A new ar-
Cambridge University Press, 1982 rival: evidence about differential diagnosis. ACP J Club,
Klompas M: Does this patient have ventilator-associated 133:A11A12, 2000a
pneumonia? JAMA 297:15831593, 2007 Richardson WS, Wilson MC, Williams JW Jr, et al: Users
Kraemer HC, Kazdin AE, Offord DR, et al: Coming to terms guides to the medical literature: XXIV. How to use an ar-
with the terms of risk. Arch Gen Psychiatry 54:337343, ticle on the clinical manifestations of disease. Evidence-
1997 Based Medicine Working Group. JAMA 284:869875,
Lonergan E, Britton AM, Luxenberg J, et al: Antipsychotics 2000b
for delirium. Cochrane Database Syst Rev (2):CD005594, Richardson WS, Polashenski WA, Robbins BW: Could our
2007 pretest probabilities become evidence based? A prospec-
Lyman GH, Balducci L: Overestimation of test effects in tive survey of hospital practice. J Gen Intern Med
clinical judgment. J Cancer Educ 8:297307, 1993 18:203208, 2003
Lyman GH, Balducci L: The effect of changing disease risk Roca RP, Klein LE, Kirby SM, et al: Recognition of dementia
on clinical reasoning. J Gen Intern Med 9:488495, 1994 among medical patients. Arch Intern Med 144:7375, 1984
Mascola AJ: Guided mentorship in evidence-based medicine Rothman AJ, Kiviniemi MT: Treating people with informa-
for psychiatry: a pilot cohort study supporting a promis- tion: an analysis and review of approaches to communi-
ing method of real-time clinical instruction. Acad Psy- cating health risk information. J Natl Cancer Inst
chiatry 32:475483, 2008 Monogr 25:4451, 1999
Mayo-Smith MF, Beecher LH, Fischer TL, et al: Manage- Sackett DL: The rational clinical examination. A primer on
ment of alcohol withdrawal delirium: an evidence-based the precision and accuracy of the clinical examination.
practice guideline. Arch Intern Med 164:14051412, JAMA 267:26382644, 1992
2004 Sackett DL, Straus SE: Finding and applying evidence dur-
McCusker J, Cole M, Abrahamowicz M, et al: Delirium pre- ing clinical rounds: the evidence cart. JAMA 280:1336
dicts 12-month mortality. Arch Intern Med 162:457 1338, 1998
463, 2002 Siddiqi N, House AO, Homes JD: Occurrence and outcome
McGee S: Evidence-Based Physical Diagnosis. Philadelphia, of delirium in medical in-patients: a systematic literature
PA, WB Saunders, 2007 review. Age Ageing 35:350364, 2006
Nicholas LM, Lindsey BA: Delirium presenting with symp- Steurer J, Fischer JE, Bachmann LM, et al: Communicating
toms of depression. Psychosomatics 36:471479, 1995 accuracy of tests to general practitioners: a controlled
Olafsdottir M, Skoog I, Marcusson J: Detection of dementia study. BMJ 324: 824826, 2002
in primary care: the Linkoping study. Dement Geriatr Streiner DL: Diagnosing tests: using and misusing diagnostic
Cogn Disord 11: 223229, 2000 and screening tests. J Pers Assess 81:209219, 2003
Pauker S, Kassirer J: The threshold approach to clinical de- Swigart SE, Kishi Y, Thurber S, et al: Misdiagnosed delirium
cision making. N Engl J Med 302:11091117, 1980 in patient referrals to a university-based hospital psychi-
Pisani MA, Inouye SK, McNicoll L, et al: Screening for pre- atry department. Psychosomatics 49:104108, 2008
existing cognitive impairment in older intensive care unit Valcour VG, Masaki KH, Curb JD, et al: The detection of
patients: use of proxy assessment. J Am Geriatr Soc dementia in the primary care setting. Arch Intern Med
51:689693, 2003a 160:29642968, 2000
Pisani MA, Redlich C, McNicoll L, et al: Underrecognition Whiting PF, Weswood ME, Rutjes AW, et al: Evaluation of
of preexisting cognitive impairment by physicians in QUADAS, a tool for the quality assessment of diagnostic
older ICU patients. Chest 124:22672274, 2003b accuracy studies. BMC Med Res Methodol 6:9, 2006
34
Alcohol Dependence
Treated by a Psychiatry Resident
Violeta Tan, M.D.
337
338 How to Practice Evidence-Based Psychiatry
stressors were related to forming a relationship with least until her son completed the eighth grade. She
a man in the East and having concerns over sustain- revealed unmet fantasies of having more children to
ing it given the distance. Even more, Ms. M.T. felt create the picture of a family she had envisioned
her son disapproved of this developing bond. She with a stable marriage. During this session, I prima-
was struggling with a desire to fulfill her own needs rily used supportive and interpersonal therapy tech-
versus the needs of her sonwanting to move East niques in addressing her relationship issues. I
where her family and new boyfriend were living yet recognized Ms. M.T.s 9 days of sobriety and also
feeling a responsibility to remain in California at encouraged her to attend AA.
Event PA PA L S PA PA AA
Wk
2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
How severe were the cravings in the past week? (1 = no cravings to 10 = severe)
10
9
8
7
6 x
5 x x x x x
4 x x x x
3 x x x
2 x x x x x
1 x x
Wk
2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
brief periods of abstinence. Her longest period of uted to improved relations with her boyfriend and
sobriety was about 7 years while she was with her ex- son. She had visited her boyfriend recently, which
husband, who did not drink. After their separation, eased some of her loneliness. She also spoke with her
she began drinking off and on, oftentimes returning son about her dilemma of wanting to return to the
to alcohol under stress. east yet not wanting to remove him from his com-
I focused on events that she could recall that led fortable California network of friends. Although
to her drinking, identifying her triggers in the pro- there was no firm resolution with this issue, she was
cess. In the past year, her drinking was motivated by relieved after sharing her struggles with the individ-
a desire to numb out personal problems related to ual she felt it would most affect.
her ex-husband. By the end of this session, we had She continued to successfully abstain from alco-
gathered a handful of triggers to be mindful of for hol, finding support in her new boyfriend, who I dis-
the future, most notably including the sight of alco- covered had a history of alcohol dependence and
holic beverages and periods of depression and isola- who was, at that time, abstaining. Ms. M.T.s crav-
tion. ings were also diminished, rated at 2/10. We contin-
Ms. M.T. was preparing for a trip to the East ued to discuss strategies for preventing relapse,
Coast to visit family and expressed concerns of re- particularly for her upcoming visit back home. An-
lapse in this familiar environment with many poten- other trigger for cravings was identifiedthat of
tial alcohol-related triggers. In following the relapse boredom leading to depressed mood. To prevent re-
prevention strategies (Table 341), we discussed al- lapse, she engaged herself in various activities after
ternative, nonchemical coping responses, which in- work, including painting, piano, and swimming.
cluded attending AA on the East Coast, informing We reinforced the various strategies and coping
family in advance about her goals, using nonalcoholic skills for her to use during her 2-week trip to the
beer as a substitute, and finding alternate activities East Coast. She was advised to seek AA while there
such as art. During this session, I utilized several of and to return to the clinic when she arrived back in
the APAs relapse prevention strategies (Table 341), California.
with some points addressed or expanded on in future
encounters. Visit 6 (Week 8)
Ms. M.T. returned from her trip, where she had suc-
Visits 45 (Weeks 45) cessfully remained sober. However, upon her return
Ms. M.T.s mood was notably improved the next to California, she lapsed, experiencing loneliness
couple visits, rated at 34/10. This was partly attrib- and boredom, which led to her drinking leftover al-
342 How to Practice Evidence-Based Psychiatry
Assessment Followed
Obtain information from the patient and, with the patient's permission, from collateral sources (e.g.,
available family members, friends, current and past treaters, employers) as appropriate
Obtain detailed history of the patients past and present use of substances, including:
Types of substance used (including nicotine, caffeine, prescribed and over-the-counter medications)
and whether multiple substances are used in combination
Mode of onset, quantity, frequency, duration, route of administration, and pattern and circumstances
of substance use (e.g., where, with whom)
Timing and amount of most recent use
Degree of associated intoxication, withdrawal, and subjective effects of all substances used
History of prior substance use treatments (e.g., settings, context, modalities, duration, and adherence),
efforts to stop substance use, and outcomes (e.g., duration of abstinence, subsequent substance use,
reasons for relapse, social and occupational functioning achieved)
Current readiness to change, including:
Awareness of substance use as a problem
Plans for ceasing substance use
Motivations for substance use, including desired effects
Barriers to treatment and to abstinence
Expectations and preferences for future treatment
Effects on cognitive, psychological, behavioral, social, occupational, and physiological functioning
General medical and psychiatric history and physical and mental status examination
Family history of substance use or psychiatric disorder
Social history (including family and peer relationships, financial problems, and legal problems) and
psychosocial supports (including influence of close friends or other household members to support or
undermine past efforts at abstinence)
Educational and occupational history, including school or vocational adjustment and identification of
occupations at increased risk of substance use
Source. Adapted from American Psychiatric Association: Practice Guideline for the Treatment of Patients With Substance Use Disorders,
2nd Edition. 2006. Available at: http://www.psychiatryonline.com/pracGuide/loadGuidelinePdf.aspx?file=SUD2ePG_04-28-06.
Accessed June 1, 2009.
cohol in her home. Her depression was rated higher tients ambivalence. We set a goal for her to contact
than when we first met. We discussed reasons for her her former neighbor, who also was recovering from
lapse, and she identified missing her family and boy- alcohol dependence, to attend AA with her.
friend. We agreed that we had planned adequately After this lapse, I found myself searching for
for her trip to the east but had not anticipated the more in-depth relapse prevention guidelines. I
difficulty she might have returning to California. logged onto the National Guideline Clearinghouse
In addressing where to go at this point, Ms. M.T. at www.guideline.gov, but the recommendations I
was ambivalent. She expressed a desire to limit her did find were strategies I had already been using or
drinking to weekends, giving up her goal of complete more related to screening for substance use. There-
abstinence but also hoping to return to that goal fore, I turned to researching articles online and
eventually. Although I was already using motivational seeking advice from supervisors. I presented the case
interviewing, I knew this clinical method would be during a conference to a group of psychiatrists and
especially relevant in exploring and resolving the pa- psychologists, seeking their opinions. I also video-
Alcohol Dependence/Psychiatry Resident 343
taped my sessions and showed them to my supervi- home as another trigger for her alcohol use and
sor for input. agreed to pack them away. Concerned that I needed
I came across an article online with suggestions on to more carefully assess the extent of her depression
how to prevent a lapse from becoming a relapse, the and better monitor its relation to her drinking, I de-
main message being to view the lapse not as a failure cided to incorporate the STAR*D QIDS-SR16 ques-
but as a reminder flag to be vigilant about ones be- tionnaire at week 12. She scored 14, in the moderate
haviorto learn from the lapse rather than using it as range, and could be considered for the next step in
an excuse to relapse completely (Hunt 2007). From the STAR*D algorithm. However, given her general
my last session with Ms. M.T., I feared she might al- improvement in depression, I decided to wait before
ready be viewing her lapse as an excuse to continue making further medication changes.
drinkingshe was considering a new goal that would By week 13, she had incorporated some changes
allow her to drink on weekends instead of completely into her life including exercise, meditation, reading,
abstaining. Hence, prior to her next visit, I called Ms. contacting sources of support, and attending AA
M.T., validating her efforts and achievements of the again. Despite these many achievements, she craved
past several weeks and giving her affirmation that her alcohol and continued to drink. She mentioned dur-
lapse did not need to become a relapse. The online ing this session that she disliked that in AA individ-
suggestion allowed me to present to Ms. M.T. an- uals usually say their name and announce I am an
other way of viewing her setback that aided in main- alcoholic before speaking. I wanted to probe fur-
taining hope and self-esteem. Ms. M.T. expressed ther but instead found myself highlighting her ac-
her appreciation for the call. complishments. I made a note to myself to address
this next week. We agreed she would make a list of
Visits 711 (Weeks 913) rewards to use instead of alcohol and to continue at-
Over the next several sessions, my patient continued tending AA.
to drink approximately two to three glasses of wine
two to three times per week. Beyond using alcohol Visit 12 (Week 14)
as a coping mechanism for depression and isolation, The patient was abstinent for 1 week, an achievement
I recognized that she began to use it as a reward for she was clearly proud of. She continued to attend AA
accomplishing things such as exercising or even go- and to exercise. Although I recognized her achieve-
ing to AA. During week 9, I discovered that she did ments, I felt I needed to address the lingering issue of
not feel alcohol was that problematic for her, believ- whether she viewed alcohol as a problem in her life. I
ing that she could control her use. I realized the ini- began by addressing her hesitancy to say I am an al-
tial steps in the APA guideline, which we had once coholic in AA. She first gave reasons for why alcohol
gone through, needed to be reassessed, particularly might not be a problem for her but in the process re-
with current readiness to change (Table 343). Ms. alized her use of alcohol was not as controlled as it had
M.T. felt that because she had lapsed, she could in- been in the past. She then wanted to know if I thought
dulge in alcohol before abstaining again. Further she was an alcoholic. I responded first recognizing
complicating the picture, her boyfriend, who had her accomplishments, then moved toward recogniz-
also lapsed, stayed with her for a period and encour- ing her struggles in trying to abstain, careful to avoid
aged her to drink to celebrate their reunion. argumentation and expressing empathy throughout.
Throughout these sessions, we discussed alter- In line with the principles of motivational interview-
nate forms of reward, incorporating other activities ing, I also noted discrepancies between her continued
into her life such as exercise, reading books, watch- use of alcohol and the goals she set for herself each
ing DVDs, and establishing other sources of sup- week to stop (Table 344). Ultimately, I did say that I
port/contact. Each time we ended a session, she believed she was an alcoholic. She was saddened, re-
committed herself to beginning sobriety that day, alizing she could never drink again if this was true,
but the pattern of drinking continued over a 5-week and seemed regretful that she had been lenient with
period. She admitted being reluctant to attend AA, herself in returning to alcohol. We discussed other
feeling she needed a companion to attend at least at barriers to her viewing alcohol as a problem, includ-
the outset. She identified the wine glasses in her ing family who viewed alcohol favorably.
344 How to Practice Evidence-Based Psychiatry
I videotaped this session, which I played for my she had not been out of town and if we had followed
supervisor. This session, utilizing the five general up sooner on our last session, would she have been
principles of motivational interviewing (Table 34 more accepting of the things we discussed?
4), propelled the patient to view her alcohol use in a
different light. It made her step back and question Visit 14 (Week 19)
how she had been handling her use. It also allowed Two weeks passed until my next session with Ms.
her to contemplate the implications of being absti- M.T. because of my being away at a conference. In
nent and how not drinking would influence various my absence, the patients depression peaked to its
aspects of her life. highest, with a continuation of her prior stressors in-
volving family strife and feelings of loneliness. For
Visit 13 (Week 17) the first time since I had known her, she expressed
Three weeks passed until my next session with Ms. death wishes, without suicidal intent or plan but
M.T. She had been out of town visiting family. De- more with a wish to release the emotional pain. I rec-
spite a spike in depression attributed largely to stres- ognized the vicious cycle she was in of feeling de-
sors on her return home, her alcohol use had pressed and drinking as a consequence to numb the
diminished; she had abstained in the week following pain. Although I had been careful to monitor her
our last session, then had one glass of wine on her re- mood weekly, I realized that I may not have been ad-
turn home. She had not been attending AA but was dressing it sufficiently given my emphasis on her
making use of relaxation techniques. Although I alcohol use. Ms. M.T. was not interested in commit-
continued to encourage her to attend AA, what I had ments to abstain at this point, but she did feel that
failed to do in this and previous sessions was explore any changes in her alcohol use would be difficult to
why she was not going to AA in the first place. I achieve unless her mood was better. I reviewed her
asked her how she felt about our last session, and al- antidepressant medications, which was a reasonable
though she was ambivalent about accepting alcohol combination of two antidepressants at good doses.
as a significant problem in her life, her cravings dis- Although I considered increasing her bupropion, I
appeared for a time after that session. I wondered, if decided to hold off making pharmacological changes,
Alcohol Dependence/Psychiatry Resident 345
feeling her mood seemed most affected by current and we agreed that the process was not finished but
interpersonal stressors, which we spent the session that I would not be available to continue in her care.
processing. The article provided a similar example, and stated
that regression could be an unfortunate consequence.
Visits 1516 (Weeks 2021) Ms. M.T. was toying with the idea of discontinuing
Patients mood gradually improved over the next therapy after I left, and after my research, I felt even
couple weeks, utilizing assertiveness skills, which stronger about encouraging her to continue. I made a
worked well in her interpersonal relationships. She note to myself to address this in the next session.
also began to exercise regularly, which she found
enormously helpful. Despite significant improve- Visit 17 (Week 22)
ments in her mood, her drinking persisted, increas- The patients mood remained stable, but despite her
ing to the point of drinking daily. intended commitment to abstain, she had used alco-
I decided to reassess where she wanted to go with hol every day in the past week and had not attended
her alcohol use. I had reminded Ms. M.T. I would be AA. Unanticipated celebrations and boredom led to
leaving the clinic in about a month. In probing, she her drinking, although she admitted to feelings of
revealed that knowing that I would be leaving the disappointment. We discussed her boyfriends im-
clinic soon left her feeling unmotivated to quit alco- pending move and her concern that he could influ-
hol. She admitted she was giving herself the allow- ence her if he continued drinking. She set goals to
ance to drink. She felt an obligation toward me, discuss this with her boyfriend and to attend AA. But
regularly coming to the clinic despite the financial the most significant goal she set for herself was quit-
and scheduling burdens. And part of this obligation ting alcohol for an extended period, recognizing
involved not wanting to disappoint me if she set a that setting a commitment to quit for a limited period
commitment to quit and failed. I felt another key was not working. It was a movement toward closing
moment in therapy where change might be possible, the door of leniency she had given herself for years.
similar to our session when I addressed her aware- During this session, we continued with pretermi-
ness of alcohol as a problem. After sharing these nation counseling. I wanted to readdress her plans af-
feelings of needing to please me, she felt a weight ter I left the clinic, concerned that she might decide
lifted from her shoulders and readily set a commit- to halt therapy and regress. My strategy was to use
ment to stop drinking for a week and to attend AA. the content of this session and emphasize the many
This session encouraged me to look deeper into changes she was about to confront in the coming
the process of psychotherapy termination. Although months and ask her how she felt about handling it on
I had ensured that Ms. M.T. was fully informed from her own without a therapist. She admitted that it
the beginning that my time in this resident clinic could be challenging and seemed to recognize the
would be limited to 6 months, it was clear that my up- potential pitfalls of discontinuing. We discussed her
coming departure was influencing her life decisions reservations, namely that therapy was work on her
in ways opposite to what we were trying to achieve. end and that this termination was a chance to take a
Not only did she verbally reflect this, but I also no- break before signing up with another therapist. I
ticed spikes in her depression and drinking in the agreed with her that therapy was work but then noted
weeks when either she or I was away and unable to that in the work she had done in this clinic, she had
meet (Figures 341 and 342). I found that, in some made tremendous progress. She agreed that what
ways, she was using my departure as a way to explain might be better was a therapist closer to her home,
her continued drinking. I could find no evidence- covered by her insurance, and one where continuity
based guidelines on psychotherapy termination, but I could be better ensured. The plan seemed to lift some
did find an article in the Journal of Clinical Psychology of the burdens she had been feeling and removed the
(Vasquez et al. 2008) via PubMed that discussed the ambivalence she had with continuing in therapy.
consequences of inappropriate termination, ethical
and clinical responsibilities of the therapist, and prac- Visit 18 (Week 23)
tice recommendations (Table 345). In this case, The patients depression continued to steadily de-
there was a strong therapeutic alliance between us, cline, her STAR*D QIDS-SR16 score at 10. Accord-
346 How to Practice Evidence-Based Psychiatry
Recommendation Followed
Provide patients with a complete description of the therapeutic process, including termination;
obtain informed consent for this process at the beginning of treatment and provide reminders
throughout treatment.
Ensure that the psychotherapist and client agree collaboratively on the goals for psychotherapy and
the ending of psychotherapy.
Provide periodic progress updates that include discussions of termination and, toward the end of
psychotherapy, provide pretermination counseling.
Offer a contract that provides patients with a plan in case the psychotherapist is suddenly unavailable No
(including death, or financial, employment, or insurance complications).
Help clients develop health and referral plans for posttermination life.
Make sure you understand termination, abandonment, and their potential effects on patients.
Consider developing (and updating) your professional will to proactively address unexpected No
termination and abandonment, including the name(s) of colleagues who will contact current
patients in the case of your sudden disability or death.
Contact clients who prematurely terminate via telephone or letters to express your concern and offer NA
to assist them.
Use the American Psychological Association Ethics Code (2002), your state practice regulations,
and consultations with knowledgeable colleagues to help guide your understanding and behavior in
regard to psychotherapy termination.
Review other ethics codes for discussions of abandonment. The American Counseling Association
(http://www.counseling.org/Resources/CodeOfEthics/TP/Home/CT2.aspx) and the American
Mental Health Counselors Association (http://www.amhca.org/code) contain prohibitions against
abandonment.
Make the topic of termination a part of your regular continuing education or professional
development.
Be vigilant in monitoring your clinical effectiveness and personal distress. Psychotherapists who
self-monitor and practice effective self-care are less likely to have inappropriate terminations or
clients who feel abandoned.
Note. NA= not applicable.
Source. Adapted from Vasquez et al. 2008.
ing to the QIDS-SR16 scoring criteria (University of presented Ms. M.T. during a case conference. I de-
Pittsburgh Epidemiology Data Center 2009), this cided to readdress how she viewed her alcohol use,
was an improvement from moderate depression at and although she felt she was not dependent on alco-
week 12 to mild depression. Her alcohol use de- hol, she believed there was a stronger potential for
creased substantially as wellshe had 2 drinking this and firmly stated she was not going to wait for it
days in the past week, compared with her daily drink- to get out of hand.
ing during the previous couple of weeks. She also We continued with pretermination counseling,
made courageous steps toward asking her boyfriend Ms. M.T. reflecting on and proud of the progress
to not drink upon his move because of its likely influ- she had made in the last year. I validated her growth
ence on her. I recognized how her achievements and strengths. She openly shared that transitioning
seemed to make her feel positive, careful that my own to a new therapist might be difficult given how much
commendations or expressions of pride could hasten she had revealed and how hard that had been for her.
any obligations she might feel toward me. This was a I recognized her feelings and was forthcoming that
recommendation offered by other therapists when I the termination would be difficult for me as well, ac-
Alcohol Dependence/Psychiatry Resident 347
knowledging our strong therapeutic alliance. We apy, perhaps the emphasis could have been less on
again touched on her plans to find a therapist closer the label and more on alcohol as a problem.
to her home to continue with after my departure. I I also reviewed my use of the practice recommen-
offered to look over the list of providers covered un- dations for psychotherapy termination, which I was
der her insurance plan with my supervisor and pro- satisfied I had followed. Despite following published
vide her with recommendations. In inquiring what guidelines and recommendations, this case demon-
her future goals in therapy would be, she stated Al- strated and affirmed for me the need to expand ones
cohol use, going to AA, and making sure I dont get use of resources in caring for patients (i.e., confer-
off tracka positive addition to her prior goals, ences, supervision, articles, etc.), especially when no
which had primarily focused on addressing her further guidelines exist.
mood. The prevailing question I had for myself at the
end of my time with Ms. M.T. was how successful I
Summary of Guideline Use had been treating her alcohol use. What measure
could I use as a gauge? In the COMBINE study,
At the end of 23 weeks, I reviewed my use of the about 1,300 patients were enrolled in a study that
guidelines. I felt I had followed the APA Practice compared nine different alcohol abuse treatments
Guideline for the Treatment of Patients With Substance (Anton et al. 2006). In this study, the main outcomes
Use Disorders (Tables 341 and 343) relatively well were percentage of days abstinent over the 16 weeks
and consistently. The few areas I did not carry out of the study and time to first heavy drinking (five
involved intensifying relapse prevention either standard drinks per day for men, four for women).
through encouraging monitoring programs or ob- The mean percentage of days abstinent was about
taining more objective evidence of relapse. Both 65%, or 2 days out of 3, which was considered a min-
these approaches may have given the patient more imal standard. Using this studys criteria, my patient
accountability for her actions. Furthermore, my su- did indeed achieve a level of abstinence above the
pervisor and I had considered medications for her minimal standard, at 68%.
cravings, but I did not pursue this, and I may have as-
sumed prematurely she would have decided against
this since she believed she had self-control of her al- Ways to Improve Practice
cohol use. A thorough discussion regarding her In reviewing my practice, although I had encouraged
cravings and medications as an option could have of- family therapy, I might have improved my care of Ms.
fered her an alternate treatment route to consider. M.T. by inviting her boyfriend and perhaps her son
The clinic charts (Figures 341 through 343) to one of our sessions because there were interper-
were excellent tools that allowed Ms. M.T. and me sonal stressors. This would have allowed me to
to view the trends of her mood as it related to her al- gather collateral information, explore interpersonal
cohol use and cravings. I would have liked to use the dynamics, examine what understanding her family
STAR*D assessments and guidelines more carefully had of her drinking, and perhaps discuss ways in
and from the beginning of treatment. which they could assist with her goals. Second, I
Although I had had a few lectures in the course of would have more carefully monitored and inquired
residency on motivational interviewing, I plunged about how our missed sessions were affecting her.
into the practice for the first time after Ms. M.T.s Had I noticed this pattern earlier, I could have been
initial lapse. Only later did I review the five general more vigilant about checking in via telephone if we
principles (see Table 344), which I felt I had cov- were unable to meet in person. Third, I might have
ered sufficiently. The one recommendation I failed been more aggressive with following the STAR*D al-
to follow was not to give clients a label such as al- gorithm. Her QIDS-SR16 was still above the optimal
coholic. In answering Ms. M.T.s question, I did level for remission at our last visit. Lastly, a consulta-
state I believed she was an alcoholic which trig- tion with experts in the field of substance use/addic-
gered her into viewing her use differently. Although tion could have offered further guidance in helping
I felt this was a pivotal and significant point in ther- my patient achieve abstinence for a sustained period.
348 How to Practice Evidence-Based Psychiatry
Glossary
absolute risk increase (ARI) D i f f e r e n c e b e - tent meaning to them, and it is better to specify
tween experimental event rate (EER) and control which participants have been blinded.
event rate (CER) when a treatment increases the
risk of a negative outcome. case report Description of a single case.
absolute risk reduction (ARR) Difference be- case series Description of a series of cases.
tween control event rate (CER) and experimental case-control study Observational study in which
event rate (EER) when a treatment decreases the exposure to a suspected risk factor is assessed in
risk of a negative outcome. cases with the disease and in control subjects
allocation concealment Refers to whether the without the disease.
person making the allocation of a patient to either cohort A group of persons followed over time.
the experimental or control treatment in a ran- cohort study An observational study in which a co-
domized controlled trial is aware of the group to hort is followed over time and the number of cases
which the next patient will be assigned. of disease (or another outcome measure) is assessed.
alpha () Probability of a type I error (i.e., falsely Typically, the cohort is divided into those who are
concluding that there is a difference between the exposed to a potential risk factor and those who are
experimental and control groups when such a dif- not exposed, and the difference or ratio of incidence
ference is the result of chance alone). rates is computed.
attributable risk Difference in incidence rates co-intervention Intervention other than the
between exposed and nonexposed cohorts; also treatment under study that is applied differen-
known as risk difference (RD). tially to the control and experimental groups.
confidence interval (CI) Range of values within
beta () Probability of a type II error (i.e., falsely which the true value most likely lies.
concluding that there is no difference between confounding variable Variable related to the
the experimental and control groups when such a outcome, which differs in frequency between the
difference in fact exists). experimental (or exposed) and control (or non-
bias Systematic deviation of the results from the exposed) groups. Confounding variables, not the
truth. variable under study, may be responsible for ob-
blinded or blind Refers to whether patients, cli- served differences in the groups.
nicians, raters, and data analysts are aware of control event rate (CER) Rate of events in
which treatment a patient in a trial is receiving. the control (nonexposed or nonexperimental)
Although terms like single blind, double blind, or group. Typically expressed in terms of negative
triple blind are sometimes used, there is no consis- events.
349
350 How to Practice Evidence-Based Psychiatry
cross-product ratio Odds ratio. odds Ratio of the probability of an event occur-
cross-sectional survey Observational study de- ring to the probability of an event not occurring.
sign in which exposures and outcomes are deter- odds ratio (OR) Ratio of odds of event in ex-
mined at the same point in time. posed group to odds of event in nonexposed
group. In a case-control study, ratio of odds of ex-
dichotomous outcome Outcome that can take posure in cases to odds of exposure in control sub-
only two values (e.g., dead or alive). jects; also known as cross-product ratio.
effect size Measure of the difference in outcomes patient expected event rate Expected risk of
between the control and experimental groups. negative outcomes in patient if control treatment
experimental event rate (EER) Rate of events is administered.
in the experimental (exposed) group. Typically positive predictive value (PPV) Proportion of
expressed in terms of negative events. positive test results that are true positives.
posttest odds Odds of disease in patient after re-
Hawthorne effect Performance improves when sults of test are known.
subjects know they are being studied. posttest probability Probability of disease in pa-
tient after results of test are known.
inception cohort Group of people assembled at pretest odds Odds of disease in patient before
a common point, early in the course of their ill- results of test are known.
nesses. pretest probability Probability of disease in pa-
incidence Number of new cases of disease in a tient before results of test are known.
population in a given period of time. prevalence Proportion of persons in a popula-
intention-to-treat analysis Statistical analysis tion with disease of interest.
that includes all patients assigned to a treatment
group, regardless of whether they completed randomization Allocation of subjects to groups
study. by chance.
randomized controlled trial (RCT) C l i n i c a l
Kaplan-Meier curve Survival curve. trial in which patients are randomly allocated to
control or experimental treatment groups.
likelihood ratio (LR) Relative likelihood of test receiver operating characteristic curve (ROC) Plot
results in those with disease, compared with those of false positive rate (1 specificity) versus true
without disease. positive rate (sensitivity).
relative risk (RR) In a cohort study, ratio of inci-
meta-analysis Statistical technique that pools re- dence of disease in exposed group to incidence in
sults from more than one study to yield a sum- nonexposed group. In a randomized controlled
mary result. trial, ratio of rate of negative events in experimen-
tal group (EER) to rate in control group (CER).
negative predictive value (NPV) Proportion of
relative risk reduction (RRR) In an random-
negative test results that are true negatives.
ized controlled trial, proportion of risk of negative
number needed to harm (NNH) N u m b e r o f
outcome reduced by the experimental therapy.
patients that must be treated with an experimen-
Calculated as 1relative risk (RR).
tal therapy to produce one additional bad out-
reliability Degree to which results are reproduc-
come that would not have occurred on the
ible.
control therapy. Inverse of absolute risk increase.
risk difference (RD) Difference in incidence
number needed to treat (NNT) N u m b e r o f
rates between exposed and nonexposed cohorts.
patients that must be treated with an experimen-
risk factor Patient characteristic that increases
tal therapy to prevent one bad outcome that
risk of disease.
would have occurred on the control therapy. In-
risk ratio Relative risk.
verse of absolute risk reduction.
Glossary 351
sensitivity Proportion of persons with a disease type I error Falsely concluding that there is a
who are correctly identified by a diagnostic test. difference between experimental and control
specificity Proportion of persons without a disease groups when such a difference is the result of
who are correctly identified by a diagnostic test. chance alone.
survival analysis Method of analyzing time-to- type II error Falsely concluding that there is no
event data. difference between experimental and control
survival curve Graphical display of proportion groups when such a difference in fact exists.
of individuals who have not had event occur, plot-
ted over time. validity Degree to which results of a study are un-
systematic review Literature review that involves biased.
comprehensive search for relevant articles, fol-
lowed by critical appraisal and summarizing of ar-
ticles that meet quality criteria.
This page intentionally left blank
APPENDIX B
353
354 How to Practice Evidence-Based Psychiatry
TABLE B1. Confidence intervals (CIs) for TABLE B2. Calculating patient-specific
number needed to treat and number needed to treat and
number needed to harm number needed to harm
estimates
Experimental Control
treatment treatment Experimental Control
Bad outcome A B treatment treatment
Upper limit of 95% CI for ARR (UARR)=ARR+1.96 SEARR Relative risk reduction (RRR)= 1 RR
Lower limit of 95% CI for ARR (LARR)=ARR1.96 SEARR Patients expected absolute risk reduction
(PARR)= PEERRRR
Upper limit of 95% CI for NNT (U NNT)= 1/LARR
Patient-specific number needed to treat (PNNT)= 1/PARR
Lower limit of 95% CI for NNT (LNNT)= 1/U ARR
1 + ( CER ) ( 1 OR )
NNH = ----------------------------------------------------------------
( CER ) ( 1 CER ) ( 1 OR )
Note. NNT= number needed to treat; CER =estimated
control event rate; OR =odds ratio; NNH= number needed
to harm.
This page intentionally left blank
Index
Page numbers printed in boldface type refer to tables or figures
ABAB approach, for single case overestimation of prevalence of, American Heart Association
design, 35 110 (AHA), 23
Abbreviated Mental Test, 325 presenting as mood disorder American Medical Association
Absolute risk, 109, 115 (case study), 233245 (AMA), 5
Absolute risk reduction (ARR), 42 screening for, 235 American Psychiatric Association
Abstracts. See. Synopses treatment of, by psychiatry (APA), 133
Accreditation Council for Graduate resident (case study), 337 evidence-based medicine
Medical Education (ACGME), 348 workshops of, 123
5, 121, 125, 137 Alcohol consumption rates, in practice guidelines, 26, 26, 70, 71
core competencies requirement women, 239 for borderline personality
of, 133134, 134 Alcohol withdrawal, 332, 333, 334 disorder, 247, 248, 249,
Outcome Project, 133, 135 Algorithms, 26, 7071. See also 251
Accuracy, 95, 96, 97, 324 Texas Medication Algorithm for bulimia nervosa, 256
checklist of studies of, 326 Project (TMAP) for depression, 126, 277, 279
ACP. See American College of as basis for psychiatry practice, 284, 285
Physicians 126127 for eating disorders, 7576,
ACP Journal Club (journal and for case studies, 145146 77, 78, 161, 174, 179,
database), 24, 25, 27, 123 implementation of, 76, 78 180
A+ DELPHI psychotherapy billing for psychopharmacology, Web for major depressive disorder,
software, 90 site of, 70 158160, 159160, 164,
Adolescents, antidepressant-related summaries of, 26, 26 168, 171172, 184, 196,
suicide risk in, 4850 Allocation bias, 37 201
Adverse drug reactions (ADRs), 107 Allocation concealment, 43 for obsessive-compulsive
Agency for Healthcare Research All-or-none case studies, 36 disorder, 174, 177179,
and Quality (AHRQ), 5, 26, 45, American Academy of Child and 247, 249, 251
70, 71, 73, 297 Adolescent Psychiatry for schizophrenia, 30, 176,
Age-specific incidence and (AACAP), 49 225, 226, 231
prevalence rates, 102 American Association of Health for substance use disorders,
Agoraphobia, 149 Plans (AAHP), 5, 26 127, 237, 337, 338, 340,
AGREE (Appraisal of Guidelines American College of 343, 347
Research and Evaluation), 330 Neuropharmacology (ACN), use in case studies, 144
Alcohol abuse 4849 Web site, 24
comorbidity with American College of Obstetricians American Psychiatric Publishing, 88
depression, 126129 and Gynecologists (ACOG), American Psychological Association
personality disorder (case 290 ClinPSYC and PsycINFO
study), 247251 American College of Physicians databases, 29
posttraumatic stress disorder (ACP), 25 Task Force on Evidence-Based
(case study), 263273 ACP Journal Club, 24, 25, 27, 123 Practice, 6
357
358 How to Practice Evidence-Based Psychiatry
Americas Health Insurance Plans, 5 psychometric properties of, 85 representativeness bias, 319,
Anorexia. See also Bulimia nervosa 87 327
case studies of, 167172, 173 for target symptoms/problems, rumination bias, 110
181 147148 selection bias, 37, 104, 110,
clinical practice guidelines for, Attrition, in studies of prognosis, 111
180 118 spectrum bias, 94
Answers. See also Questions Attrition bias, 44 time lag bias, 57
applying to patients, 14 Authors, of journal articles, Biostatistics, 123
in clinical trials, 45 conflicts of interest of, 23 Bipolar disorder
in diagnostic studies, 9899 Availability bias, 319 case study of, 203216
in studies of etiology or harm, Avoidant personality disorder (case differentiated from major
112113 study), 247251 depressive disorder, 210,
in studies of prognosis, 119 210
in surveys of disease Background questions, 17 placebo response rate in, 38, 39
frequency, 104 Bandolier (online journal), 28 treatment of, 288289
in systematic reviews, 64 Bayes theorem, 319, 327 algorithm for, 70
reasons for not finding, 32 Beck, Aaron T., 84 in health maintenance
searching for. See Evidence, Beck Depression Inventory (BDI), organization setting (case
searching for 158, 297 study), 307313
Antidepressant therapy, 126127, Beck Depression InventoryII number needed to treat
276285, 288289 (BDI-II), 84 (NNT), 43
as bipolar disorder treatment, Best case/worst case analysis, 118 Bipolarity Index, 209
210212 Bias Blinding, in clinical trials, 37, 38,
versus electroconvulsive therapy, in case-control studies, 110 4344
195202 in clinical practice guidelines, 69 Blobbograms, 60, 60
for postpartum depression, 288 in cohort studies, 109 BMJ (journal), 14, 123
289, 290, 291, 293, 295, 303 definition of, 111 BMJ Publishing Group, 5, 25, 27
side effects of, 277, 278279, diagnostic, 318321, 325, 334 Books, as evidence-based medicine
282, 283284 of experts, 22 resource, 123
as suicide risk factor, 4850 minimizing of, 38, 43 Borderline personality disorder
Anxiety in narrative reviews, 55 (case study), 247251
comorbidity with bipolar in randomized controlled trials, BPRS (Brief Psychiatric Rating
disorder, 212 3738 Scale), 176, 198, 199, 200, 201
differential diagnosis of (case sources of Brain Lock (Schwartz), 219
study), 315336 allocation bias, 37 Breastfeeding, 290, 290
postpartum, 289, 292 ascertainment bias, 38 Brief Mood Survey, 291, 292, 297,
Appraisal of Guidelines Research citation bias, 57 301
and Evaluation (AGREE), 330 confirmation bias, 319 Brief Psychiatric Rating Scale
Archives of General Psychiatry database bias, 57 (BPRS), 176, 198, 199, 200,
(journal), 22, 23, 45 detection bias, 38 201
ARI (absolute risk increase), 107, 108 duplicate publication bias, 47, British Association for
ARR (absolute risk reduction), 42 57, 5758 Psychopharmacology
Ascertainment bias, 38 file drawer bias, 5657 Consensus Guidelines, 26
Assessment instruments, 8392, hindsight bias, 334 British Psychological Society, 5, 27
103, 104. See also names of information bias, 110, 111, Bulimia nervosa
specific assessment instruments 111, 115 case studies of, 157166, 253
choice of, 8384 language bias, 5657, 57 259
construction of, 8485 location bias, 57 clinical practice guidelines for,
copyrighted, 8889 migration bias, 118 75, 76, 157, 158, 160, 164
development of, 89, 89, 90 observer bias, 36, 38, 4344 165
finding and using, 8889 outcome reporting bias, 57 number needed to treat (NNT)
nonstandardized, 89, 89, 90, 147 publication bias, 4548, 46 in, 43
in pharmaceutical industry- recall bias, 110, 111, 115 Burns, David, 287, 288, 297, 302,
sponsored clinical trials, 46 regret bias, 319320 303
Index 359
CAGE questionnaire, 9697, 98 Centre for Evidence-Based Clinical Queries filters, 329
CAM-ICU (Confusion Assessment Medicine, 3, 25, 133, 137 Clinical questions. See Questions
Method for the Intensive Care Centre for Evidence-Based Mental Clinical Research Information
Unit), 329334, 331 Health, 5, 25, 137 System (CRIS), 25, 91
Campbell Collaboration, 58 Centre for Health Evidence, 4 Clinical review bias, 325
Canada, evidence-based medicine CER (control event rate), 41, 42 Clinical trials, 3553
in, 4 Chance, 111, 111 appraisal of, 4345, 44
Canadian Medical Association, 26 Change, sensitivity to, 8687 with blinding, 37, 38, 4344
CMAJ: Canadian Medical Charts, 147, 148 controlled, 36
Association Journal, 4 Checklists, of clinical practice controlled versus uncontrolled,
Cancer patients guidelines, 148 3536
consultation-liaison psychiatric Children, antidepressant-related exclusion criteria for, 8
intervention with (case suicide risk in, 4850 measures of effectiveness of, 41
study), 315336 Chi-square test, 60, 64 42, 43
depression and refusal to eat in CIDI (Composite International nonrandomized, 3637, 43
(case study), 167172 Diagnostic Interview), 9350 pharmaceutical industry-
Case-control studies CINAHL (Cumulative Index to sponsored, 4550
appraisal of, 114115, 115 Nursing and Allied Health publication bias in, 4548,
controls in, 110 Literature), 29 46
individual, 22 Citation bias, 57 randomized. See Randomized
information bias in, 115 Clinical Antipsychotic Trials of clinical trials
measures of risk in, 111 Intervention Effectiveness registries of, 4445
nested, 110 (CATIE), 78, 176 standardized reporting of, 44
recall bias in, 110, 111, 115 Clinical Evidence (journal and uncontrolled, 36, 36
reverse causality in, 110111 database), 4, 8, 25, 32 underrepresented groups in, 8
for studies of etiology or harm, Updates, 25 validity of, 4345
108 Web site, 24 ClinPSYC (database), 29
systematic reviews of, 22 Clinical Institute Withdrawal Cluster sampling, 103
validity of, 114115 Assessment for Alcohol, 333 Cochrane Central Registry of
Case registries, 102103 Clinical Knowledge Summaries, 26 Controlled Trials, 24, 56
Case reports, for studies of etiology Clinical Monitoring Form, 203, Cochrane Collaboration, 27, 58
or harm, 107, 108 204207, 213, 214 Cochrane Database of Systematic
Case series, 3536, 107 Clinical practice guidelines, 6981. Reviews, 25, 27, 121, 324
all-or-none, 22, 36 See also American Psychiatric Cochrane Library, 29, 3031
for studies of etiology or harm, Association (APA), Practice Cognitive-behavioral therapy
107, 108 guidelines (CBT)
as worst source of evidence, 22 appraisal of, 7375, 74 for bipolar disorder, 210, 212,
Case studies, for studies of etiology as basis for psychiatry practice, 214, 215
or harm, 108 126127 for bulimia nervosa, 76, 255256
CAT (critically appraised topic), for case studies, 145146 clinical practice competency in,
324325 as checklists, 148 128
CATIE (Clinical Antipsychotic choice of, 7879 for depression, 126127
Trials of Intervention comparison of, 7576 for major depressive disorder,
Effectiveness), 78, 176 definition of, 69 158, 160162, 163, 165
Causality development of, 7173, 72, 73 for obsessive-compulsive
criteria for, 111, 112, 115 differences among, 7173 disorder, 174175, 217224
in epidemiological studies, 111, implementation of, 7475, 76, for panic disorder, 149150, 151,
111 78 153, 156
reverse, 110111 improving the use of, 78 for postpartum depression, 228,
CBT. See Cognitive-behavioral role of, 69 288
therapy sources of, 70 for posttraumatic stress disorder,
CDP (critical decision point), 185, summaries of, 26, 26 267268
185, 186, 186191, 187, 188, top-down approach of, 3 for schizophrenia, searching for
190, 191 updating of, 9, 73 evidence on (example), 30
360 How to Practice Evidence-Based Psychiatry
DerSimonian and Laird method, 58 systematic review and meta- EBM. See Evidence-based medicine
Detection bias, 38 analysis of, 9798 EBPP. See Evidence-based
Diagnosis Dichotomous outcome measures, psychiatric practice
errors in assigning, 318319 5859, 9496 Ecological studies, 22
evidence-based approach to (case Differential diagnosis, 315, 319335 Edinburgh Postnatal Depression
study), 315336 decision trees for, 320, 320321, Scale, 297
questions related to, 18 321 Effective Treatments for PTSD:
Diagnostic and Statistical Manual of possibilistic approach to, 320 Practice Guidelines From the
Mental Disorders, Fourth probabilistic approach to, 320 International Society for
Edition, Text Revision (DSM- prognostic approach to, 320 Traumatic Stress Studies
IV-TR), diagnostic criteria of, Discriminant validity, 86, 87 (Foa et al.), 265
8485, 87, 103 DIS (Diagnostic Interview Effect size, 73
for anxiety, 320 Schedule), 93 Effort after meaning, 110
for bipolar disorder, 208 Disease frequency Electroconvulsive therapy (ECT)
manic with psychotic measure of, 101102 versus antidepressant use, 195
features, 308 surveys of, 103104 202
for bulimia nervosa, 118, 255 Disease registries, 102103 for postpartum depression, 288,
for delirium, 322 Disease self-management, 183193 295, 296, 301, 302
for major depression, 184 DISH (Depression Interview and Electronic medical record systems,
with alcohol dependence, Structural Hamilton), 87 with decision support systems,
168, 338 Dizziness, 150151, 153 24, 25
with bulimia nervosa, 158 DOR (diagnostic odds ratio), 96 Electronic office assessment
with panic disorder, 277 Dosage/dosage schedules, 46, 46 systems, 9091
with postpartum onset, 288 Double-blind study, 38 Eloquence-based medicine, 135
with psychotic features, 197 DSM-IV-TR. See Diagnostic and EMBASE (database), 29
severe, single episode, 196 Statistical Manual of Mental Eminence-based medicine, 135
for obsessive-compulsive Disorders, Fourth Edition, Text End points, in clinical trials, 46, 47
disorder, 171, 218 Revision 48
for panic disorder with DSM-IV-TR Handbook of Epidemiological studies
agoraphobia, 149 Differential Diagnosis (First et causality in, 111, 111
for postpartum depression, 297 al.), 320321, 334 studies of etiology or harm, 108
for posttraumatic stress DSS (Depression Severity Scale), 111
disorder/substance abuse 278, 279 Epidemiology
comorbidity, 264 Dual diagnoses, 240 clinical, 123
for schizophrenia, paranoid type, alcohol abuse/personality descriptive, 101
228 disorder (case study), 247 ERP (exposure and response
as standards for diagnostic test 251 prevention), 217224
evaluation, 93 substance abuse/posttraumatic Error rate, 95, 96
for substance abuse, 230, 235, 237 stress disorder (case study), Errors
for substance-induced mood 263273 in assigning diagnosis, 318
disorders, 236 Duke University 319
use in clinical trials, 319 Clinical Research Information medical, 129131
Diagnostic Interview Schedule System (CRIS), 25, 91 random, 37
(DIS), 93 Department of Psychiatry, 14, Etiology
Diagnostic odds ratio (DOR), 96 136 appraisal of, 111, 113114
Diagnostic testing, 319 Duplicated publications, 47 questions related to, 18, 19
Diagnostic testing threshold, 319 Duplicate publication bias, 47, 57, studies of
Diagnostic tests, 93100. 5758 case-control studies, 114115
See also names of specific cohort studies, 113114
diagnostic tests Eating disorders. See also Anorexia; randomized controlled trials,
evaluating, 18, 9394 Bulimia nervosa 112113
as intervention, 18 assessment of, 253 Evaluation, of evidence-based
measures of performance of, 94 clinical practice guidelines for, 75 medicine skills, 121124, 122,
97, 95, 97 76, 77, 161, 174, 179, 180 125131, 137
362 How to Practice Evidence-Based Psychiatry
Mood charting, 213, 214 obsessive-compulsive disorder Observational studies. See also
Mood disorder, presenting as handout, 175 Cohort studies
substance use disorder (case personalized care initiative of, misleading results of, 21
study), 233245 192 Observer bias, 36, 38, 4344
Morbidity risk, 102 Study of the Pharmacotherapy Obsessive-compulsive disorder
Motivational interviewing, 337348 of Psychotic Depression (OCD)
Multiple publication bias, 47, 5758 (STOP-PD), 198 with anorexia and depression
Myocardial infarction patients, 6 National Institutes of Health (case study), 173181
(NIH), 24 case study of, 217224
Narrative reviews, 5556 National Library of Medicine, number needed to treat (NNT),
Nasopharyngeal cancer patient PubMed (database), 28, 28, 31, 43
(case study), 167172 32 with personality disorder (case
National Alliance on Mental Illness National Registry of Evidence- study), 247251
(NAMI), 225, 226, 227, 228 Based Programs and Practices, placebo response rate in, 39
National Association of Psychiatric 6 Obsessive Compulsive Foundation,
Health Systems (NAPHS), 129 Natural experiments, 109 Web site of, 219
National Association of State Natural history of the illness, 36 OCD Handbook (Hyman and
Mental Health Program Negative predictive value (NPV), Pedrick), 219
Directors (NASM-HPD), 129 94, 95, 95 Odds ratio (OR), 109, 111, 111
National Collaborating Centre for Negative test result, likelihood ratio in case-control studies, 115
Mental Health, 75 (LR) of, 95, 97 comparison with relative risk,
National Comorbidity Survey, 102 Negative thought/positive thought 5859
National electronic Library for method, 294, 297 definition of, 42
Mental Health, 24, 29, 30 Nested case-control study, 110 diagnostic, 96
National Guideline Clearinghouse, New Zealand Guidelines Group, as measure of treatment
5, 26, 26, 29, 70, 75, 342 26 effectiveness, 42
Web site, 24 NHS. See National Health Service in meta-analysis, 5859
National Health Service (NHS) (United Kingdom) in systematic reviews, 5859
(United Kingdom) NICE. See National Institute for OfficeEMR (software), 90
Centre for Reviews and Health and Clinical Excellence Online disease management
Dissemination, 27, 56 Nicotine dependence, 243 systems, 275286
evidence-based medicine Nomograms, 327328, 328 OR. See Odds ratio
resources of, 25 Null hypothesis, 40 Ordinal results, 9697
National Service Framework, 6 Number needed to harm (NNH), Osler, William, 125, 129
support for evidence-based 109, 112 Outcome
medicine, 45 in bipolar disorder treatment, application to patients, 104, 104
National Heart, Lung, and Blood 211 assessment of, 14, 104, 104, 121
Institute, Enhancing Recovery calculated from odds ratio, 115 barriers to measurement of, 83
in Coronary Heart Disease in cohort studies, 109, 114 of clinical trials, 45
trial, 87 comparison with number needed effect of evidence-based
National Institute for Health and to treat, 112, 115 medicine on, 6
Clinical Excellence (NICE), definition of, 108 effect of funding source on, 47
45 individualized, 114 48
clinical practice guidelines and Number needed to treat (NNT), negative, 18
algorithms of, 26 45, 108, 111, 112 as part of question, 18
for bulimia nervosa, 157, 158, in bipolar disorder treatment, in pharmaceutical industry-
160, 164165 211 sponsored clinical trials, 45
development of, 7273, 74 calculated from odds ratio, 59 47, 46
for eating disorders, 7576, calculated related to outcomes, positive, 18
77, 78 45 statistically significant, 3940, 40
for panic disorder, 149, 150, comparison with number needed in studies of prognosis, 118
154 to harm, 112, 115 time-to-event, 118, 119
National Institute of Mental Health as measure of treatment Outcome measures
(NIMH) effectiveness, 42 for case studies, 145146
Index 365
continuous, 59, 9697 Peto model, for producing odds Postpartum period, depression
dichotomous, 5859, 9496 ratios, 58 during (case study), 287305
Outcome reporting bias, 57 Pharmaceutical companies Posttest probability, of disease, 95,
Outcomes research, 22 as clinical trial sponsors, 4550 96, 99, 323
Overcoming Eating Disorders (Agras influence on clinical practice definition of, 323
and Apple), 162 guideline development, 72 of delirium, 332
Ovid Evidence-Based Medicine influence on medical education, Posttraumatic stress disorder
Reviews, 27, 56 48 (PTSD), 5
Oxford University Pharmacotherapy. See also with substance abuse (case
Centre for Evidence-Based Antidepressant therapy; study), 263273
Mental Health, 5, 25, 137 Selective serotonin reuptake Posttraumatic Stress Disorder
Department of Psychiatry, 25 inhibitors Checklist, 84
Oxford University Press, 6 for alcohol dependence, 241 Power, statistical, 40
242, 242 Practice guidelines. See Clinical
Panic disorder for bipolar disorder, 210212, practice guidelines. See also
with agoraphobia (case study), 211, 214, 288289, 308, under names of specific diagnoses
147155 309310, 311312, 313 and specific organizations
with depression (case study), for bulimia nervosa, 160, 161, Predictive validity, 86
275281 162163, 163 Preferred provider organizations, 5
number needed to treat (NNT) for depression, 126127, 276 Pretest probability, of disease, 95,
for, 43 285, 288289 96, 99
placebo response rate in, 39 for obsessive-compulsive of delirium, 322323, 328334,
Patient Health Questionnaire9 disorder, 217224 330
(PHQ-9), 308, 309, 312 for panic disorder, 149150, 151, of dementia, 323, 327328
Patients 152, 156 ignoring of, 319
applying answers to, 1718 for personality disorders, 248 Prevalence, 104
in clinical practice guidelines, 249, 251 lifetime, 102
7475 for postpartum depression, 288 period, 102
in clinical trials, 45 289, 290, 291, 293, 295, 303 point, 101102
in diagnostic tests, 9899 for posttraumatic stress disorder, in specific populations, 103
in studies of etiology or harm, 265, 268269 Prevalent cases, versus incident
112113, 113, 114, 115 in pregnancy and lactation, 290, cases, 117118
in studies of prognosis, 119, 290 Principal components analysis, 85
119 PICO questions, 4-part, 1718, 18, Private practice, postpartum
in surveys of disease 62, 136, 323, 324, 328330 depression treatment in (case
frequency, 104 PIER (Physician's Information and study), 287305
in systematic reviews, 64 Education Resource), 24, 25 Probability, of disease, 9596, 97
with limited financial resources, Pirates of the Caribbean (movie), 221 98
173181 Placebo, as intervention, 18 of dementia, 324325
as part of question, 14 Placebo effect, 36, 3738, 41, 4344 Problem, as part of questions, 1718
treatment-resistant, 9 Placebo response rate, in Prognosis
PatientTrac (software), 90 schizophrenia, 38, 39 questions related to, 18, 19, 117
PCL-C (PTSD Checklist-Civilian Point prevalence, 101102 studies of, 117120
Version), 264, 268, 269, 273 Poisson regression, 111 appraisal of, 118119, 119
Peer review, 126 Population, 103, 104 follow-up and attrition in, 118
Percentage response, 41 in assessment instrument outcomes and data analysis in,
Performance intervention, 38 development, 85 118
Performance measures, 129, 130 in studies of prognosis, 117 selection of patients for, 117118
Period prevalence, 102 Positive predictive value (PPV), 94,
Personal digital assistants (PDAs), 25 95, 95 Prospective cohort study, 109
Personality disorders, complex case Positive test result, likelihood ratio Psychiatric clinical practice. See also
of (case study), 247251 (LR+) of, 9596, 97 Evidence-based psychiatric
Personalized care approach, 183 Postpartum Depression Screening practice (EBPP)
193 Scale, 297 non-evidence-based, 7
366 How to Practice Evidence-Based Psychiatry
Psychiatry, evidence-based. See Random effects model, 59, 60 Relative risk reduction (RRR), 42
Evidence-based psychiatric Random error, 37 Reliability, of assessment
practice Randomization, 37, 43, 109 instruments, 8586, 103, 104,
Psychoeducational approach Randomized controlled trials 327
in bipolar disorder treatment, (RCTs), 36 Remote care, for depressed patients
289 appraisal of, 112113, 113 (case study), 275286
in schizophrenia treatment, 225 as best source of evidence, 21, 22 Reporting systems, 102
232 bias in, 3738 Representativeness bias, 319, 327
Psychotherapy. See also specific types with blinding, 36 Residents
of psychotherapy comparison with cohort studies, alcohol dependence treatment
termination of, 345347, 346 109 provided by, 337348
Psychotic symptoms, of major exclusion of comorbid attitudes toward evidence-based
depressive disorder, 195202 conditions from, 8 medicine, 137138
PsycINFO (database), 29 with 80% follow-up, 22, 44 practice guideline use
PTSD Checklist-Civilian Version measures of risk in, 107108, competency of, 125
(PCL-C), 264, 268, 269, 273 108 teaching evidence-based
Publication bias, 5657, 57 standardized reporting of, 44 medicine to, 5, 122123,
duplicate, 47, 5758, 57 for studies of etiology or harm, 133139
funnel plot analysis of, 61, 6162 107108, 108, 112113 Results. See Outcome
in pharmaceutical industry- systematic reviews of, 21, 22 Retrospective cohort studies, 109
sponsored clinical trails, 45 validity of, 112 Reverse causality, 110111
48, 46 without blinding, 36 Review articles, 7. See also Narrative
PubMed (database), 4, 24, 28, 28, Random samples, 103 reviews; Systematic reviews
31, 32, 76 Rapid cycling, of illness, 212 Reviewers, of journal articles,
Clinical Queries filters, 329 Ratio. See Likelihood ratio; Odds conflicts of interest of, 23
P value, 40, 111 ratio Richmond Agitation Sedation Scale
Pygmalion effect, 36, 3738, 4344 Rational Clinical Exam series, 323, (RASS), 330, 333334
324 Risk
Q.D. Clinical EMR (software), 90 RCTs. See Randomized controlled measures of
Quality-of life measure, 84 trials in case-control studies, 111
Quality of Life (QOL) measure, Recall bias, 102, 110, 111 in cohort studies, 108109,
278, 279, 281 Receiver operator characteristic 109
Quality of Reporting of Meta- (ROC) curves, 9698, 98 in randomized controlled
analyses (QUOROM), 62 Registries trials, 108
Questions of clinical trials, 4445 studies of
background, 17 of disease, 102103 appraisal of, 111
foreground, 17 Regression analysis, 111 in case-control studies, 108,
formulating of, 13, 1718, 56 Regression toward the means, 36 110
4-part PICO, 1718, 18, 62, Regret bias, 319320 in case reports and case series,
136, 323, 324, 328330 Relabeling strategy, 222 107, 108
QUEST model, 14 Relapse, in depression, 158 in cohort studies, 108, 108
Quick Inventory of Depressive Relapse prevention strategies, 127, 109
Symptomatology (QIDS), 84, 267268, 337348 in randomized controlled
85, 88 Relative risk (RR) trials, 107108, 108
Quick Inventory of Depressive in cohort studies, 113, 114 Risk differences (RD), 109, 109
SymptomatologySelf-Report comparison with odds ratio, 58 Risk factors, interventions as, 18
(QIDS-SR), 84, 126, 127, 147, 59 ROC (receiver operator
149, 158, 168, 170, 170, 171, definition of, 41 characteristic) curves, 9698,
174, 176, 184, 185 as measure of treatment 98
use in alcohol dependence effectiveness, 4142 Rounds, evidence-based medicine
treatment, 338, 339, 340, in randomized controlled trials, teaching during, 14, 136
343, 345 107108 Royal College of Psychiatrists, 5,
QUOROM (Quality of Reporting Relative risk increase (RRI), 107 25, 27
of Meta-analyses), 62 108 RR. See Relative risk
Index 367
RRI (relative risk increase), 107108 Seminars, on evidence-based Standard deviation (SD), 59
RRR (relative risk reduction), 42 medicine, 135 Standardized mean, 59
Rumination bias, 110 Sensitivity Standards of care, 129
Russell's sign, 255 conversion into likelihood ratio, STAR*D (Sequenced Treatment
324 Alternatives to Relieve
Samples, 103 of diagnostic tests, 94, 95, 97, Depression), 7, 71, 76, 78, 83,
Sample size, 7, 103 9798 91, 126, 147, 149, 157, 158,
Scales. See Assessment instruments filters for, 32, 56 160, 164, 165, 168, 171, 183
Schizophrenia Sensitivity analysis, 62, 118 193, 283
clinical practice guidelines for, Sentiens, HealthSteps System, 275 STARD (Standards for the
176 286 Reporting of Diagnostic
placebo response rate in, 38, 39 Sequenced Treatment Alternatives Accuracy Studies), 324325,
treatment of to Relieve Depression 326, 333334
algorithm for, 70 (STAR*D) trial, 7, 71, 76, 78, Statistical significance, 3940, 40
clinical practice guidelines 83, 91, 126, 147, 149, 157, 158, tests of, 37
for, 225 160, 164, 165, 168, 171, 183 Statistics
family psychoeducational 193, 283 basic concepts of, 3840
approach, 225232 Sex-specific incidence and biostatistics, 123
number needed to treat prevalence rates, 102 in meta-analysis studies, 5862
(NNT) in, 43 Shortcuts, for 5S model, 14 Steady-state situations, incidence
Schizophrenia Annual Evidence Short-term therapy, for alcohol and prevalence in, 101102
Update 2008, 25 dependence, 337348 STOP-D (Study of the
SCID (Structured Clinical Side effects, 46, 107, 112, 113 Pharmacotherapy of Psychotic
Interview for DSM), 93 of antidepressants, 277, 278 Depression), 198
Scottish Intercollegiate Guidelines 279, 282, 283284 Stress management, 267268,
Network (SIGN), 26 masking of, 45, 46, 47 269
Screening Side Effects Scale (SES), 278279, Structured Clinical Interview for
for postpartum depression, 297, 282 DSM (SCID), 93
298 SIGN (Scottish Intercollegiate Studies. See also Evidence; specific
for substance use disorders, 234 Guidelines Network, 26 types of studies
235, 235 Single blind study, 38 methods for locating, 5657
SD. See Standard deviation Single case reports, 35 sources of, 28
Seeking safety groups, 271272 Small-group sessions, on evidence- Study design, 104, 104
Selection bias, 37, 104, 110, 111 based medicine, 135 in pharmaceutical industry-
Selective serotonin reuptake Smoking cessation, 240, 243, 244 sponsored clinical trials, 45
inhibitors (SSRIs) SnOut mnemonic, 94 48, 46
as bipolar disorder treatment, Snowballing, 27 Study of the Pharmacotherapy of
288289 Social phobia Psychotic Depression (STOP-
comparison with cognitive- number needed to treat (NNT) PD), 198
behavioral therapy, 76 in, 43 Subgroup analysis, 61
as obsessive-compulsive disorder placebo response rate in, 39 Subjective Units of Distress
treatment, 217224 Specificity (SUDS), 219
STAR*D (Sequenced Treatment conversion into likelihood ratio, Subjects. See also Population
Alternatives to Relieve 324 of diagnostic tests, 9394
Depression) trial of, 7, 71, of diagnostic tests, 94, 95, 97, Substance Abuse and Mental
76, 78, 83, 91, 126, 147, 9798 Health Services Administration
149, 157, 158, 160, 164, filters for, 32 (SAMHSA), National Registry
165, 168, 171, 183193, 283 of question formulation, 1718 of Evidence-Based Programs
as suicide risk factor, 4850 Spectrum bias, 94 and Practices, 6
use during pregnancy and Sponsorship, masked, 47 Substance use disorders. See also
lactation, 290, 291 SpPin mnemonic, 94 Alcohol abuse
Self-help approach, 162, 164165, SpPinTest threshold mnemonic, 94 presenting as mood disorder
240 SSRIs. See Selective serotonin (case study), 233245
Self-report measures, 88, 89 reuptake inhibitors (SSRIs) screening for, 234235, 235
368 How to Practice Evidence-Based Psychiatry