You are on page 1of 2

Clinical Review & Education

JAMA Guide to Statistics and Methods

Overview of Cost-effectiveness Analysis


Gillian D. Sanders, PhD; Matthew L. Maciejewski, PhD; Anirban Basu, PhD

Health care decision makers, including patients, clinicians, hospi- QALYs are the most commonly used benefit measure in cost-
tals, private health systems, and public payers (eg, Medicare), are effectiveness analyses, in which the length of life is left unchanged
often challenged with choosing among several new or existing in- or adjusted downward to reflect the health-related quality of life.
terventions or programs to commit their limited resources to. This Specifically, a quality weight of 1 indicates optimal health, 0 indi-
choice is ideally based on a comparison of health benefits, harms, cates the equivalent of death, and weights between 0 and 1 indi-
and costs associated with each alternative. How best to determine cate less-than-optimal health. The weight for each period is multi-
the optimal intervention is a challenging task because benefits, plied by the length of the period to yield the QALYs for that period.
harms, and costs must be weighed for a given option and com- A primary rationale for using QALYs as a standard effective-
pared with alternatives. ness outcome in cost-effectiveness analyses is the ability for policy
One way to inform such decisions is to perform a cost- makers to compare ICERs for various interventions across different
effectiveness analysis. A cost-effectiveness analysis is an analytic diseases when allocating scarce resources to the intervention(s) that
method for quantifying the relative benefits and costs among 2 or provide the greatest value for money. ICER values that are low sug-
more alternative interventions in a consistent framework. In a 2018 gest that intervention A improves health at a small additional cost
study published in JAMA Oncology, Moss et al1 examined the cost- per unit of health, assuming that A is both more costly and effec-
effectiveness of multimodal ovarian cancer screening with serum tive than B. If the ICER is negative, interpretation is more complex
cancer antigen 125 compared with no screening in the United States, because negative ICERs can result from negative incremental costs
based on findings from the large United Kingdom Collaborative Trial (ie, the new treatment is less costly than the existing treatment) or
of Ovarian Cancer Screening (UKCTOCS). The UKCTOCS evaluated from negative incremental benefits (ie, the new treatment is less ef-
the effect of screening on ovarian cancer mortality2 and demon- fective than the existing treatment). A new treatment is said to be
strated that multimodal screening reduced mortality among women “dominant” if it is lower in cost and more effective than the com-
without prevalent ovarian cancer. parator and is clearly of better value for money. However, the new
treatment is said to be “dominated” if it is higher in cost and less ef-
The Use of Cost-effectiveness Analysis fective than the comparator and is not of good value for money.
Choosing among alternative treatments or programs is complicated
because benefits, harms, and costs vary in the following ways: (1) ben- Limitation in the Use of Cost-effectiveness Analysis
efitsmaybereflectedinvaryingpatternsofreducedmorbidityormor- There are important qualifications to consider when reviewing a cost-
tality in patients; (2) interventions vary in price and also in costs of effectiveness analysis. What is considered cost-effective depends
acquiringorprovidingthem(eg,timecosts);and(3)benefitsandcosts on comparing the ICER to the threshold value (eg, $50 000 or
accrue differently to different constituents (patients, caregivers, cli- $100 000 per additional QALY) of the decision maker, which rep-
nicians, health systems, and society). A cost-effectiveness analysis resents the willingness to pay for a unit of increased effectiveness
is designed to allow decision makers to clearly understand the (eg, 1 QALY). The threshold helps to determine which interven-
tradeoffs of costs, harms, and benefits between alternative treat- tions merit investment. This willingness to pay is often repre-
ments and to combine those considerations into a single metric, the sented by the largest ICER among all the interventions that were ad-
incremental cost-effectiveness ratio (ICER), that can be used to in- opted before current resources were exhausted, because adoption
form decision making when limited resources are available. of any new intervention would require removal of an existing inter-
vention to free up resources. There is no fixed threshold for cost per
Description of Cost-effectiveness Analysis QALY to determine what is cost-effective. Most decision makers do
Cost-effectiveness analysis is an analytic tool in which the costs and not rely on a single threshold to determine investment decisions.
harms and benefits of an intervention (intervention A) and at least 1 Cost-effectiveness analyses have numerous limitations, includ-
alternative (intervention B) are calculated and presented as a ratio of ing that available data may be drawn from heterogeneous popula-
the incremental cost (cost of intervention A − cost of intervention B) tions, data on important outcomes may be unavailable, and that only
and the incremental effect (effectiveness of intervention A − effec- short-term outcomes may be available and long-term outcomes must
tiveness of intervention B). This ratio is known as the ICER. be extrapolated. Further, simplifying assumptions often must be
The incremental cost in the numerator represents the additional made about how to represent the health states associated with the
resources (eg, medical care costs, costs from productivity changes) disease being studied that may not accurately represent the nu-
incurred from the use of intervention A over intervention B. The in- ance and complexities of the clinical setting.
cremental effect in the denominator of the ICER represents the ad- In 2016, the Second Panel on Cost-Effectiveness in Health and
ditional health outcomes (eg, the number of cases of a disease pre- Medicine 4 recommended that all cost-effectiveness analyses
vented or the quality-adjusted life-years [QALYs] gained) through the should include a discussion of relevant limitations and efforts to
use of intervention A over intervention B.3 compensate for the shortcomings of cost-effectiveness analyses.

jama.com (Reprinted) JAMA Published online March 11, 2019 E1

© 2019 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ on 03/11/2019


Clinical Review & Education JAMA Guide to Statistics and Methods

The Second Panel also recommended that all cost-effectiveness Clinical effectiveness was estimated from the UKCTOCS trial es-
analyses should provide their findings from a health care sector timates of the effects of MMS on ovarian cancer mortality, with ex-
perspective, which would incorporate the costs, benefits, and trapolation of the long-term effects beyond the 11-year follow-up pe-
harms that are incurred by a payer, and from a societal perspective, riod. Direct medical costs were estimated based on Medicare claims
which would incorporate all costs and health effects regardless of data. Quality of life–related weights were included for the health
who incurs the costs or experiences the effects. To ensure that all states of being cancer free, undergoing MMS screening, and hav-
consequences to patients, caregivers, social services, and others ing ovarian cancer (incorporating lower weights for the chemo-
outside the health care sector are considered, the Second Panel therapy and cancer stage).
recommended use of an “Impact Inventory” that lists the health-
and non–health-related effects of an intervention. This tool allows How Should the Cost-effectiveness Analysis
analysts to evaluate categories of effects that may be most impor- Be Interpreted in This Study
tant to diverse stakeholders. Checklists for the various items that In the main, base-case analysis, MMS screening with a risk algo-
should be included when reporting cost-effectiveness analysis rithm cost estimate of $100 reduced ovarian cancer mortality by 15%,
results were provided by the Second Panel.4 resulting in an incremental cost-effectiveness ratio of $106 187 per
QALY gained (95% CI, $97 496-$127 793). The authors explored the
How Was the Cost-effectiveness Analysis Performed uncertainty in the underlying parameters and found that screening
in This Study women starting at 50 years of age with MMS was cost-effective in
Moss et al evaluated the cost-effectiveness of a multimodal screen- 70% of the simulations at a willingness to pay of $150 000 per QALY.
ing(MMS)programforovariancancerintheUnitedStatesfromahealth If the willingness to pay were $100 000 per QALY, then screening
care sector perspective (eg, Medicare).1 In a health care sector per- was cost-effective 47% of the time.
spective, only costs, health benefits, and harms that were observed A cost-effectiveness analysis does not make the decision for pa-
by the health care sector are considered, and other costs, benefits, tients, clinicians, health care systems, or policy makers, but rather
and harms that may affect patients or their caregivers are ignored.4 provides information that they can use to facilitate decision mak-
The authors developed a Markov simulation model using data ing. A cost-effectiveness analysis is also not designed for cost con-
from the UKCTOCS to compare MMS with no screening for women tainment. These analyses do not set the level of resources to be spent
beginning at 50 years of age in the general population. The model, on health care, but rather they provide information that can be used
which involved a mathematical simulation that evaluated the to ensure that those resources, whatever the level available, are used
benefits of the screening strategies in hypothetical cohorts of as effectively as possible to improve health. When reviewing cost-
patients as they moved from one health state to the next, accord- effectiveness analyses, readers should examine the study and use
ing to transition probabilities, demonstrated that MMS was both the recommendations from the Second Panel on Cost-Effective-
more expensive and more effective in reducing ovarian cancer mor- ness in Health and Medicine4 to help understand the implications
tality than no screening. of cost-effectiveness analysis research.

ARTICLE INFORMATION Section Editors: Roger J. Lewis, MD, PhD, multimodal ovarian cancer screening program in
Author Affiliations: Department of Population Department of Emergency Medicine, Harbor-UCLA the united states: secondary analysis of the UK
Health Sciences, Duke University School of Medical Center and David Geffen School of Collaborative Trial of Ovarian Cancer Screening
Medicine, Durham, North Carolina (Sanders, Medicine at UCLA; and Edward H. Livingston, MD, (UKCTOCS). JAMA Oncol. 2018;4(2):190-195. doi:
Maciejewski); Duke Clinical Research Institute, Deputy Editor, JAMA. 10.1001/jamaoncol.2017.4211
Duke University, Durham, North Carolina (Sanders); Published Online: March 11, 2019. 2. Jacobs IJ, Menon U, Ryan A, et al. Ovarian cancer
Duke-Margolis Center for Health Policy, Duke doi:10.1001/jama.2019.1265 screening and mortality in the UK Collaborative Trial
University, Durham, North Carolina (Sanders); Conflict of Interest Disclosures: Dr Maciejewski of Ovarian Cancer Screening (UKCTOCS):
Center for Health Services Research in Primary reported receiving research and center funding a randomised controlled trial. Lancet. 2016;387
Care, Durham Veterans Affairs Medical Center, (CIN 13-410) from the VA Health Services Research (10022):945-956. doi:10.1016/S0140-6736(15)
Durham, North Carolina (Maciejewski); Division of and Development Service, receiving a contract for 01224-6
General Internal Medicine, Department of research from the National Committee for Quality 3. Neumann PJ, Cohen JT. QALYs in
Medicine, Duke University School of Medicine, Assurance, receiving research funding from the 2018–advantages and Concerns. JAMA. 2018;319
Durham, North Carolina (Maciejewski); The National Institute on Drug Abuse (RCS 10-391), (24):2473-2474. doi:10.1001/jama.2018.6072
Comparative Health Outcomes, Policy, and and that his spouse owns stock in Amgen.
Economics (CHOICE) Institute, Departments of 4. Sanders GD, Neumann PJ, Basu A, et al.
Dr Basu reported consulting for Merck, Pfizer, Recommendations for conduct, methodological
Pharmacy, Health, Services and Economics, GlaxoSmithKline, Janssen, and AstraZeneca as
University of Washington, Seattle (Basu). practices, and reporting of cost-effectiveness
an expert on issues related to cost-effectiveness analyses: Second Panel on Cost-effectiveness in
Corresponding Author: Gillian D. Sanders, PhD, analysis. No other disclosures were reported. Health and Medicine. JAMA. 2016;316(10):1093-1103.
Duke University Medical Center, 100 Fuqua Dr, doi:10.1001/jama.2016.12195
Box 90120, Durham, NC 27710 (gillian.sanders@ REFERENCES
duke.edu). 1. Moss HA, Berchuck A, Neely ML, Myers ER,
Havrilesky LJ. Estimating cost-effectiveness of a

E2 JAMA Published online March 11, 2019 (Reprinted) jama.com

© 2019 American Medical Association. All rights reserved.

Downloaded From: https://jamanetwork.com/ on 03/11/2019

You might also like