You are on page 1of 11

Pharmacoeconomics 2009; 27 (9): 713-723

REVIEW ARTICLE 1170-7690/09/0009-0713/$49.95/0

ª 2009 Adis Data Information BV. All rights reserved.

Methods for Measuring Temporary Health


States for Cost-Utility Analyses
Davene R. Wright,1 Eve Wittenberg,1,2 J. Shannon Swan,1,3 Rebecca A. Miksad1,3,4 and
Lisa A. Prosser1,5,6
1 Preferences Working Group, Center for Health Decision Science, Harvard School of Public Health,
Boston, Massachusetts, USA
2 Schneider Institutes for Health Policy, Heller School for Social Policy and Management,
Brandeis University, Waltham, Massachusetts, USA
3 Institute for Technology Assessment and Department of Radiology, Massachusetts General Hospital,
Harvard Medical School, Boston, Massachusetts, USA
4 Beth Israel Deaconess Medical Center, Harvard Medical School, Division of Hematology and Oncology,
Boston, Massachusetts, USA
5 Center for Child Health Care Studies, Department of Ambulatory Care and Prevention, Harvard Medical
School and Harvard Pilgrim Health Care, Boston, Massachusetts, USA
6 Child Health Evaluation and Research Unit, Division of General Pediatrics, University of Michigan Health
System, Ann Arbor, Michigan, USA

Contents
Abstract. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 713
1. Health-State Utilities, Temporary Health States and QALYs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 714
2. Assessment of Preference-Based Valuation Methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 715
2.1 Search Methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 715
2.2 Assessment Criteria. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 715
3. Review of Temporary Health-State Valuation Methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 716
3.1 Categories. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 716
3.2 Traditional Preference-Based Elicitation Methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 716
3.2.1 Health Status Instruments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 716
3.2.2 Time Trade-Off or Standard Gamble Techniques . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 716
3.3 Adapted Methods for Valuing Temporary Health States. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 719
3.3.1 Time Trade-Off with Specified Duration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 719
3.3.2 Time Trade-Off with ‘Lifespan’ Modification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 719
3.3.3 Waiting Trade-Off. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 719
3.3.4 Chained Methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 719
3.3.5 Sleep Trade-Off . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 720
4. Discussion. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 720
5. Conclusions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 721

Abstract A variety of methods are available to measure preferences for temporary


health states for cost-utility analyses. The objectives of this review were to
summarize the available temporary health-state valuation methods, identify
advantages and disadvantages of each, and identify areas for future research.
714 Wright et al.

We describe the key aspects of each method and summarize advantages and
disadvantages of each method in terms of consistency with QALY theory,
relevance to temporary health-state-specific domains, ease of use, time pre-
ference, and performance in validation studies. Two broad categories of
methods were identified: traditional and adapted.
Traditional methods were health status instruments, time trade-off (TTO),
and the standard gamble (SG). Methods adapted specifically for temporary
health-state valuation were TTO with specified duration of the health state,
TTO with a lifespan modification, waiting trade-off, chained approaches for
TTO and SG, and sleep trade-off.
Advantages and disadvantages vary by method and no ‘gold standard’
method emerged. Selection of a method to value temporary health states will
depend on the relative importance of the following considerations: ability to
accurately capture the unique characteristics of the temporary health state, level
of respondent burden and cognition, theoretical consistency of elicited preference
values with the overall purpose of the study, and resources available for study
development and data collection. Further research should focus on evaluating
validity, reliability and feasibility of temporary health-state valuation methods.

Cost-utility analyses can facilitate policy and state to affect valuation. This article describes the
clinical decision making by prioritizing health in- key aspects of each published preference-based
terventions. Health outcomes in cost-utility ana- valuation method, the advantages and dis-
lyses are valued via health-state utilities that reflect advantages of each approach, and identifies areas
preferences for living in various states of health for for future research. The overall objective of the
the duration of the health state and with the quality article was to provide detailed information for
of life (QOL) experienced in the health state. The each available method to assist in the selection of
standard cost-utility framework assumes that the appropriate methods, as well as to assist readers
preference for a health state is independent of its in understanding and interpreting the results of
duration, allowing the same utility value to be studies that have employed these methods.
assigned to each unit of time spent in the health
state irrespective of the duration.[1-3] However, 1. Health-State Utilities, Temporary Health
empirical evidence suggests that preferences for States and QALYs
temporary health states may depend, in part, on
the duration of the health state, potentially pro- For the purposes of this article, we defined a
ducing inaccurate utility values if duration is not ‘temporary’ health state as a transient health state
considered.[1-3] lasting <1 year that may impart some discomfort
In this article, we identify preference-based or temporary reduction in QOL. Temporary
methods used in the literature to value temporary health states are common and include infections,
health states for cost-utility analyses. The meth- short-term medications and procedures, vaccina-
ods fall into two categories: traditional preference tions, screening tests and diagnostic procedures.
measurement methods and those adapted speci- A review of the 2005 Cost-Effectiveness Analysis
fically for the measurement of preferences for Registry maintained by the Center for the Eva-
temporary health states. The first class, traditional luation of Value and Risk in Health at Tufts
methods, consists of techniques that assume va- Medical Center (CEA Registry) revealed that ap-
lue is independent from duration. The second proximately 20% of published cost-effectiveness
category, adapted methods, consists of ap- analyses to date may include measures of health
proaches that allow for the duration of the health states deemed temporary by this definition.[4]

ª 2009 Adis Data Information BV. All rights reserved. Pharmacoeconomics 2009; 27 (9)
Measuring Temporary Health States for Cost-Utility Analyses 715

Standard preference-elicitation methods fol- utilities. PubMed was searched during March
low specific axioms of economic theory in order 2008 using the following search terms: ‘tempo-
to obtain utility values appropriate for calculat- rary’, ‘transient’, ‘short term’, ‘health state’,
ing QALYs.[5] Utility values used for generating ‘quality of life’, ‘health-related quality of life’,
QALYs must satisfy three key theoretical as- ‘utility’ and ‘preference’. In addition, 4299 unique
sumptions: (i) constant proportional trade-off; HR-QOL entries in the CEA Registry were re-
(ii) risk neutrality across life-years; and (iii) in- viewed during March 2008 (registry updated to
dependence of preferences for health regardless 2005 at the time of analysis).[4] These searches
of life expectancy. Constant proportional trade- were expanded by reviewing the references of
off requires that the proportion of time traded identified articles and by discussion with experts.
does not depend on the remaining number of life- In total, 34 manuscripts describing unique
years, risk neutrality requires that the utility temporary health states were identified.
function over life-years be linear, and utility in-
dependence is required between life-years and 2.2 Assessment Criteria
health status.[6-9] Numerous studies have dis-
cussed violations of these requirements and al- The preference-based valuation methods were
ternative models have been proposed.[10,11] evaluated according to four criteria: (i) consis-
However, conventional QALYs remain the stan- tency with QALY theory; (ii) ability to accurately
dard metric for valuing health in cost-utility anal- describe the health state; (iii) whether estimation
yses. Methods designed to capture the distinctive of discount rates for time preference was required;
aspects of preferences for temporary health states and (iv) ease of administration.
may not conform to the axiom of constant pro- Consistency with QALY theory has implica-
portional trade-off because the duration of the tions for how temporary health-state utilities are
health state may affect valuation.[3] interpreted and used. This issue is an important
consideration when combining or comparing
utilities elicited using different methods in a
2. Assessment of Preference-Based
Valuation Methods decision-analytic model, particularly when both
temporary health-state and long-term health-
This article describes the key aspects of each state utilities are included in the analysis. The
published preference-based valuation method, the relative importance of theoretical consistency will
advantages and disadvantages of each approach, depend on characteristics of the decision being
and identifies areas for future research. Selected modeled.
papers from the literature review were used as The accuracy of preference measurement for
examples. In contrast with a systematic literature the valuation of any health state of any duration
review, we seek to describe the advantages and depends, in part, on how well the health state is
disadvantages of available preference-based ap- captured in the valuation task. The extent to
proaches in order to frame the debate around which an adapted method accurately reflects a
temporary health-state valuation and identify particular health state will depend on the health
areas for future research. state being valued. For example, diagnostic tests
and other experiences with very short duration
2.1 Search Methods
may be easier to describe using adapted methods
or more difficult to describe using traditional
We identified preference-based methods used methods.
in the literature to value temporary health states Valuation methods that include trading time
for cost-utility analyses. Searches of an electronic from the end of a person’s life or over a long
literature database and of an online health- period (e.g. 20 years) require estimation of discount
related QOL (HR-QOL) database were conducted rates for time preference. Individual rates may
to identify all published short-term health-state vary widely across individuals[12] and estimation

ª 2009 Adis Data Information BV. All rights reserved. Pharmacoeconomics 2009; 27 (9)
716 Wright et al.

of this factor may add uncertainty to utility esti- appropriate method, are presented in table II.
mates. Time trade-off (TTO) approaches will often Selected examples for different preference-based
overlook this effect when calculating health-state valuation methods were drawn from the search
utilities, but this has been shown to potentially using the CEA Registry, as well as examples that
affect calculated values.[13] were known to the authors.
The availability of resources to develop, ad-
minister and analyse a temporary health-state 3.2 Traditional Preference-Based Elicitation
valuation survey may limit the feasibility of using Methods
some of the preference-based valuation methods. 3.2.1 Health Status Instruments
Researchers must balance the trade-off between Health status instruments assess health states
cognitive burden and flexible domains. Ease of sur- using a specified set of attributes, and a utility value
vey administration is often an important consid- is calculated from a mathematical model based
eration when designing a preference-measurement on community preferences.[7,39,40] The EQ-5D,
study, but is likely to be a key factor for tempo- the Quality of Well Being Scale (QWB-SA), and
rary health-state valuations given the complexity the Health Utilities Index Mark 2 and 3 (HUI2,
of some of the adapted valuation methods. HUI3) are commonly used health status instru-
ments that yield preference-based health-state
3. Review of Temporary Health-State utility weights.[39,41-47]
Valuation Methods In order to calculate temporary health-state
values with health status instruments, the tem-
3.1 Categories porary health state is presented to the survey re-
spondent as if it were a chronic health state. The
Two categories of temporary health-state va- transient nature of the temporary health state is
luation methods were identified: (i) traditional accounted for in the calculation of QALYs asso-
preference-based techniques as used for chronic ciated with the time spent in the temporary health
health-state valuation, such as health status in- state.
struments, the standard gamble (SG), or the The primary advantage of health status in-
TTO; and (ii) adaptations of traditional methods struments for the measurement of temporary
to specifically address the issue of the short health states is that utility weights are community
duration of the temporary health states. weights derived using TTO or SG techniques,
The traditional valuation methods of the first both of which are consistent with QALY theory.
category assume that value is independent from However, the health-state utility weights may not
duration. Such methods generally adjust for dura- fully encompass the preferences associated with
tion through the calculation of QALYs, using the the state because health status instruments may
duration of the temporary state in the same way lack attributes specifically related to the tempor-
that duration is used for any health state. ary health states. From a practical perspective, it
The adapted methods of the second category may be unrealistic to ask respondents to imagine
allow for the duration of the health state to affect enduring a short-term health state (e.g. a diag-
valuation. Adaptations of traditional methods nostic test) for a longer timeframe.
use a variety of approaches to specifically address
duration in the valuation task: lifespan-based 3.2.2 Time Trade-Off or Standard Gamble
TTO, waiting trade-off (WTO), chained methods Techniques
and sleep trade-off. Traditional TTO or SG methods have also
Descriptions of temporary health-state valua- been used to elicit health-state utility weights for
tion methods along with available validation temporary health states.[3,19-25] The objective of
studies are presented in table I. How each method the traditional TTO is to establish the duration of
fits with our assessment criteria (see section 2.2), time in perfect health that the respondent regards
and other considerations for choosing the most as equivalent to time spent in the impaired health

ª 2009 Adis Data Information BV. All rights reserved. Pharmacoeconomics 2009; 27 (9)
Measuring Temporary Health States for Cost-Utility Analyses 717

Table I. Available methods for valuing temporary health states in cost-utility analyses
Method Description Scope of use Examples of use in temporary
health-state valuation
Traditional preference-based techniques
Health status Health-state utility (assigned to Used widely for chronic health states Influenza[14]
instruments a health state using indicated Context, convergent and discriminant Pneumonia[14]
levels of health domains) is validity, statistical strength of models, and Angiography (MR and
prorated by the amount of reliability have been verified conventional)[15,16]
time spent in the temporary Not evaluated for temporary health states Pulmonary rehabilitation[17]
health state Knee arthroplasty[18]
TTO and SG Utility value from TTO or SG Used widely for chronic health states Herpes zoster (TTO)[19]
prorated by amount of time Validity and reliability well tested Cancer screening and diagnoses
spent in temporary health state Used often for temporary states (TTO and SG)[3,20,21]
Not evaluated for temporary health states Cancer treatment (TTO and SG)[22,23]
Cardiac rehabilitation (TTO)[24]
Kidney donation (TTO)[25]
Adapted techniques for temporary health states
TTO with specified Utility value from TTO where Used occasionally in practice Pertussis[26]
duration of health time horizon is limited to the Not formally tested for validity for
state length of the temporary temporary health states
health state
TTO with ‘lifespan’ Utility value from TTO where Used occasionally in practice Pertussis[26]
modification time horizon is length of Not formally tested for validity for temporary Herpes zoster[19]
respondent’s life expectancy health states Otitis media, pneumonia,
rather than duration of meningitis[1,27,28]
health statea Newborn screening[29]
Waiting trade-off Utility value from TTO of Used occasionally MR angiography[15]
waiting time for an ‘ideal’ test Some evidence of convergent validity for Conventional angiography[30]
compared with immediate temporary health states Breast biopsy[20]
actual test Originally designed for use in states
related to diagnostic screening and
testing
Chained methods Utility value obtained using Used more frequently for chronic health Gallstone disease treatment (TTO)[31]
(TTO and SG) traditional TTO or SG methods states; occasionally used for temporary Breast cancer screening, diagnosis,
with an intermediary state used states and chemotherapy (TTO and SG)[32]
as an anchor instead of death Tested for validity and reliability Deep vein thrombosis, pulmonary
Some testing of reliability, consistency, embolism, bleeding (TTO)[33]
and concordance relative to traditional Oesophageal cancer (TTO and SG)[34]
TTO and SG
Not evaluated for temporary health states
Sleep trade-off Utility value from TTO of time Used minimally Stroke and stroke prophylaxis[35]
spent in non-restful sleep to Some evidence of fluctuations in validity Fractures, infection, peptic ulcer,
avoid time in an undesirable and reliability for temporary health states pneumonia[36]
state (anchors are current Hormone replacement therapy,
health as 1.0 and sleep as 0) osteoporosis prevention[37,38]
a Time traded from end of life is discounted to the present value of that time.
MR = magnetic resonance; SG = standard gamble; TTO = time trade-off.

state (i.e. the amount of time the respondent is a gamble between perfect health and death.[40]
willing to give up to avoid the impaired health The researcher presents the temporary health
state). In the SG method, the objective is to state as if it were a chronic health state and the
determine the probability of death for which the health state is valued by the respondent according
respondent is indifferent to a particular number to typical TTO or SG methods. The elicited
of life-years in a constant impaired health state or health-state utility weight is then applied to the

ª 2009 Adis Data Information BV. All rights reserved. Pharmacoeconomics 2009; 27 (9)
718 Wright et al.

duration of the temporary health state to calcu- result in a lack of sensitivity if the respondent
late the change in QALYs associated with the does not perceive the temporary health state as
temporary health state.[48] sufficiently impaired to induce them to trade time
Traditional TTO and SG techniques are well from their life or to gamble with a probability of
tested and consistent with QALY theory.[7] death. This ‘ceiling effect’ may occur despite the
However, in practice, appropriate adjustments presence of disutility from the impaired health
for time preferences (i.e. discounting) for trade- state.[33] The TTO and SG methods, and those
offs made over a long period of time may be methods adapted from them, allow flexibility in
challenging to apply.[22] These techniques may health-state descriptions but are relatively more

Table II. Considerations for identifying an appropriate temporary health-state utility valuation method
Method Considerations
Traditional preference-based techniques
Health status instruments Consistent with QALY theory
Relatively easy to administer
May omit domains specific to the temporary health state(s) under evaluation
Assumes preferences are independent of health-state duration
May introduce cognitive challenges when a temporary state is presented as a chronic health state
TTO and SG Consistent with QALY theory
Allows flexibility in health state description
Relatively more resource intensive than health status instruments
Assumes preferences are independent of health state duration
TTO does not address time preferences when trading time from end of life
SG has high cognitive burden for respondents
Adapted techniques
TTO with specified duration Consistent with QALY theory
Allows flexibility in health state descriptions
Does not allow for states to be valued as worse than dead
Relatively more resource intensive than health status instruments
TTO with ‘lifespan’ modification Allows flexibility in health state descriptions
Violates constant proportional trade-off assumption of QALY theory
Inclusion of life expectancy may introduce variance and bias
Does not address time preference when trading time from end of life
Relatively more resource intensive than health status instruments
Waiting trade-off Developed for screening and diagnostic tests
Allows flexibility in health state descriptions, including realistic treatment scenarios
Respondents trade current time, which eliminates discounting bias
Allows respondents to value state as worse than dead
Violates constant proportional trade-off assumption of QALY theory
Uses chain-method (see below), which may increase variance and bias
Relatively more resource intensive than health status instruments
May require estimation of pre- and post-treatment utility values
Chained methods: TTO and SG Consistent with QALY theory
Allows flexibility in health state descriptions
May provide increased sensitivity for minimally impaired states or transitory states
Choice of anchor state may affect sensitivity
Calculation of population utility somewhat unclear (mean of total utility vs mean of each link in chain)
Chaining increases variance
Relatively more resource intensive than health status instruments
Sleep trade-off Allows flexibility in health state descriptions
Respondents trade current time, which eliminates possible bias due to discounting for time preference
Consistent with QALY theory if sleep is valued as equal to dead
Relatively more resource intensive than health status instruments
SG = standard gamble; TTO = time trade-off.

ª 2009 Adis Data Information BV. All rights reserved. Pharmacoeconomics 2009; 27 (9)
Measuring Temporary Health States for Cost-Utility Analyses 719

resource intensive than health status instruments. may be influenced by the respondent’s assump-
The SG, in particular, has a high cognitive bur- tions regarding their life expectancy.[49]
den for respondents.
3.3.3 Waiting Trade-Off
3.3 Adapted Methods for Valuing Temporary The WTO is another variation of the TTO
Health States specifically developed for valuing health states
3.3.1 Time Trade-Off with Specified Duration associated with diagnostic screening and testing.
Modifications of the TTO method attempt to Respondents are presented with a choice between
overcome limitations of traditional approaches for having an invasive test and receiving results and
temporary health-state valuation. The relatively treatment immediately or waiting a specified
short time spent in the temporary health state can period of time for results from a hypothetical
be directly addressed by limiting the maximum ‘ideal’ non-invasive test.[15,30] The QALYs asso-
amount of time that can be traded (the denomi- ciated with the invasive test are calculated as the
nator) to the duration of the temporary health product of this ‘waiting time’ and the difference
state. This modification is consistent with QALY between the post-treatment and baseline health-
theory and may avoid time-preference issues. state utilities, which may be separately assessed
However, the time limitation does not allow the or obtained from the literature.[20,50]
respondent to value the transient state as ‘worse In the screening and diagnostic testing setting,
than dead’ because the respondent cannot trade the WTO may be more intuitive for some re-
more time than the duration of the health state. spondents than other TTOs. Another advantage
is that the WTO does not require respondents
3.3.2 Time Trade-Off with ‘Lifespan’ Modification to imagine themselves in excellent health.[15] Be-
In the ‘lifespan’ TTO modification, respondents cause respondents trade off current time, dis-
are asked to value a description that includes a counting is not a concern. However, as with other
temporary health state followed by their remain- adapted TTO methods, the WTO violates the
ing life in full health.[26] The maximum amount of proportional trade-off assumption of QALY
time that can be traded to avoid the temporary theory. The WTO may also implicitly incorporate
health state (the denominator) is the respondent’s a bias if respondents assume that a delay prior to
life expectancy, a more intuitive assessment for treatment may affect their prognosis. This lim-
some respondents. An advantage of the ‘lifespan’ itation may be addressed by asking the re-
TTO is that the temporary health state can be spondent to assume that any delay does not affect
valued as worse than death because the amount the disease or treatment outcome. As an addi-
of time that can be traded is not limited to the tional limitation, the WTO requires estimation of
duration of the temporary health state. pre- and post-treatment utilities if values are not
However, the ‘lifespan’ modification violates available from the literature, which can introduce
the constant proportional trade-off assumption additional uncertainty into the calculation of
and requires assumptions about the rate of time QALYs, as well as increasing respondent and
preference in order to adjust (i.e. discount) the investigator burden. Lastly, the use of a two-step
value of time traded from the end of life. Time- chained method such as the WTO may increase
preference assumptions may lead to increased variance and bias in derived utility values.
uncertainty around utility estimates because dis-
count rates tend to vary by individual and by 3.3.4 Chained Methods
situation.[2] As an additional limitation, the will- TTO and SG chained health-state valuation
ingness of an individual to trade time near the end methods were developed to address ‘ceiling effect’
of their life may be influenced by the anticipation issues associated with mild impairment health
that later years will have lower quality. Finally, states. Chained health-state methods avoid the
unless life expectancy is explicitly stated, the uti- choice between a mild health impairment and
lities derived using the ‘lifespan’ TTO method death, which can be difficult or disturbing for

ª 2009 Adis Data Information BV. All rights reserved. Pharmacoeconomics 2009; 27 (9)
720 Wright et al.

respondents. The chained health-state approach non-restful state compared with time spent in a
can be used with either an SG or TTO ques- temporary health state.[36,37] This approach
tion[23,33,40] by breaking the utility assessment avoids the need for discounting. As with all var-
process into two distinct steps. First, a reference iations of the TTO, it allows for investigator dis-
health state worse than the state of interest (but not cretion in the description of the health states, and
dead) is defined and valued using traditional SG or thus domains can be customized for temporary
TTO methods. In the second step, this reference health states. The primary limitation is that re-
state is used as the bottom anchor in a traditional spondents must value time spent in the sleep state
SG or TTO: the respondent is asked to choose as equal to zero on a utility scale in order for the
between the impaired health state of interest and a method to be consistent with QALY theory,
gamble or trade-off involving life in perfect health which may be difficult for respondents since this
and the reference state valued in the previous step. implies equivalence with being dead.
The chained approach was developed specifi-
cally for valuing mild health impairments and, 4. Discussion
therefore, may be particularly well suited to the
valuation of temporary health states given the We identified and reviewed nine different
mild nature of many temporary health states. published methods for valuing temporary health
Chained methods are consistent with QALY states for cost-utility analyses, but due to the
theory and do not force a direct comparison be- scarcity of validity and reliability testing, no
tween death and a temporary health state.[49,51] method emerges as a ‘gold standard’. Although
Disadvantages of chained approaches include some methods have been well tested for chronic
time-intensive administration and higher var- health states, evaluation of their appropriateness
iance in results because of the two-step pro- for valuing temporary health states is lacking.
cess.[40,52] The two-step nature of this approach Without additional validation, we will be unable
has lead to differences in how researchers can go to generalize the utility values from studies that
about calculating the population utility. Some utilize temporary health-state methods. Given
researchers may calculate the mean of the total the frequency and diversity of temporary health
utility, rather than the mean of each link in the states, additional research is needed to rigorously
chain, which may make the result less precise. As evaluate the relative performance of temporary
an additional limitation, a ‘floor effect’ is possible health-state valuation methods and to determine
if a respondent prefers the anchor state to the whether, and to what extent, health-state duration
temporary health state. However, the chained affects the utility value assigned to a health state.
method has been validated against other pre- Because of the diversity of methods, all four of
ference elicitation methods for health states that the evaluation criteria do not apply equally to all
are preferred to death.[9,23] methods. Each method has advantages and dis-
It has performed well in a test-retest reliability advantages, and the selection of a method for
evaluation, with an agreement between the rank- valuing a temporary health state should reflect
ings of health states of 0.63 using a visual analogue the specific attributes of the condition and the
scale and 0.57 using the chained TTO. Further clinical or policy decision being studied, as well as
details on the reliability of the chained TTO can be the needs and resources of the researcher. For
found in the 2004 analysis by Locadia et al.[33] example, direct valuation methods (TTO, SG and
their variants) tend to be more time consuming
3.3.5 Sleep Trade-Off and complex for both the researcher and the re-
The sleep trade-off is a variation of the TTO spondent, and typically require more resources
method that substitutes non-restful sleep for than health status instruments but allow the in-
being dead in a traditional TTO. In this ap- vestigator to tailor the health-state descrip-
proach, the respondent is asked for the amount of tion.[53] If health status instrument attributes do
time he or she is willing to spend sleeping in a not capture the salient QOL aspects of the health

ª 2009 Adis Data Information BV. All rights reserved. Pharmacoeconomics 2009; 27 (9)
Measuring Temporary Health States for Cost-Utility Analyses 721

state being valued, then direct valuation using limitations of combining utilities elicited via dif-
TTO, SG, or an adapted method may be a better ferent methods.
choice of method. The SG, the WTO, and the Although both the TTO and the SG have been
sleep trade-off methods avoid the issue of esti- used to assess temporary health states, we found
mating time preference, while time preference will a larger number of adapted methods that were
need to be considered for most TTO-based ap- based on the TTO. It may be that the TTO is
proaches.[20] more easily adapted to the measurement of
Concordance with QALY theory is a key temporary health states as the timeframe can be
consideration. There is value in standardizing directly manipulated. Fewer approaches, such as
utility elicitation methods to generate QALYs the chained SG, have been published for use in
that can provide a common metric for cost-utility temporary health-state measurement.
ratios and allow the comparison of interventions Generally, the advantages of the standard
that address very different types of health, e.g. valuation methods are considerable. They are
being able to compare the cost-utility of cancer consistent with QALY theory, familiar to re-
treatments with newborn screening programmes. searchers, and have been rigorously tested for
In concordance with the theoretical assumptions chronic health states. On the other hand, adap-
of QALYs, experts recommend that QALYs tations of standard methods developed specifi-
should be anchored on perfect health and death cally for valuing temporary health states have the
to allow for a common base of comparison across benefit of allowing the value of the health state to
interventions.[5] There are consequences to vio- vary with duration. However, these adapted
lating these assumptions, as sometimes occurs in methods may require careful design, may be in-
the valuation of temporary health states. Further consistent with QALY theory, and most lack
research should investigate the negative impact rigorous testing (table II). There is sparse litera-
of violating axioms of QALY theory and how ture evaluating either standard or adapted
this would or should limit the use of health-state methods and additional research is needed for
utilities elicited using non-traditional methods. both categories of methods.
On the one hand, in the strictest interpretation,
methods that fail to meet the three axioms of 5. Conclusions
QALY theory could be considered invalid and
cost-utility analyses that rely on these methods This paper summarizes available methods for
suspect. On the other hand, if the QALY loss valuing temporary health states, outlines a num-
measured using non-traditional methods more ber of key considerations for selecting a method
closely represents preferences for these states of for a specific application, and describes the key
health than QALY loss measured using tradi- advantages and disadvantages of each method.
tional methods, it could be argued that the use of Among the currently available methods, there is
adapted methods for measuring temporary no clear ‘gold standard’ temporary health-state
health states may provide more accurate mea- valuation method. When deciding which method
surement of health-state preferences. Current to employ, we suggest that researchers consider:
cost-effectiveness analyses often combine utilities (i) whether the valuation method accurately
from disparate sets of elicitation methods with captures the unique characteristics of the tem-
little discussion (e.g. utility weights from the EQ- porary health state; (ii) the population from
5D, HUI, and direct TTO or SG questions). whom values will be elicited, and the relative im-
Along with the identification of appropriate portance of respondent burden and cognition;
methods for valuing temporary health states, (iii) the relative importance of theoretical con-
additional research should focus on the con- sistency of elicited preference values with the
sequences of using various elicitation methods, as overall purpose of the study; and (iv) resources
well as encouraging transparency in publications available for survey development, data collection
regarding sources of utility weights and potential and data analysis. Given the limited evidence on

ª 2009 Adis Data Information BV. All rights reserved. Pharmacoeconomics 2009; 27 (9)
722 Wright et al.

performance for many of the available temporary 6. Pliskin JS, Shepard DS, Weinstein MC. Utility functions for
state valuation methods, the choice of method life years and health status. Operations Res 1980 01; 28 (1):
206-24
should be guided by the features and constraints
7. Dolan P. Output measures and valuation in health. In:
of the specific situation in which preferences are Drummond MF, McGuire A, editors. Economic evalua-
being measured. tion in health care. New York: Oxford University Press,
Further research on temporary health-state 2001: 46-67
valuation methods is necessary to improve the 8. Bleichrodt H, Johannesson M. The validity of QALYs: an
experimental test of constant proportional tradeoff and
optimal use of existing and future methods. utility independence. Med Decis Making 1997 Jan-Mar;
Needed research includes reporting the use of 17 (1): 21-32
existing or new methods for valuing temporary 9. Bleichrodt H, Wakker PP, Johannesson M. Characterizing
health states in order to expand our knowledge of QALYs by risk neutrality. J Risk Uncertain 1997; 15 (2):
107-14
the feasibility and validity of these methods, as
10. Wakker P, Stiggelbout A. Explaining distortions in utility
well as rigorous testing of performance measures elicitation through the rank-dependent model for risky
for the various methods. Key areas for further choices. Med Decis Making 1995 Apr-Jun; 15 (2): 180-6
research include the estimation of discount rates 11. Bleichrodt H, Diecidue E, Quiggin J. Equity weights in the
for both traditional and variations of TTO allocation of health care: the rank-dependent QALY
model. J Health Econ 2004 Jan; 23 (1): 157-71
methods applied to temporary health states and
12. Lazaro A, Barberan R, Rubio E. Private and social time
valuation effects relating to the choice of anchor preferences for health and money: an empirical estimation.
state. Improvements in the methods for valuing Health Econ 2001 Jun; 10 (4): 351-6
temporary health states would improve economic 13. Johannesson M, Pliskin JS, Weinstein MC. A note on QA-
evaluations and contribute to policy decisions LYs, time tradeoff, and discounting. Med Decis Making
1994 Apr-Jun; 14 (2): 188-93
that more accurately reflect public preferences.
14. Turner D, Wailoo A, Nicholson K, et al. Systematic review
and economic decision modelling for the prevention and
treatment of influenza A and B. Leicester: University of
Acknowledgements Leicester and University of Sheffield, 2002 Apr 29
15. Swan JS, Fryback DG, Lawrence WF, et al. A time-tradeoff
The authors gratefully acknowledge the assistance of method for cost-effectiveness models applied to radiology.
Drs Milton Weinstein and James Hammitt for their helpful Med Decis Making 2000 Jan-Mar; 20 (1): 79-88
comments. Funding for this project was provided by the 16. Yin D, Baum RA, Carpenter JP, et al. Cost-effectiveness of
Center for Health Decision Science at the Harvard School of MR angiography in cases of limb-threatening peripheral
Public Health. We also thank two anonymous reviewers for vascular disease. Radiology 1995 Mar; 194 (3): 757-64
their very helpful comments and suggestions.
17. Griffiths TL, Phillips CJ, Davies S, et al. Cost effectiveness
The authors have no conflicts of interest that are directly
of an outpatient multidisciplinary pulmonary rehabilita-
relevant to the content of this review.
tion programme. Thorax 2001 Oct; 56 (10): 779-84
18. Lavernia CJ, Guzman JF, Gachupin-Garcia A. Cost effec-
tiveness and quality of life in knee arthroplasty. Clin Or-
References thop Relat Res 1997 Dec; 345: 134-9
1. Prosser LA, Lieu TA. Comments on the Prosser et al. ap- 19. Lieu TA, Ortega-Sanchez I, Ray GT, et al. Community and
proach to value disease reduction in children. Pediatrics patient values for preventing Herpes zoster. Pharmacoe-
2004 Nov; 114 (5): 1375-6
conomics 2008; 26 (3): 235-49
2. Dolan P, Stalmeier P. The validity of time trade-off values in
20. Swan JS, Lawrence WF, Roy J. Process utility in breast
calculating QALYs: constant proportional time trade-off
biopsy. Med Decis Making 2006 Jul-Aug; 26 (4): 347-59
versus the proportional heuristic. J Health Econ 2003 May;
22 (3): 445-58 21. Dominitz JA, Provenzale D. Patient preferences and quality
3. Bala M, Wood L, Zarkin G, et al. Are health states ‘time- of life associated with colorectal cancer screening. Am J
less’? The case of the standard gamble method. J Clin Gastroenterol 1997 Dec; 92 (12): 2171-8
Epidemiol 1999; 52 (11): 1047-53 22. Badia X, Monserrat S, Roset M, et al. Feasibility, validity
4. The cost-effectiveness analysis registry 2005 [online]. Avail- and test-retest reliability of scaling methods for health
able from URL: http://research.tufts-nemc.org/cear/default. states: the visual analogue scale and the time trade-off.
aspx [Accessed 2008 Mar 1] Qual Life Res 1999 Jun; 8 (4): 303-10
5. Drummond MF, Sculpher MJ, Torrance GW, et al. Meth- 23. Jansen SJ, Stiggelbout AM, Wakker PP, et al. Patients’ uti-
ods for the economic evaluation of health care pro- lities for cancer treatments: a study of the chained proce-
grammes. 3rd ed. New York: Oxford University Press, dure for the standard gamble and time tradeoff. Med Decis
2005 Making 1998 Oct-Dec; 18 (4): 391-9

ª 2009 Adis Data Information BV. All rights reserved. Pharmacoeconomics 2009; 27 (9)
Measuring Temporary Health States for Cost-Utility Analyses 723

24. Oldridge N, Furlong W, Feeny D, et al. Economic evalua- 41. Kaplan RM, Bush JW, Berry CC. Health status: types of
tion of cardiac rehabilitation soon after acute myocardial validity and the index of well-being. Health Serv Res 1976
infarction. Am J Cardiol 1993 Jul 15; 72 (2): 154-61 Winter; 11 (4): 478-507
25. Pace KT, Dyer SJ, Phan V, et al. Laparoscopic v open donor 42. Kaplan RM, Anderson JP, Wu AW, et al. The Quality of
nephrectomy: a cost-utility analysis of the initial experience Well-Being scale: applications in AIDS, cystic fibrosis, and
at a tertiary-care center. J Endourol 2002 Sep; 16 (7): 495-508 arthritis. Med Care 1989 Mar; 27 (3 Suppl.): S27-43
26. Lee GM, Salomon JA, LeBaron CW, et al. Health-state 43. Anderson JP, Kaplan RM, Berry CC, et al. Interday relia-
valuations for pertussis: methods for valuing short-term bility of function assessment for a health status measure:
health states. Health Qual Life Outcomes 2005; 3: 17 the Quality of Well-Being scale. Med Care 1989 Nov;
27. Prosser LA, Ray GT, O’Brien M, et al. Preferences and will- 27 (11): 1076-83
ingness to pay for health states prevented by pneumococcal 44. Kaplan RM, Anderson JP. An integrated approach to
conjugate vaccine. Pediatrics 2004 Feb; 113 (2): 283-90 quality of life assessment: the general health policy model.
28. Beutels P, Viney RC. Comments on the Prosser et al. ap- In: Spilker B, editor. Quality of life in clinical studies. New
proach to value disease reduction in children [author reply]. York: Raven Press, 1990: 131-49
Pediatrics 2004 Nov; 114 (5): 1375-6 45. Torrance GW, Feeny DH, Furlong WJ, et al. Multiattribute
29. Prosser LA, Ladapo JA, Rusinak D, et al. Parental tolerance utility function for a comprehensive health status classifi-
for false-positive newborn screening results. Arch Pediatr cation system: Health Utilities Index Mark 2. Med Care
Adolesc Med 2008 Sep; 162 (9): 870-6 1996 Jul; 34 (7): 702-22
30. Swan JS, Sainfort F, Lawrence WF, et al. Process utility for 46. Shaw JW, Johnson JA, Coons SJ. US valuation of the EQ-
imaging in cerebrovascular disease. Acad Radiol 2003 5D health states: development and testing of the D1 va-
Mar; 10 (3): 266-74 luation model. Med Care 2005 Mar; 43 (3): 203-20
31. Cook J, Richardson J, Street A. A cost utility analysis of 47. Kaplan RM, Anderson JP, Ganiants TG. The Quality of
treatment options for gallstone disease: methodological Well-Being scale: rationale for a single quality of life index.
issues and results. Health Econ 1994 May-Jun; 3 (3): 157-68 In: Walker SR, Rosser RM, editors. Quality of life assess-
ment: key issues in the 1990s. 2nd ed. New York: Springer-
32. Jansen SJ, Stiggelbout AM, Wakker PP, et al. Unstable pre-
Verlag, 1999
ferences: a shift in valuation or an effect of the elicitation
procedure? Med Decis Making 2000 Jan-Mar; 20 (1): 62-71 48. Torrance GW, Thomas WH, Sackett DL. A utility max-
imization model for evaluation of health care programs.
33. Locadia M, Stalmeier PF, Oort FJ, et al. A comparison of 3
Health Serv Res 1972 Summer; 7 (2): 118-33
valuation methods for temporary health states in patients
treated with oral anticoagulants. Med Decis Making 2004 49. van Nooten F, Brouwer W. The influence of subjective ex-
Nov-Dec; 24 (6): 625-33 pectations about length and quality of life on time trade-off
answers. Health Econ 2004 Aug; 13 (8): 819-23
34. McNamee P, Glendinning S, Shenfine J, et al. Chained time
trade-off and standard gamble methods: applications in 50. Cullen J, Schwartz MD, Lawrence WF, et al. Short-term
oesophageal cancer. Eur J Health Econ 2004 Feb; 5 (1): 81-6 impact of cancer prevention and screening activities on
quality of life. J Clin Oncol 2004 Mar 1; 22 (5): 943-52
35. Gage BF, Cardinalli AB, Owens DK. The effect of stroke
and stroke prophylaxis with aspirin or warfarin on quality 51. Rutten-van Molken MP. Methodological issues of patient
of life. Arch Intern Med 1996 Sep 9; 156 (16): 1829-36 utility measurement: experience from two clinical trials.
Med Care 1995; 33 (9): 922-37
36. Merlino LA, Bagchi I, Taylor TN, et al. Preference for
fractures and other glucocorticoid-associated adverse ef- 52. O’Connor AM. Effects of framing and level of probability
fects among rheumatoid arthritis patients. Med Decis on patients’ preferences for cancer chemotherapy. J Clin
Making 2001 Mar-Apr; 21 (2): 122-32 Epidemiol 1989; 42 (2): 119-26
37. Tosteson AN, Kneeland TS, Nease RF, et al. Automated 53. Bennett KJ, Torrance GW. Measuring health state prefer-
current health time-trade-off assessments in women’s ences and utilities: rating scale, time trade-off, and standard
health. Value Health 2002 Mar-Apr; 5 (2): 98-105 gamble techniques. In: Spilker B, editor. Quality of life and
pharmacoeconomics in clinical trials. Philadelphia (PA):
38. Tosteson AN, Kneeland TS, Nease R. Feasibility of auto-
Lippincott-Raven, 1996: 253-65
mated utility assessment in a phase III clinical trails:
U-Titer and a raloxifene osteoporosis prevention trial.
Med Decis Making 1995; 15: 412-36
39. Keeney R, Raiffa H. Decisions with multiple objectives:
Correspondence: Dr Lisa A. Prosser, Child Health Evalua-
preferences and value tradeoffs. New York: Cambridge tion and Research Unit, Division of General Pediatrics,
University Press, 1993 University of Michigan Health System, 300 N. Ingalls St,
40. Torrance GW. Measurement of health state utilities for Room 6E14, SPC 5456, Ann Arbor, MI 48109, USA.
economic appraisal. J Health Econ 1986; 5: 1-30 E-mail: lisapros@med.umich.edu

ª 2009 Adis Data Information BV. All rights reserved. Pharmacoeconomics 2009; 27 (9)

You might also like