You are on page 1of 5

COPD: Journal of Chronic Obstructive Pulmonary Disease, 2:51–55

ISSN: 1541-2555 print / 1541-2563 online


Copyright D 2005 Taylor & Francis Inc.
DOI: 10.1081/COPD-200050641

INVITED SYMPOSIUM

Minimal Clinically Important Difference, Clinical


Perspective: An Opinion
Stephen I. Rennard (srennard@unmc.edu).
Pulmonary and Critical Care Medicine [Phone: (402) 559-7313, Fax: (402) 559-4878], University of Nebraska Medical Center,
985885 Nebraska Medical Center, Omaha, Nebraska 68198-5885, USA.

ABSTRACT
COPD Downloaded from informahealthcare.com by Washington University Library on 07/22/13

The Minimal Clinically Important Difference has become a key feature for both the validation
of clinical tools and for the assessment of clinical studies. Several methods have been
developed to establish what a Minimal Clinically Important Difference is. The primary purpose
of the Minimal Clinically Important Difference, however, is to provide a measure of relevance
for a statistically applied measure. It does not, despite its name, necessarily relate to the
‘‘Clinical’’ condition. In this context, human beings are capable of extremely fine grades of
discrimination of very subtle differences, when they care about the measures. When they do
not care about the measure, large differences may be irrelevant. The flavors of wines or the
tone qualities of musical instruments are readily recognizable examples. The importance of an
outcome, for a clinician caring for an individual patient, therefore, will be highly patient
For personal use only.

specific. The Minimal Clinically Important Difference has great utility in assessing tools for
clinical investigation. It has limitations in assisting the clinician. The subtleties that may be
meaningful to individuals are often lost in discrimination tests in large populations where not
all have the same interests. In addition, readily applicable tests, for example, discriminating
degrees of salty water, for which Minimal Clinically Important Difference can be readily defined,
are often tests that have no interest for the majority of the population tested. This leads to
several paradoxes. Readily defined Minimal Clinically Important Differences are likely to be
defined for parameters that are of little interest to a large number of persons. Conversely,
parameters that are of great interest to selected individuals, that could be discerned by them
with great subtly are likely to be poorly generalizable. Without doubt, defining a Minimal
Clinically Important Difference will remain a key goal in the validation and application of tools
for clinical investigations. The limits of the concept, particularly as it relates to issues of
importance to patients, however, needs to be recognized.

INTRODUCTION pulmonary disease (COPD). This is an extremely important


problem. COPD affects up to 24 million Americans (1) and is
The minimal clinically important difference (MCID) is an currently the fourth leading cause of death in the United States
important emerging concept. The conference, of which the (2). Current therapy can do much to improve patient well-
following presentation was part, attempts to address the MCID being, but no treatment except smoking cessation (3) has been
for a variety of measures applied to chronic obstructive shown to slow the loss of lung function that characterizes
COPD. In addition, new treatments that address the many
varied clinical manifestations of the disorder are needed.
Keywords: Discrimination, Clinical relevance, MCID, Addressing these needs will require the application of a
Patient-centered outcomes. number of clinical tools designed to measure various aspects
Correspondence to: of this heterogeneous disorder. Understanding the MCID for
Stephen I. Rennard
Pulmonary and Critical Care Medicine, University of Nebraska
each of these tools will help assess the importance of potential.
Medical Center, 985125 Nebraska Medical Center, Omaha The following presentation was designed to provide a clinical
NE 68198-5125 perspective of the MCID and represents an opinion rather than
USA a review.
phone: (402) 559-7313 fax: (402) 559-4878 ‘‘Clinical’’ has several definitions. In the medical context,
email: srennard@unmc.edu
it generally refers to issues relevant to the patient. One of the

COPD: Journal of Chronic Obstructive Pulmonary Disease March 2005 51

Order reprints of this article at www.copyright.rightslink.com


great advances of our era has been the development of everyday meaning, can put performance in an intuitively
statistical methods and their application to the evaluation of understandable context. Nevertheless, this leaves important
clinical problems. These methods have improved the classi- questions unanswered. In a 6-minute walking test comparing
fication and staging of clinical disorders. Perhaps most performance after an intervention, for example, how much of a
importantly, they have permitted rigorous evaluation of difference is important remains controversial. In fact, it seems
therapeutic interventions. Specifically, by determining the most likely that there will be no resolution to this issue
probability that an apparent effect may be due to chance, these specifically because a meaningful difference is entirely
methods have permitted rigorous evaluation of therapeutic context specific. For individuals engaged in a competitive
interventions and have been crucial in the medical advances of race, very small differences can be crucially important. For
the last century. So important are these statistical methodol- the same individuals in other situations, those differences can
ogies, that their rigorous application is now a sine qua non for be meaningless.
approval of new medications and for acceptance of new The context-specific nature of importance has another
medical observations. implication. Specifically, the more important a measure is, the
Statistical methods, however, have both requirements and more likely small differences are important. That is, in a race,
limitations. The major limitation, which is addressed in detail very small differences in distance traveled are crucial.
in this symposium, is that statistical methods, while able to Similarly, for an artist, extremely subtle differences in color
COPD Downloaded from informahealthcare.com by Washington University Library on 07/22/13

determine whether a difference is likely due to chance, are not are important that may be irrelevant to others. The same may
readily used to determine if a difference is meaningful. be said for flavors to the oenophile, sounds to the musician,
Nevertheless statistical approaches to the problem of mean- words to the poet, or elegance to the mathematician, to name a
ingfulness have been explored. Norman and colleagues few. Psychological approaches to define minimal important
evaluated a series of 38 studies (4). In these studies, 62 differences are often based on the ability of a population to
clinically important differences were reported. Interestingly, distinguish among gradations in a measure. The ability of most
the magnitude of the effect size that was deemed important people, in contrast to a skilled chef, to distinguish seven
seemed to follow a normal distribution. With a few outliers, the flavors of saltiness (5), for example, does not define the
independently determined important difference was very close importance of the difference, nor of saltiness. Unfortunately, it
to 0.5 standard deviations of the effect size. This observation is should be expected that the more important a measure is for an
For personal use only.

all the more striking as the standards used to define ‘‘impor- individual, the increasingly refined is the ability to distin-
tant’’ were generally based on ‘‘clinical judgment.’’ Finally, guish differences.
this difference corresponded reasonably well with the seven The examples above demonstrating the ability of selected
units that serves as a rough measure of the gradations that can individuals to discriminate a large number of subtle gradations
be readily perceived (5). Furthermore, defining the important intentionally reflect the more specialized aspects of the human
difference in terms of the population evaluated, rather than in activity. Clinically important differences are those differences
terms of the measure used to make the evaluation, is appealing relevant to the individual patient and important to the patient’s
and suggest something general about ‘‘importance.’’ life. MCID is a concept that refers to groups of people, but
For a clinician concerned with individual patients, because of the wording used, it is likely that confusion will
however, the concept of a ‘‘one-half standard deviation’’ arise. This is the problem for the clinician. People are
ignores patient specific concerns. It also seems to fail to pass a different, particularly in their perception of what is important.
plausibility test where a minimal important difference can be In general, the most important differences for an individual
easily defined. Consider, for example, the distribution of patient will require the most discerning measures. However,
scores, expressed as a difference between visitor and home just as the subtle flavors of wine are meaningless to the
team for major league baseball for June of 2003, which teetotaller, small differences crucial to some are irrelevant for
shows a strikingly bell-shaped curve (Figure 1A). Similarly, others. Unfortunately (or rather for the sake of humanity,
the distribution of football scores for NCAA Division I teams fortunately), people are exceedingly variable in their ability to
in the first three games of the 2003 season shows a similar discern and value differences. Thus, the major problem with
approximately normal distribution (Figure 1B). One-half defining an MCID for any measure is that the most important
standard deviation for these distributions, however, represents differences, which require the most subtle measures for an
greater than two runs and greater than 10 points. These are individual patient, are likely to have the least general
differences much larger than those clearly recognized as the application. Conversely, measures that can be generalized
‘‘minimal important difference.’’ Perhaps the reason sports are are unlikely to have much individual importance and will,
as compelling entertaining as they are is that the differences therefore, be very crude tools. An MCID is unlikely, therefore
observed are far subtler than can be expected statistically. to influence a physician making a clinical decision with an
Another approach to define a meaningful difference is to individual patient.
anchor the measure to a value with a generally recognized Combining measures, which may have differing impor-
meaning. In the context of exercise physiology, for example, tance for different individuals, has been suggested and there
watts of worked performed is much less recognizable than have been many attempts to develop indices evaluating
distance walked. Using distance walked, because it has an multiple domains. Such measures have proved exceedingly

52 March 2005 COPD: Journal of Chronic Obstructive Pulmonary Disease


COPD Downloaded from informahealthcare.com by Washington University Library on 07/22/13
For personal use only.

Figure 1. Distribution of winning sports scores. Panel A: The difference at the end of the game for Major League Baseball games in June 2003 is
shown. Vertical axis, number of games; horizontal axis, difference home team – visitors. Panel B: The difference at the end of the game for NCAA
football in September 2003 is shown. Vertical axis, number of games; horizontal axis, difference home team – visitors.

useful. They also pose a number of theoretical and practical symptomatic dyspnea, namely exertion with its attendant
problems, and considerable creative scholarly work has been tachypnea and hyperinflation (8). As a result, patients can
invested in their design and evaluation. Their utility is not in become extraordinarily sedentary and, often, adjust their
doubt. They also have clear limitations. Adding apples to expectations to their sedentary lifestyle (6, 7). Reality testing
oranges clearly can assess fruit. On the other hand, adding is intact in that they recognize their limitations. It is striking,
apples to oranges loses information. however, that surveys such as Confronting COPD in America
A simple approach to clinical problems might be to ask the (7) consistently show that individuals with severe dyspnea,
patient if a difference is important. Unfortunately, the readily recognized with well-used questions, frequently regard
evidence from COPD is that such an approach is not helpful, their disease as mild or moderate. Similarly, patients who are
at least in many contexts. Because of the insidious nature dyspneic at rest or with speech will, 30 to 40% of the time
of the development of COPD, many patients greatly restrict regard their disease completely or well controlled. These are
their activity (6, 7), thereby eliminating the major cause of not self-evaluations that are appealing from a clinical context.

COPD: Journal of Chronic Obstructive Pulmonary Disease March 2005 53


The same apparent lack of insight appears to apply to
Table 1. Categorical nature of medical
exacerbations. Exacerbations of COPD are major determinants decisions
of morbidity, mortality, and costs associated with the disease.
That they have major acute and long-standing effects on health Level Choice
Regulator Approve or not
status is well established. Nevertheless, Seemungal and
Payor Reimburse or not
colleagues prospectively assessed COPD patients with diary Clinician Prescribe or not
cards and found that only about 50% of the exacerbations that Patient Take or not
were experienced, according to the cards, were reported by
the patients when asked (9). Perhaps more surprisingly, the
severity of symptoms associated with the unreported exacer- resources are committed to effective measures is essential. In a
bations was similar to that of the reported exacerbations. This resource-limited environment, moreover, resources must be
observation has, appropriately, engendered considerable committed to the most important interventions. In this context,
controversy and discussion. It is consistent, however, with the ability of various measures to compare heterogeneous
the concept that important differences, in this case differences interventions applied across diverse populations can be used to
from baseline status, are entirely context specific. prioritize resource allocation. As noted above, however, such
Physician assessment of differences is fraught with
COPD Downloaded from informahealthcare.com by Washington University Library on 07/22/13

collective assessments, using parameters that combine multi-


paradox as much as is patient assessment. In COPD, the ple generalizable domains, are likely to provide a means of
most widely used and best validated measure of disease is the comparison at the expense of concealing the differences that
forced expiratory volume in 1 second. What a meaningful are most individually important.
difference in this measure may be, however, remains contro- Finally, the concept of a minimal important difference im-
versial. For many years, 200 ml was regarded as the minimum plies a categorical classification, i.e., a difference is important
difference that was acutely important. Differences of 100 ml or it is not. For a sports event, this is natural. . .winning or not.
or even 50 ml, however, are now accepted, at least by some, For most of human experience, differences are expressed in a
as potentially important (2, 10). This is, at least in part, due to continuum with no arbitrary ‘‘cut-point.’’ Statisticians recog-
the fact that people do not breathe with forced spirometric nize the problem that forcing continuous variables into
maneuvers and that the FEV1 as an indirect reflection of
For personal use only.

categorical classifications poses for rigorous analysis. Never-


real breathing. theless, making categorical decisions in the face of continuous
The rate at which FEV1 declines over time is also an gradations is the nature of medical decisions (Table 1).
important variable. In this case, normal individuals decline at a The clinical perspective, therefore, is fraught with paradox
rate of approximately 20 ml per year, and individuals and tension. There is paradox in that categorical decisions
progressing to develop symptomatic COPD progress at 60 to must be made from continuous data. There is also tension as
100 ml per year (11). Differences of 20 ml per year have been the more important the issue for an individual, the more subtle
regarded as meaningful and have been used as target effect the measure should be, but the less general the applicability to
sizes for clinical interventions (12). None of the large studies groups of patients. Medical issues require assessment among
designed to evaluate inhaled glucocorticoids, for example, groups of patients. We accept the veterinary application of
were able to achieve such an effect size (13 –16), although interventions to herds of cattle and flocks of chickens with the
smaller differences that did not achieve statistical significance, expectation of a probability of success across the population.
were noted. Meta-analyses have attempted, with varying In medicine, such approaches are regarded appropriate for
results, to combine these studies to increase the power to some public health interventions, e.g., vaccination. However,
determine if these small differences are likely random (17, 18). the clinical perspective, the perspective from which this
It remains undetermined, however, if smaller differences opinion is offered, is one firmly connected to the individual
might not also be important. For example, a 2.5 ml/year dif- patient, and from that perspective, all valuation becomes
ference, if sustained over a 40-year time frame, would result intensely personal. In that context, the concept of MCID is one
in a 100 ml difference. Such a difference might have both that applies to epidemiologic questions. It will not define
functional and survival implications. Currently available importance, or even what is important, for an individual
treatments may be able to achieve an effect size in excess patient. As a means of defining and measuring importance
of 2.5 ml/year (17, 18). A clinical trial to evaluate such an among groups, however, the MCID promises to be an
effect, however, would need to be substantially larger than any important addition to medical methodology.
conducted to date.
While there are many theoretical issues regarding the
assessment of clinically important differences, that they have REFERENCES
practical utility is not in doubt. Regulatory agencies are
1. Mannino DM, Homa DM, Akinbami LJ, Ford ES, Redd SC.
charged with approving novel medications based on efficacy Chronic obstructive pulmonary disease surveillance—United
and safety. Both statistical rigor and clinical relevance is States, 1971 – 2000. MMWR Surveill Summ 2002; 51(6):1 – 16.
generally required. Payors have similar issues. Assuring that 2. American Thoracic Society/European Respiratory Society

54 March 2005 COPD: Journal of Chronic Obstructive Pulmonary Disease


Guidelines Update, 2003; Available at www.thoracic.org. Press, 1976:1 – 272. Available at: www.goldcopd.com Accessed
Accessed November 2003. November 2003.
3. Anthonisen NR, Connett JE, Murray RP. Smoking and lung 12. Anthonisen N, Connett J, Friedman B, Glass M, Kilday DP,
function of Lung Health Study participants after 11 years. Am J Mongo TS, Rudolphus A, Williams GW. Design of a clinical trial
Respir Crit Care Med 2002; 166(5):675 – 679. to test a treatment of the underlying cause of emphysema. Ann NY
4. Norman GR, Sloan JA, Wyrwich KW. Interpretation of changes Acad Sci 1991; 624:31 – 34.
in health-related quality of life: the remarkable universality of half a 13. Pauwels RA, Lofdahl CG, Laitinen LA, Schouten JP, Postma
standard deviation. Med Care 2003; 41(5):582 – 592. DS, Pride NB, Ohlsson SV. Long-term treatment with inhaled
5. Miller GA. The magic number seven plus or minus two, some budesonide in persons with mild chronic obstructive pulmonary di-
limits on our capacity to process information. Psychol Rev 1956; sease who continue smoking. N Engl J Med 1999; 340:1948 – 1953.
63:81 – 97. 14. Vestbo J, Sorensen T, Lange P, Brix A, Torre P, Viskum K.
6. Rennard SI, Calverley P. Rescue! Therapy and the paradox of Long-term effect of inhaled budesonide in mild and moderate
the Barcalounger. Eur Respir J 2003; 21(6):916 – 917. chronic obstructive pulmonary disease: a randomised controlled
7. Rennard S, Decramer M, Calverley PM, Pride NB, Soriano JB, trial. Lancet 1999; 353(9167):1819 – 1823.
Vermeire PA, Vestbo J. Impact of COPD in North America 15. Burge PS, Calverley PM, Jones PW, Spencer S, Anderson JA.
and Europe in 2000: subjects’ perspective of Confronting Prednisolone response in patients with chronic obstructive
COPD International Survey. Eur Respir J 2002; 20(4):799 – 805. pulmonary disease: results from the ISOLDE study. Thorax
8. O’Donnell DE, Revill SM, Webb KA. Dynamic hyperinflation and 2003; 58(8):654 – 658.
exercise intolerance in chronic obstructive pulmonary disease. Am 16. Group TLHSR. Effect of inhaled triamcinolone on the decline in
COPD Downloaded from informahealthcare.com by Washington University Library on 07/22/13

J Respir Crit Care Med 2001; 164(5):770 – 777. pulmonary function in chronic obstructive pulmonary disease. N
9. Seemungal TA, Donaldson GC, Bhowmik A, Jeffries DJ, Engl J Med 2000; 343(26):1902 – 1909.
Wedzicha JA. Time course and recovery of exacerbations in 17. Sutherland ER, Allmers H, Ayas NT, Venn AJ, Martin RJ.
patients with chronic obstructive pulmonary disease. Am J Respir Inhaled corticosteroids reduce the progression of airflow limitation
Crit Care Med 2000; 161(5):1608 – 1613. in chronic obstructive pulmonary disease: a meta-analysis. Thorax
10. Global Strategy for the Diagnosis, Management, and Prevention of 2003; 58(11):937 – 941.
Chronic Obstructive Pulmonary Disease. 2003. Available at: 18. Highland KB, Strange C, Heffner JE. Long-term effects of
www.goldcopd.com. Accessed November 2003. inhaled corticosteroids on FEV1 in patients with chronic obstructive
11. Fletcher C, Peto R, Tinker C, Speizer FE. The Natural History of pulmonary disease. A meta-analysis. Ann Intern Med 2003;
Chronic Bronchitis and Emphysema. New York: Oxford University 138(12):969 – 973.
For personal use only.

COPD: Journal of Chronic Obstructive Pulmonary Disease March 2005 55

You might also like