You are on page 1of 6

Psychometric Properties of the

Modified Fatigue Impact Scale


Rebecca D. Larson, PhD

Psychometric assessments are tests or questionnaires that have been designed to measure constructs of
interest in an individual or a target population. A goal of many of these self-report instruments is to
provide researchers with the ability to gather subjective information in a manner that might allow
for quantitative analysis and interpretation of these results. This requires the instrument of choice to
have adequate psychometric properties of reliability and validity. Much research has been conducted
on creating self-report quality of life questionnaires for individuals with multiple sclerosis (MS). This
article focuses on one in particular, the Modified Fatigue Impact Scale (MFIS). The article starts with
a brief description of the rationale, construction, and scoring of the inventory. Next, the best available
reliability and validity data on the MFIS are presented. The article concludes with a brief discussion
on the interpretation of scores, followed by suggestions for future research. This summative analysis
is intended to examine whether the instrument is adequately measuring the impact of fatigue and
whether the scores allow for meaningful interpretations. Int J MS Care. 2013;15:15–20.

M
ultiple sclerosis (MS) is a chronic, pro- in MS and its negative effects on quality of life, the
gressive, and degenerative disease of the pathophysiology of MS-related fatigue remains unclear.
central nervous system characterized by Additionally, the difficulty of measuring fatigue due to
demyelination1 and axonal deterioration.2 Symptoms its subjective nature and its impact on quality of life has
of MS include abnormal gait, deficient balance, muscle been troublesome.
weakness, spasticity, and fatigue, all of which can reduce According to the Multiple Sclerosis Council for Clin-
physical function and profoundly affect health and qual- ical Practice and Guidelines, a subjective (self-reported)
ity of life.1 Fatigue is one of the most common symp- measure of fatigue should be based on the individual’s
toms, affecting more than 75% of people with MS.3,4 assessment of fatigue and its impact on quality of life,7
Fatigue has been defined as “a subjective lack of physi- which requires the measure to have adequate psycho-
cal or mental energy that is perceived by the individual metric properties including reliability and validity.
or caregiver to interfere with activities of daily living.”5 After performing a review of the literature, the Council
Fatigue can be considered primary or secondary. Pri- recommended using the Modified Fatigue Impact Scale
mary fatigue refers to factors directly associated with (MFIS).7 Although the Council called for further psy-
the disease process, whereas secondary fatigue relates chometric evaluation, researchers have been repeatedly
to the consequences of primary fatigue and may result using the MFIS in the absence of such a comprehensive
from lack of conditioning, depression, and medication evaluation of the instrument.
side effects.6 Despite the known prevalence of fatigue The MFIS is a modified version of the 40-item
Fatigue Impact Scale (FIS), which was originally devel-
From the Department of Kinesiology, University of Georgia, Athens,
oped to assess the effects of fatigue on quality of life in
GA, USA. Dr. Larson is now with the Department of Health and
Exercise Science, University of Oklahoma, Norman, OK, USA. Cor- patients with chronic diseases, specifically MS.3 The FIS
respondence: Rebecca D. Larson, PhD, Department of Health and has patients rate the extent to which fatigue has affected
Exercise Science, University of Oklahoma, Norman, OK 73019;
their life in the past 4 weeks on a questionnaire consist-
e-mail: rdlarson@ou.edu.
ing of 10 “physical” items, 10 “cognitive” items, and 20
DOI: 10.7224/1537-2073.2012-019 “social” items, with 0 indicating “no problem” and 4
© 2013 Consortium of Multiple Sclerosis Centers. indicating “extreme problem.” The maximum possible

International Journal of MS Care


15
Larson

score is 160. The MFIS evolved from the FIS during fatigue inventory and its defined scores for fatigued and
the development of a clinical inventory assessing over- nonfatigued.12 Verification of these results has been less
all quality of life in individuals with MS, the Multiple than adequate, with researchers simply citing the study
Sclerosis Quality of Life Inventory (MSQLI). During of Flachenecker et al.12 as a rationale for using a cutoff
the phase 2 field testing of the MSQLI, the 40-item FIS score of 38 to discriminate fatigued from nonfatigued
was abbreviated into the 21-item MFIS by “eliminating individuals with MS. The lack of population norms and
items which appeared both content-redundant and had a possibly inappropriate cutoff score raise some questions
high inter-item correlations,”8 but the exact procedures about the instrument and the ability to interpret scores.
and data have not been published. The MFIS contains
9 “physical” items, 10 “cognitive” items, and 2 “psycho- Reliability
social” items. The maximum possible score is 84, with The reliability of the MFIS has been evaluated in a
higher scores indicating a greater impact on quality of small number of articles10,13 and in the MSQLI technical
life (Appendix 1). The original intention was to use the inventory, which includes the MFIS. When consider-
total score to reflect a global (unidimensional) score.3,9 ing reliability, two questions come to mind: 1) Is the
The authors of the FIS and those involved in the modi- MFIS reliable (internal consistency)? 2) Is the impact of
fication of the FIS into the MFIS have not published fatigue experienced by individuals with MS stable and
evidence verifying the underlying structure of the instru- reproducible with repeated measurements? The MSQLI
ment or the rationale for the three subscales and the technical inventory provides some of the better reliability
items selected to create the subscales. (internal consistency) evidence. The phase 2 field testing
The underlying structure of the MFIS has been of the MSQLI instrument studied a sample of 300 indi-
examined through principal components analysis with viduals with MS selected from 4 MS clinics in Canada.
varimax rotation using data from 181 MS patients The sampling of subjects was focused on gender and
from four different European countries: Belgium (n = a commonly used measure of disability, the Expanded
51), Italy (n = 50), Slovenia (n = 50), and Spain (n = Disability Status Scale (EDSS), keeping it similar to
30).10 All 21 items meet the required item-loading fac- those of previous epidemiological studies.8 The reported
tor of 0.500. However, the first item, “I feel less alert” internal consistency of all the MFIS scores was “excel-
(a cognitive item), had a factor loading of 0.495 but lent,” with the following Cronbach α values: total, 0.81;
also loaded with the psychosocial factor at 0.599. The cognitive, 0.95; physical, 0.91; and psychosocial, 0.81.8
eighth item, “I am less motivated to participate in social The technical guide suggests that the MFIS can be used
activities” (a psychosocial item), had a factor loading of as a comprehensive (total score) and multidimensional
0.528 but also loaded with the physical factor at 0.499. (separate subscales) assessment of the impact of fatigue.
The ninth item, “I am less motivated to do things away The internal consistency reported by Kos et al.10 in 2005
from home,” from the psychosocial subscale, was actu- showed similar results for the total score and two of the
ally assigned to the physical factor. These results are not subscales, physical and cognitive (Cronbach α values
in agreement with the original underlying structure of of 0.92, 0.88, and 0.92, respectively). However, the
the subscales, leading Kos and colleagues to recommend Cronbach α for the psychosocial subscale was 0.65.10
caution when interpreting the psychosocial subscale.10 The lack of agreement with the psychosocial subscale
The lack of agreement in the underlying structure could could be explained by the fact that the studies involved
confound the interpretations of the MFIS as an outcome individuals with different cultural backgrounds, which
measure. could also influence the other subscales. Lack of agree-
The total score of the MFIS ranges from 0 to 84. The ment does not invalidate the subscale but does suggest
ranges of scores for each subscale are as follows: physical, further exploration of cultural differences as a confound-
0 to 36; cognitive, 0 to 40; and psychosocial, 0 to 8. No ing variable.
data have so far been published regarding population The second question regarding reliability relates
norms for the MFIS and its subscales. Some studies use to whether the impact of fatigue experienced by the
a total score of 38 as a cutoff to discriminate fatigued individuals varies from test to test. The MFIS has been
from nonfatigued individuals.10,11 The score of 38 was used as an outcome measure in several clinical trials,14,15
based on a study that correlated the MFIS with another which assumes that the impact of fatigue persists and is

International Journal of MS Care


16
Psychometric Properties of the MFIS

the same within an individual and across repeated mea- fatigue. The MFIS does have moderate to strong correla-
sures. A few studies have been conducted to investigate tions with the Fatigue Severity Scale (FSS), a measure of
the test-retest reproducibility of the MFIS.10,13 In 2003, fatigue in general use,11,12 which is not surprising given
Kos et al.13 conducted a study in which participants (n that the FIS was derived from the FSS. Tellez et al.11
= 51) completed the MFIS on two separate occasions reported correlations between the FSS scores and the
at the same time of day. The subscales, along with the total MFIS score, with a correlation coefficient of 0.68.
total score, were considered stable over the 3 days using The subscales also correlated with the FSS, with correla-
a Wilcoxon rank sum test to assess differences from day tion coefficients of 0.75 for the physical subscale, 0.44
to day. Similar results were observed in a subsequent for the cognitive subscale, and 0.62 for the psychosocial
study in 200510 in a much larger sample (n = 181). Once subscale.11 Kos et al.13 reported a correlation of 0.66
again, the MFIS was administered on two occasions 3 between the FSS and the total MFIS score. With both
days apart, with no significant difference found in scores instruments assessing fatigue, a much higher correlation
(intraclass correlation coefficient [ICC] of the subscales might be expected; however, it should be considered that
ranged from 0.84 to 0.91 and of the total was 0.91). the MFIS assesses primarily the impact of fatigue, while
However, a limitation of this study is the lack of expla- the FSS also assesses severity and frequency. When the
nation in the methodology regarding administration of FSS is correlated with the separate subscales from the
the MFIS and whether confounding variables such as MFIS, the physical subscale shows a stronger correlation
sleep or caffeine intake were accounted for. These data than the other subscales. This is not surprising given that
suggest that the MFIS has adequate test-retest reliability; the impact of fatigue questions on the FSS focus more
however, because of the possibility of confounding vari- on the physical aspects of daily living. Results from the
ables affecting test results, this reliability should be veri- phase 2 trial assessing the validity of the MSQLI indi-
fied by conducting a study in which these variables are cated significant correlations of the 36-item Short Form
controlled. Another confounding aspect that could affect Health Status Survey (SF-36) vitality scale (r = −0.59),
reproducibility is the notion that fatigue may or may not the Sickness Impact Profile (SIP) Sleep and Rest Scale
be stable in a person with MS. (r = 0.47), and the SIP Alertness Scale (r = 0.65) with
the MFIS.8 Both the SF-36 and the SIP are widely used
Validity instruments. The correlation with the vitality scale helps
An instrument can be reliable but not valid; this is establish validity, because it is logical that fatigue could
akin to the important distinction between precision be accompanied by decreased vitality. The correlations
and accuracy. Validity refers to how well the instru- with the Sleep and Rest Scale and the Alertness Scale
ment is measuring the construct of interest. In assessing might suggest problems with the MFIS in that it cannot
whether an instrument is valid, one should consider the distinguish between sleepiness and alertness with respect
nomological network under which the instrument was to impact of fatigue.
constructed. The nomological network under which the Depression could be a symptom of fatigue, and
MFIS was constructed has not been directly established fatigue could be a symptom of depression, leading to a
or clarified. Therefore, we must first identify what fac- long-standing debate about the causal direction between
tors should correlate highly with the MFIS, as well as these variables. Tellez et al.11 found a clear relationship
those factors that should be unrelated or weakly correlat- between depression and fatigue in individuals with MS,
ed. If the construct is assessing what it purports to assess, with a significant correlation (r = 0.70) between the
it should correlate highly with other measures of similar MFIS total score and depression measured with the Beck
constructs (convergent validity), and it should weakly Depression Inventory (BDI). Depression and fatigue
correlate with constructs that are theoretically unrelated are often associated with disease-specific variables such
(discriminant validity). One way to assess these aspects as disability and disease duration. When EDSS scores
of validity is to simultaneously administer the MFIS were controlled, the correlation between depression and
with other related and unrelated psychometric instru- fatigue remained positive.11 When these variables were
ments and assess the strength of their correlations. analyzed using multiple linear regression, EDSS score,
Because the MFIS assesses the impact of fatigue, depression, and disease duration were all independent
it should converge with other subjective measures of predictors of all the MFIS subscale and total scores.11

International Journal of MS Care


17
Larson

However, Greim et al.16 reported that depressed MS day), the mean MFIS score (42.1) did not differ from
patients subjectively felt significantly more tired than that of the placebo run-in period. The mean MFIS score
nondepressed MS patients (mean [SD] = 49.8 [13.1] following the placebo washout period was roughly equal
vs. mean [SD] = 32.6 [16.8]; P < .003), supporting the to that after the placebo run-in period (43.0 and 44.7,
notion that a depressed mood can affect the subjective respectively).14 This does provide some evidence that the
estimation of fatigue. MFIS can detect a change in scores; however, the lack of
The validity of a subjective instrument can be a true control group and the failure to control for other
strengthened when it is paired with an objective mea- variables such as sleep and depression may confound the
sure, provided that the measures are appropriate sur- outcomes. These results suggest that the MFIS is sensi-
rogates. The study conducted by Greim et al.16 assessed tive to change but that the interpretation of these results
objective and subjective measures of mental and physical is limited to just that: a reduction in MFIS scores.
fatigue in individuals with and without MS. Participants Little to no research has been published outlining
completed subjective measures of fatigue, specifically what a change in MFIS scores (increasing or decreasing)
the MFIS, before and after a 30-minute vigilance test reflects objectively. Currently the interpretation is lim-
(an objective test of mental fatigue) and a hand-dyna- ited to change directions—that is, a reduction in scores,
mometer test (an objective test to assess physical fatigue). no significant change in scores, or an increase in scores.
Depression was controlled during the study because of The term clinically meaningful or clinically relevant has
its possible influence on subjective and objective mea- been used in a number of studies in an attempt to give
sures of fatigue. A significant correlation between the meaning to the results and allow for some kind of inter-
subjective feelings (MFIS) and the objective measures pretation of the scores.15,17 However, these studies do
was observed in the individuals with MS. The indi- not provide sufficient evidence for their selection of what
viduals with higher levels of subjective fatigue performed is deemed clinically meaningful. A study by Kos et al.17
worse on the objective measures. However, the depres- considered a change in score of 10 or more to be clini-
sion scale (BDI) was significantly correlated with the cally relevant, based on other studies that found a differ-
measures of fatigue, confirming previous data indicating ence in MFIS scores of 7 to 20.1. Another article used
an interaction between fatigue and depression that can a cut-point of 45 or more for the total MFIS score as a
confound study results and subsequent interpretations. study entry criterion, without providing a clear rationale
Considerable research has been conducted to find for the selection of that score.15 The lack of objective
ways to reduce the impact of fatigue in individuals with anchors for the MFIS total and subscale scores limits the
MS. Various pharmacologic agents are used to this end, interpretations of this instrument’s results.
and data from these studies can provide validity evi- A more recent article found flaws in the underlying
dence for the MFIS. Modafinil (Provigil), a commonly structure of the MFIS and used the Rasch measurement
prescribed medication used to reduce the symptoms of model to determine that the use of the total score is
fatigue with the aim of reducing the impact of fatigue invalid.18 The Rasch model represents the interactions
on quality of life, was tested during a 9-week single- between subjects and the test items to produce linear
blind study involving a sample of 72 individuals with measurements: “The model states that the probability of
MS.14 All participants received the medication, but a person giving a certain answer to an item is a logistic
the treatment sequence was blinded. The medication function of the difference between the person’s ‘ability’
regimen included a placebo run-in period (weeks 1–2), and the item’s ‘difficulty.’”18 In the case of the MFIS,
200 mg/day of modafinil (weeks 3–4), 400 mg/day of a person with high levels of fatigue would affirm items
modafinil (weeks 5–6), and a placebo washout period expressing high levels of fatigue, while a person with low
(weeks 7–9). The MFIS was one of the main outcome levels of fatigue would have difficulty affirming these
variables for this study. The MFIS total score, along items. According to Wright and Linacre,19 it is the only
with scores for the three subscales, were significantly way in which ordinal observations of clinical phenomena
reduced when individuals were administered 200 mg/ can be converted into linear measurements. The 21-item
day of modafinil.14 The actual mean score went from MFIS did not fit the Rasch model, which does not
44.7 to 37.7 (7-point reduction). However, when par- support the use of the total score as a global index but
ticipants were administered the higher dosage (400 mg/ rather indicates that it is multidimensional.18 Mills and

International Journal of MS Care


18
Psychometric Properties of the MFIS

colleagues18 further explored this concept and were able are limited to whether a score changed significantly and
to achieve fit to the Rasch model through the removal the direction of that change. No studies have yet been
of the following items: 4 (“I am clumsy and uncoordi- published that objectively show what a change in the
nated”; physical subscale), 14 (“I am physically uncom- MFIS represents. In other words, if an MS patient’s
fortable”; physical subscale), and 17 (“I am less able to physical subscale score on the MFIS improves by 5
complete tasks that require physical effort; physical sub- points, does that mean that the person can walk farther
scale). The authors then identified two subscales of the and faster? Further research on the MFIS is needed to
MFIS: physical and cognitive. The psychosocial subscale address some of the problems described here and to
was eliminated because the items were found to be part identify what a change in MFIS score represents on an
of the physical subscale, consistent with the findings of objective measure of quality of life in the physical and
Kos et al.10 The authors argue that studies in which the cognitive domains. o
global MFIS score was used as an outcome measure or a Financial Disclosures: The author has no conflicts of interest to
selection tool might be invalid or subject to misinterpre- disclose.
tations. Despite the problems regarding the underlying References
structure, it appears that the physical and cognitive sub-   1. Romberg A, Virtanen A, Aunola S, Karppi SL, Karanko H, Ruutiainen
J. Exercise capacity, disability and leisure physical activity of subjects
scales can be useful as outcome measures. with multiple sclerosis. Mult Scler. 2004;10:212–218.
  2. Carroll CC, Gallagher PM, Seidle ME, Trappe SW. Skeletal muscle
Conclusion characteristics of people with multiple sclerosis. Arch Phys Med Reha-
bil. 2005;86:224–229.
Clearly, the MFIS as an outcome measure has some   3. Fisk JD, Pontefract A, Ritvo PG, Archibald CJ, Murray TJ. The impact
of fatigue on patients with multiple sclerosis. Can J Neurol Sci.
problems resulting in limitations in interpreting the 1994;21:9–14.
 4. Freal JE, Kraft GH, Coryell JK. Symptomatic fatigue in multiple sclero-
scores. The lack of agreement between the underly- sis. Arch Phys Med Rehabil. 1984;65:135–138.
ing structure and its subscales raises complex issues,  5. Kos D, Nagels G, D’Hooghe MB, Duportail M, Kerckhofs E. A rapid
screening tool for fatigue impact in multiple sclerosis. BMC Neurol.
especially if the MFIS total score is invalid. The MFIS 2006;6:27.
  6. Lapierre Y, Hum S. Treating fatigue. Int MS J. 2007;14:64–71.
total score has been commonly reported as an outcome   7. Multiple Sclerosis Council. Fatigue and multiple sclerosis—clinical prac-
measure, but given the results reported by Mills et al.,18 tice guideline. Paralyzed Veterans of America; 1998. http://www.kin-
tera.org/AccountTempFiles/Account403152/ECSoft/MS-FatigueCPG.
the interpretations of studies using the MFIS total scores pdf 2003.
 8. Ritvo PG, Fischer JS, Miller DM, Andrews H, Paty DW, LaRocca NG.
may need to be reevaluated. Additionally, the potential MSQLI: Multiple Sclerosis Quality of Life Inventory: A User’s Manual.
New York, NY: National Multiple Sclerosis Society; 1997.
effects of confounding variables—specifically, depres-   9. Krupp LB, LaRocca NG, Muir-Nash J, Steinberg AD. The fatigue sever-
sion—on MFIS scores may lead to misinterpretation ity scale: application to patients with multiple sclerosis and systemic
lupus erythematosus. Arch Neurol. 1989;46:1121–1123.
of the results of uncontrolled studies. There may be no 10. Kos D, Kerckhofs E, Carrea I, Verza R, Ramos M, Jansa J. Evaluation
of the Modified Fatigue Impact Scale in four different European coun-
good way to separate these constructs in some samples tries. Mult Scler. 2005;11:76–80.
such as people with MS. Probably the biggest problem 11. Tellez N, Rio J, Tintore M, Nos C, Galan I, Montalban X. Does the
Modified Fatigue Impact Scale offer a more comprehensive assessment
with MFIS score interpretation is the lack of objective of fatigue in MS? Mult Scler. 2005;11:198–202.
12. Flachenecker P, Kumpfel T, Kallmann B, et al. Fatigue in multiple scle-
anchors. As the measurement stands, the interpretations rosis: a comparison of different rating scales and correlation to clinical
parameters. Mult Scler. 2002;8:523–526.
13. Kos D, Kerckhofs E, Nagels G, et al. Assessing fatigue in multiple
PracticePoints sclerosis: Dutch Modified Fatigue Impact Scale. Acta Neurol Belg.
2003;103:185–191.
14. Rammohan KW, Rosenberg JH, Lynn DJ, Blumenfeld AM, Pollak CP,
• The Modified Fatigue Impact Scale (MFIS) is a Nagaraja HN. Efficacy and safety of modafinil (Provigil) for the treat-
ment of fatigue in multiple sclerosis: a two centre phase 2 study. J Neu-
widely used self-report measure of fatigue in rol Neurosurg Psychiatry. 2002;72:179–183.
people with MS, but its reliability and validity 15. Stankoff B, Waubant E, Confavreux C, et al. Modafinil for fatigue in
MS: a randomized placebo-controlled double-blind study. Neurology.
have not been adequately addressed. 2005;64:1139–1143.
• The MFIS has various problems that result in limi- 16. Greim B, Benecke R, Zettl UK. Qualitative and quantitative assessment
of fatigue in multiple sclerosis (MS). J Neurol. 2007;254(suppl 2):
tations in interpreting the scores. II58–II64.
• In particular, the scale’s lack of agreement 17. Kos D, Duportail M, D’hooghe M, Nagels G, Kerckhofs E. Multidisci-
plinary fatigue management programme in multiple sclerosis: a ran-
between the underlying structure and its sub- domized clinical trial. Mult Scler. 2007;13:996–1003.
18. Mills RJ, Young CA, Pallant JF, Tennant A. Rasch analysis of the Modi-
scales raises complex issues and should be con- fied Fatigue Impact Scale (MFIS) in multiple sclerosis. J Neurol Neuro-
sidered before use of this instrument in clinical surg Psychiatry. 2010;81:1049–1051.
19. Wright BD, Linacre JM. Observations are always ordinal; mea-
research and practice. surements, however, must be interval. Arch Phys Med Rehabil.
1989;70:857–860.

International Journal of MS Care


19
Larson

Appendix 1. Modified Fatigue Impact Scale

Patient’s Code: ________________________  Date: ______/______/______


month day year
Test#: 1 2 3 4
MODIFIED FATIGUE IMPACT SCALE (MFIS)
INSTRUCTIONS
Following is a list of statements that describe how fatigue may affect a person. Fatigue is a feeling of physical tiredness and
lack of energy that many people experience from time to time. In medical conditions like MS, feelings of fatigue can occur
more often and have a greater impact than usual. Please read each statement carefully, and then circle the one number
that best indicates how often fatigue has affected you in this way during the past 4 weeks. (If you need help in marking
your responses, tell the interviewer the number of the best response.) Please answer every question. The interviewer
can explain any words or phrases that you do not understand.
Because
of my fatigue during the past 4 weeks…

Some- Almost
Never Rarely times Often Always
  1. I have been less alert. 0 1 2 3 4
  2. I have had difficulty paying attention for long periods of 0 1 2 3 4
time.
  3. I have been unable to think clearly. 0 1 2 3 4
  4. I have been clumsy and uncoordinated. 0 1 2 3 4
  5. I have been forgetful. 0 1 2 3 4
  6. I have had to pace myself in my physical activities. 0 1 2 3 4
  7. I have been less motivated to do anything that requires 0 1 2 3 4
physical effort.
  8. I have been less motivated to participate in social activities. 0 1 2 3 4
  9. I have been less motivated to do things away from home. 0 1 2 3 4
10. I have had trouble maintaining physical effort for long 0 1 2 3 4
periods.
11. I have had difficulty making decisions. 0 1 2 3 4
12. I have been less motivated to do anything that requires 0 1 2 3 4
thinking.
13. My muscles have felt weak. 0 1 2 3 4
14. I have been physically uncomfortable. 0 1 2 3 4
15. I have had trouble finishing tasks that require thinking. 0 1 2 3 4
16. I have had difficulty organizing my thoughts when doing 0 1 2 3 4
things at home or at work.
17. I have been less able to complete tasks that require physi- 0 1 2 3 4
cal effort.
18. My thinking has been slowed down. 0 1 2 3 4
19. I have had trouble concentrating. 0 1 2 3 4
20. I have limited my physical activities. 0 1 2 3 4
21. I have needed to rest more often or for longer periods. 0 1 2 3 4

International Journal of MS Care


20

You might also like