Professional Documents
Culture Documents
com/dre
ISSN 0963-8288 print/ISSN 1464-5165 online
RESEARCH PAPER
Abstract Keywords
Purpose: To examine the ecological validity, predictive validity, and responsiveness of the Attention, responsiveness, validity
Five Digit Test (FDT) in patients with stroke. Methods: We included inpatients with stroke
(n ¼ 144, 114 and 105 in the ecological validity, predictive validity, and responsiveness analysis, History
respectively) in the study. At admission, the FDT and Barthel Index (BI) were assessed; at
discharge, the FDT, BI, Postural Assessment Scale for Stroke Patients (PASS), and Mobility Received 10 August 2014
Subscale of the Stroke Rehabilitation Assessment of Movement (MO-STREAM) were assessed. Revised 5 March 2015
Results: In the ecological validity analysis, the scores of the selective and alternating attention Accepted 16 March 2015
indices of the FDT were moderately correlated with those of the BI at admission and discharge Published online 7 April 2015
(Spearman ¼ –0.38 to –0.45). In the predictive validity analysis, the scores of the two attention
indices of the FDT at admission were moderately correlated with the scores of the BI, PASS, and
MO-STREAM at discharge ( ¼ –0.33 to –0.45). In the responsiveness analysis, the two attention
For personal use only.
indices of the FDT between admission and discharge had large differences (success rate
difference ¼ 0.56–0.67, Wilcoxon Z ¼ –5.90 to –6.60). Conclusion: Our results indicate that the
selective and alternating attention indices of the FDT have acceptable ecological validity,
predictive validity, and good responsiveness in patients with stroke.
evidence of its ecological validity, predictive validity, and 4. Subjects are required to complete the four parts of the FDT.
responsiveness. The total duration (in seconds) to complete a part is recorded as
The purpose of this study was to examine the ecological the score of each part. In addition, the accuracy of each part is
validity, predictive validity, and responsiveness of the two recorded as the number of errors. The score of part 1 is a reading
attention indices (including the selective attention index and the speed index. The score of part 2 is a counting speed index. The
alternating attention index) of the FDT in patients with stroke. We score of part 3 is a selective attention index [6]. The score of part
hypothesized that the ecological validity, predictive validity, and 4 is an alternating attention index [6]. A shorter time to test
responsiveness of the two attention indices of the FDT would be completion indicates better attention. Parts 1 and 2 of the FDT
acceptable. were used to confirm that subjects had the fundamental abilities to
perform the selective attention and alternating attention parts of
Methods the FDT. However, because parts 1 and 2 of the FDT do not assess
the attention of subjects, we did not analyse the psychometric
Subjects
properties of these two parts. A previous study reported that parts
The sample of the prospective cohort study was patients with 1 and 2 of the FDT had sufficient test–retest reliability and
stroke from a medical center in Taiwan. The patients received acceptable convergent validity in patients with stroke [4].
regular rehabilitation programmes (e.g. rehabilitation of ADL,
motor, balance, mobility, or cognition) during the study period. Barthel index
Patients were included in the project if they met the following
The BI was used to assess the patients’ level of independence in
criteria: (1) stroke onset within 10 d before hospital admission;
Disabil Rehabil Downloaded from informahealthcare.com by Nyu Medical Center on 04/13/15
Measures
Five Digit Test
The FDT has four parts, each of which contains 50 items [4]. The
testing items are groups of digits or stars arranged in frames like
those seen on playing cards (Figure 1). In part 1, subjects have to
read digits; in part 2, subjects have to count the number of stars; in
part 3, subjects are required to count the number of digits (if five
2s are in an item, the correct response is five); and in part 4,
subjects are required to switch their task-relevant attention
between counting the number of digits and reading digits.
When the digits are presented in a bold frame, the subjects have
to count the number of digits. When the digits are presented in a
slim frame, the subjects have to read the digits. The digits in bold
frames and those in slim frames are alternatingly presented in part Figure 1. Examples of the four parts of the FDT.
DOI: 10.3109/09638288.2015.1031288 Psychometric properties of the FDT 3
from 0 to 36. A score of 36 indicates good balance function, and a indicated that patients’ selective and alternating attention are both
score of 0 indicates a severe balance deficit. The PASS has good moderately correlated with patients’ functional recovery of
reliability and predictive validity in patients with stroke [11–13]. balance, motor status, and ADL [1,2]. Hence, the predictive
validity of the two attention indices of the FDT was investigated
Mobility subscale of the stroke rehabilitation assessment by examining the associations between each of the attention
of movement indices at admission and the PASS, the MO-STREAM, and the BI
scores at discharge using the Spearman correlation coefficient ().
The MO-STREAM was used to assess mobility function in
A greater than 0.6 indicates high predictive validity, 0.3–0.6
patients with stroke [14]. The MO-STREAM contains 10 four-
acceptable, and less than 0.3 poor [25]. We hypothesized that the
point (0, 1, 2, or 3) items: rolling, bridging, moving from supine
two attention indices of the FDT would have at least acceptable
to sitting, moving from sitting to standing, standing for a count to
predictive validity.
20, placing the affected foot on to the first step, taking three steps
Responsiveness is defined as the ability of a measure to detect
backward, taking three steps to the affected side, walking 10 m,
changes that take place over a specific time period [27]. In the
and walking down three steps. The total score for the MO-
study, the participants’ selective attention and alternating attention
STREAM ranges from 0 to 30. A score of 30 indicates good
would improve during the hospital stay because of natural
mobility function, and a score of 0 indicates severe mobility
recovery and/or cognitive rehabilitation [28,29]. Thus, we
deficit. The MO-STREAM has sufficient reliability, validity, and
examined the responsiveness of the two attention indices with
responsiveness in patients with stroke [15–17].
two approaches. First, Wilcoxon signed-rank test was performed
to determine the statistical significance of the change scores.
Disabil Rehabil Downloaded from informahealthcare.com by Nyu Medical Center on 04/13/15
MMSE, mini-mental status examination; BI, Barthel Index; PASS, postural assessment scale for stroke patients; MO-STREAM, Mobility subscale of
the stroke rehabilitation assessment of movement.
a
The numbers of males and females in the ecological validity studies were different because 39 participants (21 male and 18 female) completed the
assessments at admission and 31 participants (26 male and 5 female) completed the assessments at discharge.
Table 2. Completion time and accuracy of the selective and alternating attention indices of the FDT.
Ecological validity were large (SRD ¼ 0.56–0.67). The Wilcoxon Z scores of the two
attention indices were negative because the improvements in
The ecological validities of the two attention indices of the FDT
selective and alternating attention in the patients resulted in lower
are shown in Table 3. The correlations between each of the
scores on the two attention indices.
indices and the BI at admission and discharge were moderate
( ¼ –0.38 to –0.45) and significant (p50.01).
Discussion
Predictive validity To our knowledge, this study is the first to examine the predictive
validity, ecological validity, and responsiveness of the FDT in
Table 3 shows that the scores of the two attention indices of the
patients with stroke. The results of the study indicate that the two
FDT at admission were moderately correlated with those of the
attention indices of the FDT have acceptable ecological validity,
BI, the PASS, and the MO-STREAM scores at discharge
acceptable predictive validity, and sufficient responsiveness. The
( ¼ –0.33 to –0.45). All correlations in the predictive validity
strength of the study was that the psychometric properties of the
study were significant (p50.01).
FDT were validated with quite a large sample size (n4100),
which allows a more reliable generalization of our findings to
Responsiveness
other patients who meet the inclusion criteria of this study. The
The responsiveness of the two attention indices is presented in findings of this study are critical for clinicians and researchers to
Table 3. The changes in the two attention indices were all interpret the two attention indices of the FDT in patients with
significant (p50.01), and the SRDs of the two attention indices stroke.
DOI: 10.3109/09638288.2015.1031288 Psychometric properties of the FDT 5
Table 3. Ecological validity, predictive validity, and responsiveness of completion of each part of the FDT (e.g. the first part of the FDT
the FDT. cannot take more than 100 s) [21]. Moreover, setting time limits
for completion of the FDT could reduce the time of administration
Selective Alternating and promote testing efficiency for clinicians.
attention attention
Psychometric property index index
There are two limitations that should be considered for proper
interpretation of the findings of this study. The first limitation is
Ecological validity () that our sampling included patients who had only one occurrence
BI at admission (n ¼ 144) –0.38* –0.39* of stroke and stayed in a rehabilitation ward for more than 7 d.
BI at discharge (n ¼ 136) –0.43* –0.45*
Predictive validity () (n ¼ 114)
Therefore, the findings of this study might not be applicable to
BI at discharge –0.44* –0.36* patients with recurrent stroke or those with mild stroke who are
PASS at discharge –0.42* –0.38* discharged from the hospital within 7 d. The second limitation is
MO-STREAM at discharge –0.42* –0.33* that this study recruited only patients who were hospitalized. The
Responsiveness (n ¼ 105) –5.90* –6.60* evidence for the ecological validity, predictive validity, and
Wilcoxon Z responsiveness of the FDT in outpatients with stroke is still
SRD 0.56 0.67
limited. Future studies should examine the validity and respon-
*p 0.01. siveness of the FDT in outpatients with stroke.
Conclusions
Disabil Rehabil Downloaded from informahealthcare.com by Nyu Medical Center on 04/13/15
Assessment Scale for Stroke Patients (PASS). Stroke 1999;30: 22. Juhel J. Should we take the shape of reaction time distributions into
1862–8. account when studying the relationship between RT and psycho-
12. Mao HF, Hsueh IP, Tang PF, et al. Analysis and comparison of the metric intelligence? Pers Individ Dif 1993;15:357–60.
psychometric properties of three balance measures for stroke 23. Chan Y. Biostatistics 101: data presentation. Singapore Med J 2003;
patients. Stroke 2002;33:1022–7. 44:280–5.
13. Berg K. Measuring balance in the elderly: preliminary development 24. Chaytor N, Schmitter-Edgecombe M. The ecological validity of
of an instrument. Physiother Can 1989;41:304–11. neuropsychological tests: a review of the literature on everyday
14. Daley K, Mayo N, Danys I, et al. The Stroke Rehabilitation cognitive skills. Neuropsychol Rev 2003;13:181–97.
Assessment of Movement (STREAM): refining and validating the 25. Salter K, Jutai J, Teasell R, et al. Issues for selection of outcome
content. Physiother Can 1997;49:269–78. measures in stroke rehabilitation: ICF activity. Disabil Rehabil 2005;
15. Ahmed S, Mayo NE, Higgins J, et al. The Stroke Rehabilitation 27:315–40.
Assessment of Movement (STREAM): a comparison with other 26. Kline P. The new psychometrics: science, psychology and meas-
measures used to evaluate effects of stroke and rehabilitation. Phys urement. Florence (KY): Routledge; 1998.
Ther 2003;83:617–30. 27. Husted JA, Cook RJ, Farewell VT, Gladman DD. Methods for
16. Wang CH, Hsieh CL, Dai MH, et al. Inter-rater reliability and assessing responsiveness: a critical review and recommendations.
validity of the Stroke Rehabilitation Assessment of Movement J Clin Epidemiol 2000;53:459–68.
(STREAM) instrument. J Rehabil Med 2002;34:20–4. 28. Barker-Collo S, Feigin V, Lawes C, et al. Natural history of attention
17. Hsueh IP, Hsu MJ, Sheu CF, et al. Psychometric comparisons of 2 deficits and their influence on functional recovery from acute stages
versions of the Fugl-Meyer Motor Scale and 2 versions of the Stroke to 6 months after stroke. Neuroepidemiology 2009;35:255–62.
Rehabilitation Assessment of Movement. Neurorehabil Neural 29. Hyndman D, Pickering RM, Ashburn A. The influence of attention
Repair 2008;22:737–44. deficits on functional recovery post stroke during the first 12 months
18. Albert ML. A simple test of visual neglect. Neurology 1973;23: after discharge from hospital. J Neurol Neurosurg Psychiatr 2008;79:
Disabil Rehabil Downloaded from informahealthcare.com by Nyu Medical Center on 04/13/15
658–64. 656–63.
19. Folstein MF, Folstein SE, McHugh PR. ‘‘Mini-mental state’’: a 30. Cliff N. Dominance statistics: ordinal analyses to answer ordinal
practical method for grading the cognitive state of patients for the questions. Psychol Bull 1993;114:494.
clinician. J Psychiatr Res 1975;12:189–98. 31. Kraemer HC, Kupfer DJ. Size of treatment effects and their
20. Grace J, Nadler JD, White DA, et al. Folstein vs modified Mini-
importance to clinical research and practice. Biol Psychiatr 2006;59:
Mental State Examination in geriatric stroke: stability, validity, and
990–6.
screening utility. Arch Neurol 1995;52:477–84.
32. Van Zandt T. How to fit a response time distribution. Psychon Bull
21. Jensen AR. The importance of intraindividual variation in reaction
Rev 2000;7:424–65.
time. Pers Individ Dif 1992;13:869–81.
For personal use only.