Professional Documents
Culture Documents
R
ecent evidence-based practice Reports on frequency of use have Case Description: Target
initiatives and the need for focused on what OMs have been Setting
accountability in clinical prac- used versus what should be used. The recommendations for the use of
tice have focused attention on the Test “batteries” of OMs used post- OMs poststroke were developed in
use of standardized outcome mea- stroke have been reported based on several stages using both qualitative
sures (OMs) in physical therapy.1– 4 frequency of use.5,10,13,22 Several and quantitative data analyses. As
Monitoring patient status through authors have made recommenda- part of the first stage, the American
the appropriate use of OMs is con- tions for OMs used poststroke,23–29 Physical Therapy Association (APTA)
sidered good clinical practice5 and but most are limited to specific con- Neurology Section Board of Direc-
has been suggested to enhance structs,23,27,30 lack information about tors (NS BOD) appointed 2 individu-
patient care as it contributes to a how recommendations were devel- als representing the Neurology Sec-
more thorough examination, assists oped,27,28 or recommended multiple tion’s regional continuing education
Table 1.
Background Information on the StrokEDGE Task Force Members
Faculty
Appointment Conducted
in Physical Teaches Neurologic Conducted and Published Years
Therapist Content in and Published Neurologic Research of
Task Force Education Physical Therapist Stroke-Related Clinical Using the Current Clinical Clinical State of
Member Program Education Program Research Therapist Delphi Process Position Practice Licensure
J.E.S. ● ● ● 36 Illinois
(Co-chair)
P.M.K. ● ● ● 21 Kansas
ture all necessary data to make an review the available literature on or action by an individual, and par-
informed recommendation regard- OMs. This process includes a struc- ticipation refers to an individual’s
ing OM use, the task force held a tured format to formulate questions, involvement in a life situation. In
focus group discussion. During this appraise literature, and make recom- cases where an OM captured multi-
discussion, task force members were mendations.37 The CAT approach ple ICF categories (eg, OMs that mea-
asked to review and discuss the mer- was developed by the McMaster sure balance), task force members
its of each item on the EDGE tem- University Occupational Therapy indicated this in their review.
plate. The group proposed several Evidenced-Based Practice Research
revisions to the EDGE template in Group and is a structured way to In order to maximize interrater
order to meet the specific outcomes critically review the essential compo- and intrarater reliability in making
of this project. For each proposed nents of published peer-reviewed recommendations for each of the
addition to the template, a formal articles.38 Using the CAT approach, OMs, a 4-point scoring matrix for
discussion was initiated. If the group task force members individually clinical recommendations was devel-
achieved 100% consensus on a pro- reviewed and evaluated the available oped. The scoring criteria were dis-
posed item, it was incorporated into literature on OMs in assigned con- cussed and revised until the task
the EDGE template. The resulting tent areas. The task force agreed that force reached unanimous agree-
modified template was termed the the International Classification of ment. A score of 4 indicates the OM
“StrokEDGE” template (Appendix). Functioning, Disability and Health has good psychometric properties
The StrokEDGE template integrates (ICF)39 model would be used as a and clinical utility when used in the
data from the following areas as it framework to characterize the OMs stroke population, whereas a score
relates to each test: construct, type reviewed. The ICF framework has of 1 indicates the OM has poor psy-
of measurement, instrument proper- been recommended as a useful tool chometric properties or clinical util-
ties, instrument clinical usability, to capture the constructs of OMs.7,8,22 ity. Table 2 lists the criteria of the
recommendation for use by practice The task force wanted to include 4-point recommendation system.
setting and patient acuity, and suit- OMs capturing 3 levels of the ICF
ability for professional education and model: body structure and function, Reviewers also made recommenda-
research. activities, and participation. The ICF tions on OMs physical therapist stu-
model defines function as the phys- dents should “learn to administer” or
Application of the Process iological and psychological functions “have knowledge of/be exposed to”
Review of Outcome Measures of body systems and structure as the during professional education. The
The task force used a critically anatomical parts of the body. Activ- task force used A Normative Model
appraised topic (CAT) approach to ity describes the execution of a task of Physical Therapist Professional
Group Delphi Online Survey review of the literature, proposed a the Toolbox course (16). Numerous
Review Process recommendation, and provided writ- OMs were represented in more than
The completed StrokEDGE docu- ten support for the ratings. A sum- one of these sources. The task force
ments were uploaded to an anony- mary document of the revised rat- agreed that tools capturing the con-
mous online survey site housed on ings and rationale was sent to task structs of language (1), depression
the Seton Hall University server force members. Following review of (3), perception (8), and cognition
through Academic Survey System the document by the task force, a (5) would not be reviewed at this
and Evaluation Tool (ASSET). Task conference call was held to address time because these tools are used
force participants were asked to crit- and discuss the proposed ratings and primarily during the screening or
ically review all StrokEDGE docu- achieve consensus. Following dis- systems review components of the
ments and supporting evidence for cussion, members were asked to examination versus measuring the
each category of OM recommenda- indicate whether they agreed with outcome of intervention. Further-
tion and indicate their agreement by the revised recommendation. The more, the group eliminated mea-
a “yes” or “no” response. This pro- final vote resulted in 100% consen- sures where there was overlap in a
cess of critical review constituted sus for all OM recommendations. construct. For example, the Two-,
round 2 of the Delphi process. Based The Figure provides an overview of Three-, and Five-Minute Walk Tests
upon prior literature, which suggests the task force charges and the pro- were eliminated, and only the Six-
that 70% to 80% agreement is con- cess the group developed and used Minute Walk Test was included for
sidered a reasonable guideline for to address them. review. A final list of 56 OMs was
this type of data analysis, 80% selected for detailed review and rec-
agreement was sought for each Outcomes ommendation. Task force members
recommendation.43 The task force developed an initial agreed that if review of the literature
list of 77 potential OMs for review, uncovered additional OMs that
Delphi Consensus including those recommended by would be appropriate for review,
Conference Call the APTA Neurology Section’s Stroke these could be added at a later point.
For those recommendations reach- Special-Interest Group (25) and by However, no additional measures
ing less than 80% agreement, the the E-L NC (19), OMs included in 2 were identified.
co-chairs (G.P.Z. and J.E.S.) indepen- Web-based repositories of stroke
dently conducted an additional OMs (45),31,32 and OMs included in
Following the modified 3-round Del- Discussion more, dissemination will occur via a
phi process, 100% consensus was One of the goals of the task force collaborative agreement with Reha-
reached among the 7 task force was to develop recommendations bilitation Measures Database (RMD),
members for the OMs recommenda- regarding the use of OMs for individ- a Web-based repository of informa-
tions in the areas of practice setting uals poststroke. Through the use of tion on OMs. Beginning in 2013,
and patient acuity (Tab. 3). The list a Delphi process, consensus was RMD will include a category of “Pro-
includes measures that capture the reached among 7 physical therapists fessional Association Recommenda-
ICF domains body structure/func- with clinical and research expertise tions” to each OM listed.32 In addi-
tion (21), activity (28), and participa- in stroke rehabilitation. The review tion, the collaboration with RMD
tion (14). Some of the reviewed mea- criteria and recommendation cate- may help address the concern about
sures captured multiple ICF domains. gories reported are consistent with updating OM information, as the site
Fourteen OMs (25%) received a rat- established psychometric stan- conducts regular reviews to ensure
October 2013
Students Students
Should Should Recommended
Body Learn to Be for Use in
Structure/ Inpatient Administer Exposed Stroke
Outcome Measure Function Activity Participation Acute Rehabilitation Home SNF OP Acute Subacute Chronic OM to OM Research
Five Times Sit-to-Stand ● ● 3 3 3 3 3 3 3 3 ● ●
Test51
Six-Minute-Walk Test52 ● ● 4 4 4 4 4 4 4 4 ● ●
Activities-specific ● ● 1 3 3 3 3 1 3 3 ● ●
Balance Confidence
(ABC) Test56
Ashworth scale58 ● 3 3 3 3 3 3 3 3 ● ●
Assessment of Life ● 1 3 3 3 3 1 3 3 ● ●
Habits59
Balance Evaluation ● ● 2 2 2 2 2 2 2 2 ●
Systems Test
(BESTest)60
Volume 93
Box & Blocks Test53 ● 3 3 3 3 3 3 3 3 ●
Canadian Occupational ● ● 1 2 2 2 2 2 2 2 ●
Performance
Measure63
Number 10
Chedoke Arm and ● 1 1 1 1 1 1 1 1 ●
Hand Activity
Inventory64
Chedoke-McMaster ● 3 3 3 2 3 3 3 3 ●
Stroke Assessment65
Physical Therapy f
Dynamometry67 ● 1 3 1 1 3 3 3 3 ● ●
(Continued)
1389
Outcome Measures for Individuals With Stroke
1390
Continued
f
ICF Category Practice Setting Patient Acuity Education
Students Students
Should Should Recommended
Body Learn to Be for Use in
Structure/ Inpatient Administer Exposed Stroke
Outcome Measure Function Activity Participation Acute Rehabilitation Home SNF OP Acute Subacute Chronic OM to OM Research
Physical Therapy
EuroQOL68 ● 1 3 3 3 3 1 3 3 ● ●
Fugl-Meyer Assessment ● 4 4 4 4 4 4 4 4 ● ●
of Motor
Volume 93
Performance–Lower
Extremity Subscale70
Fugl-Meyer Assessment ● 3 3 3 3 3 3 3 3 ● ●
of Motor
Performance–Upper
Number 10
Extremity Subscale70
Fugl-Meyer Sensory ● 1 1 1 1 1 1 1 1 ●
Examination71
Outcome Measures for Individuals With Stroke
Functional Ambulation ● 2 3 2 2 2 3 2 2
Categories72
Functional ● 2 4 2 2 2 4 2 2 ● ●
Independence
Measure (FIM)73
Goal Attainment ● 2 4 2 2 2 4 2 2 ●
Scale75
Hi-Level Mobility ● 2 2 2 2 2 2 2 2 ● ●
Assessment Tool
(HiMAT)76
Modified Fatigue ● 1 1 2 2 2 1 2 2 ●
Impact Scale78
Modified Rankin ● 3 3 3 3 3 3 3 3 ●
Scale79
Motricity Index81 ● 2 2 2 2 2 3 2 2 ●
(Continued)
October 2013
Downloaded from https://academic.oup.com/ptj/article/93/10/1383/2735565 by guest on 06 April 2023
Table 3.
Continued
ICF Category Practice Setting Patient Acuity Education
October 2013
Students Students
Should Should Recommended
Body Learn to Be for Use in
Structure/ Inpatient Administer Exposed Stroke
Outcome Measure Function Activity Participation Acute Rehabilitation Home SNF OP Acute Subacute Chronic OM to OM Research
Nottingham ● 1 2 2 2 2 2 2 2 ● ●
Assessment of
Somatosensation83
Orpington Prognostic ● 4 4* 1 1 1 4 4* 1 ● ●
Scale84,b
Postural Assessment ● 4 4 4 4 4 4 3 1 ● ●
Scale for Stroke
Patients85
Rating of Perceived ● 1 1 1 1 1 1 1 1
Exertion86
Reintegration to ● 1 1 2 1 2 2 2
Normal Living87
Rivermead Assessment ● 1 1 1 1 1 1 1 1 ●
of Somatosensory
Performance88
Rivermead Motor ● 3 3 3 3 3 3 3 3 ●
Assessment89
Semmes-Weinstein ● 2 2 2 2 2 2 2 2 ●
monofilaments91
SF-3692 1 3 3 3 3 1 3 3
Volume 93
● ● ●
Stroke Adapted ● 1 1 3 3 3 1 3 3 ● ●
Sickness Impact
Scale–3093
Number 10
(SIS)94
Stroke Rehabilitation ● 3 3 3 3 3 3 3 3 ● ●
Assessment of
Movement–Mobility
Subscale (STREAM)95
Stroke Rehabilitation ● 4 4 4 4 4 4 4 4 ● ●
Assessment of
Movement–Limb
Physical Therapy f
Subscales
(STREAM)95
1391
Outcome Measures for Individuals With Stroke
(Continued)
Scores for tools that have been “highly recommended” with a rating of 4 are bolded in the table. Asterisk indicates “highly recommended within the first 2 weeks following stroke.” SNF⫽skilled nursing
Recommended
severity. Although clinicians may use
for Use in
Research
Stroke
clinical judgment, their documenta-
●
tion must indicate how they deter-
mined the level of severity. Easy
access to and use of recommended
Students
Exposed
to OM
Be
●
pists’ compliance with the require-
Education
Learn to
Should
Medicaid beneficiaries.
OM
facility, OP⫽outpatient, V̇O2max⫽maximum oxygen consumption, SF-36⫽Medical Outcomes Study 36-Item Short-Form Health Survey questionnaire.
previously to enhance comprehen-
Patient Acuity
3
quantify the concepts of interest in
The Orpington Prognostic Scale is a predictive measure of recovery and needs to be conducted within the first 2 weeks poststroke.
clinical trials.22 Although the authors
Acute
V̇O2max100
Continued
(TUG)66
Table 3.
Scale96
Scale99
Test101
template and the definitions of rec- of tools and a consistent language to 2 Herbert R, Jantvedt G, Mead J, et al. Out-
come measures measure outcomes, not
ommendation categories will allow capture and describe body function/ effects of interventions [editorial]. Aust J
individual physical therapists or facil- structure, activity, and participation Physiother. 2005;51:3– 4.
ities to examine existing or newly limitations poststroke. The use of a 3 Craik RL. Thirty-Sixth Mary McMillan Lec-
ture: Never satisfied. Phys Ther. 2005;85:
developed OMs to determine appro- clearly defined and comprehensive 1224 –1237.
priateness. The ability to decide, as a assessment template as used here 4 Duncan PW, Jorganson HS, Wade DT.
department or service, which OMs may facilitate the pooling of data on Outcome measrues in acute stroke trials:
a systematic review and some recom-
to use has been cited as a key factor OMs and contribute the necessary mendations to improve practice. Stroke.
in successful clinical implementation evidence for the determination of 2000;31:1429 –1438.
of OMs.19 Optimally, these OM rec- best practice guidelines. The explicit 5 Haigh R, Tennant A, Biering-Sørensen F,
et al. The use of outcome measures in
ommendations may be incorporated description of the process used for physical medicine and rehabilitation
into proposed strategies to enhance developing an evaluation template within Europe. J Rehabil Med. 2001;33:
17 Kay TM, Myers AM, Huijbregts MP. How 31 Guide to Physical Therapist Practice, 46 Sullivan JE, Pinto-Zipp G, Kluding PM,
far have we come since 1992? A compar- With Catalog of Tests and Measures et al. Neurology Section outcome mea-
ative survey of physiotherapists’ use of [CD-ROM]. Version 1.1. Alexandria, VA: sure recommendations. APTA’s Neurology
outcome measures Physiother Can. American Physical Therapy Association; Section website. Available at: http://www.
2001;53:268 –281. 2003. neuropt.org/go/healthcare-professionals/
neurology-section-outcome-measures-
18 Stevens JGA, Beurskens AJMH. Imple- 32 Heinemann A. Rehabilitation Measures recommendations. Accessed May 26,
mentation of measurement instruments Database. Available at: http://www. 2011.
in physical therapist practice: develop- rehabmeasures.org/default.aspx. Accessed
ment of a tailored strategy. Phys Ther. May 15, 2011. 47 APTA. Tests and measures. PTNow web-
2010;90:953–961. site. Available at: http://www.ptnow.
33 Geriatric Examination Toolkit. Available org/ClinicalTools/Tests.aspx. Accessed
19 Huijbregts MP, Myers MA, Kay T, Gavin at: http://web.missouri.edu/⬃proste/ February 23, 2013.
T. Systematic outcome measurement in tool/. Accessed May 13, 2011.
clinical practice: challenges experienced 48 Department of Health and Human Ser-
34 Teasell R, McClure A, Salter K, Krugger
by physiotherapists. Physiother Can. vices. Implementing the claims-based
H. Clinical assessment tools. Evidence-
2002;54:25–36. data collection requirement for outpa-
Based Review of Stroke Rehabilitation tient therapy services—section3005(g)
20 Abrams D, Davidson M, Harrick J, et al. website. Available at: http://www.ebrsr.
59 Poulin V, Desrosiers J. Reliability of the 75 Gordon AB, McMulkin ML, Baird GO. 88 Winward CE, Halligan PW, Wade DT.
Life-H satisfaction scale and relationship Modified goal attainment scale outcomes The Rivermead Assessment of Somato-
between participation and satisfaction for ambulatory children: with and with- sensory Performance (RASP): standard-
of older adults with disabilities. Disabil out orthopedic surgery. Gait Posture. ization and reliability data. Clin Rehabil.
Rehabil. 2009;31:1311–1317. 2011;33:77– 82. 2002;16:523–533.
60 Leddy AL, Crowner BE, Earhart GM. 76 Williams G, Robertson V, Greenwood K, 89 Adams SA, Pickering RM, Ashburn A,
Functional Gait Assessment and Balance et al. The concurrent validity and respon- et al. The scalability of the Rivermead
Evaluation System Test: reliability, valid- siveness of the High-Level Mobility Motor Assessment in nonacute stroke
ity, sensitivity, and specificity for identi- Assessment Tool for measuring the patients. Clin Rehabil. 1997;11:52–59.
fying individuals with Parkinson disease mobility limitations of people with trau- 90 Carlson J, Ochoa S, Haro JM, et al. Adap-
who fall. Phys Ther. 2011;91:102–113. matic brain injury. Arch Phys Med Reha- tation and validation of the Quality-of-Life
bil. 2006;87:437– 442.
61 Blum L, Korner-Bitensky N. Usefulness of Scale: satisfaction with life domains scale
the Berg Balance Scale in stroke rehabil- 77 Bovend’Eerdt TJ, Dawes H, Johansen- by Baker and Intagliata. Compr Psychia-
itation: a systematic review. Phys Ther. Berg H, et al. Evaluation of the Modified try. 2009;50:76 – 80.
2008;88:559 –566. Jebsen Test of Hand Function and the 91 Collins S, Visscher P, De Vet HC, et al.
University of Maryland Arm Question-
62 Tyson SF, DeSouza LH. Development of Reliability of the Semmes-Weinstein
Appendix.
StrokEDGE Outcome Measure Review Forma
Instrument name:
Type of measure:
_____ Performance-based _____ Self-report
Instrument properties:
Ceiling/floor effects
Instrument use:
Equipment required
Time to complete
Limitations
Recommendations:
Practice Setting: Patient Acuity: Entry-Level Education: Is this OM appropriate for research
● Acute ● Acute (⬍2 months since stroke) ___ Students should learn to administer OM use?
● Inpatient rehabilitation ● Subacute (2–6 months since stroke) ___ Students should have knowledge of OM ___ Yes ___ No
● Home care ● Chronic (⬎6 months since stroke)
● Skilled nursing
● Outpatient
References
a
This form was adapted from the Section on Research Evidence Database to Guide Effectiveness (EDGE) Task Force template. ICF⫽International Classification
of Functioning, Disability and Health, MCID⫽minimal clinically important difference, MDC⫽minimal detectable change, OM⫽outcome measure.