Professional Documents
Culture Documents
Ped Functional Outcome Measures
Ped Functional Outcome Measures
20
Pediatric Functional
Outcome Measures
OVERVIEW
This article was supported in part by grants Hl33B80009 and Hl33G80043 from the
National Institute on Disability and Rehabilitation Research, US Department of
Education .
Physical Medicine and Rehabilitation Clinics of North America- Vol. 2, No. 4, November 1991 689
690 STEPHEN M. HALEY ET AL.
Definition of Function
Surprising similarities exist across many diverse disciplines re-
garding the general definition of functional skills in the daily lives of
children. Functional skills are viewed as essential activities required
in the child's natural environments of home and school. 13 Many essen-
tial activities of daily life are common to all children, such as commu-
nication, personal care, ambulation, transfers, and manipulation. Other
functional activities may be more individual and support the needs
and desires of the child, such as play activities and type of social
interaction. The successful integration of the child with disabling con-
ditions into the home and school environment often depends upon the
child's ability to perform essential functional activities independently
in a safe and timely manner.
The assessment of the child's functional skills has a different focus
than most other clinical measures used in pediatrics. The individual
child in the context of the environment is the unit of analysis rather
than a particular component ability. A measure of functional indepen-
dence is a direct measure of the impact of physical and cognitive
deficits on the child's life. Children's functional abilities are viewed as
"moving targets" that expand and become increasingly complex as
children develop and mature.76 Furthermore, functional performance
following rehabilitation may depend highly upon the type of setting to
which the child returns and the availability and extent of family re-
sources.19· 21
The most widely accepted definition of function in the rehabilita-
tion literature is the one provided by the World Health Organization
(WH0). 99 In this framework, function is tied to the concept of disabil-
ity and is concerned with the restriction of compound, integrated
PEDIATRIC FUNCTIONAL OUTCOME MEASURES 691
FUNCTIONAL DOMAIN
Motor
performance
•
Transitions School
attendance
Motor control Transfers
Social
Pre-functional Body activities
determinants movements
Transport Mobility
Self-initiated
movements Self-care Endurance
CONCEPTUAL FRAMEWORKS
'°00
Name._ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __
Chronological Age _ _ _ _ Interview/lest d a t e - - - - - - -
Low
Ability
Mobility
High Ability
.-~~.--~~-.-~~-,-~~--,-~~--,,-~~.-~~.--~~---.-~~-,-~~--,-~~~.-~~~~~~
5
4
3
2
Low Dowstairs
Ability
Social Function
5
4
Figure 2. Example of item profile of functional skills of a 3-year-old child, using the PEDI. (Single form divided to fit page. From Haley SM,
Baryza MJ: A hierarchy of motor outcome assessment: Self-initiated movements through adaptive motor function. Infants and Young Children 3: 1,
1990: with permission.)
O'l
(,o
(,o
~ Name Chronological Age _ _ _ _ Interview/test date _ _ _ _ _ __
0
Caregiver Assistance I Modifications
Self-Care • =3yr.
5 Independent
4 Supervision/Setup
3 Minimal Assistance
2 Moderate As~stance
1 Maximal Assistance
OTotal Assistance
3 Extensive
2 Rehab Equipment
1 Non-specialized
0 No Modifi=tions
Mobility
5 Independent
4 Supervision/Setup
3 Minimal Assistance
2 Moderate Assistance
1 Maximal Assistance
0 ·Total Assistance
3 Extensive
2 Rehab Equipment
1 Non-specialized
0 No Modifications
Social Function
5 Independent
4 Supervision/Setup
3 Minimal Assistance
2 Moderate Assistance
1 Maximal Assistance
0 Totol Assistance
3 Extensive
2 Rehab Equipment
1 Non·specialized
0 No Modifications
Figure 3. Example of item profile of caregiver assistance and modifications of a 3-year-old child, using the PEDI. (Single form divided to fit page.
From Haley SM, Baryza MJ: A hierarchy of motor outcome assessment: Self-initiated movements through adaptive motor function. Infants and Young
Children 3:1, 1990; with permission.)
-1
0
~
702 STEPHEN M. HALEY ET AL.
CHILD ENVIRONMENT
Development Setting
level Task
Experiences T conditions
Social
support
Impairments Child's Modifications Child's
Functional Functional
Capacity Performance
Figure 4. Conceptual model of pediatric disability: factors affecting functional capa-
bility and performance in children.
CONTENT DOMAIN
(continued)
706 STEPHEN M. HALEY ET AL.
MEASUREMENT DIMENSIONS
MODE OF ADMINISTRATION
MEASUREMENT PROPERTIES
Standardization
Standardization refers to the explicit designation of administration
or interview procedures, availability of strict guidelines for scoring,
provision of technical information such as reliability and validity data
to support specific clinical applications, stated qualifications and train-
ing procedures of the examiner, and performance data from normative
or comparative populations. One of the most obvious deficiencies in
functional scales developed by rehabilitation practitioners for adults
and children has been the lack of standardization. 51 The requirements
and resources needed to standardize an outcome measure are exten-
sive, and often clinicians have opted to use outcome measures with
limited or nonexistent standardization properties. Although use of
functional outcome measures with less than optimal standardization
properties may be necessary at this time, clinicians can play an ex-
tremely important role in improving the standardization of functional
outcome measures. Collaboration between clinicians and test de-
velopers is needed to collect the enormous amount of clinical data
required for reliability studies, clinical validation, and the norming
process. 17
A particularly formidable task in the standardization process of
pediatric functional outcome measures is the development of perfor-
mance data on a normative or comparative sample. Developmental
tests used by many practitioners in pediatric rehabilitation have tradi-
tionally been norm-referenced; that is, standards of what is typical
performance for a child at a given age are used for comparison. An
important property of discriminative functional outcome measures is
the determination of age-related functional performance and caregiver
dependence. Since the temporal pattern of neurologic impairments
may be static, transient, or progressive, 32 the provision of a norm-based
comparison would help identify the rate and pattern of functional
improvement or deterioration in children.
Although norms based on nondisabled populations are useful for
some purposes, potentially more valuable referent groups for clinical
comparisons are populations of children treated in rehabilitation. Per-
formance data on these referent groups could provide an analysis of the
performance of an individual child in relation to age-matched peers
with similar diagnoses. Unfortunately, such disability-comparison data
have been collected for only a few childhood diagnoses, such as for
children with myelomeningocele. 89
Many of the functional and activities of daily living scales used in
pediatric rehabilitation are criterion-referenced tests, which examine
individual performance in relation to external standards. These stan-
dards may be directly related to task analyses of functional items and
often lead into instructional strategies and the identification of factors
that restrict the development of functional independence. Criterion-
referenced outcome measures are most useful for evaluation and treat-
ment planning.
712 STEPHEN M. HALEY ET AL .
Practicality
Although this is not strictly a measurement property, functional
outcome measures for routine clinical use need to be as practical as
possible. Clinicians in a rehabilitation service setting must realize,
however, that assessment in pediatric disability is complex and that
oversimplified outcome measures do not provide essential information
for adequate treatment planning or monitoring of progress. Outcome
measures are more readily accepted if their relevance to treatment and
program decisions is unmistakably clear. The collection, storing, and
retrieval of data from functional outcome measures can be facilitated
by the use of computers and a well-designed data management plan.
Efficient use of functional outcome data is best achieved if clinical
staff, middle management, and senior administration officials have all
made strong commitments to the implementation and maintenance of a
functional outcome data system. 86
ALTERNATIVE APPROACHES
Aggregate Scores
One of the most important advantages in the use of standardized
pediatric functional outcome measures is the identification of an aggre-
gate index of performance. The advantages of having an overall score
to summarize performance include the facilitation of interpreting com-
plex data, the rapid comparison of performance changes, and the abil-
ity to use individual data in group comparisons. 49 Many of the develop-
mental and adaptive instruments used with children have been
standardized on a normative sample and thus provide a series of age-
related scores to assess performance. In general, most functional as-
sessment instruments used in rehabilitation either use implicit
weights 63 or simply derive summary scores from adding ordinal scale
ratings. Unfortunately, using unsubstantiated implicit weighting
schemes and simple additive scoring procedures may provide a very
misleading index of a child's functional status or functional change
over time. Recently, this issue has emerged as a major challenge to the
appropriateness of summary scores in a number of widely used func-
tional outcome measures for adults and children.68 • 100
Rasch Model
Development of new functional outcome measures in pediatric
rehabilitation can be enhanced by use of a test development technol-
ogy that organizes items into hierarchical ability scales. By developing
ability scales of functional items, it is possible to avoid many of the
summary score problems inherent in other functional outcome mea-
sures. The s.gecific measurement technology is referred to as the Rasch
IRT model. 2 A primary purpose of this model is to aid in the construc-
tion of sound testing instruments through assessing the extent to which
functional items fit a hypothesized hierarchical, unidimensional struc-
ture.
A hierarchical test attempts to define functional performance as a
set of sequential tasks that represent increasingly more complicated
cumulative functions along a single dimension. Each independent
dimension is then operationally defined in terms of a continuum ofless
difficult to more difficult tasks. In this model, mastery of lower level
tasks is requisite for success in higher level tasks. Figure 5 presents a
hierarchical model of the Mobility items in the Caregiver Assistance
section of the PEDI from preliminary normative data. Note that the
items are arranged in a scale in which easy items (indoor locomotion)
and difficult items (car transfers) are identified. This scale provides the
framework from which a summary score for Caregiver Assistance in
mobility can be developed.
The Rasch model provides a mechanism for identifying child sta-
tus through the placement of child ability measures along dimensions
(domains) of functional behavior. A valid ability measure requires a
718 STEPHEN M. HALEY ET AL.
High Difficulty
5 Car transfers (4.86)
0
Low Difficulty
Figure 5. Preliminary difficulty values and scale hierarchy for mobility items on
PEDI.
relatively low score for children with low performance and a relatively
high score for children with high performance. However, if a child
receives a low score that results from accomplishing a few of the most
difficult tasks while not accomplishing relatively easier ones, then the
summary score does not adequately reflect the child's true ability.
Rasch models provide goodness-of-fit statistics that test these assump-
tions of congruence between one's observed clinical score and the
expected level of performance represented by that summary score. 101
The scoring system and its success in identifying performance levels
depend upon the validity of the scale for relevant populations of chil-
dren. In the example given, this scale was very stable for nondisabled
children. Future data collection in the development of the PEDI will
establish the validity of the scale for children with a wide variety of
disabilities. If the scales developed for both normative and clinical
groups fit the Rasch model, clinicians will be able to represent a child's
performance accurately with a summary index and chart progress in a
meaningful manner as functional performance undergoes changes.
REFERENCES
1. Achenbach TM, Edelbrock C: Manual for the Child Behavior Checklist and Re-
vised Child Behavior Profile. Burlington, VT, University of Vermont Depart-
ment of Psychiatry, 1983
2. Alexander JL, Fuhrer MJ: Functional assessment of individuals with physical
impairments. In Halpern AS, Fuhrer MJ (eds): Functional Assessment in Reha-
bilitation. Baltimore, Paul H. Brookes, 1984, p 45
3. Allen D: Measuring rehabilitation outcomes for infants and young children: A
family approach. In Fuhrer MJ (ed): Rehabilitation Outcomes Analysis and
Measurement. Baltimore, Paul H . Brookes, 1987, p 185
4. Alpern G, Boll T, Schearer M: Developmental Profile II. Los Angeles, Western
Psychological Services, 1986
5. American Psychological Association: Standards for Educational and Psychological
Testing. Washington, DC, American Psychological Association, 1985
6. American Physical Therapy Association : Standards for Tests and Measurements in
Physical Therapy Practice. Alexandria, VA, American Physical Therapy Associa-
tion, 1991
7. American Physical Therapy Association: Quality Assurance Manual. Alexandria,
VA, American Physical Therapy Association, 1990
8. Bagnato SJ, Neisworth JT, Munson SM: Linking Developmental Assessment and
Early Intervention: Curriculum-Based Prescriptions. Rockville, MD, Aspen
Publishers, 1989
9. Bagnato SJ, Neisworth JT: The Perceptions of Developmental Skills (PODS) Pro-
file. University Park, PA, Penn State HICOMP Preschool Project, 1977
10. Balthazar EE: Balthazar Scales of Adaptive Behavior. Palo Alto, CA, Consulting
Psychologists Press, 1976
11. Batavia Al, DeJong G: Developing a comprehensive health services research
capacity in physical disability and rehabilitation. J Dis Policy Studies 1:37, 1990
720 STEPHEN M. HALEY ET AL.
12. Brigance A: Brigance Diagnostic Inventory of Early Deve lopment. North Billerica,
MA, Curriculum Associates, 1978
13. Brown L, Branston MB, Hamre-Nietupski S, et al: A strategy for developing
chronological-age-appropriate and functional curricular content for severely
handicapped adolescents and young adults. J Spec Ed 13:81, 1979
14: Brown M, Gordon WA, Diller L: Rehabilitation indicators. In Halpern AS, Fuhrer
MJ (eds): Functional Assessment in Rehabilitation. Baltimore, Paul H. Brookes,
1984, p 187
15. Bruininks RH, Woodcock RW, Weatherman RF, et al: Scales of Independent
Behavior. Allen, TX, DLM Teaching Resources, 1984
16. Campbell SK: Assessment of the child with CNS dysfunction. In Rothstein JM (ed):
Measurement in Physical Therapy. New York, Churchill Livingstone, 1985, p
207
17. Campbell SK: Measurement in developmental therapy: Past, present, and future.
Phys Occup Ther Pediatr 9:1, 1989
18. Capute AJ, Biehl RF: Functional developmental evaluation: Prerequisite to reha-
bilitation. Pediatr Clin North Am 20:3, 1973
19. Christiansen CH, Schwartz RK, Barnes KJ: Self-care: Evaluation and management.
In DeLisa JA, Currie DM, Gans BM, et al (eds): Rehabilitation Medicine: Prin-
ciples and Practice. Philadelphia, JB Lippincott, 1988, p 95
20. Clark MS, Caudrey DJ: Evaluation of rehabilitation services: Use of goal at-
tainment scaling. Int Rehabil Med 5:41, 1983
21. Clydesdale TT, Faas IJ, Kilgore KM , et al: Social dimensions to functional gain in
pediatric patients. Arch Phys Med Rehabil 71:469, 1990
22. Coley IL: Pediatric As,sessment of Self-Care Activities. St. Louis, CV Mosby, 1978
23. Diller L, Ben-Yishay Y: Assessment in traumatic brain injury. In Bach-y-Rita P
(ed): Traumatic Brain Injury. (Comprehensive Neurologic Rehabilitation, vol. 2.)
New York, Demos, 1989, p 161
24. Feinstein AR, Josephy BR, Wells CK: Scientific and clinical problems in indexes of
functional disability. Ann Intern Med 105:413, 1986
25. Feldman A, Haley SM, Coryell J: Concurrent and construct validity of the Pediatric
Evaluation of Disability Inventory. Phys Ther 70:602, 1990
26. Fischer K: A theory of cognitive development: The control and construction of
hierarchies of skill. Psycho! Rev 87 :477, 1980
27. Fisher AG: Assessment of motor and process skills manual. Unpublished test
manual. Departme nt of Occupational Therapy, University of Illinois at Chicago,
1989
28. Fleischer KH, Belgredan JH, Bagnato SJ, et al: An overview of judgment-based
assessment. Top Early Childhood Spec Ed 10:13, 1990
29. Frey WD: Functional outcome: Assessment and evaluation. In DeLisa JA (ed):
Rehabilitation Medicine: Principles and Practice. Philadelphia, JB Lippincott,
1988
30. Furano S, O'Reilly K, Hoska CM, et al: Hawaii Early Learning Profile. Palo Alto,
VORT Corporation, 1985
31. Furher MJ: Overview of outcome analysis in rehabilitation. In Furber MJ (ed):
Rehabilitation Outcomes Analysis and Measurement. Baltimore, Paul H.
Brookes, 1987, p 1
32. Gans BM: Rehabilitation of the disabled child. In DeLisa JL (ed): Rehabilitation
Medicine: Principles and Practice. Philadephia, JB Lippincott, 1988, p 391
33. Garwood SG: (Mis)use of developmental scales in program evaluation. Top Early
Childhood Spec Ed 1:61, 1982
34. Glass RM: Program evaluation. In England B, Glass RM, Patterson CH (eds):
Quality Rehabilitation: Results-Oriented Patient Care. Chicago, American Hos-
pital Association, 1989, p 19
35. Granger CV, Hamilton BB, Kayton R: Guide for the use of the Functional Indepen-
dence Measure (Wee FIM) of the Uniform Data Set for medical rehabilitation.
Buffalo, Research Foundation, State University of New York, 1989
36. Granger CV, Hamilton BB, Keith RA, et al: Advances in functional assessment for
medical rehabilitation. Top Geriatr Rehabil 1:59, 1986
PEDIATRIC FUNCTIONAL OUTCOME MEASURES 721
37. Gresham FM , Elliot SN: The Social Skills Rating System (SSRS). Circle Pines,
MN, American Guidance Service, 1990
38. Guccione AA, Cullen K, O'Sullivan SB: Functional assessment. In O'Sullivan SB,
Schmitz TJ (eds): Physical Rehabilitation Assessment and Treatment, ed 2.
Philadelphia, FA Davis, 1988, p 219
39. Haley SM, Baryza MJ: A hierarchy of motor outcome assessment: Self-initiated
movements through adaptive motor function. Infants and Young Children 3:
1, 1990
40. Haley SM, Faas RM, Coster WJ, et al: Pediatric Evaluation of Disability Inventory
(PEDI). Boston, New England Medical Center, 1989
41. Haley SM, Hallenborg S, Gans BM: Functional assessment in young children with
neurological impairments. Top Early Childhood Spec Ed 9:106, 1989
42. Haring NG, White OR, Edgar EB, et al: Uniform Performance Assessment System.
San Antonio, The Psychological Corporation, 1981
43. Harris SR: Efficacy of physical therapy in promoting family functioning and func-
tional independence for children with cerebral palsy. Pediatr Phys Ther 2:
160, 1990
44. Harris SR: Early intervention: Does developmental therapy make a difference?
Top Early Childhood Spec Ed 7:20, 1988
45. Hartley L: Assessment of functional communication. In Tupper DE, Cicerone KD
(eds): The Neuropsychology of Everyday Life: Assessment and Basic Competen-
cies. Boston, Kluwer, 1990, p 125
46. Hedrick DL, Prather EM, Tobin AR: Sequenced Inventory of Communication
Development. Seattle, University of Washington Press, 1975
47. Hresko WP, Brown L: Test of Early Socioemotional Development. Austin, TX,
Pro-Ed, 1984
48. lgnjatovic-Savic N, Kovac-Cerovic T, Plut D, et al: Social interaction in early
childhood and its developmental effects. In Valsiner J (ed): Parental Cognition
and Adult-Child Interaction. Voll: Child Development Within Culturally Struc-
tured Environments. Norwood, NJ, Ablex, 1988, p 89
49. Jette AM: State of the art in functional status assessment. In Rothstein JM (ed):
Measurement in Physical Therapy. New York, Churchill Livingstone, 1985,
p 137
50. Johnson-Martin N, Jens KG, Attermeier SM: The Carolina Curriculum for Handi-
capped Infants and Infants at Risk. Baltimore, Paul H. Brookes, 1986
51. Keith RA: Functional assessment measures in medical rehabilitation: Current
status. Arch Phys Med Rehabil 65:74, 1984
52. Kerner JF, Alexander J: Activities of daily living: Reliability and validity of gross
vs. specific ratings. Arch Phys Med Rehabil 62: 161, 1981
53. Kirshner B, Guyatt G: A methodological framework for assessing health indices.
J Chron Dis 38:27, 1985
54. Klein RM, Bell B: Self-care skills: Behavioral measurement with Klein-Bell ADL
Scale . Arch Phys Med Rehabil 63:335, 1982
55. Lambert NM, Windmiller M, Tharinger D, et al: AAMD Adaptive Behavior
Scale- School Edition. Monterey, CA, McGraw-Hill, 1981
56. Law M: Measurement in occupational therapy: Scientific criteria for evaluation.
Can J Occup Ther 54:133, 1987
57. Law M, Usher P: Validation of the Klein-Bell Activities of Daily Living Scale for
children. Can Occup Ther 55:63, 1988
58. Lawton MP: The functional assessment of elderly people . J Am Geriatr Soc 14:
465, 1971
59. Lehr E: Outcome and future directions. In Lehr E (ed): Psychological Manage-
ment of Traumatic Brain Injuries in Children and Adolescents. Rockville, MD,
Aspen Publishers, 1990
60. Levine S, Elzey FF, Thormahlen P, et al: Manual for the T.M.R. School Com-
petency Scales. Palo Alto, CA, Consulting Psychologists Press, 1976
61. Lipsey MW: Design sensitivity: Statistical power for experimental research. New-
bury Park, CA, Sage Publications, 1990
62. Ludlow LH, Haley SM: Polytomous Rasch models for behavioral assessment: The
722 STEPHEN M. HALEY ET AL.