You are on page 1of 10

R E V I E W A R T I C L E

The Clinimetric Properties of


Performance-Based Gross Motor
Tests Used for Children With
Developmental Coordination
Disorder: A Systematic Review
Downloaded from https://journals.lww.com/pedpt by BhDMf5ePHKav1zEoum1tQfN4a+kJLhEZgbsIHo4XMi0hCywCX1AWnYQp/IlQrHD36i5Q5e8D5BvI1AKEYVRZFoyNd6RFe1+tf27YVZArGdg= on 04/02/2020

Leanne M. Slater, BPhty (Hons); Susan L. Hillier, PhD; Lauren R. Civetta, BPhty (Hons), Grad Dip Pub Hlth
Centre for Allied Health Evidence, School of Health Sciences, University of South Australia, Adelaide, South Australia,
Australia

Purpose: Performance-based measures of gross motor skills are required for children with developmental
coordination disorder to quantify motor ability and objectify change. Information related to psychometrics,
clinical utility, feasibility, and client appropriateness and acceptability is needed so that clinicians and research-
ers are assured that they have chosen the most appropriate and robust tool. Methods: This review identified
performance-based measures of gross motor skills for this population, and the research evidence for their
clinimetric properties through a systematic literature search. Results: Seven measures met the inclusion criteria
and were appraised for their clinimetric properties. The Movement Assessment Battery for Children and the
Test for Gross Motor Development (second version) scored highest on appraisal. Conclusions: The 2 highest
scoring measures are recommended in the first instance for clinicians wishing to evaluate gross motor perfor-
mance in children with developmental coordination disorder. However, both measures require further testing
to increase confidence in their validity for this population. (Pediatr Phys Ther 2010;22:170 –179) Key words:
child, developmental coordination disorder, human movement system, motor skills disorders, outcome
measures, psychomotor performance, validation studies as topic

INTRODUCTION and psychological health factors to encompass the World


Historically, outcome measures were used primarily Health Organization’s definition of health.1,2
to assess quality of care through numbers of morbidities, Changes in funding models, management, and na-
mortalities, readmissions, and length of stay.1 More re- tional health strategies have increased the importance of
cently, outcome measures have been developed to assess implementing outcome measures to evaluate interventions
health care interventions by measuring physical, social, used in health care facilities.3,4 Health practitioners are in-
creasingly being pressured to use appropriate outcome
measures to assess patient’s progress and justify funding.4
0898-5669/110/2202-0170 This includes pediatric physiotherapy as children with sus-
Pediatric Physical Therapy pected developmental coordination disorder (DCD) are of-
Copyright © 2010 Section on Pediatrics of the American Physical
Therapy Association. ten referred for gross motor assessment and intervention.
DCD is a term used to describe children who exhibit
Correspondence: Susan L. Hillier, PhD, Centre for Allied Health Evi- insufficient motor coordination skills in comparison with
dence, School of Health Sciences, University of South Australia (City that expected for their chronological age and intellect and
East), GPO Box 2471, Adelaide, South Australia 5001, Australia
(susan.hillier@unisa.edu.au). for which there are no attributable medical disorders.5 The
This systematic review was completed as partial fulfillment of the Bach- motor impairments (MIs) are at a level at which activities
elor of Physiotherapy with Honors by Leanne Slater (Nee Plummer) at the
University of South Australia.
of daily living and/or academic achievement are signifi-
DOI: 10.1097/PEP.0b013e3181dbeff0
cantly negatively affected.5 The prevalence of DCD is esti-
mated to range from 5% to 9% of school-age children.6,7

170 Slater et al Pediatric Physical Therapy


Children with DCD form a heterogeneous group, and that 2 tests that do not measure the same construct do not
individuals tend to be deficient in a variety of motor tasks.8 correlate well (discriminative validity), or by factor analy-
These children commonly withdraw from physical, aca- sis in which statistical analysis demonstrates that the items
demic, and social activities because of their motor deficits, on a test can be grouped to fit into related components or
fear of failure, and peer criticism. Consequently, poor aca- factors.1,15–17
demic performance, low levels of perceived competence, A test is reliable when it demonstrates that test scores
low self-esteem, deficient social skills, and reduced physi- are stable over time (test-retest reliability) and with differ-
cal fitness and strength often ensue.8,9 ent examiners (interrater reliability).1,15–17 A reliable test
Evidence suggests that without intervention, motor will also have internal consistency, where the degree to
deficits and problems associated with DCD are not always which test items all measure the same construct is ade-
outgrown in adolescence and can persist into adult- quate.1,15 Finally, a test should at an appropriate level of
hood.10 –12 Thus, appropriate outcome measures to help difficulty be able to demonstrate change (responsive-
monitor changes in gross motor development in response ness) and be able to accurately discriminate a person
to intervention are required. This will enable health prac- with a positive impairment (sensitivity) or no impair-
titioners to manage individuals with DCD effectively and to
ment (specificity).1,15
justify funding of intervention.
A test that is viable clinically should be practical to
Gross motor skills can be measured through formal
use. Tests that show excellent psychometric properties
and informal means.13 Informal assessments have no standard
may not be feasible due to complicated equipment require-
procedure, are generally flexible, and can provide useful qual-
ments, long administration times, difficult application/
itative information, but they can be time-consuming and are
generally not suitable when comparing results across indi- scoring systems, and/or difficulties with interpretation of
viduals.13 Examples include interviews and general/teacher scores. Additionally, the measure needs to be acceptable
observations.13 Formal tests are standardized with strict and meaningful to the patient/client. Thus, these clinimet-
testing procedures and are used to diagnose, make intervention ric factors also need to be taken into consideration when a
decisions, and/or evaluate intervention.13 Performance-based clinician selects an appropriate test.
tests are a common type of formal measure used to assess There are several performance-based measures used
children’s gross motor skills.14 A performance-based gross clinically and in research to investigate or monitor the mo-
motor measure assesses a child’s ability in a variety of mo- tor coordination of children with DCD. However, it is im-
tor skill domains by determining the child’s performance portant that decisions for the choice of one measure over
on a specific test administration.14 another are based on the principles outlined earlier. Nev-
The quality and weighting of the information gained ertheless, after an extensive search of the literature, no
from an outcome measure depends, in part, on the psycho- reviews were identified that investigated this. Thus, to
metric properties of the test.15 The most trustworthy tools identify performance-based measures of gross motor func-
have a strong level of measurement and established valid- tion and to determine the relative strength of these mea-
ity, reliability, and responsiveness in the population being sures, we conducted secondary research. This was under-
tested.1,15 taken using a systematic review and appraisal approach.
All standardized tests provide a measure that is scaled. The aims were to systematically identify (1) performance-
One definition states that “a measurement is obtained by based outcome measures that assess gross motor skills of
applying a standard scale to variables, thus translating di- children with DCD, (2) literature reporting on the psycho-
rect observations or patient/proxy reports to a numerical metrics of the identified measures in the DCD population
scoring system.”15 Therapists need to ensure that numbers and to evaluate the quality of these studies, and (3) the
obtained from outcome measures are used in a valid and most robust outcome measure based on evaluation of the
meaningful way.15 A test that is valid accurately measures literature identified.
the domain that it is intended to measure.16 Validity can be
demonstrated by showing that the measure correlates sig-
nificantly with another test that measures the same con- METHODS
structs (criterion validity, which can be assessed with con- Inclusion and Exclusion Criteria for Considering
current or predictive validity), experts in the area agree Studies
that the items in the test are representative of the whole
domain that the test claims to measure (content validity), Outcome measures were included in the review if they
the test seems to test what it is meant to by using subjective met the following criteria: (1) a standardized performance-
factors (face validity), and the test measures an abstract based gross motor assessment suitable for children with
concept or construct (construct validity).1,15–17 Acceptable MIs consistent with DCD, (2) printed in English, (3) a test
construct validity is demonstrated when the test identifies that identified DCD and measured changes in gross motor
a characteristic that it claims to measure within a popula- performance of children (for composite tests, at least 50%
tion that is known to have that characteristic (known of the overall suite must be gross motor), (4) for children
group method), by demonstrating that 2 tests that measure older than 4 years, and (5) the most recent version reported
the same construct correlate well (convergent validity), in the published literature searched.

Pediatric Physical Therapy Measures of Gross Motor Skills for Children With DCD 171
Studies were included if they (1) assessed psychomet- Three groups of search terms were used; outcome
ric properties of any of the measures that met the afore- measurement, DCD or associated terms, and psychometric
mentioned inclusion criteria, (2) were published in En- properties (separated by Booleans “OR” and “AND”). A full
glish in a peer-reviewed journal between January 1980 and list of search terms have been included in Table 1. The
February 2008 (the date 1980 was chosen to exclude those search was conducted between February 4 and 8, 2008.
measures that do not reflect current thinking regarding
motor performance13), and (3) if participants were aged Critical Appraisal
between 4 and 16 years. Studies that used normative sam-
Tool to Identify and Evaluate Measures. The Measure-
ples were included when relevant, for example, to gather
ment Critical Appraisal Tool (MCAT) was used to identify
normative data or when the population was representa-
and then evaluate the outcome measures in separate processes
tional, and therefore included children with motor difficul-
(Table 2). This tool was modified to suit the needs of this
ties. Such studies are clearly identified in the results. Stud-
review from a version of the criteria developed by the United
ies were excluded if (1) the majority of participants had
Kingdom’s Clearing House on Health Outcomes.18
been diagnosed with a disorder other than DCD or equiv-
Tool to Appraise the Quality of Studies. The quality
alent DCD term (ie, cerebral palsy, Down syndrome, and
scoring of the studies evaluating each measure was carried
autism were excluded), (2) the performance-based assess-
out using a modified critical appraisal tool from the
ment was used as a criterion measure for a screening tool or
NHMRC Handbook series.19 This tool is referred to as the
nonmotor performance-based test, or (3) the studies were
Quality Critical Appraisal Tool (QCAT) (a copy of the tool
published before 1980 because it was thought that the in-
can be obtained from the authors).
formation would pertain to a generation different from the
current child population and a different philosophical ap-
proach to motor skills. Data Extraction and Synthesis
Descriptive data on the clinimetrics and psychomet-
Search Strategies rics of outcome measures were extracted from the included
A systematic search of computer databases was used studies by the first reviewer and entered into separate
to locate studies. The databases searched were MEDLINE, spreadsheets. Two reviewers then appraised all articles us-
AMED, Meditext, Ausport, Ausportmed, Humanities and ing both the MCAT and the QCAT tools. If disagreements
Social Science Collection, A⫹ Education, CINAHL, Aca- arose between scorers, then a third reviewer was available
demic Search Premier, SPORTdiscus, ERIC, Health Source: to facilitate consensus. This was not necessary.
Consumer Edition, Health Source: Nursing/Academic Edi- The outcome measures quality score (MCAT) was ob-
tion, PsycINFO, Current Contents Connect, Blackwell tained from summing scores for validity (3 points), reli-
Synergy, Cochrane, PEDro, OTseeker, EMBASE, and Sco- ability (3 points), responsiveness (1 point), precision (1
pus. Pearling of the reference lists of all retrieved studies point), client centeredness (2 points), and tester centered-
was also performed. ness (2 points). Half scores were given if part of an item was

TABLE 1
Search Terms Used

Outcome Measures Terms DCD and Alternate Terms Psychometric Terms


Basic Gross Motor Assessment (BGMA) DCD Psychometrica
Basic Motor Ability Test Revised (BMAT-R) Minimal motor dysfunction (MMD) Valida
Bruininks-Oseretsky Test of Motor Proficiency Deficits in attention or motor control and Reliaba
(BOTMP) perception (DAMPS) Responsivea
Cratty’s 6 Category Gross Motor Tests (Cratty) Minimal cerebral dysfunction (MCD) Sensitia
McCarron Assessment of Neuromuscular Minimal brain dysfunction Specifica
Development (MAND) Developmental (dys)praxia Feasibila
Movement Assessment Battery for Children (M-ABC) Motor (dys)praxia Accuraa
Neuro Sensory Motor Developmental Assessment Clumsy kida Scalaba
(NSMDA) Clumsy childa Dimensionaa
Ohio State University Scale of Intra-Gross Motor Perceptual motor dysfunction Factor analysisa
Assessment (OS-SIGMA) Motor skills disordera
Peabody Developmental Motor Scale (PDMS) Sensory integration dysfunction
Sensory Integration Praxis Test (SIPT) Motor
Southern Californian Sensory Integration Test
(SCSIT)
Test of Gross Motor Development (TGMD)
Test of Motor Proficiency (TMP)
Searched separately: Zurich Neuromotor Assessment
(ZNA)
Abbreviation: DCD, developmental coordination disorder.
a
Appropriate truncations were used for specific databases.

172 Slater et al Pediatric Physical Therapy


TABLE 2 ysis, and measurement bias. Three points were allocated to
Measurement Critical Appraisal Tool each area based on set criteria (Table 3). The scores from
Full name of outcome measure:
each area were summed to give a total risk of bias score, the
Abbreviated name: scores were categorized as follows: low risk of bias, score 7
Designer of outcome measure: to 9; moderate risk of bias, score 5 to 6; and high risk of
1. Purpose: Does it have a specific Continue? Y/N
bias, score 3 to 4 (maximum score of 9). Individual studies
aim to measure gross motor
performance in motor impaired were scored and reasoning was reported descriptively.
children? What is it?
2. Background: Is the design Continue? Y/N
performance based and for
RESULTS
fundamental motor skills? Identification of Outcome Measures
3. Population: Does the test Continue? Y/N
measure motor performance in The preliminary search resulted in the identifica-
children older than 4 years? tion of 26 potential assessments that measured motor
What ages have been studied? skills of children. Through consultation with 2 experi-
4. Pathology: Does the test measure Continue? Y/N
motor performance of children
enced pediatric physiotherapists, 13 outcome measures
with DCD? met the 5 outcome measure inclusion criteria listed ear-
5. Number of items: Number of test Continue? Y/N lier, and the other 13 were excluded as they clearly were
items/subscales. Is the gross not designed for children with DCD, were not gross
motor performance ⱖ50% of the
motor performance tests, or were a previous version of
score?
6. Score system: Does the score Continue? Y/N an included measure. If there was any disagreement
system rate performance? State about whether the outcome measure should be ex-
scoring system. cluded, the assessment name was still included in the
7. Equipment requirements
8. Time required to perform
search to be evaluated more thoroughly using the
9. Description: Are the tests Y/N/not stated MCAT. A full list of the 26 measures, with reasons for
adequately described? exclusion, is available from the authors.
10. Normative data/scores: Are Y/N/not stated After the evaluation on the MCAT, a further 7 mea-
norms provided?
11. Validity: Have 3 types of validity Y/N/not stated sures were excluded. The Sensory Integration and Praxis
been established? ie, criterion, Score __/3 Test and its predecessor the Southern California Sensory
face/content, construct/factor Integration Test were excluded because total composite
analysis. scores were less than 50% gross motor based.20 The Test of
12. Reliability: Have 3 types of Y/N/not stated
reliability been established? ie, Score __/3
Motor Proficiency was also excluded because it was only
internal consistency, test-retest used as a screening test.21 No studies meeting the inclusion
reliability, interrater reliability. criteria were retrieved to evaluate the psychometrics of the
13. Responsiveness: Sensitivity, Y/N/not stated Ohio State University Scale of Intra-Gross Motor Assess-
specificity, and floor/ceiling Score __/1
ment, Neurosensory Motor Developmental Assessment,
effects?
14. Precision: Is the precision of the Y/N/not stated Basic Motor Ability Test Revised, or the Cratty 6 Category
outcome measure sound? Score __/1 Gross Motor Tests. An additional outcome measure, the Zu-
15. Client centeredness Y/N/not stated rich Neuromotor Assessment (ZNA), was identified during
Appropriateness: Is the test Score __/2
the pearling process and met the criteria for inclusion.
appropriate? ie, meaningful to
the patient/parent. All the outcome measures reviewed represent the most
Acceptability: Is the test recent versions available in the current literature, with the
acceptable to the client? ie, time, exception of the Movement Assessment Battery for Children
activities carried out. (M-ABC), which has recently been updated in 2007. After
16. Tester centeredness Y/N/not stated
Utility: Has the measure got Score __/2
consultation with 2 experts in pediatric physiotherapy, it was
adequate interpretability, decided that a 12-month period was not sufficient for the
acceptability, and relevance? distribution, use, and testing of the M-ABC-2, and, therefore,
Feasibility: Ease of administration the first version was evaluated. Thus, a total of 7 gross motor
and process? measures were identified: the Basic Gross Motor Assessment
Total score __/12
(BGMA), Bruininks-Oseretsky Test, 2nd ed. (BOT-2),
Abbreviations: DCD, developmental coordination disorder; N, no; M-ABC, the McCarron Assessment of Neuromuscular Devel-
Y, yes.
opment (MAND), Peabody Developmental Motor Scale, 2nd
ed. (PDMS-2), the Test of Gross Motor Development, 2nd ed.
achieved (maximum score of 12; Table 2). Acceptable sta- (TGMD-2), and the ZNA. Table 4 outlines the reviewed clin-
tistical analysis and results for each metric were defined a ical properties of the test.
priori to determine whether each criterion was met posi- Identification of Literature Reporting on the Psy-
tively (available from authors). chometrics of the Identified Measures in the DCD Pop-
Risk of bias (quality scoring using the QCAT) was ulation and Evaluation of the Quality of These Evalua-
determined using 3 defined areas including selection, anal- tive Studies. The number of studies identified, the

Pediatric Physical Therapy Measures of Gross Motor Skills for Children With DCD 173
TABLE 3
Risk of Bias Scoring

Score of Bias Selection Bias Analysis/Statistical Bias Measurement/Assessment Bias


3: Low risk of Population is truly random Analysis conforms to acceptable methodology. Assessors are blinded
bias (where appropriate) and/or Specific definitions and acceptable values (where appropriate),
targeting motor impairment (ascertained from referenced literature) trained/experienced, reliability
children (where appropriate) were attributed to each area in sections 11–16 tested.
OR age-matched controls. of the MCAT. A full description of these
definitions can be obtained from the author.
2: Moderate risk Sample is one of convenience but Analysis is not conventional but plausible. 1–2 of the criteria above are not met.
of bias representation has been
established.
1: High risk of Sample is one of total convenience Analysis is descriptive or incorrect. None of the above criteria are met.
bias and only applicable to that
setting (eg, a clinic sample).
Abbreviation: MCAT, Measurement Critical Appraisal Tool.
The scores from each tool were summed to give a total risk of bias score, the scores were categorized into the following: low risk of bias, score 7–9;
moderate risk of bias, score 5– 6; and high risk of bias, score 3– 4 (maximum score of 9).

TABLE 4
Clinical Properties of Outcome Measures

Outcome Equipment Time for


Measure Age Number of Test Items Score Interpretability Provided Administration
BGMA22 51⁄2–121⁄2 y 8 items ⱖ7 y Raw score converted to percentile ⻫ Not stated
51⁄2 items ⬍7 y or normative score.
BOT-223 4–21 y 53 items (LF) Raw score converted to scale score ⻫ 40–60 min (LF)
13 items (SF) and standard score (complicated 15–20 mins (SF)
conversion system).
M-ABC24 4–12 y 32 items (8 for each age Raw score converted to Impairment ⻫ 20–40 min
group) score and into percentile
(simple conversions).
MAND25 31⁄2 y to 10 items Scores converted to a scaled score, ⻫ Not stated
young adult neuromuscular index, and factor
scores: specific to test
(complicated scoring and
interpretation).
PDMS-226 0–5 y, 11mo 241 items divided into Raw scores converted into Approximately 1⁄2 45–60 min
age-expected fields percentile, age equivalent, and purchased
standardized scores (complicated separately
scoring/conversions).
TGMD-227 3–10 y 12 items Raw scores converted to standard All equipment 15–20 min
score and converted to a gross purchased
motor quotient score and separately
percentile rank.
ZNA28 5–18 y 15 items Conversion of scores via computer ⻫ ⬃20 min
program, raw scores converted to
Z-score and percentile.
Abbreviations: BGMA, Basic Gross Motor Assessment; BOT-2, Bruininks-Oseretsky Test, 2nd ed.; LF, long form; MABC-2, Movement Assessment
Battery for Children; MAND, McCarron Assessment of Neuromuscular Development; PDMS-2, Peabody Developmental Motor Scale, 2nd ed.; SF, short
form; TGMD-2, Test of Gross Motor Development, 2nd ed.; ZNA, Zurich Neuromotor Assessment.
The symbol ⻫ represents equipment provided with kit except for consumables, that is, stopwatch, tape. Note that time given for administration does
not include set up or scoring time. All of the measures have adequate description of items in their manuals.

duplicates, and the studies excluded during the search The quality of the studies (risk of bias) was evaluated
procedure are summarized in the Figure 1. Six manuals using the QCAT. The number of studies for each measure,
meeting the inclusion criteria were identified in the lit- QCAT score ranges, and mean total quality scores with
erature, and 5 were obtained from 2 experienced pedi- standard deviation for each measure are summarized in
atric physiotherapists. The sixth manual for the ZNA Table 5. All studies, except 1, were at a low to moderate risk
was not obtained; however, the authors were contacted for bias in their reporting. The 1 study scoring poorly was
and subsequently referred researchers to studies already a descriptive report of concurrent validity between the M-
acquired. The BGMA manual was written in 1979, and ABC and a balance test. The main methodologic problems
thus was excluded. identified that increased chances of bias in studies were

174 Slater et al Pediatric Physical Therapy


Fig. 1. Flow chart of search results.

TABLE 5
Quality Scores From QCAT on Studies for Each Outcome Measure

Reviewed Outcome Measures


BGMA BOT-2 M-ABC MAND PDMS-2 TGMD-2 ZNA All Scores
Number of studies 1 1a,b 25c 3 3c 3 4 38
Score ranges N/A 7–9 3–9 7–8 7–8 5–8 5–8 3–9
Mean (SD) 7 (N/A) 8 (1.41) 7.28 (1.1) 7.33 (0.58) 7.67 (0.58) 6.33 (1.53) 6.75 (1.26) 7.2 (1.1)
Abbreviations: BGMA, Basic Gross Motor Assessment; BOT-2, Bruininks-Oseretsky Test, 2nd ed.; MABC-2, Movement Assessment Battery for
Children; MAND, McCarron Assessment of Neuromuscular Development; N/A, not applicable; PDMS-2, Peabody Developmental Motor Scale, 2nd ed.;
QCAT, Quality Critical Appraisal Tool; TGMD-2, Test of Gross Motor Development, 2nd ed.; ZNA, Zurich Neuromotor Assessment.
a
Two parts of one study scored separately.
b
One study reports on that specific outcome measure and another reviewed outcome measure.
c
Two studies report on that specific outcome measure and another reviewed outcome measure.

Pediatric Physical Therapy Measures of Gross Motor Skills for Children With DCD 175
lack of information on tester training and/or blinding and Reliability and Responsiveness of Measures
subject recruitment methods. Additionally, many subjects The BGMA has good to excellent test-retest reliability
represented samples of convenience and not true represen- and interrater reliability (r ⫽ 0.97 and 0.99, respectively) in
tations of the DCD/child populations, thus reducing the small samples (n ⫽ 48 and n ⫽ 10, respectively).22 The BOT-2
generalizability of the results. also has demonstrated good to excellent (r ⬎ 0.80) test-retest
and interrater reliability correlations.23 Correlations for
Critical Appraisal of Psychometrics of Each the test-retest24,34,45– 47 and interrater reliability46 – 49 on
Identified Outcome Measure total scores of M-ABC are consistently good to excellent
(r ⫽ 0.72– 0.95) in children developing typically and
Using the MCAT, relevant data on the psychometrics children with MI. The internal consistency of the M-ABC
of the outcome measures were extracted from the 33 arti- was investigated in a single study that showed the items
cles and 5 manuals. Information on the psychometrics of measured different constructs.50 The M-ABC total scores
each outcome measure is outlined briefly here. The mea- are reportedly adequately responsive to change45,51 and
surement critical appraisal scores and types of validity, re- sensitive45,51; however, subtest and individual item scores
liability, and responsiveness established are summarized have only moderate to low responsiveness to change.51
for each outcome measure in Table 6. Information on the The PDMS-2 has demonstrated good internal consis-
population in which validity and reliability were estab- tency and excellent (r ⫽ 0.89) interrater reliability correla-
lished and user/tester centeredness of individual outcome tions.26,41 The TGMD-2 reportedly has excellent internal
measures are also summarized in Table 6. For further de- consistency and interrater reliability27(r ⫽ 0.98). However,
tails, contact the authors. Note that normative data were for interrater reliability, raters used previously scored proto-
provided adequately for all outcome measures. cols and thus only summed and converted scores. Test-retest
reliability correlations of the TGMD-2 were good to excellent27
Validity of Measures (r ⫽ 0.84–0.96). The ZNA test-retest reliability correlations for
timed performance scores were good to moderate28,52–54 (r ⫽
Construct validity of the BGMA was demonstrated 0.65) but only fair for scores based on accessory move-
through factor analysis, all but 1 item loaded onto 7 factors; ments28,52–54 (r ⫽ 0.45). Inter- and intrarater reliability correla-
however, the BGMA has only 8 tasks, suggesting each item tions overall were moderate to excellent for the ZNA; however,
measures a different construct.22 The BOT-2 has moderate some very low correlations (⬍0.1) were obtained on some items
to excellent concurrent validity correlations with the with accessory movement scores.28,52–54
PDMS-2 and BOT of Motor Proficiency and adequate con-
tent and construct validity demonstrated via item and fac-
tor analysis and goodness of fit tests, respectively.23 Con- DISCUSSION
current validity correlation coefficients on the M-ABC with The search strategies identified several performance-
other motor tests were moderate to excellent (r ⫽ 0.50 – based outcome measures that assess gross motor skills of chil-
1.00) in more than 50% of 13 studies, with 10 of the studies dren with DCD. The critical appraisal process has also indi-
of children with DCD/MI.24,29 – 40 The lowest correlation co- cated which tests are the most robust psychometrically and
efficients obtained between the M-ABC and other motor clinically. The studies identified that investigated outcome
tests occurred when the subjects had DCD and/or learning measures were nearly all at a low to moderate risk of bias, and
disabilities.33,35,38 Lower correlations also occurred when thus the results could be considered of acceptable quality.
the M-ABC scores were compared with very specific tests The M-ABC and TGMD-2 scored equally on overall
measuring multiple constructs of a particular skill.31,32,37,40 psychometric and clinical quality ratings. The M-ABC
The PDMS-2 and MAND also have moderate to excel- scored well due to demonstrations of adequate sensitivity
lent concurrent validity (r ⱖ 0.50) with other similar mo- and because it was the only measure to demonstrate re-
tor measures in studies with DCD/MI.30,36,41 Additionally, sponsiveness to change. The M-ABC has also had its psy-
the PDMS-2 has moderate to good concurrent validity cor- chometric qualities tested the most of all the measures in
relations coefficients with gross motor subtests (r ⫽ 0.63– the DCD population. Additionally, the M-ABC is quick to
0.75) in typical populations23,26 and adequate results on set up, administer, and score and requires minimal train-
factor analysis and goodness of fit tests to support its con- ing, making it a viable tool clinically. The suitability of the
struct validity.26 However, for gross motor components, M-ABC’s US normative data has also been investigated for
the MAND only correlated to a fair degree (r ⬍ 0.50) with other cultural groups in a number of studies.39,49,55–59 The
specific motor tests.25,42 In a single study, the TGMD-2 M-ABC, however, requires further support for its validity,
showed support for its concurrent/predictive validity with which should be considered when choosing tests. The M-
fair to good correlation coefficients on its subtests and total ABC also seems to have less stable concurrent validity
scores with a similar motor test27 (locomotion r ⫽ 0.63 and when testing children with DCD and learning disabilities.
object control r ⫽ 0.41, total scores r ⫽ 0.63). The The TGMD-2 has demonstrated good psychometric
TGMD-2 also has acceptable content validity (through ra- qualities27; however, it is important to note that the inves-
tionale, item analyses and discriminative tests) and con- tigations were only from the manual and were conducted
struct validity (through factor analysis).27,43,44 in children who are typically developing; thus, results have

176 Slater et al Pediatric Physical Therapy


TABLE 6
Scores on Outcome Measures From the Measure Critical Appraisal Tool
User Centeredness Tester Centeredness
Validity Achieved (Population in Reliability Achieved
Test Brackets) (Population in Brackets) Responsiveness Precision Appropriate Acceptable Feasibility Utility MCAT (/12)

BGMA Content (partially: expert opinion Internal consistency (all  ⻫ 22 ⻫ 22 ⻫ 22 Partial: time admin 22 Partial: scoring 9
only)22 norms)22 difficulties22
Construct (all norms 7–12 y)22 Test-retest (special ed and

Pediatric Physical Therapy


phys ed: age unknown)22
Interrater (referred for MI, age
unknown)22
BOT-2 Criterion (general population Internal consistency  ⻫23 ⻫23 Partial: long admin23 Partial: training⫹ long Partial: scoring 91⁄2
6–24 y)23 (representative sample)23 admin23 difficulties23
Content (all norms, 4–21 y)23 Test-retest (gen pop, 4–21 y)23
Construct (DCD and general Interrater (gen pop, 4–21 y)23
population 4–12 y)23
M-ABC Criterion (DCD and general Internal consistency (gen pop ⻫ (DCD, 4 ⫺8 y)45,51 ⻫24 ⻫24 ⻫24 ⻫24,30 ⻫24,30,47 101⁄2
population 4–12 y)24,29–40 in 4 y)41
Construct partial, known group Test-retest (4–8 ys DCD, 8–12
methods only (MI, 4 y)24 y gen pop)24,34,45–47
Interrater (MI, 4–12 y)46–49
MAND Criterion (MI, 4–10 y and norms 7 None Partial: (MI sensitivity ⻫25 Partial: interpret Partial: task probs, ? time Partial: training⫹ ? time Partial: scoring 7
y)25,36,42 only)25 probs25 admin25 admin25 difficulties25
Content (gen pop, 7 y)25
Construct (gen pop, 7 y only)25
PDMS-2 Criterion (part norms, gen pop Internal consistency (all  ⻫26 ⻫26 Partial: long admin26 Partial: training⫹26,30 Partial: scoring 81⁄2
and MI, 4–5 y)23,26,30,41 norms)26 difficulties26,30
Content (all norms, 4–5 y)26 Interrater (at risk for MI only
Construct (norms and phys in 4 y)41
disable 4–5 y)26
TGMD-2 Criterion (gen pop elementary Internal consistency (all  ⻫27 ⻫27 ⻫27 ⻫27 ⻫27 101⁄2
school)27 norms)27
Content (all norms)27 Test-retest (gen pop and
children attending a special
program 3–10 y)27
Construct (all norms)27,43,44 Interrater; partial: previous
scored sheets (part norms
3–10 y)27
ZNA None reported, content seems to Test-retest (gen pop,  ⻫28 ⻫28,52–54 ⻫28,52–54 Partial: training⫹28 Partial: scoring 7
be based on previous tests 7–10 y)28,52–54 difficulties28
Interrater (gen pop,
6–12 y)28,52–54
Intrarater (gen pop,
6–12 y)28,52–54

Abbreviations: BGMA, Basic Gross Motor Assessment; BOT-2, Bruininks-Oseretsky Test, 2nd ed.; DCD, developmental coordination disorder; MABC-2, Movement Assessment Battery for Children; MAND,
McCarron Assessment of Neuromuscular Development; MI, motor impaired; PDMS-2, Peabody Developmental Motor Scale, 2nd ed.; TGMD-2, Test of Gross Motor Development, 2nd ed.; ZNA, Zurich neuromotor
assessment.
Gen pop indicates the general population (representing typical children or unspecified group of children); phys disable, physically disabled; all norms, the entire sample used to establish normative data; part
norms, part of sample used to establish normative data; special ed and phys ed, special education and/or special physical education classes; interpret probs, interpretation problems from test scores for patients;
long admin, long administration time of the testing procedures; task probs, some tasks do not seem to be important for children; and training⫹, large amount of extra training required to use test efficiently. The
symbol ⻫ represents adequately achieved in the area; , did not adequately achieve in the area; and ?, unknown. Note: All the measures had normative data for their entire age groups and used ordinal
measurements.

Measures of Gross Motor Skills for Children With DCD 177


not yet been demonstrated to be as pertinent for children Summary and Implications for Research and
with DCD. Additionally, the reliability between raters ad- Clinical Practice
ministering/scoring performance of children on the Overall, none of the outcome measures identified
TGMD-2 is unreported. The TGMD-2 is reasonably quick scored perfectly; all had redeeming factors along with their
to set up and administer, with acceptable additional train- flaws. When choosing the most appropriate test, it is im-
ing requirements for administration and scoring.27 Both portant for a clinician or researcher to consider not only
these tests give standardized scores that are easily ex- which psychometric properties have been demonstrated
plained to the patient/parent, and both have items that adequately but also what population and age group have
children would find acceptable and relevant.24,27 been investigated. Additionally, the practicality of the clin-
The BOT-2 scored third and also demonstrated ac- ical qualities of a test should be taken into account when
ceptable psychometric qualities, but only 1 study on each selecting an assessment for a particular patient.
psychometric area has been performed, and most were on We recommend that the M-ABC and the TGMD-2
children who are typically developing.23 The BOT-2 has should be considered for assessing the gross motor perfor-
been reported to have a confusing scoring system and mance of children with DCD in the first instance, but also
markedly lengthy administration, scoring, and preparation recommend further studies be conducted to clarify the psy-
times.60 However, once calculated, the score can be con- chometric qualities of these tests. Specifically, the M-ABC
veyed to the patient adequately.60 needs further evidence of its validity, and the TGMD-2
The BGMA was ranked fourth in terms of psychomet- requires psychometric testing with children with DCD to
ric and clinical quality. Although there is only a single enable stronger justification for use in this population.
small study investigating the psychometric qualities of
BGMA, this test requires minimal equipment and set up ACKNOWLEDGMENTS
and administration time.22 Additionally, the raw score is The completion of this review in its current form was
simply converted into an easy-to-understand percentile.13 only possible through the support and assistance of Liz
However, the BGMA study lacked some methodological Pridham, Emily Ward, and Auburn McIntyre.
rigor as ages were not specified for some areas and sample
sizes were small; thus, these factors should be noted if REFERENCES
considering this test. 1. Portney LG, Watkins MP. Foundations of Clinical Research: Applica-
The PDMS-2 was fifth on rankings of overall psycho- tions to Practice. 2nd ed. Upper Saddle River, NJ: Prentice-Hall
Health; 2000.
metric and clinical quality. Although it has adequate psy-
2. World Health Organisation. The World Health Report, Reducing Risks,
chometric properties in children who are typically devel- Promoting Healthy Life. Geneva, Switzerland: World Health Organiza-
oping (except for test-retest reliability), its user and tester tion; 2002. http://epsl.asu.edu/ceru/Documents/whr_overview_eng.pdf.
centeredness have been criticized.30 The PDMS-2 has been Accessed May 21, 2008.
3. Australian Institute of Health and Welfare. Australia’s Health 2006.
reported to require extensive training; additionally, it has a
Canberra, Australia: Australian Institute of Health and Welfare; 2006.
long administration time and purportedly can be difficult http://www.aihw.gov.au/publications/aus/ah06/ah06.pdf. Accessed
to administer and score.26,30 Furthermore, the PDMS-2 also May 21, 2008.
lacked sensitivity in identifying/monitoring children with 4. Shapiro M, Setterlund D, Warburton J, et al. The outcomes research
minor motor dysfunctions.30 project: an exploration of customary practice in Australian health
settings. Br J Soc Work. 2007:1–16.
The MAND and ZNA were the equal lowest scoring 5. American Psychiatric Association. Diagnostic and Statistical Manual of
measures. This is partially due to the ZNA lacking formal- Mental Disorders. 4th ed. Washington, DC: American Psychiatric
ized validity and the MAND lacking reliability in children. Publishing Inc; 2000.
In addition, the MAND scored lower because of some un- 6. Barnhart RC, Davenport M, Epps SB, et al. Developmental coordina-
tion disorder. Phys Ther. 2003;83:722–731.
usual test items along with the extended training time and 7. Zoia S, Barnett A, Wilson P, et al. Developmental coordination disor-
difficulties with interpretation of the scores.25 The MAND der: current issues. Child Care Health Dev. 2006;32:613– 618.
studies were also largely carried out on a small sample of 8. Wilson PH. Practitioner review: approaches to assessment and treat-
7-year-old children with typical development, thus caution ment of children with DCD, an evaluative review. J Child Psychol
Psychiatry. 2005;46:806 – 823.
should be practiced if generalizing these results to other 9. Mandich AD, Polatajko HJ, Rodger S. Rites of passage: understanding
age groups. The MAND, however, has demonstrated ade- participation of children with developmental coordination disorder.
quate sensitivity in identifying MI in 4- to 5-year-old chil- Hum Mov Sci. 2003;22:583–595.
dren.36 The ZNA is currently lacking in psychometric rigor. 10. Sugden DA, Chambers ME. Children With Developmental Coordina-
tion Disorder. London, UK: Whurr Publishers; 2005.
Investigations into its reliability involved a small sample 11. Cantell MH, Smyth MM, Ahonen TP. Two distinct pathways for de-
size of typical children and some items showed question- velopmental coordination disorder: persistence and resolution. Hum
able correlations on interrater and test-retest reliability, the Mov Sci. 2003;22:413– 431.
same reliability results are published in 4 separate publica- 12. Cantell MH, Smyth MM, Ahonen TP. Clumsiness in adolescence:
educational, motor, and social outcomes of motor delay detected at 5
tions.28,52–54 The ZNA also scored lower on its tester cen- years. Adapt Phys Activ Q. 1994;11:115–129.
teredness due to difficulties with scoring accessory move- 13. Burton AW, Miller DE. Movement Skill Assessment. Champaign, IL:
ments and the extended training required.28,52–54 Human Kinetics; 1998.

178 Slater et al Pediatric Physical Therapy


14. Wiepert SL, Mercer VS. Effects of an increased number of practice erlands: the relationship between the movement Assessment Battery
trials on Peabody developmental gross motor scale scores in children for Children and the Korperkoordinations Test fuer Kinder. Hum Mov
of preschool age with typical development. Pediatr Phys Ther. 2002; Sci. 1998;17:699 –709.
14:22–28. 40. Smyth MM, Mason UC. Use of proprioception in normal and clumsy
15. Fawcett AL. Principles of Assessment and Outcome Measurement for children. Dev Med Child Neurol. 1998;40:672– 681.
Occupational Therapists and Physiotherapists: Theory, Skills and Appli- 41. Darrah J, Magill-Evans J, Volden J, et al. Scores of typically develop-
cation. West Sussex, England: John Wiley & Sons; 2007. ing children on the Peabody Developmental Motor Scales: infancy to
16. Rubin A. Practitioner’s Guide to Using Research for Evidence-Based preschool. Phys Occup Ther Pediatr. 2007;27:5–19.
Practice. Hoboken, NJ: John Wiley & Sons; 2008. 42. Miller J. Primary school-aged children and fundamental motor
17. Finch E, Broks D, Stratford PW, et al. Physical Rehabilitation Outcome skills—what is all the fuss about? Paper published and presented at
Measures a Guide to Enhanced Clinical Decision Making. 2nd ed. On- the Australian Association for Research in Education 2006, Interna-
tario, Canada: Lippincott Williams & Wilkins; 2002. tional education research conference, Adelaide, Australia; November
18. United Kingdom’s Clearing House on Health Outcomes. University 27–30, 2006.
of Leeds. 1993. http://www.leeds.ac.uk/nuffield/infoservices/UKCH/ 43. Wong KYA, Cheung SY. Structural validity of the test of gross motor
home.html. Accessed February 15, 2008. development-2. Res Q Exerc Sport. 2007;78(Suppl 1):A-46.
19. National Health and Medical Research Council. How to review the evi- 44. Lee M, Zhu W, Ulrich D. Many-Faceted Rasch Calibration of
dence: a systematic identification and review of the scientific literature. TGMD-2. Res Q Exerc Sport. 2005;76(Suppl 1):A-116.
2008. http://www.nhmrc.gov.au/publications/synopses/_files/cp65.pdf. 45. Van Waelvelde H, Peersman W, Lenoir M, et al. The reliability of the
Accessed May 21, 2008. Movement Assessment Battery for Children for preschool children
20. Bodison S, Mailloux Z. The Sensory Integration and Praxis Tests: with mild to moderate motor impairment. Clin Rehabil. 2007;21:465–
illuminating struggles and strengths in participation at school. OT 470.
Practice. 2006;11:CE-1–CE-7. 46. Chow SMK, Henderson SE. Interrater and test-retest reliability of the
21. Maeland AF. Identification of children with motor coordination Movement Assessment Battery for Chinese preschool children. Am J
problems. Adapt Phys Activ Q. 1992;9:330 –342. Occup Ther. 2003;57:574 –577.
22. Hughes JE, Riley A. Basic gross motor assessment: tool for use with 47. Chow SMK, Chan L, Chan CPS, et al. Reliability of the experimental
children having minor motor dysfunction. Phys Ther. 1981;61:503–511. version of the Movement ABC. Br J Ther Rehabil. 2002;9:404 – 407.
23. Bruininks R, Bruininks B. Bruininks-Oseretsky Test of Motor Profi-
48. Smits-Engelsman BCM, Fiers MJ, Henderson SE, et al. Interrater re-
ciency. 2nd ed. Minneapolis, MN: NCS Pearson; 2005.
liability of the Movement Assessment Battery for Children. Phys Ther.
24. Henderson SE, Sugden DA. Movement Assessment Battery for Children.
2008;88:286 –294.
London, UK: Psychological Corporation; 1992.
49. Chow SMK, Hsu Y, Henderson SE, et al. The movement ABC: a
25. McCarron LT. MAND McCarron Assessment of Neuromuscular Devel-
cross-cultural comparison of preschool children from Hong Kong,
opment. Dallas, TX: Common Market Press; 1997.
Taiwan, and the USA. Adapt Phys Activ Q. 2006;23:31– 48.
26. Folio MR, Fewell RR. Peabody Developmental Motor Scales. 2nd ed.
50. Haga M, Pedersen AV, Sigmundsson H. Interrelationship among se-
Austin, TX: Pro-Ed; 2000.
lected measures of motor skills. Child Care Health Dev. 2008;34:245–
27. Ulrich DA. Test of Gross Motor Development. 2nd ed. Austin, TX:
248.
Pro-Ed; 2000.
51. Leemrijse C, Meijer OG, Vermeer A, et al. Detecting individual
28. Rousson V, Gasser T, Caflisch J, et al. Reliability of the Zurich Neu-
change in children with mild to moderate motor impairment: the
romotor Assessment. Clin Neuropsychol. 2008;22:60 –72.
standard error of measurement of the Movement ABC. Clin Rehabil.
29. Deconinck FJA, De Clercq D, Van Coster R, et al. Sensory contribu-
1999;13:420 – 429.
tions to balance in boys with developmental coordination disorder.
Adapt Phys Activ Q. 2008;25:17–35. 52. Gasser T, Rousson V, Caflisch JA, et al. Quantitative reference curves
30. Van Waelvelde H, Peersman W, Lenoir M, et al. Convergent validity for associated movements in children and adolescents. Dev Med Child
between two motor tests: movement-ABC and PDMS-2. Adapt Phys Neurol. 2007;49:608 – 614.
Activ Q. 2007;24:59 – 69. 53. Largo RH, Caflisch JA, Hug F, et al. Neuromotor development from 5
31. Van Waelvelde H, De Weerdt W, De Cock P, et al. Aspects of the to 18 years. Part 1: timed performance. Dev Med Child Neurol. 2001;
validity of the Movement Assessment Battery for Children. Hum Mov 43:436 – 443.
Sci. 2004;23:49 – 60. 54. Largo RH, Caflisch JA, Hug F, et al. Neuromotor development from 5
32. Van Waelvelde H, De Weerdt W, De Cock P, et al. Association be- to 18 years. Part 2: associated movements. Dev Med Child Neurol.
tween visual perceptual deficits and motor deficits in children with 2001;43:444 – 453.
developmental coordination disorder. Dev Med Child Neurol. 2004; 55. Livesey D, Coleman R, Piek J. Performance on the Movement Assess-
46:661– 666. ment Battery for Children by Australian 3- to 5-year-old children.
33. Crawford SG, Wilson BN, Dewey D. Identifying developmental coor- Child Care Health Dev. 2007;33:713–719.
dination disorder: consistency between tests. Phys Occup Ther Pedi- 56. Ruiz LM, Graupera JL, Gutiérrez M, et al. The assessment of motor
atr. 2001;20:29 –50. coordination in children with the Movement ABC test: a comparative
34. Croce RV, Horvat M, McCarthy E. Reliability and concurrent validity study among Japan, USA and Spain. Int J Appl Sports Sci. 2003;15:22–35.
of the movement assessment battery for children. Percept Mot Skills. 57. Chow SMK, Henderson SE, Barnett AL. The Movement Assessment
2001;93:275–280. Battery for Children: a comparison of 4-year-old to 6-year-old chil-
35. Dewey D, Wilson B. Developmental coordination disorder: what is it? dren from Hong Kong and the United States. Am J Occup Ther. 2001;
Phys Occup Ther Pediatr. 2001;20:5–27. 55:55– 61.
36. Tan SK, Parker HE, Larkin D. Concurrent validity of motor tests used 58. Miyahara M, Tsujii M, Hanai T, et al. The Movement Assessment
to identify children with motor impairment. Adapt Phys Activ Q. Battery for Children: a preliminary investigation of its usefulness in
2001;18:168 –182. Japan. Hum Mov Sci. 1998;17:679 – 697.
37. High J, Gough A, Pennington D, et al. Alternative assessments for 59. Rösblad B, Gard L. The assessment of children with developmental
sensory integration dysfunction. Br J Occup Ther. 2000;63:2– 8. coordination disorders in Sweden: a preliminary investigation of the
38. Kaplan BJ, Wilson BN, Dewey D, et al. DCD may not be a discrete suitability of the Movement ABC. Hum Mov Sci. 1998;17:711–719.
disorder. Hum Mov Sci. 1998;17:471– 490. 60. Deitz JC, Kartin D, Kopp K. Review of the Bruininks-Oseretsky Test
39. Smits-Engelsman BCM, Henderson SE, Michels CGJ. The assessment of Motor Proficiency, second edition (BOT-2). Phys Occup Ther Pediatr.
of children with developmental coordination disorders in the Neth- 2007;27:87–102.

Pediatric Physical Therapy Measures of Gross Motor Skills for Children With DCD 179

You might also like