You are on page 1of 21

J Autism Dev Disord

DOI 10.1007/s10803-016-3005-0

ORIGINAL PAPER

Test of Gross Motor Development-3 (TGMD-3) with the Use


of Visual Supports for Children with Autism Spectrum Disorder:
Validity and Reliability
K. A. Allen1 · B. Bredero1 · T. Van Damme1 · D. A. Ulrich2 · J. Simons1

© Springer Science+Business Media New York 2017

Abstract The validity and reliability of the Test of Keywords Test of Gross Motor Development-3 · Autism
Gross Motor Development-3 (TGMD-3) were measured, spectrum disorder · Visual supports · Validity · Reliability ·
taking into consideration the preference for visual learn- Gross motor performance
ing of children with autism spectrum disorder (ASD).
The TGMD-3 was administered to 14 children with ASD
(4–10 years) and 21 age-matched typically developing chil- Introduction
dren under two conditions: TGMD-3 traditional protocol,
and TGMD-3 visual support protocol. Excellent levels of It is shown that children with ASD exhibit significant
internal consistency, test–retest, interrater and intrarater delays in motor development, impaired movement per-
reliability were achieved for the TGMD-3 visual support formance and impaired motor planning compared to their
protocol. TGMD-3 raw scores of children with ASD were typically developing peers (Fournier et al. 2010; Hilton
significantly lower than typically developing peers, how- et al. 2012; Ming et al. 2007). Due to the increasing evi-
ever, significantly improved using the TGMD-3 visual sup- dence that motor delays can be identified during infancy
port protocol. This demonstrates that the TGMD-3 visual (Bhat et al. 2011; Leonard et al. 2014; Liu 2012; Lloyd
support protocol is a valid and reliable assessment of gross et al. 2011; Shetreat-Klein et al. 2014; Teitelbaum et al.
motor performance for children with ASD. 1998), early administration of movement skill assessments
and screening for delays in motor milestones may facilitate
early detection of ASD (Bhat et al. 2011; Liu 2012; Ozo-
noff et al. 2008). Moreover, in recent years, motor impair-
ment in children with ASD has received an increasing
* J. Simons amount of attention. Abundant evidence clearly indicates
johan.simons@kuleuven.be a high prevalence of motor impairment in children with
K. A. Allen ASD. However, one of the major challenges in the adminis-
kirstyallen_@hotmail.com tration of motor assessment in this population concerns the
B. Bredero task understanding. However, before motor performance
Beeleke.bredero@kuleuven.be can be considered as a principal characteristic of ASD, it is
T. Van Damme essential to establish a valid and reliable motor assessment
Tine.vandamme@kuleuven.be for use in children with ASD that incorporates appropriate
D. A. Ulrich adaptations to facilitate task understanding and to ensure an
Ulrichd@umich.edu accurate evaluation of motor performance can be achieved.
1 Several internationally recognised and standardised
Department of Rehabilitation Sciences, Faculty
of Kinesiology and Rehabilitation Sciences, KU Leuven, movement skill assessments exist and have been used
O&N IV, bus 1510, 3000 Leuven, Belgium extensively throughout the literature to evaluate the motor
2
School of Kinesiology, University of Michigan, 1402 performance of infants, children and adolescents with ASD
Washington Hts, Ann Arbor, MI, USA in comparison to normative data, typically developing

13
Vol.:(0123456789)
J Autism Dev Disord

peers and other disabilities (Staples et al. 2012). The most have both been validated for ASD populations (Bruininks
frequent of these assessments used include; the Test of and Bruininks 2005; Cools et al. 2009; Lavay and Lasko-
Gross Motor Development (TGMD and TGMD-2), the McCarthey 1992; Sparrow et al. 2005; Staples et al. 2012).
Movement Assessment Battery for Children (MABC and Studies have suggested that the reduced motor perfor-
MABC-2), the Bruininks-Oseretsky Test of Motor Profi- mance observed among children with ASD may not exclu-
ciency (BOTMP and BOT-2), the Peabody Developmen- sively be the result of impaired motor functioning or a lack
tal Motor Scales (PDMS and PDMS-2), and the Bayley of competency in fundamental motor skills, but rather a
Scales of Infant and Toddler Development (BSID, BSID- misunderstanding of task requirements (Berkeley et al.
II and Bayley-III) (Bayley 1969, 1993, 2006; Bruininks 2001; Bhat et al. 2011; Green et al. 2009; Staples and Reid
1978; Bruininks and Bruininks 2005; Folio and Fewell 2010). Green et al. (2009) proposed that the motor perfor-
1983, 2000; Henderson and Sugden 1992; Henderson et al. mance results of children with ASD may be compromised
2007; Ulrich 1985, 2000). Staples and Reid (2010) used as a result of their inability to comprehend verbal instruc-
the TGMD-2 to evaluate the fundamental motor skills of tions and follow physical demonstrations that are provided
25 children with ASD in comparison to typically develop- during movement skill assessments. Staples and Reid
ing children. Children with ASD scored significantly lower (2010) recognized that children with ASD had difficulty
on both the TGMD-2 locomotor and object control sub- interpreting verbal instructions that were provided during
tests, and their performance was comparable to typically TGMD-2 assessments and that physical demonstrations
developing children half their chronological age (Staples alone were not reliable in facilitating task understanding
and Reid 2010). Liu et al. (2014) compared the TGMD-2 or performance. The assessment protocol was adapted to
performance scores of 21 children with ASD, and 21 age- simplify the complexity of the verbal instructions presented
matched typically developing children. The TGMD-2 and physical guidance techniques were implemented,
scores revealed that the gross motor performances of chil- resulting in improved TGMD-2 performance scores (Sta-
dren with ASD were significantly lower than typically ples and Reid 2010). In addition, Berkeley et al. (2001)
developing peers, with 91% of ASD participants displaying observed that during the completion of the TGMD-2, chil-
impaired gross motor performance (Liu et al. 2014). dren with ASD disregarded verbal instructions and physical
In related research, the MABC-2 was used to identify demonstrations during locomotion tasks. Instead, children
differences between the fine and gross motor performances with ASD performed locomotion tasks placing emphasis
of 30 children with ASD and 30 age-matched typically on achieving the task objective (i.e., moving from one cone
developing children (Liu and Breslin 2013a). Liu and Bres- to the indicated cone) rather than focusing on the move-
lin (2013a) reported that 77% of participants with ASD ment execution to achieve that goal (e.g. skipping).
demonstrated motor impairments, and that a significant Consequently, when administering motor assessment
difference was shown between the MABC-2 performance instruments, these aspects should be taken into account. In
scores of children with ASD and the MABC-2 perfor- order to ensure reliability, the focus should lie on reducing
mance scores of typically developing children. Dewey et al. barriers towards understanding of task instructions. Previ-
(2007) compared the BOTMP scores of children and ado- ous research had suggested that additional visual support
lescents with ASD, developmental coordination disorder might be useful in order to enhance understanding and
(DCD), attention deficit hyperactivity disorder (ADHD), results in improvement of the motor performance scores
and typically developing children. The overall BOTMP (Breslin and Liu 2015).
scores for the ASD group were significantly lower than Many children with ASD also exhibit impaired cogni-
the other groups, and identified that 59% of the 49 partici- tive function and experience delays in the development of
pants with ASD had deficits in motor performance (Dewey expressive and receptive communication skills (Bhat et al.
et al. 2007). The fine and gross motor skills of 19 children 2011; Dziuk et al. 2007; Ghaziuddin and Butler 1998;
with ASD were assessed using both the BSID-II and the Green et al. 2009; Whyatt and Craig 2012). Research has
PDMS-2 (Provost et al. 2007). Provost et al. (2007) showed shown that deficits in cognitive ability and language devel-
that all children with ASD had a delay in motor perfor- opment are highly correlated with the severity of motor
mance to some degree, with 84% of participants exhibiting impairments in children with ASD as a result of a misun-
significant delays on the BSID-II and 95% attaining below derstanding of task requirements (Bhat et al. 2011; Dziuk
average on the PDMS-2. et al. 2007; Ghaziuddin and Butler 1998; Green et al. 2009;
Despite the extensive use of movement skill assessments Whyatt and Craig 2012). Ghaziuddin and Butler (1998)
in ASD research, the validity and reliability of these assess- observed the fine and gross motor skills of children with
ments do not take into consideration individuals with ASD, ASD using the BOTMP and found a significant relation-
with the exception of the BOT-2 and the Vineland Adap- ship between BOTMP performance scores and intelligence
tive Behavior Scales, Second Edition (Vineland-II), which quotient (IQ). However, the correlation between IQ and

13
J Autism Dev Disord

BOTMP performance scores was not significant, suggest- The inclusion of visual supports in movement skill
ing that cognitive ability is the main perpetrator of motor assessments may help to establish a valid and reliable
impairments in children with ASD. assessment instrument for children with ASD that provides
Deficits in communication and cognitive function among instructional information in a preferable format, which
children with ASD contributes to a reduced comprehension would facilitate a more accurate measure of motor perfor-
of auditory information, body language, movement imi- mance. A valid and reliable movement skill assessment that
tation and expressive gestures (Dewey et al. 2007; Green incorporates a visual support protocol is yet to be devel-
et al. 2009; Zachor et al. 2010). As a result, task under- oped for children who have difficulty processing auditory
standing is jeopardized, impacting motor skill acquisition information, such as children with ASD (Bruininks and
and consequently, affecting performance on movement Bruininks 2005). The purpose of this study is to measure
skill assessments (Green et al. 2009). This demonstrates aspects of validity and reliability of the Test of Gross Motor
the importance of ensuring movement skill assessments Development-3 (Ulrich 2016: TGMD-3, http://www.kines.
are suitably adapted to facilitate task understanding among umich.edu/tgmd3) for assessing the gross motor perfor-
children with ASD. mance of children with ASD, with the inclusion of a visual
Movement assessment tasks are typically explained support protocol, to facilitate task understanding, compared
using a combination of physical demonstrations and ver- to age-matched typically developing children.
bal instructions, and therefore do not take into considera- The TGMD-3 is a process-orientated assessment that is
tion the communication difficulties of children with ASD. designed to assess the gross motor performance of young
Studies have shown, however, that an improved understand- children, aged 3–10 years (Ulrich 2016, http://www.kines.
ing of task requirements and an accurate measure of motor umich.edu/tgmd3). The assessment includes a selection of
performance for children with ASD can be facilitated by locomotor skills and ball skills that represent fundamental
minimizing the degree of verbal instructions provided and motor skills that are commonly taught in primary physical
incorporating the use of visual supports (Breslin and Rud- education curriculum on an international scale. A critical
isill 2011; Liu and Breslin 2013b). Breslin and Rudisill function of the TGMD-3 is to identify delays and deficits
(2011) demonstrated that the addition of picture task cards in gross motor development in early childhood, as well as
to the TGMD-2 protocol enhanced task understanding and, serving as a research tool to explore and compare the gross
as a result, significantly increased the gross motor perfor- motor development of both typically developing children
mance of children with ASD compared to the TGMD-2 and children with atypical movement function (Ulrich
traditional protocol. Furthermore, Liu and Breslin (2013b) 2016, http://www.kines.umich.edu/tgmd3).
found that the incorporation of a picture activity schedule The previous editions of the TGMD-3, the TGMD-2 and
protocol significantly improved the MABC-2 scores of the TGMD, have not included a visual support protocol and
children with ASD by approximately 20% compared to the have only been validated using U.S. normative data for typ-
MABC-2 traditional protocol. ically developing children (Evaggelinou et al. 2002; Kim
It has been shown that children with ASD respond better et al. 2014; Ulrich 1985, 2000; Valentini 2012), children
to visual stimuli when compared with verbal communica- with Down syndrome (Ulrich 2000), visual impairments
tion methods (Fittipaldi-Wert and Mowling 2009; Houston- (Houwen et al. 2010), hearing impairments (Dummer
Wilson and Lieberman 2003; Quill 1995; Rao and Gagie et al. 1996) and for children with intellectual disabilities
2006; Tissot and Evans 2003). They tend to disassociate who exhibit cognitive processing difficulties (Simons et al.
with verbal instructions and prefer to process information 2007). However, these conclusions cannot be generalised
with the use of visual supports, which allows for easier for the revised TGMD-3 protocol or for use among indi-
cognitive understanding, improving memory retention, viduals with ASD (Yun and Ulrich 2002).
concentration, communication, stereotypical behavior, skill This study will measure aspects of construct validity and
development and social interactions (Fittipaldi-Wert and reliability of the TGMD-3 for children with ASD and age-
Mowling 2009; Green and Sandt 2013; Houston-Wilson matched typically developing children under two assess-
and Lieberman 2003; Meadan et al. 2011; Quill 1995; Rao ment conditions; (a) TGMD-3 traditional protocol, and
and Gagie 2006; Schultheis et al. 2000; Tissot and Evans (b) TGMD-3 visual support protocol. To the researcher’s
2003; Waugh et al. 2007). Visual supports also assist with knowledge, this will be the first study to examine aspects
predictability and create an ordered and structured learn- of validity and reliability of the TGMD-3 for children
ing environment, which in turn reduces levels of anxiety with ASD and with the inclusion of a visual support pro-
in children with ASD (Fittipaldi-Wert and Mowling 2009; tocol to establish whether this addition facilitates a better
Houston-Wilson and Lieberman 2003; Meadan et al. 2011; task understanding, consequently improving motor perfor-
Menear and Smith 2011; Quill 1995; Rao and Gagie 2006; mance. The reliability of the TGMD-3 for measuring the
Schultheis et al. 2000). gross motor performance of children with ASD (TGMD-3

13
J Autism Dev Disord

traditional protocol and TGMD-3 visual support protocol) or injury that restricted participation in physical activ-
and typically developing children (TGMD-3 traditional pro- ity. Using a snowball sampling method (Biernacki and
tocol only) will be established by determining the internal Waldorf 1981), 21 typically developing children, aged
consistency, test–retest reliability, interrater reliability and between 4 and 10 years, were recruited. A large propor-
intrarater reliability. We hypothesized that acceptable lev- tion of the typically developing participants were siblings
els of internal consistency, test–retest reliability, interrater of children in the ASD sample (N = 9) and the remainder
reliability and intrarater reliability will be achieved for both were recruited through parent referral, predominantly
the TGMD-3 traditional protocol and the TGMD-3 visual friends and classmates of children already participating
support protocol for children with ASD, and the TGMD-3 in the study (N = 12). Children were included in the typi-
traditional protocol for typically developing children. cally developing sample if they were: (a) aged between 3.0
To support aspects of construct validity of the TGMD-3 and 10.11 years at the time of data collection and (b) did
raw scores for children with ASD and typically developing not have an illness or injury that restricted participation in
children. We hypothesized that the TGMD-3 raw scores of physical activity.
age-matched typically developing children will be signifi- Ethical clearance was received from the human ethics
cantly greater than the TGMD-3 traditional protocol raw committee of the School of Human Movement Studies,
scores of children with ASD. Furthermore, we hypoth- University of Queensland (UQ), and all procedures of the
esized that the TGMD-3 visual support protocol will pro- study complied with the ethical guidelines outlined by UQ
duce significantly greater TGMD-3 raw scores than the and the ‘National Statement on Ethical Conduct in Human
TGMD-3 traditional protocol for children with ASD. Research’. Legal guardians provided written informed con-
Competency in fundamental movement skills has been sent and participant medical information on behalf of the
shown to follow a developmental trajectory, with motor study participants prior to the commencement of data col-
performance improving with chronological age (McKenzie lection. Verbal agreement was obtained from each partici-
et al. 2002; Okely and Booth 2004; Williams et al. 2008; pant at the beginning of the testing session. Participants’
Ulrich 2000). We hypothesized that a strong correlation TGMD-3 assessment results were made available to their
between chronological age and TGMD-3 raw scores will legal guardians once the study had been completed.
be observed in typically developing children. Children with An overview of the demographics for ASD and typi-
ASD are believed to follow a similar developmental trajec- cally developing groups are summarized in Tables 1 and 2,
tory to typically developing children. However, improve- and are categorized based on the assessment protocol per-
ments in fundamental movement skills are obtained at formed (i.e. TGMD-3 typical protocol or TGMD-3 visual
a slower rate than typically developing peers (Hauck and support protocol). Participants’ socioeconomic status (SES)
Dewey 2001; Landa and Garrett-Mayer 2006; Lloyd et al. was established using the residential postcodes provided.
2011; Staples and Reid 2010). As a result, we hypothe- The ASD and typically developing groups were matched
sized that a correlation between TGMD-3 raw scores and by chronological age (within a 3 month window) and sex
chronological age will occur for children with ASD in the to accurately evaluate the relationship between ASD and
TGMD-3 traditional protocol and TGMD-3 visual pro- typically developing motor performance. Ten pairs met
tocol, while also indicating that the difference between this criteria (≤1 month N = 6, ≤3 months N = 10), whereas
the TGMD-3 raw scores for children with ASD and the four pairs had age differences that ranged between 4 and
TGMD-3 raw scores of typically developing children will 9 months. A diagnosis of ASD, as defined in the DSM-V
become more prominent with chronological age. guidelines, was provided predominantly by pediatricians,
psychiatrists and psychologists and confirmed based on
medical information reported by the legal guardian on the
Methods participants’ medical screening form and supporting docu-
mentation provided (APA 2013).
Participants
Instrument
Participants for the ASD sample were obtained through a
convenience sampling approach. Fourteen children with Participants’ gross motor performances were evaluated
ASD, aged between 4 and 10 years, were recruited. Chil- using the TGMD-3. Motor performance is observed and
dren were included in the ASD sample if they were: (a) evaluated based on predetermined qualitative performance
aged between 3.0 and 10.11 years at the time of data col- criteria that represent each TGMD-3 assessment item.
lection, (b) had a primary diagnosis of ASD in accordance Scores are determined for each respective criterion based
with the DSM-V guidelines, (c) had no associated diag- on whether the criterion was fulfilled (score awarded = 1)
nosis other than ASD and (d) did not have an impairment or not (score awarded = 0) (Ulrich 2016, http://www.kines.

13
J Autism Dev Disord

Table 1  Demographic data of Interrater and intrarater reli- Test–retest reliability Aspects of validity (visual
ASD participants ability, internal consistency vs. traditional protocol
and aspects of validity only)
Traditional Visual Traditional Visual Traditional Visual
N = 14 N = 12 N=8 N=8 N = 12 N = 12

Age (months)
M (SD) 89.1 (24.4) 93.9 (22.6) 98.4 (25.4) 98.4 (25.4) 93.9 (22.6) 93.9 (22.6)
Range 52–131 60–131 60–131 60–131 60–131 60–131
Sex, n (%)
Male 10 (71.4) 8 (66.7) 6 (75.0) 6 (75.0) 8 (66.7) 8 (66.7)
Female 4 (28.6) 4 (33.3) 2 (25.0) 2 (25.0) 4 (33.3) 4 (33.3)
Ethnicity, n (%)
Caucasian 12 (85.7) 10 (83.3) 7 (87.5) 7 (87.5) 10 (83.3) 10 (83.3)
Asian 2 (14.3) 2 (16.7) 1 (12.5) 1 (12.5) 2 (16.7) 2 (16.7)
SES, n (%)
Upper 6 (42.9) 6 (50.0) 4 (50.0) 4 (50.0) 6 (50.0) 6 (50.0)
Middle 7 (50.0) 5 (41.7) 3 (37.5) 3 (37.5) 5 (41.7) 5 (41.7)
Lower 1 (7.1) 1 (8.3) 1 (12.5) 1 (12.5) 1 (8.3) 1 (8.3)

SES socioeconomic status; Traditional TGMD-3 traditional protocol; Visual TGMD-3 visual support pro-
tocol

Table 2  Demographic Interrater and intrarater reliability, inter- Test–retest reliability Aspects of validity
data of typically developing nal consistency and aspects of validity (TD vs. ASD only)
participants
Traditional (N = 21) Traditional (N = 17) Traditional (N = 14)

Age (months)
M (SD) 88.0 (21.0) 90.3 (20.8) 88.9 (23.8)
Range 49–125 49–125 49–125
Sex, n (%)
Male 12 (57.1) 10 (58.8) 10 (71.4)
Female 9 (42.9) 7 (41.2) 4 (28.6)
Ethnicity, n (%)
Caucasian 20 (95.2) 16 (94.1) 14 (100.0)
Asian 1 (4.8) 1 (5.9) 0 (0.0)
SES, n (%)
Upper 15 (71.4) 12 (70.6) 10 (71.4)
Middle 6 (28.6) 5 (29.4) 4 (28.6)
Lower 0 (0.0) 0 (0.0) 0 (0.0)

umich.edu/tgmd3). Two trials are completed for each motor Procedures


skill item and scored accordingly (Ulrich 2016, http://www.
kines.umich.edu/tgmd3). The total score for each item is Testing sessions were completed in an indoor gymna-
established by the summation of all performance criteria sium at the School of Human Movement Studies, UQ.
scores for both trials, which are accumulated to determine Two TGMD-3 assessment protocols were administered
the total locomotor and ball skills subtest scores and the to ASD participants across two consecutive days, includ-
overall TGMD-3 raw score for gross motor performance ing; (a) TGMD-3 traditional protocol, where assessment
(Ulrich 2016, http://www.kines.umich.edu/tgmd3). The items were demonstrated using a combination of physical
maximum score a participant can obtain on the TGMD- and verbal instructions, and (b) TGMD-3 visual support
3, for the locomotor subtest, ball skills subtest and overall protocol, where assessment items were explained using
gross motor performance, is 46, 54 and 100, respectively a combination of picture cards, short verbal prompts and
(Ulrich 2016, http://www.kines.umich.edu/tgmd3). physical demonstrations. To minimize the possibility of a

13
J Autism Dev Disord

carryover effect influencing performance results, the order TGMD-3 standardized scoring procedures. To ensure
of protocol delivery was counterbalanced and performed in scoring precision and consistency and that agreement
random sequence. Protocol randomization was determined was established between the principal investigator and
by a fair coin flip (tails equaled traditional protocol, heads the research assistant, TGMD-3 performance videos
equaled visual protocol) and were divided evenly within the of typically developing children (used for training pur-
ASD group by chance (N = 7 commenced with the tradi- poses only) were analyzed in detail and then scored inde-
tional protocol, N = 7 commenced with the visual support pendently. Before analysis of participants’ videotaped
protocol). Typically developing participants were assessed TGMD-3 performances could be completed, scoring
using the TGMD-3 traditional protocol only. For test–retest was repeated on the training videos until at least a 90%
reliability the TGMD-3 assessment protocol/s were admin- concurrence was achieved between the two raters on two
istered to a selection of ASD (N = 8) and typically devel- successive days. To measure interrater reliability, the
oping participants (N = 17) who repeated the assessment/s principal investigator and the trained research assistant
under identical testing conditions to the initial testing ses- independently scored all typically developing (N = 21)
sions, approximately 1–2 weeks later. Where possible, the and ASD (TGMD-3 traditional protocol N = 14, TGMD-3
TGMD-3 was administered at the same time and day of the visual support protocol N = 12) participants’ videotaped
week as the participants’ initial testing session/s to elimi- performances using the same TGMD-3 scoring criteria.
nate external factors influencing performance results. To determine intrarater reliability, the principal investiga-
Participants were familiarized with the testing envi- tor repeated scoring procedures for the same videotaped
ronment and procedures before commencing each test- performances of all typically developing and ASD par-
ing session. In addition, ASD participants were provided ticipants, approximately 1 month after the initial scoring
with social stories at least 1 week prior to testing, includ- had been completed.
ing images of the testing environment, equipment and the
research team (Bryan and Gast 2000). Strategies were intro-
duced to minimize distractions and stimulate participation. Data Analysis
These included consistent room setup, reward systems,
activity schedule, individual assessment, and the use of 13 Video analysis software, Dartfish (version 7.0), was used
color-coordinated activity station markers for positioning to evaluate the videotaped TGMD-3 performances. To
during demonstrations. A 45 min period was provided for minimize the risk of the examiners’ knowledge of results
ASD participants to complete the testing sessions, based influencing the data collection process, TGMD-3 per-
on previous recommendations and taking into considera- formances for the typically developing and ASD groups
tion the inclusion of an additional test item and the use of were evaluated only after all participants had completed
visual supports (Pan et al. 2009). A 30 min time frame was testing. As international normative data for the TGMD-3
allocated for the typically developing group based on previ- is currently under review, TGMD-3 standard scores, per-
ous recommendations and the addition of the extra test item centiles, age equivalent scores, and gross motor quotient
(Ulrich 2000). scores could not be used for analysis in this study. As a
All TGMD-3 assessment trials, excluding practice trials, result, participants’ TGMD-3 locomotor and ball skills
were videotaped for data evaluation. A series of computer- subtest raw scores, and overall gross motor performance
generated Picture Communication Symbols (PCS) were raw scores were interpreted as the principal depend-
displayed as one picture card for each TGMD-3 assessment ent variables. Statistical Package for the Social Sciences
item, representing the performance criteria for the respec- (SPSS, software version 22.0, IBM Corp, 2013) was used
tive motor skill (see Appendix for the visual supports used to perform statistical analysis to investigate aspects of
in the TGMD-3 visual support protocol). Before a physi- validity and reliability for the TGMD-3 traditional and
cal demonstration was provided for an assessment item visual support protocols for both the typically developing
in the TGMD-3 visual support protocol, a picture card and ASD groups. A significance level was established at
was presented on a hand-held display board (dimensions: α = 0.05.
21 × 30 cm) and the Velcro picture card was removed by The Shapiro–Wilk test of normality was used to examine
the child once an understanding of the assessment item was the distribution of the TGMD-3 performance data applied
acquired. for the analysis of aspects of validity and reliability (Sha-
The TGMD-3 was administered individually to each piro and Wilk 1965). As the assumptions required for the
participant by the principal investigator and two research application of parametric analysis was predominantly met,
assistants, all of whom were familiar with the purpose parametric tests were used to evaluate aspects of validity
of the study. To ensure interrater-reliability, one of the and reliability for the TGMD-3 traditional and visual sup-
research assistants received additional training in the port protocols.

13
J Autism Dev Disord

Reliability was determined to further evaluate the association between


the TGMD-3 traditional protocol performance scores and
Cronbach’s coefficient alpha was used to evaluate the inter- TGMD-3 visual support protocol performance scores for
nal consistency of the TGMD-3 locomotor and ball skills the ASD group.
subtests and total gross motor performance for the typically To further demonstrate the construct validity of the
developing (TGMD-3 traditional protocol) and ASD groups TGMD-3 a two tailed independent t test was used to meas-
(TGMD-3 traditional protocol and TGMD-3 visual support ure the difference between the TGMD-3 traditional pro-
protocol) (Cronbach 1951). According to the coefficient tocol performance scores of the typically developing and
alpha size guidelines recommended by Nunnally (1978) ASD groups. Effect size (d) and corresponding 95% con-
and Cicchetti and Sparrow (1990), correlations ≥0.70 are fidence intervals were established to observe the extent of
interpreted as acceptable levels of internal consistency; the difference. A point-biserial correlation was calculated
correlations ranging from 0.80 to 0.89 demonstrate a good to further assess the relationship between the typically
level of clinical significance, and ≥0.90 as excellent (Cic- developing and ASD groups’ TGMD-3 traditional proto-
chetti 1994; Cicchetti and Sparrow 1990). An estimation of col performance scores. A two tailed paired t test was also
the standard error of measurement (SEM) was calculated, performed to observe the difference between the TGMD-3
using the Cronbach’s alphas calculated for internal consist- traditional protocol performance scores of the chronologi-
ency to determine the accuracy of the scores obtained for cally aged matched pairs (TD Age M = 88.9; ASD Age
the TGMD-3 locomotor and ball skills subtests and overall M = 89.1). The Pitman-Morgan test was executed to estab-
gross motor performance (Weir 2005). lish the homogeneity of the variances (Morgan 1939; Pit-
Interrater, intrarater and test–retest reliability of the man 1939). In addition, effect size (d) and corresponding
TGMD-3 locomotor and ball skills subtests and TGMD-3 95% confidence intervals were calculated.
overall gross motor performance scores were assessed Pearson’s r was used to evaluate the correlation between
using the intra-class correlation coefficient (ICC) and TGMD-3 gross motor performance scores and chrono-
corresponding 95% confidence intervals (McGraw and logical age for both the typically developing (TGMD-3
Wong 1996; Shrout and Fleiss 1979; Weir 2005). A two- traditional protocol) and ASD groups (TGMD-3 tradi-
way random, single-measures ICC (model 2,1) was used tional protocol and TGMD-3 visual support protocol).
to estimate the degree of absolute agreement between the As assumptions necessary for the application of the inde-
examiners’ measures of participants TGMD-3 raw scores pendent t test were not met, including unequal group vari-
(McGraw and Wong 1996; Shrout and Fleiss 1979; Weir ances and sample sizes, the relationship between TGMD-3
2005). The following criteria for intra-class correlations gross motor performance scores and sex for both the typi-
were used: a reliability coefficient of <0.40 demonstrates a cally developing (TGMD-3 traditional protocol) and ASD
poor level of clinical significance, fair when the reliability groups (TGMD-3 traditional protocol and TGMD-3 visual
coefficient is between 0.40 and 0.59, good when between support protocol) were analyzed using the Welch’s t test
0.60 and 0.74, and an excellent level of clinical significance (Kohr and Games 1974; Welch 1947).
when between 0.75 and 1.00 (Cicchetti and Sparrow 1981).
SEMs were also determined using the interrater, intrarater
and test–retest reliability coefficients for the TGMD-3 loco-
motor and ball skills subtests and TGMD-3 overall gross Results
motor performance scores (Weir 2005).
Reliability
Validity
Table 3 illustrates the resultant Cronbach’s coefficient
A two tailed paired t test was used to analyze the differ- alphas and associated SEMs for the TGMD-3 subtests and
ence between the TGMD-3 traditional protocol perfor- TGMD-3 overall gross motor performance scores for the
mance raw scores and the TGMD-3 visual support protocol typically developing and ASD groups. The corresponding
performance raw scores of the ASD group. Effect size (d) average Cronbach’s coefficient alphas and rounded SEMs
was calculated, using the standard deviations and means for the TGMD-2 are also presented in Table 3 for compari-
from the TGMD-3 performance raw data, to establish the son with the TGMD-3 results of this study (Ulrich 2000).
magnitude of the difference (Durlak 2009). Effect sizes Acceptable levels of internal consistency were obtained for
were interpreted in compliance with Cohen’s (1988) rec- the TGMD-3 locomotor and ball skills subtests, and overall
ommendations for effect size i.e. small d < 0.20, medium gross motor performance of both the typically developing
d = 0.20–0.50, large d = 0.50–0.80, very large d ˃ 0.80. Pear- (TGMD-3 traditional protocol) and ASD groups (TGMD-3
son product-moment correlation coefficient (Pearson’s r) traditional protocol and TGMD-3 visual support protocol),

13
J Autism Dev Disord

Table 3  Internal consistency of the TGMD-3 subtests and over- (TGMD-3 traditional protocol) and ASD groups (TGMD-3
all gross motor performance for the typically developing and ASD traditional protocol and TGMD-3 visual support protocol).
groups
For interrater reliability, excellent levels of rater agree-
TGMD-3 Cronbach’s alpha SEM ment were established for the TGMD-3 subtests and
Typically developing (N = 21)
TGMD-3 overall gross motor performance for both the typ-
Locomotor skills 0.70 3.20
ically developing (TGMD-3 traditional protocol) and ASD
Ball skills 0.60 3.86
groups (TGMD-3 traditional protocol and TGMD-3 visual
Overall 0.74 5.18
support protocol). Furthermore, the intrarater reliability
ASD—Traditional (N = 14)
demonstrated excellent levels of agreement between the
Locomotor skills 0.82 3.90
principal investigators’ repeated analysis of the TGMD-3
Ball skills 0.75 4.63
performances for all typically developing (TGMD-3 tradi-
Overall 0.88 6.03
tional protocol) and ASD participants (TGMD-3 traditional
ASD—Visual (N = 12)
protocol and TGMD-3 visual support protocol). All corre-
Locomotor skills 0.93 3.28
lation coefficients demonstrated narrow confidence inter-
Ball skills 0.81 4.39
vals to further support the excellent agreement achieved.
Overall 0.93 5.73
TGMD-2 (N = 1208)
Validity
Locomotor skills 0.85 1.00
Ball skills 0.88 1.00
A statistically significant difference was shown between
Overall 0.91 5.00
the TGMD-3 traditional protocol and TGMD-3 visual
support protocol for the ASD group. Table 5 illustrates
SEM standard error of measurement; Overall overall gross motor that the TGMD-3 subtests and overall gross motor perfor-
performance. TGMD-3 traditional protocol (typically developing).
mance scores for the ASD group when assessed using the
TGMD-3 traditional protocol (ASD). TGMD-3 visual support proto-
col (ASD) TGMD-3 visual support protocol were significantly larger
than the TGMD-3 traditional protocol. Moderate effect
sizes were established, additionally supporting the differ-
with the exception of the ball skills subtest in the typically ence between performance scores for the TGMD-3 locomo-
developing group. tor and ball skills subtests, and overall gross motor perfor-
Table 4 summarises the ICC reliability coefficients mance, with d = 0.50 (−0.32, 1.31), d = 0.26 (−0.54, 1.07),
and corresponding 95% confident intervals, and SEMs, and d = 0.40 (−0.41, 1.21), respectively (Cohen 1988).
for test–retest, interrater and intrarater reliability of the Furthermore, there were very strong positive correlations
TGMD-3 for both the typically developing and ASD between the performance scores of the TGMD-3 traditional
groups. Excellent levels of agreement for test–retest reli- protocol and the TGMD-3 visual protocol in the locomo-
ability were achieved for both the typically developing tor subtest, r(10) = 0.94, p < 0.001, 95% CI (0.80, 0.98),

Table 4  Test–retest, interrater ASD—visual ASD—traditional Typically developing


and intrarater reliability of the
TGMD-3 subtests and overall ICC 95% CI SEM ICC 95% CI SEM ICC 95% CI SEM
gross motor performance for
typically developing and ASD Test–retest N=8 N=8 N = 17
group Locomotor 0.92 (0.65, 0.98) 2.99 0.92 (0.65, 0.98) 2.24 0.81 (0.54, 0.93) 2.22
Ball skills 0.83 (0.39, 0.96) 2.83 0.82 (0.31, 0.96) 2.93 0.84 (0.62, 0.94) 2.45
Overall 0.92 (0.66, 0.98) 4.62 0.91 (0.63, 0.98) 4.06 0.92 (0.78, 0.97) 2.72
Interrater N = 12 N = 14 N = 21
Locomotor 0.98 (0.94, 1.00) 1.75 0.98 (0.92, 0.99) 1.30 0.91 (0.79, 0.96) 1.76
Ball skills 0.96 (0.86, 0.99) 2.02 0.97 (0.91, 0.99) 1.60 0.92 (0.81, 0.97) 1.73
Overall 0.99 (0.95, 1.00) 2.17 0.98 (0.94, 1.00) 2.46 0.94 (0.87, 0.98) 2.49
Intrarater N = 12 N = 14 N = 21
Locomotor 0.99 (0.95, 1.00) 1.24 0.97 (0.88, 0.99) 1.59 0.97 (0.93, 0.99) 1.01
Ball skills 1.00 (0.98, 1.00) 0.71 0.99 (0.96, 1.00) 0.93 0.91 (0.68, 0.97) 1.83
Overall 0.99 (0.98, 1.00) 2.17 0.99 (0.92, 1.00) 1.74 0.95 (0.84, 0.98) 2.27

ICC intra-class correlation coefficient, CI confidence interval, SEM standard error of measurement, Overall
overall gross motor performance

13
J Autism Dev Disord

Table 5  Difference between the Visual (N = 12) Traditional t-value df p 95% CI difference
TGMD-3 traditional protocol (N = 12)
and the TGMD-3 visual support
protocol performance scores for M SD M SD
the ASD group
Locomotor skills 26.2 12.4 20.6 9.98 4.24 11 0.001 (2.69, 8.48)
Ball skills 32.7 10.1 30.1 9.73 2.35 11 0.038 (0.17, 5.00)
Overall 58.8 21.7 50.7 18.7 4.21 11 0.001 (3.90, 12.4)

ball skills subtest, r(10) = 0.93, p < 0.001, 95% CI (0.76, 95% CI (0.035, 0.74)] and ball skills [r(19) = 0.83,
0.98), and overall gross motor performance, r(10) = 0.96, p < 0.001, 95% CI (0.62, 0.93)] subtests, and overall gross
p < 0.001, 95% CI (0.86, 0.99). motor performance [r(19) = 0.77, p < 0.001, 95% CI (0.51,
The difference between the TGMD-3 traditional proto- 0.90)], with TGMD-3 performance scores increasing
col performance scores of the typically developing group with age. Correlations between TGMD-3 traditional pro-
and the ASD group were statistically significant. The tocol performance scores and chronological age for the
results provided in Table 6 show that the TGMD-3 sub- ASD group, however, were non-significant in the locomo-
tests and overall gross motor performance scores for the tor [r(12) = 0.26, p = 0.37, 95% CI (−0.31, 0.69)] and ball
typically developing group were significantly larger than skills [r(12) = 0.14, p = 0.62, 95% CI (−0.42, 0.62)] sub-
the ASD group. In addition, very large effect sizes for the tests and overall gross motor performance [r(12) = 0.21,
TGMD-3 locomotor and ball skills subtests, and overall p = 0.47, 95% CI (−0.36, 0.67)]. Similarly, non-significant
gross motor performance were established, d = 1.43 (0.60, correlations were found between the TGMD-3 visual sup-
2.26), d = 1.33 (0.51, 2.14), and d = 1.49 (0.65, 2.33), port protocol performance scores and chronological age
respectively. Moderate positive correlations between the for the ASD group in the locomotor [r(10) = 0.18, p = 0.58,
TGMD-3 traditional protocol performance scores of the 95% CI (−0.44, 0.68)] and ball skills [r(10) = 0.16, p = 0.61,
typically developing group and the TGMD-3 traditional 95% CI (−0.46, 0.67)] subtests, and overall gross motor
protocol performance scores of the ASD group were also performance [r(10) = 0.18, p = 0.58, 95% CI (−0.44, 0.68)].
shown in the locomotor subtest [r(26) = 0.59, p = 0.001, Table 7 illustrates that sex had a non-significant effect
95% CI (0.28, 0.79)], ball skills subtest [r(26) = 0.57, on the TGMD-3 gross motor performance scores for the
p = 0.002, 95% CI (0.25, 0.78)], and overall gross motor typically developing group (TGMD-3 traditional protocol)
performance [r(26) = 0.61, p = 0.001, 95% CI (0.31, 0.80)]. and the ASD groups (TGMD-3 traditional protocol and
Furthermore, when matched in accordance to chronological TGMD-3 visual support protocol). Small effect sizes and
age and sex, a statistically significant difference between wide confidence intervals further support that TGMD-3
the typically developing group and the ASD group was gross motor performance scores were not influenced by
further highlighted. In this analysis, the typically devel- sex for the typically developing group in the locomotor
oping group scored significantly higher on the TGMD-3 [d = 0.13, 95% CI (−0.73, 1.00)] and ball skills [d = 0.082,
traditional protocol than the ASD group for the locomo- 95% CI (−0.94, 0.78)] subtests, and overall gross motor
tor subtest, [t(13) = 3.80, p = 0.002, 95% CI (4.72, 17.1)], performance [d = 0.029, 95% CI (−0.84, 0.89)]. Similar
ball skills subtest, [t(13) = 3.36, p = 0.005, 95% CI (3.92, conclusions were obtained for the ASD group, with small
18.1)], and overall gross motor performance, [t(13) = 3.86, effect sizes and wide confidence intervals established for
p = 0.002, 95% CI (9.67, 34.2)]. the locomotor [d = 0.27, 95% CI (−0.89, 1.44)] and ball
Moderate to large and statistically significant correla- skills [d = 0.25, 95% CI (−0.91, 1.41)] subtests, and over-
tions were established between TGMD-3 gross motor per- all gross motor performance scores [d = 0.28, 95% CI
formance scores and chronological age for the typically (−0.88, 1.45)] of the TGMD-3 traditional protocol. Fur-
developing group in the locomotor [r(19) = 0.46, p = 0.035, thermore, the effect sizes and 95% confidence intervals for

Table 6  Difference between the ASD—tradi- TD—traditional t-value df p 95% CI difference


TGMD-3 traditional protocol tional (N = 14) (N = 14)
performance scores of the
typically developing group and M SD M SD
the ASD group
Locomotor skills 20.6 9.19 31.6 5.85 3.75 26 0.001 (4.94, 16.9)
Ball skills 31.0 9.25 42.0 7.22 3.51 26 0.002 (4.55, 17.4)
Overall 51.6 17.4 73.6 11.5 3.93 26 0.001 (10.5, 33.4)

13
J Autism Dev Disord

Table 7  Difference between Males Females t-value p value 95% CI difference


TGMD-3 subtests and overall
gross motor performance M SD M SD
scores and sex for the typically
developing group and the ASD Typically developing N = 12 N=9
groups Locomotor skills 30.8 6.03 31.6 5.92 0.31 0.76 (−4.73, 6.34)
Ball skills 41.8 6.94 41.3 5.20 0.19 0.85 (−6.04, 5.04)
Overall 72.6 11.9 72.9 7.98 0.070 0.95 (−8.79, 9.40)
ASD Traditional N = 10 N=4
Locomotor skills 21.4 8.76 18.8 11.4 0.42 0.69 (−19.4, 14.1)
Ball skills 31.7 6.33 29.3 15.7 0.30 0.78 (−26.5, 21.6)
Overall 53.1 13.9 48.0 26.7 0.36 0.74 (−45.6, 35.4)
ASD visual N=8 N=4
Locomotor skills 25.9 11.2 26.8 16.5 0.096 0.93 (−23.5, 25.3)
Ball skills 33.1 7.10 31.8 15.9 0.17 0.88 (−25.5, 22.7)
Overall 59.0 17.3 58.5 31.9 0.029 0.98 (−48.4, 47.4)

the TGMD-3 visual support protocol performance scores Aside from the differing versions of the TGMD and the
of the ASD group were, d = 0.069, 95% CI (−1.13, 1.27), small sample size used in the current study, geographical
d = 0.12, 95% CI (−1.08, 1.32), and d = 0.022, 95% CI location is an influencing factor in the discrepancy between
(−1.18, 1.22), respectively. the internal consistency of the TGMD-3 for the typically
developing sample in this study, and in previous studies.
Cultural tendencies, such as sporting preferences, differ
Discussion internationally, and can influence the fundamental motor
skills children learn and develop competency in. In the
The purpose of this study was to evaluate the psychomet- United States the prevalence of baseball can contribute to
ric properties (aspects of construct validity and reliabil- children being more proficient in skills such as the two-
ity) of the TGMD-3 traditional protocol and the modified hand strike in the TGMD, compared to children in Aus-
TGMD-3 visual support protocol. In doing so, the aim was tralia, where sports like tennis may be more common. This
to establish whether the TGMD-3 is suitable in assessing may have been reflected in the low internal consistency
the gross motor performance of typically developing chil- achieved in the TGMD-3 ball skills subtest for the typically
dren, and if the inclusion of the TGMD-3 visual support developing group. This outcome is consistent with previ-
protocol is an appropriate instrument to accurately measure ous studies which have been conducted in countries outside
the gross motor performance of children with ASD. the United States (Simons and Van Hombeeck 2003). As
normative data for the TGMD-3 is currently not available
Reliability internationally, including within Australia, no cultural com-
parisons could be made to determine if the results obtained
The results support the hypothesis that the TGMD-3 tra- in this study are a reflection of the fundamental motor skill
ditional protocol and the TGMD-3 visual support protocol competency of typically developing children in Australia.
are reliable in measuring the gross motor performance for Future research is recommended in this area when norma-
typically developing children and children with ASD. The tive data becomes available.
good levels of internal consistency, and excellent levels of The SEMs reported for internal consistency, are consid-
test–retest, interrater and intrarater reliability achieved for erably larger in this study in comparison to previous stud-
the typically developing group and using both TGMD-3 ies that have used the TGMD-2 (Ulrich 2000; Weir 2005).
protocols for the ASD groups in the current study, are Increased SEMs were anticipated for children with ASD in
comparable to previous studies that have observed the this study, compared to typically developing children, due
reliability of the TGMD-2 (Barnett et al. 2013; Kim et al. to a reduced consistency in their motor performance, which
2014; Ulrich 2000; Valentini 2012). However, formulat- could be a reflection of an inadequate understanding of the
ing assumptions between the results obtained in this study task requirements. As the SEMs are marginally smaller
and with previous studies would not be entirely accurate as in the TGMD-3 visual support protocol compared to the
these studies have used different versions of the TGMD, TGMD-3 traditional protocol for the ASD group, this lends
sample characteristics, geographical locations and statisti- support to the hypothesis that the inclusion of picture task
cal procedures. cards in the TGMD-3 visual support protocol improves task

13
J Autism Dev Disord

understanding for children with ASD. Although the SEM performance when measured using the TGMD-3 visual
values were larger than in previous studies, the average support protocol. The results obtained in this study high-
amount of error in the scores for this study was similar for light the importance of including picture task cards in the
both the TGMD-3 traditional protocol and TGMD-3 visual TGMD-3 to improve task understanding and provide an
support protocol. accurate interpretation of gross motor performance. The
The test–retest reliability, obtained for both the typi- enhanced motor performance achieved using the TGMD-3
cally developing group and ASD groups are consistent with visual support protocol in this study is consistent with pre-
typically developing populations in earlier studies (Kim vious studies that have modified movement skill assess-
et al. 2014; Ulrich 2000; Valentini 2012). Somewhat larger ments with the inclusion of visual supports to accommo-
SEMs and wider confidence intervals were calculated for date for children with ASD (Breslin and Rudisill 2011; Liu
the test–retest reliability of the ASD groups in this study. and Breslin 2013b). Liu and Breslin (2013b) found that the
The divergence in scores is likely to be associated with the addition of a picture schedule in the MABC-2 significantly
inconsistency and variation in motor performance which is improved the fundamental motor skills of children with
typically observed among children with ASD. ASD. Furthermore, Breslin and Rudisill (2011) found that
The excellent levels of interater reliability established a picture task card protocol produced significantly greater
across the board in this study are in agreement with other TGMD-2 performance scores for children with ASD when
studies that have measured the interrater reliability of the compared to the traditional TGMD-2 protocol and a picture
TGMD-2 for typically developing children (Barnett et al. schedule protocol.
2013; Kim et al. 2014; Ulrich 2000; Valentini 2012). In this Furthermore, the results show a statistically signifi-
study, the majority of ICCs for intrarater reliability for the cant correlation between the TGMD-3 raw scores and
typically developing group and ASD groups were higher chronological age for typically developing children, with
than interrater reliability. This finding supports previous TGMD-3 performance improving with age. This has been
evidence that an examiner is more likely to have higher demonstrated in previous research, which has shown that
scores for the intrarater reliability test, as opposed to the competency in fundamental movement skills improves
interrater reliability test, whereby differences in individual with chronological age, highlighting the effectiveness of
viewpoints and methods between examiners can result in the TGMD-3 to identify developmental changes associated
lower scores (Portney and Watkins 1993). with age among typical developing children (McKenzie
et al. 2002; Okely and Booth 2004; Williams et al. 2008;
Validity Ulrich 2000). In relation to the TGMD-2, Ulrich (2000)
showed comparable results to this study in that the gross
In this study, children with ASD achieved significantly motor performance of typically developing children was
lower raw scores on the TGMD-3 traditional protocol com- highly associated with chronological age for both loco-
pared to typically developing peers who were matched for motor (r = 0.69–0.72, p < 0.05) and ball skills subtests
chronological age and sex. This is consistent with existing (r = 0.71–0.75, p < 0.05).
studies and literature, whereby children with ASD exhibit Previous studies have also shown that the motor perfor-
reduced competency in fundamental movement skills mance of children with ASD improves with age, albeit at
compared to typically developing children (Dewey et al. a slower rate than their typically developing peers (Hauck
2007; Hilton et al. 2007, 2012; Liu and Breslin 2013a; Liu and Dewey 2001; Landa and Garrett-Mayer 2006; Lloyd
et al. 2014; Pan et al. 2009; Provost et al. 2007; Staples et al. 2011; Staples and Reid 2010). In contrast, this study
and Reid 2010). This verifies the ability of the TGMD-3 did not establish a significant correlation between the
to successfully identify children who display deficits in TGMD-3 raw scores and chronological age for either ASD
gross motor performance (Ulrich 2000). Previous editions groups (TGMD-3 traditional protocol and TGMD-3 visual
of the TGMD-3 have also demonstrated the efficiency of support protocol). Although not comparable with stud-
the assessment instrument and its capacity to distinguish ies observing the motor development patterns of children
between the gross motor ability of two divergent groups of with ASD, the results are comparable to studies of children
children (Simons et al. 2007; Ulrich 1985, 2000). with other disabilities that are also associated with delays
The results of this study illustrate that when compared in motor development. Simons et al., (2007) found that
to the TGMD-3 traditional protocol, the administration of the TGMD-2 performance scores for children with intel-
the TGMD-3 visual support protocol produced significantly lectual disabilities were not associated with chronological
higher raw scores for children with ASD for both the loco- age for the locomotor subtest (r = 0.16, p = 0.12), however,
motor and ball skills subtests, and overall gross motor per- a very small correlation was observed for the ball skills
formance. Of the 12 children with ASD that were tested, subtest (r = 0.25, p < 0.05). Further research is required to
11 showed significant improvements in their gross motor determine whether the differences in motor development

13
J Autism Dev Disord

observed in this study are a reflection of the small sample only display the essential visual information (Fittipaldi-
size, particularly within each age category, or if the motor Wert and Mowling 2009; Grenier and Yeaton 2011; Hou-
development trajectory of children with ASD is inconsist- ston-Wilson and Lieberman 2003; Waugh et al. 2007). The
ent compared to typically developing children. Another overuse of pictures and text on a single picture task card
possibility is that the motor skill development of children can be distracting and cause confusion during the process-
with ASD plateaus and remains in a plateau longer than ing of the visual information presented (Fittipaldi-Wert and
typical developing children unless they experience a higher Mowling 2009; Grenier and Yeaton 2011; Houston-Wilson
frequency and intensity of training as they age. and Lieberman 2003; Waugh et al. 2007). Taking this into
There were no significant differences between the account, if a child was having difficulty comprehending the
TGMD-3 raw scores of males and females for the typi- visual information displayed on the picture card, the prin-
cally developing group or ASD groups. These results differ cipal investigator would focus the child’s attention on one
from the literature, which illustrates that the fundamental singular image that best depicted each TGMD-3 assess-
motor skill performance of typically developing children ment item to improve understanding.
is greatly influenced by gender, particularly for ball skills Furthermore, Meadan et al. (2011) and Schultheis et al.
(Barnett et al. 2010; Hardy et al. 2010; Okely and Booth (2000) recommended that the choice of visual supports
2004; Ulrich 2016). As such, it is believed that the results should complement the developmental age of the individ-
obtained in the present study are influenced by the small ual. This could also explain why some children appeared
sample size. Particularly when compared to studies with a overwhelmed by the picture cards provided, as these chil-
considerably larger sample size, where there was a marked dren were in the lower end of the age range and could
difference between male and female TGMD-2 gross motor not comprehend the text incorporated as they were yet to
performance scores for the ball skills subtest (Parks et al. achieve reading competency. As this study did not take into
1999; Ulrich 2000). consideration the developmental age of participants, and a
In addition, a reduced number of female participants wide chronological age range existed, having both images
recruited for the ASD group of this study could have and text available on the picture cards catered for all par-
affected the test’s capacity to identify a true difference ticipants’ preferred visual learning style and comprehen-
between TGMD-3 gross motor performance and gender sion level. Reducing the amount of text to singular words
in the ASD groups. Lloyd et al. (2011) concluded that or short phrases that correspond with each PCS may fur-
no significant differences in fine and gross motor skills ther facilitate improved understanding (Menear and Smith
occurred between male and female toddlers with ASD 2011). Future researchers, practitioners and authors of
(p = 0.39). However, these results could have also been movement skill assessments who are considering the use of
affected by the considerably smaller number of female picture task cards and other visual support techniques are
participants compared to males in their study. Inconclu- encouraged to adopt a minimalistic approach that is devel-
sive evidence throughout the literature makes it difficult to opmentally appropriate for the population of interest when
confirm whether gender differences in motor performance designing visual supports to ensure maximum benefits are
exist among children with ASD, partially due to the pre- obtained.
dominance of males in the ASD population (CDC 2014). A lengthy acclimatisation period was unfeasible to
Further research with larger sample size and female repre- incorporate in the study design. Block et al. (1998) out-
sentation is required before assumptions can be made about lined the importance of familiarizing children with ASD
whether gender contributes to competency of fundamental to the testing environment, equipment, procedures and
movement skills among children with ASD. the research team prior to commencing testing in order to
prevent anxiety and distractions influencing performance
Limitations and Future Research results. Breslin and Rudisill (2011) and Whyatt and Craig
(2012) demonstrated the effectiveness of including a famil-
Occasionally during the delivery of the TGMD-3 visual iarization period when using the TGMD-2 and MABC-2
support protocol it was observed that some children had dif- to measure the gross motor performance of children with
ficulty processing the visual information displayed on the ASD. Not only did they find it beneficial in reducing
picture task cards. While the majority of participants dem- anxiety and facilitating performance, but it also allowed
onstrated that they understood the picture cards presented, researchers to establish a relationship with the child and
the combination of a series of PCS (between three and five become acquainted with the child’s abilities and charac-
PCS per picture card) and a large amount of text may have teristic mannerisms. If practical, future studies are advised
been overwhelming and affected TGMD-3 performance. to include an acclimatisation period in their study design
Research has recommended that picture task cards used in when testing children with ASD to maximise the child’s
physical activity environments should be kept simple and performance.

13
J Autism Dev Disord

This study did not take into consideration the IQ level, Similarly, the inclusion of siblings in this study
cognitive function or communication ability of participants accounted for 43% (N = 9) of all participants in the typi-
with ASD in comparison to typically developing peers. Pre- cally developing sample. Of the nine siblings, one was an
vious research has shown that the severity of gross motor identical twin to a child in the ASD sample and one was
impairments is related to IQ level and language competency an opposite sex fraternal twin to a child in the ASD sam-
in children with ASD (Ghaziuddin and Butler 1998; Green ple. The inclusion of siblings in the typically developing
et al. 2009; Whyatt and Craig 2012). It is also thought that sample is not believed to have influenced the analysis of the
reduced cognitive function may affect the comprehension difference between the TGMD-3 gross motor performance
of tasks in physical activity environments, further contrib- scores of typically developing children and children with
uting to delays in gross motor performance (Green et al. ASD. All typically developing siblings performed greater
2009). Controlling for these components would clarify the than siblings with ASD, irrespective of chronological age,
extent to which task understanding, and consequently gross including both sets of identical and fraternal twins. Hilton
motor performance, genuinely improved with the incorpo- et al. (2012) uncovered similar results, whereby children
ration of picture task cards in the TGMD-3 visual support who were undiagnosed with ASD had significantly better
protocol. motor performance than their siblings with ASD.
Time constraints did not allow for diagnostic assess- Picture task cards were chosen for use in the TGMD-3
ments to be included in the study design to confirm par- visual support protocol of this study because they are an
ticipants’ diagnosis. As a result, a diagnosis of ASD was economical, portable and easily replicated visual aid, and
established based only on the medical information provided have been demonstrated to improve performance on the
by participants’ legal guardian. In Australia, children are TGMD-2 (Breslin and Rudisill 2011; Meadan et al. 2011).
generally referred to a paediatrician, psychiatrist and/or a However, future research should consider exploring options
psychologist for screening and diagnosis of ASD (Skel- beyond the traditional picture task cards used in this study
lern et al. 2005). However, the diagnostic procedures and to determine the most effective visual approach in facilitat-
terminology used for ASD within Australia vary consid- ing task understanding in the TGMD-3 and to provide an
erably between the different states/territories, and when accurate measure of gross motor performance. For exam-
compared to overseas practices (Parner et al. 2011; Skel- ple, electronic tablet applications are regularly used among
lern et al. 2005; Williams et al. 2005). In addition, medi- children with developmental disabilities, including ASD,
cal practitioners in Queensland have reported an increased and have been demonstrated as an effective approach in
incentive to authorise ASD diagnoses so individuals can be developing communication skills and encouraging pur-
eligible for government benefits, such as funding and spe- poseful participation in leisure, academic and employ-
cial education services, despite not meeting all the diagnos- ment environments (Kagohara et al. 2013). It has also been
tic criteria (Skellern et al. 2005). The classification systems observed that children with ASD have reduced levels of
and assessment instruments used also vary among medical motivation to engage in physical activity, which may influ-
practitioners within Australian states and territories, further ence TGMD-3 performance scores (Obrusnikova and Cav-
contributing to the conflicting diagnostic procedures (Skel- alier 2011; Pope et al. 2012). Future studies may also find
lern et al. 2005; Williams et al. 2005). it beneficial to observe whether adaptations to the TGMD-3
Within this study, there were a number of limitations testing conditions stimulate improved performance, such as
linked to the participant samples which were used. Both the the inclusion of reward systems, verbal encouragement and
typically developing group and the ASD groups contained goal-directed activities (Lang et al. 2010; Pope et al. 2012;
small sample sizes, including the total participant sample, Reid et al. 2003).
and across gender and age categories. The challenge of
obtaining an appropriately sized homogenous sample to
produce meaningful results has been recognized in adapted Conclusion
physical activity research, including research investigat-
ing the fundamental motor skills of children with ASD This study demonstrated that the TGMD-3 visual sup-
(Berkeley et al. 2001; Breslin and Rudisill 2011; Lavay and port protocol is valid and reliable for measuring the
Lasko-McCarthey 1992; Pan et al. 2009; Sutlive and Ulrich motor performance of children with ASD. The TGMD-3
1998). Future research exploring the benefits of the inclu- was modified to incorporate visual supports to facilitate
sion of visual supports in movement skill assessments to task understanding and provide a true representation of
accurately assess the motor performance of children with their motor performance. Although children with ASD
ASD should consider a larger sample size across all gender, were found to have reduced motor performance compared
age categories and geographical regions. to typically developing peers, the inclusion of visual

13
J Autism Dev Disord

supports was established as an effective means of improv- ethnicities, gender division and SES would offer a more
ing their TGMD-3 performance scores. conclusive representation of the true potential of visual
The application of the visual support protocol demon- supports in assisting children with ASD and other devel-
strates the importance of the inclusion of visual supports, opmental disabilities.
such as picture task cards, in movement skill assessments.
At present, there are no widely available movement skill Author Contributions All authors made a substantial contribu-
tion to the study. The study was designed by KA and JS. JS and DU
assessments which include visual supports for application supervised the study and KA collected the data. KA and JS conducted
among children with developmental disabilities, includ- the statistical analyses. All authors contributed to the writing of the
ing children with ASD. Due to the tendency of children manuscript, and have read and approved the final manuscript.
with ASD to process tasks visually, assessments of motor
Compliance with Ethical Standards
performance that incorporate visual supports can reduce
anxiety levels, facilitate a greater task understanding, and
Conflict of interest K. Allen, B. Bredero, T. Van Damme, D. Ulrich
should be more readily available. and Johan Simons declare they have no conflict of interest.
Promoting and highlighting the availability of a valid
and reliable movement skill assessment for children with Ethical Approval All procedures performed in studies involving
ASD will assist health practitioners and physical educa- human participants were in accordance with the ethical standards of
the institutional and/or national research committee and with the 1964
tors to obtain a better understanding of the child’s motor Helsinki declaration and its later amendments or comparable ethical
ability to develop more accurate individualized motor standards.
skill interventions. This will generate an improved com-
petency in fundamental motor skills and encourage life- Informed consent Informed consent was obtained from all individ-
long physical activity behaviors. As a result, the devel- ual participants included in the study.
opers of movement skill assessments are encouraged to
modify assessment protocols to include visual supports to
assist the performance of children with ASD. Appendix: TGMD‑3 Visual Supports
As this study was conducted on a relatively small
scale, with a focus solely on Australian children, The Picture Communication Symbols 1981–2013 by Dyna-
researchers are encouraged to replicate this study on a Vox Mayer-Johnson LLC. All Rights Reserved Worldwide.
broader scale internationally so that the results can be Used with permission. Adapted by University of Michi-
corroborated and refined to determine additional ben- gan, School of Kinesiology, Centre for Physical Activity &
efits of visual supports when used as part of the TGMD- Health in Pediatric Disabilities (see Figs. 1, 2, 3, 4).
3. A greater sample size consisting of a broader scale of

13
J Autism Dev Disord

Fig. 1  Locomotor skills picture


task cards (run, gallop and hop)

13
J Autism Dev Disord

Fig. 2  Locomotor skills picture


task cards (skip, horizontal
jump and slide)

13
J Autism Dev Disord

Fig. 3  Ball skills picture task cards (two-hand strike, one-hand forehand strike, dribble and catch)

13
J Autism Dev Disord

Fig. 4  Ball skills picture task


cards (kick, overhand throw and
underhand throw)

References development-2. Journal of Science and Medicine in Sport.


doi:10.1016/j.jsams.2013.09.013.
Barnett, L. M., van Beurden, E., Morgan, P. J., Brooks, L. O., &
American Psychiatric Association (2013). Diagnostic and statistical
Beard, J. R. (2010). Gender differences in motor skill profi-
manual of mental disorders (5th ed.). Arlington, VA: American
ciency from childhood to adolescence. Research Quarterly for
Psychiatric Association.
Exercise and Sport, 81(2), 162–170.
Barnett, L. M., Minto, C., Lander, N., & Hardy, L. L. (2013). Inter-
Bayley, H. (2006). Bayley scales of infant and toddler development
rater reliability assessment using the test of gross motor
(3rd ed.). San Antonio, TX: The Psychological Corporation.

13
J Autism Dev Disord

Bayley, N. (1969). Bayley scales of infant development. San Antonio, hyperactivity disorder. Journal of the International Neuropsy-
TX: The Psychological Corporation. chological Society, 13(2), 246–256.
Bayley, N. (1993). Bayley scales of infant development (2nd ed.). San Dummer, G. M., Haubenstricker, J. L., & Stewart, D. A. (1996).
Antonio, TX: The Psychological Corporation. Motor skill performance of children who are deaf. Adapted
Berkeley, S. L., Zittel, L. L., Pitney, L. V., & Nichols, S. E. (2001). Physical Activity Quarterly, 13(4), 400–414.
Locomotor and object control skills of children diagnosed with Durlak, J. A. (2009). How to select, calculate, and interpret effect
autism. Adapted Physical Activity Quarterly, 18(4), 405–416. sizes. Journal of Pediatric Psychology, 34(9), 917–928.
Bhat, A. N., Landa, R. J., & Galloway, J. C. (2011). Current per- Dziuk, M. A., Larson, J. C. G., Apostu, A., Mahone, E. M.,
spectives on motor functioning in infants, children and adults Denckla, M. B., & Mostofsky, S. H. (2007). Dspraxia in
with autism spectrum disorders. Physical Therapy, 91(7), autism: Association with motor, social, and communica-
1116–1129. tive deficits. Developmental Medicine and Child Neurology,
Biernacki, P., & Waldorf, D. (1981). Snowball sampling. Problems 49(10), 734–739.
and techniques of chain referral sampling. Sociological methods Evaggelinou, C., Tsigilis, N., & Papa, A. (2002). Construct valid-
& research, 10(2), 141–163. ity of the test of gross motor development: A cross-valida-
Block, M. E., Lieberman, L. J., & Connor-Kuntz, F. (1998). Authentic tion approach. Adapted Physical Activity Quarterly, 19(4),
assessment in adapted physical education. Journal of Physical 483–495.
Education, Recreation & Dance, 69(3), 48–55. Fittipaldi-Wert, J., & Mowling, C. M. (2009). Using visual supports
Breslin, C. M., & Liu, T. (2015). Do you know what I’m saying? for students with autism in physical education. Journal of Phys-
Strategies to assess motor skills for children with autism spec- ical Education, Recreation & Dance, 80(2), 39–43.
trum disorder. Journal of Physical Education, Recreation & Folio, M. R., & Fewell, R. R. (1983). Peabody developmental motor
Dance, 86(1), 10–15. scales and activity cards. Austin, TX: Pro-Ed.
Breslin, C. M., & Rudisill, M. E. (2011). The effect of visual sup- Folio, M. R., & Fewell, R. R. (2000). Peabody developmental motor
ports on performance of the TGMD-2 for children with autism scales. Austin, TX: Pro-Ed.
spectrum disorder. Adapted Physical Activity Quarterly, 28(4), Fournier, K. A., Hars, C. J., Naik, S. K., Lodla, N., & Cauraugh, J.
342–353. H. (2010). Motor coordination in autism spectrum disorders:
Bruininks, R. H. (1978). Bruininks-oseretsky test of motor proficiency. A synthesis and meta-analysis. Journal Autism Developmental
Circle Pines, MN: American Guidance Service. Disorders, 40(10), 1227–1240.
Bruininks, R. H., & Bruininks, B. D. (2005). Bruininks-oseretsky Ghaziuddin, M., & Butler, E. (1998). Clumsiness in autism and asper-
test of motor proficiency (2nd ed.). Circle Pines, MN: AGS ger syndrome: A further report. Journal of Intellectual Disabil-
Publishing. ity Research, 42(1), 43–48.
Bryan, L. C., & Gast, D. L. (2000). Teaching on-task and on-schedule Green, A., & Sandt, D. (2013). Understanding the picture exchange
behaviors to high-functioning children with autism via picture communication system and its application in physical educa-
activity schedules. Journal of Autism and Developmental Disor- tion. Journal of Physical Education, Recreation & Dance,
ders, 30(6), 553–567. 84(2), 33–39.
Burton, A. W., & Miller, A. (1998). Movement skill assessment. Green, D., Charman, T., Pickles, A., Chandler, S., Loucas, T.,
Champaign, IL: Human Kinetics. Simonoff, E., & Baird, G. (2009). Impairment in movement
Centers for Disease Control and Prevention (CDC) (2014). Prevalence skills of children with autistic spectrum disorders. Developmen-
of autism spectrum disorders—Autism and developmental dis- tal Medicine & Child Neurology, 51(4), 311–316.
abilities monitoring network, 11 sites, United States, 2010. Grenier, M., & Yeaton, P. (2011). Previewing. Journal of Physical
MMWR Surveillance Summaries, 63(2), 1–21. Education, Recreation & Dance, 82(1), 28–43.
Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for Hardy, L. L., King, L., Farrell, L., Macniven, R., & Howlett, S.
evaluating normed and standardized assessment instruments in (2010). Fundamental movement skills among Australia pre-
psychology. Psychological Assessment, 6(4), 284–290. school children. Journal of Science and Medicine in Sport,
Cicchetti, D. V., & Sparrow, S. S. (1981). Developing criteria for 13(5), 503–508.
establishing interrater reliability of specific items: Applica- Hauck, J. A., & Dewey, D. (2001). Hand preference and motor func-
tions to assessment of adaptive behavior. American Journal of tioning in children with autism. Journal of Autism and Develop-
Mental Deficiency, 86(2), 127–137. mental Disorders, 31(3), 265–277.
Cicchetti, D. V., & Sparrow, S. S. (1990). Assessment of adaptive Henderson, S. E., & Sugden, D. A. (1992). Movement assessment bat-
behavior in young children. In J. J. Johnson & J. Goldman tery for children. London: The Psychological Corporation.
(Eds.), Developmental assessment in clinical child psychol- Henderson, S. E., Sugden, D. A., & Barnett, A. L. (2007). Movement
ogy: A handbook (pp. 173–196). New York, NY: Pergamon assessment battery for children (2nd ed.). London, UK: The
Press. Psychological Corporation.
Cohen, J. (1988). Statistical power analysis for the behavioral sci- Hilton, C., Wente, L., LaVesser, P., Ito, M., Reed, C., & Herzberg, G.
ences (2nd ed.). Hillsdale, NJ: Lawrence Earlbaum Associates. (2007). Relationship between motor skill impairment and sever-
Cools, W., De Martelaer, K., Samaey, C., & Andries, C. (2009). ity in children with Asperger syndrome. Research in Autism
Movement skill assessment of typically developing preschool Spectrum Disorders, 1(4), 339–349.
children: A review of seven movement skill assessment tools. Hilton, C. L., Zhang, Y., Whilte, M. R., Klohr, C. L., & Constantino,
Journal of Sports Science and Medicine, 8(2), 154–168. J. (2012). Motor impairment in sibling pairs concordant and dis-
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of cordant for autism spectrum disorders. Autism, 16(4), 430–441.
tests. Psychometrika, 16(3), 297–334. Hopkins, W. G. (2000). Measures of reliability in sports medicine and
Deitz, J. C., Kartin, D., & Kopp, K. (2007). Review of the bruininks- science. Sports Medicine, 30(1), 1–15.
oseretsky test of motor proficiency, second edition (BOT-2). Houston-Wilson, C., & Lieberman, L. J. (2003). Strategies for teach-
Physical & Occupational Therapy in Pediatrics, 27(4), 87–102. ing students with autism in physical education. Journal of Phys-
Dewey, D., Cantell, M., & Crawford, S. G. (2007). Motor and ges- ical Education, Recreation & Dance, 74(6), 40–44.
tural performance in children with autism spectrum disorders, Houwen, S., Hartman, E., Jonker, L., & Visscher, C. (2010). Reliabil-
developmental coordination disorder, and/or attention deficit ity and validity of the TGMD-2 in primary-school-age children

13
J Autism Dev Disord

with visual impairments. Adapted Physical Activity Quarterly, Ming, X., Brimacombe, M., & Wagner, G. C. (2007). Prevalence
27(2), 143–159. of motor impairment in autism spectrum disorders. Brain and
IBM Corp. (2013). IBM SPSS statistics for windows, version 22.0. Development, 29(9), 565–570.
Armonk, NY: IBM Corp. Morgan, W. A. (1939). A test for significance of the difference
Kagohara, D. M., van der Meer, L., Ramdoss, S., O’Reilly, M. F., between the two variances in a sample from a normal bivariate
Lancioni, G. E., Davis, T. N., … & Sigafoos, J. (2013). Using population. Biometrika, 31(1–2), 13–19.
iPods and iPads in teaching programs for individuals with Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York,
developmental disabilities: A systematic review. Research in NY: McGraw-Hill.
Developmental Disabilities, 34(1), 147–156. Obrusnikova, I., & Cavalier, A. R. (2011). Perceived barriers and
Kim, S., Kim, M. J., Valentini, N. C., & Clark, J. E. (2014). Validity facilitators of participation in after-school physical activity by
and reliability of the TGMD-2 for South Korean children. Jour- children with autism spectrum disorders. Journal of Develop-
nal of Motor Behavior, 46(5), 351–356. mental and Physical Disabilities, 23(3), 195–211.
Kohr, R. L., & Games, P. A. (1974). Robustness of the analysis of Okely, A. D., & Booth, M. K. (2004). Mastery of fundamental mov-
variance, the welch procedure and a box procedure to hetero- ment skills among children in New South Wales: Prevalence
geneous variances. Journal of Experimental Education, 43(1), and sociodemographic distribution. Journal of Science and
61–69. Medicine in Sport, 7(3), 358–372.
Landa, R., & Garrett-Mayer, E. (2006). Development in infants with Ozonoff, S., Young, G. S., Goldring, S., Greiss-Hess, L., Herrera, A.
autism spectrum disorders: A prospective study. Journal of M., Steele, J., … & Rogers, S. J. (2008). Gross motor devel-
Child Psychology and Psychiatry, 47(6), 629–638. opment, movement abnormalities, and early identification of
Lang, R., Koegel, L. K., Ashbaugh, K., Regester, A., Ence, W., & autism. Journal of Autism and Developmental Disorders, 38(4),
Smith, W. (2010). Physical exercise and individuals with autism 644–656.
spectrum disorders: A systematic review. Research in Autism Pan, C., Tsai, C., & Chu, C. (2009). Fundamental movement skills in
Spectrum Disorders, 4(4), 565–576. children diagnosed with autism spectrum disorders and atten-
Lavay, B., & Lasko-McCarthey, P. (1992). Adapted physical activity tion deficit hyperactivity disorder. Journal of Autism and Devel-
research: Issues and recommendations. Adapted Physical Activ- opmental Disorders, 39(12), 1694–1705.
ity Quarterly, 9(3), 189–196. Parks, J. B., Shewokis, P. A., & Costa, C. A. (1999). Using statistical
Leonard, H. C., Bedford, R., Charman, T., Elsabbagh, M., Johnson, power analysis in sport management research. Journal of Sport
M. H., & Hill, E. L. (2014). Motor development in children at Management, 13(2), 139–147.
risk of autism: A follow-up study of infant siblings. Autism, Parner, E. T., Thorsen, P., Dixon, G., de Klerk, N., Leonard, H., Nas-
18(3), 281–291. sar, N., … & Glasson, E. J. (2011). A comparison of autism
Liu, T. (2012). Motor milestone development in young children prevalence trends in Denmark and Western Australia. Journal
with autism spectrum disorders: An exploratory study. Edu- of Autism and Developmental Disorders, 41(12), 1601–1608.
cational Psychology in Practice: Theory, Research and Prac- Pitman, E. G. (1939). A note on normal correlation. Biometrika,
tice in Educational Psychology, 28(3), 315–326. 31(1–2), 9–12.
Liu, T., & Breslin, C. M. (2013a). Fine and gross motor perfor- Pope, M., Liu, T., Breslin, C. M., & Getchell, N. (2012). Using con-
mance of the MABC-2 by children with autism spectrum dis- straints to design developmentally appropriate movement activi-
order and typically developing children. Research in Autism ties for children with autism spectrum disorders. Journal of
Spectrum Disorders, 7(10), 1244–1249. Physical Education, Recreation & Dance, 83(2), 35–41.
Liu, T., & Breslin, C. M. (2013b). The effect of a picture activity Portney, L. G., & Watkins, M. P. (1993). Foundations of clinical
schedule on performance of the MABC-2 for children with research. Norwalk, CT: Appleton & Lange.
autism spectrum disorder. Research Quarterly for Exercise Provost, B., Lopez, B. R., & Heimerl, S. (2007). A comparison of
and Sport, 84(2), 206–212. motor delays in young children: Autism spectrum disorder,
Liu, T., Hamilton, M., Davis, L., & ElGarhy, S. (2014). Gross developmental delay, and developmental concerns. Journal of
motor performance by children with autism spectrum disor- Autism and Developmental Disorders, 37(2), 321–328.
der and typically developing children on TGMD-2. Journal of Quill, K. A. (1995). Visually cued instruction for children with autism
Child & Adolescent Behavior, 2(1), 1–4. and pervasive developmental disorders. Focus on Autism and
Lloyd, M., MacDonald, M., & Lord, C. (2011). Motor skills of Other Developmental Disabilities, 10(3), 10–20.
toddlers with autism spectrum disorders. Autism, 17(2), Rao, S. M., & Gagie, B. (2006). Learning through seeing and doing:
133–146. Visual supports for children with autism. Teaching Exceptional
McGraw, K. O., & Wong, S. P. (1996). Forming inferences about Children, 38(6), 26–33.
some intraclass correlation coefficients. Psychological Methods, Reid, G., O’Connor, J., & Lloyd, M. (2003). The autism spectrum dis-
1(1), 30–46. orders: Physical activity instruction-part III. Palaestra, 19(2),
McKenzie, T. L., Sallis, J. F., Broyles, S. L., Zive, M. M., Nader, P. 20–29.
R., Berry, C. C., & Brennan, J. J. (2002). Childhood movement Schultheis, S. F., Boswell, B. B., & Decker, J. (2000). Success-
skills: Predictors of physical activity in Anglo American and ful physical activity programming for students with autism.
Mexican American adolescents? Research Quarterly for Exer- Focus on Autism and Other Developmental Disabilities, 15(3),
cise and Sport, 73(3), 238–244. 159–162.
Meadan, H., Ostrosky, M. M., Triplett, B., Michna, A., & Fettig, A. Shapiro, S. S., & Wilk, M. B. (1965). An analysis of variance test of
(2011). Using visual supports with young children with autism normality (complete samples). Biometrika, 53(3–4), 591–611.
spectrum disorder. Teaching Exceptional Children, 43(6), Shetreat-Klein, M., Shinnar, S., & Rapin, I. (2014). Abnormalities of
28–35. joint mobility and gait in children with autism spectrum disor-
Menear, K. S., & Smith, S. C. (2011). Teaching physical education to ders. Brain and Development, 38(2), 91–96.
students with autism spectrum disorders. Strategies: A Journal Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses
for Physical and Sport Educators, 24(3), 21–24. in assessing rater reliability. Psychological Bulletin, 86(2),
420–428.

13
J Autism Dev Disord

Simons, J., Daly, D., Theodorou, F., Caron, C., Simons, J., & Ando- Ulrich, D. A. (2016). Test of gross motor development (3rd ed.). Aus-
niadou, E. (2007). Validity and reliability of the TGMD-2 in tin, TX: Pro-Ed. http://www.kines.umich.edu/tgmd3.
7-10-year-old Flemish children with intellectual disability. Valentini, N. C. (2012). Validity and reliability of the TGMD-2 for
Adapted Physical Activity Quarterly, 25(1), 71–82. Brazilian children. Journal of Motor Behavior, 44(4), 275–280.
Simons, J., & Van Hombeeck, C. (2003). Toepasbaarheid van de test Waugh, L., Bower, T., & French, R. (2007). Use of picture cards in
of gross motor development (2nd ed.). Kinevaria, 39(4), 16–21. integrated physical education classes. Strategies: A Journal for
Skellern, C., McDowell, M., & Schluter, P. (2005). Diagnosis of autis- Physical and Sport Educators, 20(4), 18–20.
tic spectrum disorders in Queensland: Variations in practice. Weber, J. C., & Lamb, D. R. (1970). Statistics and research in physi-
Journal of Paediatrics and Child Health, 41(8), 413–418. cal education. St. Louis: Mosby Co.
Sparrow, S. S., Cicchetti, D. V., & Balla, D. A. (2005). Vineland Weir, J. P. (2005). Quantifying test–retest reliability using the intra-
adaptive behavior scales (2nd ed.). Livonia, MN: Pearson class correlation coefficient and the SEM. Journal of Strength
Assessments. and Conditioning Research, 19(1), 231–240.
Staples, K. L., MacDonald, M., & Zimmer, C. (2012). Assessment Welch, B. L. (1947). The generalization of ‘student’s’ problem when
of motor behavior among children and adolescents with autism several different population variances are involved. Biometrika,
spectrum disorder. International Review of Research in Devel- 34(1–2), 28–35.
opmental Disabilities, 42(1), 179–214. Whyatt, C. P., & Craig, C. M. (2012). Motor skills in children aged
Staples, K. L., & Reid, G. (2010). Fundamental movement skills and 7–10 years, diagnosed with autism spectrum disorder. Journal
autism spectrum disorders. Journal of Autism and Developmen- of Autism and Development Disorders, 42(9), 1799–1809.
tal Disorders, 40(2), 209–217. Williams, H. G., Pfeiffer, K. A., O’Neill, J. R., Dowda, M., McIver,
Sutlive, V. H., & Ulrich, D. A. (1998). Interpreting statistical signifi- K. L., Brown, W. H., & Pate, R. R. (2008). Motor skill per-
cance and meaningfulness in adapted physical activity research. formance and physical activity in preschool children. Obesity,
Adapted Physical Activity Quarterly, 15(2), 103–118. 16(6), 1421–1426.
Teitelbaum, P., Teitelbaum, O., Nye, J., Fryman, J., & Maurer, R. G. Williams, K., Glasson, E. J., Wray, J., Tuck, M., Helmer, M., Bower,
(1998). Movement analysis in infancy may be useful for early C. I., & Mellis, C. M. (2005). Incidence of autism spectrum dis-
diagnosis of autism. Proceedings of the National Academy of orders in children in two Australian states. Medical Journal of
Sciences of the United States of America, 95(23), 13982–13987. Australia, 182(3), 108–111.
Tissot, C., & Evans, R. (2003). Visual teaching strategies for chil- Yun, J., & Ulrich, D. A. (2002). Estimating measurement validity: A
dren with autism. Early Child Development and Care, 173(4), tutorial. Adapted Physical Activity Quarterly, 19(1), 32–47.
425–433. Zachor, D. A., Ilanit, T., & Itzchak, E. B. (2010). Autism severity and
Ulrich, D. A. (1985). Test of gross motor development. Austin, TX: motor abilities correlates of imitation situations in children with
Pro-Ed. autism spectrum disorders. Research in Autism Spectrum Disor-
Ulrich, D. A. (with Sanford, C. B.) (2000). Test of gross motor devel- ders, 4(3), 438–443.
opment (2nd ed.). Austin, TX: Pro-Ed.

13

You might also like