You are on page 1of 9

This article was downloaded by: [Temple University Libraries]

On: 22 April 2015, At: 07:59


Publisher: Routledge
Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office: Mortimer House,
37-41 Mortimer Street, London W1T 3JH, UK

Journal of Sports Sciences


Publication details, including instructions for authors and subscription information:
http://www.tandfonline.com/loi/rjsp20

Test of gross motor development-2 for Filipino children


with intellectual disability: validity and reliability
ab cd e
Catherine M. Capio , Kathlynne F. Eguia & Johan Simons
a
Institute of Human Performance, The University of Hong Kong, Hong Kong, Hong Kong
b
College of Allied Medical Professions, University of the Philippines, Manila, Philippines
c
Therabilities Inc., Pasig City, Philippines
d
Communicare Life Skills Development, Paranaque City, Philippines
e
Faculty of Kinesiology and Rehabilitation Sciences, University of Leuven (KU Leuven),
Leuven, Belgium
Published online: 17 Apr 2015.
Click for updates

To cite this article: Catherine M. Capio, Kathlynne F. Eguia & Johan Simons (2015): Test of gross motor development-2
for Filipino children with intellectual disability: validity and reliability, Journal of Sports Sciences, DOI:
10.1080/02640414.2015.1033643

To link to this article: http://dx.doi.org/10.1080/02640414.2015.1033643

PLEASE SCROLL DOWN FOR ARTICLE

Taylor & Francis makes every effort to ensure the accuracy of all the information (the “Content”) contained
in the publications on our platform. However, Taylor & Francis, our agents, and our licensors make no
representations or warranties whatsoever as to the accuracy, completeness, or suitability for any purpose of the
Content. Any opinions and views expressed in this publication are the opinions and views of the authors, and
are not the views of or endorsed by Taylor & Francis. The accuracy of the Content should not be relied upon and
should be independently verified with primary sources of information. Taylor and Francis shall not be liable for
any losses, actions, claims, proceedings, demands, costs, expenses, damages, and other liabilities whatsoever
or howsoever caused arising directly or indirectly in connection with, in relation to or arising out of the use of
the Content.

This article may be used for research, teaching, and private study purposes. Any substantial or systematic
reproduction, redistribution, reselling, loan, sub-licensing, systematic supply, or distribution in any
form to anyone is expressly forbidden. Terms & Conditions of access and use can be found at http://
www.tandfonline.com/page/terms-and-conditions
Journal of Sports Sciences, 2015
http://dx.doi.org/10.1080/02640414.2015.1033643

Test of gross motor development-2 for Filipino children with


intellectual disability: validity and reliability

CATHERINE M. CAPIO1,2, KATHLYNNE F. EGUIA3,4 & JOHAN SIMONS5


1
Institute of Human Performance, The University of Hong Kong, Hong Kong, Hong Kong, 2College of Allied Medical
Professions, University of the Philippines, Manila, Philippines, 3Therabilities Inc., Pasig City, Philippines, 4Communicare Life
Skills Development, Paranaque City, Philippines and 5Faculty of Kinesiology and Rehabilitation Sciences, University of
Leuven (KU Leuven), Leuven, Belgium

(Accepted 21 March 2015)


Downloaded by [Temple University Libraries] at 07:59 22 April 2015

Abstract
This study aimed to examine aspects of validity and reliability of the Test of Gross Motor Development-2 (TGMD-2) in
Filipino children with intellectual disability. Content and construct validity were verified, as well as inter-rater and intra-
rater reliability. Two paediatric physiotherapists tested 81 children with intellectual disability (mean age = 9.29 ± 2.71 years)
on locomotor and object control skills. Analysis of covariance, confirmatory factor analysis and analysis of variance were
used to test validity, while Cronbach’s alpha, intra-class correlation coefficients (ICC) and Bland–Altman plots were used to
examine reliability. Age was a significant predictor of locomotor and object control scores (P = 0.004). The data fit the
hypothesised two-factor model with fit indices as follows: χ2 = 33.525, DF = 34, P = 0.491, χ2/DF = 0.986. As hypothesised,
gender was a significant predictor for object control skills (P = 0.038). Participants’ mean scores were significantly below
mastery (locomotor, P < 0.001; object control, P < 0.001). Cronbach’s alpha was 0.830 for locomotor and 0.792 for object
control components. ICC for locomotor and object control scores ranged from 0.995 to 0.998, suggesting excellent intra-
rater and inter-rater reliability, confirmed by Bland–Altman analysis. This study provides evidence of sufficient content and
construct validity, internal consistency and rater reliability of TGMD-2 for Filipino children with intellectual disability.

Keywords: child, locomotor, object control, intellectual disability, developing country

Background Gross Motor Development – 2 (TGMD-2; Ulrich,


2000). It is a norm and criterion-referenced test that
Fundamental movement skills (FMS) constitute an
consists of six locomotor (run, slide, leap, gallop,
important set of skills that are believed to form the
jump, hop) and six object control skills (catch, over-
essential prerequisite foundations of more complex
hand throw, underhand roll, stationary bat, station-
movements (Gallahue, Ozmun, & Goodway, 2012;
ary dribble, kick). Besides being a measurement tool
Haywood & Getchell, 2005) that are often required
for research, TGMD-2 is used in clinical settings to
in different forms of physical activity. Consisting of
identify and address delay in FMS development
locomotor and object control skills, FMS make up
(Slater et al., 2010).
an important aspect of motor development and life-
Recent studies have shown that children with
long health patterns (Lubans, Morgan, Cliff,
intellectual disability represent one such group who
Barnett, & Okely, 2010). Hence, measurement of
display FMS delay (Simons, Daly, Theodorou,
FMS proficiency continues to be an important area
Caron, & Andoniadou, 2008; Westendorp,
of research and practice. Valid measurement scales
Houwen, Hartman, & Visscher, 2011). Children
for FMS contribute to understanding motor devel-
with intellectual disability are characterised to have
opment and functions, allow identification of possi-
impaired intellectual functioning and adaptive beha-
ble developmental delays (Gallahue et al., 2012) and
viours (Schalock et al., 2010). Intellectual function-
provide the basis of evaluating supportive movement
ing refers to the ability to learn, reason and solve
training programmes (Capio, Sit, & Abernethy,
problems, and is typically measured through an
2011). One of the most frequently used measure-
intelligence quotient (IQ) test (Schalock, 2011).
ment scales for FMS proficiency is the Test of

Correspondence: Catherine M. Capio, Institute of Human Performance, The University of Hong Kong, 111–113 Pokfulam Road, Hong Kong.
E-mail: ccapio@hku.hk

© 2015 Taylor & Francis


2 C. M. Capio et al.

Adaptive behaviours consist of a range of practical, in lower-income countries had been generally
conceptual and social skills such as daily personal focused on the cognitive domain (Grantham-
care, handling money or communication with peers McGregor et al., 2007), lack of normative motor
(Tasse et al., 2012). It had been suggested that development data limits population-appropriate eva-
intellectual functioning of these children have asso- luation of gains by children who undergo motor
ciated impairments in information processing training programmes.
(Planinsec & Pisot, 2006), which may impact their The Philippines is one such developing country,
ability to learn motor skills such as FMS. and recently published studies have used compo-
While TGMD-2 had been used in studies invol- nents of TGMD-2 among typically developing
ving children with intellectual disability (Valentini, Filipino children (Capio, Sit, Eguia, & Abernethy,
2012; Westendorp et al., 2011), instrument develop- 2014) and those with intellectual disability (Eguia,
ment had been focused on typically developing chil- Capio, & Simons, in press). Eguia and colleagues (in
dren. Content validation based on the judgement of press) found that Filipino children with intellectual
three content experts, and conventional item analysis disability had deficits in FMS proficiency that
had shown satisfactory item discrimination and item appeared to be related to insufficient physical activ-
difficulty criteria (Ulrich, 2000). Further evidence of ity. Such finding suggests a need to provide pro-
content validity was based on the component scores grammes that would promote FMS development in
Downloaded by [Temple University Libraries] at 07:59 22 April 2015

having a linear relationship with age, as FMS are children with intellectual disability, the outcome
known to be developmental in nature (Gallahue measures of which should be monitored to verify
et al., 2012). TGMD-2 had also been shown to the effectiveness of any intervention (Slater et al.,
have high internal consistency (α > 0.80). Because 2010). To evaluate outcomes, valid and reliable
normative scores had been established for North measurement scales are important. In the study by
American children aged 3–10 years old with typical Eguia and colleagues (in press) the TGMD-2 com-
development, use in other regions (e.g. Brazil ponents had acceptable internal consistency.
(Valentini, 2012), Korea (Kim, Kim, Valentini, & However, there was no further evidence to support
Clark, 2014)) and in groups of children with disabil- the validity and reliability of TGMD-2 in Filipino
ity (e.g. intellectual disability (Simons et al., 2008), children with intellectual disability, and this study
visual impairment (Houwen, Hartman, Jonker, & aimed to address this research gap.
Visscher, 2010)) had necessitated further examina- Content validity refers to the extent that the test
tion of validity and reliability of TGMD-2. items indeed represent the domain that the test
Among children with intellectual disability, claims to measure (Thomas & Nelson, 1990).
aspects of validity and reliability of TGMD-2 had Consistent with TGMD-2 content validation in typi-
been established in a Flemish sample (Simons et al., cally developing children, this study also verified
2008). However, evidence of an instrument’s validity whether a linear relationship exists between age and
and reliability cannot be assumed to generalise (Yun locomotor and object control scores, respectively, by
& Ulrich, 2002) across other groups of children with testing correlations between age and scores.
intellectual disability, particularly those coming from Construct validity, on the other hand, refers to the
developing countries. Most aspects of developmental extent to which the underlying traits of a test fit the
skills are influenced in varying degrees by the oppor- theoretical model on which the test is based
tunities that are available to children, as well as by (Thomas & Nelson, 1990). In this study, the two-
physical and cultural environments (Fernald, factor model of TGMD-2 (i.e. locomotor, object
Kariger, Engle, & Raikes, 2009). Because there are control) was tested through factor analysis. As pre-
environmental disparities associated with economic vious studies had shown children with intellectual
development (Walker et al., 2007), FMS proficiency disability to have FMS deficits (Westendorp et al.,
of children from developing countries may occur 2011), scores of participants in this study were com-
through a different trajectory and should be mea- pared to scores that represented mastery to further
sured with valid and reliable instruments. verify construct validity. Finally, sex-specific differ-
Low- and middle-income countries had been ences in FMS were also examined because previous
found to have higher prevalence of intellectual dis- research had shown boys with intellectual disability
ability, suggesting the need to establish programmes generally perform better than girls in object control
that ameliorate the impact of associated impairments skills but not in locomotor skills (Simons et al.,
(Maulik, Mascarenhas, Mathers, Dua, & Saxena, 2008).
2011). Supportive programmes require valid and One aspect of the reliability of an instrument is
reliable measures of child development, including demonstrated by internal consistency, which refers
the motor skills domain, to provide markers for set- to the degree to which test components measure the
ting goals and monitoring progress (Engle et al., same construct adequately (Thomas & Nelson,
2007). Because child development measurements 1990). Internal consistency of TGMD-2 components
TGMD-2 in children with intellectual disability 3

had been found to be sufficient in a smaller sample Vineland Adaptive Behavior Scales-2nd edition
of Filipino children with intellectual disability (VABS-2; Sparrow, Cicchetti, & Balla, 2005) are
(Cronbach’s alpha = 0.78 for locomotor, 0.81 for used to assess cognitive, communication and social-
object control), in a study that examined FMS asso- behavioural functions, which then serve as basis of
ciation with physical activity levels (Eguia et al., in admission. IQ tests are neither required nor recom-
press). However, reliability of TGMD-2 has not yet mended by the schools, to avoid additional costs
been systematically established for this specific popu- associated with standardised test administration.
lation. In typically developing children, TGMD-2 Consequently, participants in this study could not
aspects of reliability were recently established in an be categorised into severity of intellectual disability
Australian sample (Barnett, Minto, Lander, & Hardy, based on IQ cut-points. Nevertheless, the school
2014). Given the characteristics associated with intel- administrators confirmed that participants in this
lectual disability and being in a developing country, it study are those categorised to have mild to moderate
is important to ascertain that FMS proficiency may be intellectual disability based on selected test compo-
measured reliably. This present study aimed to exam- nents from VABS-2. The schools’ decision not to
ine aspects of validity and reliability of TGMD-2 use IQ test appears to be consistent with how the
when used among Filipino children with intellectual construct of intellectual disability had been evolving,
disability. Content and construct validity were veri- such that an ecological focus has been adopted with
Downloaded by [Temple University Libraries] at 07:59 22 April 2015

fied, as well as the consistency of test scores between decreasing emphasis on IQ cut-points as a categori-
two different examiners (inter-rater reliability) or over cal basis of classifying severity of disability (Schalock,
multiple tests by a single examiner (intra-rater 2011).
reliability).
Procedures
Methods All the study procedures were reviewed and
approved by the institutional review board of the
Participants
university, and were consistent with ethical princi-
A total of 100 children from three special schools in ples of the Declaration of Helsinki. Parents or care-
two urban regions of the Philippines (Metro Manila givers returned informed consent, and each
and Cebu) were tested. Participants were enrolled in participant gave verbal assent prior to testing.
a special school, had impaired intellectual function- Because TGMD-2 was developed for typically devel-
ing based on standard cognitive measures and oping North American children, the cultural rele-
impaired adaptive functions based on standard func- vance of the items was considered. Consistent with
tional measures. Those with diagnoses that have guidelines for measuring child development in low-
concurrent physical impairments (i.e. Down’s income countries (Fernald et al., 2009), discussions
Syndrome, cerebral palsy) were excluded, bringing were first conducted with the physical education
the final study sample to 81 (65 boys, 16 girls). teachers and therapists of the participants on the
There were more boys than girls in the sample, but applicability of the 12 component skills. The con-
this was reflective of the gender distribution of the sensus was that galloping and stationary striking
schools’ enrollees. Participants were aged 5–14 years should be dropped in testing the current sample
(mean = 9.29 s 2.71 years) and their school levels because these did not appear to be frequently
ranged from preschool to third grade of the national observed in the local physical education context.
basic education curriculum. While TGMD-2 was Consequently, out of the 12 components of
specifically validated for typically developing chil- TGMD-2, 10 skills were tested. In other research,
dren aged 3–10 years old (Ulrich, 2000), participants selected components of TGMD-2 (i.e. not the full
in this study included those who were aged above test) had also been used to characterise FMS profi-
this upper limit. Previous studies had shown FMS ciency of children with and without disabilities (e.g.
deficits in children with intellectual disability Capio, Sit, Eguia, Abernethy & Masters, 2014;
(Simons et al., 2008; Westendorp et al., 2011), and Hardy, King, Farrell, Macniven, & Howlett, 2010).
in validating the instrument in this particular sample, Two licensed paediatric physiotherapists, each
older participants may display FMS that are closer to with >5 years of experience, conducted individual
mastery levels. tests of the participants. All tests were carried out
The schools from which the participants were during school hours, in the school premises and in
recruited are privately run, and admit students the presence of at least one teacher, thereby ensuring
using similar procedures. Students are typically a sense of familiarity for the participants. The tester
referred to schools by other professionals (e.g. occu- provided verbal instructions for each skill, followed
pational therapist, physiotherapist, developmental by two rounds of demonstration. While standard
paediatrician). Selected components of the TGMD-2 procedures include one round of
4 C. M. Capio et al.

demonstration, the current study procedures were The chi-square/df ratio should be close to 1.00 for
such so as to compensate for participants’ cognitive the model to be correct and any ratio >2.00 repre-
impairments that likely limit verbal communication sents an inadequate fit (Byrne, 1989). A GFI value
ability (Schalock et al., 2010). Video recordings were of 1.00 indicates a perfect fit and ≥0.90 is generally
done at 24 frames per second (fps), to allow post hoc considered an indicator of a good model fit (Joreskog
video analysis. TGMD-2 assessed each skill based & Sorbom, 1982). RMSEA value of ≤0.05 indicates
on three to five performance criteria, the presence of a good fit of the model and up to 0.08 for tolerable
which was scored one and absence was scored zero. amount of error (Browne & Cudeck, 1992).
Each participant performed one practice trial, fol- Because gender differences in locomotor and
lowed by two trials that were rated, yielding scores object control skills were expected, construct validity
that ranged from zero to six, zero to eight or zero to was further examined by univariate analysis of var-
ten per skill. Summation of the skill scores gave full iance (ANOVA) with locomotor and object control
scores of 40 for locomotor and 38 for object control. skills as dependent variables and gender as the fixed
factor. Finally, one-sample t-test was used to com-
pare participants’ locomotor and object control
Data analysis
aggregate scores to the full scores that represent skills
Video recordings of tests were analysed using video mastery because children with intellectual disability
Downloaded by [Temple University Libraries] at 07:59 22 April 2015

playback software that allowed frame-by-frame view- were also expected to have deficits in FMS profi-
ing. Each video was first viewed in real-time speed, ciency. The percentage of participants who gained
followed by a frame-by-frame view, in which full scores in both skills was also determined.
researchers verified the presence or absence of each
performance criterion. Two physiotherapists first Reliability. Internal consistency of the locomotor and
conducted independent analyses of a subsample of object control components of TGMD-2 was exam-
10 participants to verify inter-rater reliability. Each ined using Cronbach’s alpha, inter-item correlations
rater also performed a second analysis of the sub- and corrected item-total correlations. Cronbach’s
sample to assess intra-rater reliability. After complet- alpha, when each of the individual items (skill com-
ing the analysis that showed excellent reliability ponent) was removed from the scale, was also calcu-
(intra-class correlation coefficients (ICC) > 0.90; lated. Cronbach’s alpha of ≥0.70 and item-total
see Results for details), video analysis of the remain- correlations of ≥0.30 were considered acceptable
ing sample was performed by one of the two raters. (Nunally, 1978; Nunally & Bernstein, 1994). Inter-
Statistical analyses were performed using IBM SPSS item correlation of ≥0.80 was considered an indica-
Statistics and Amos for Windows, version 20. tor of redundancy of items. ICC, including 95%
Normality of data was ascertained based on the confidence intervals (CI), was calculated to examine
Shapiro–Wilk test, which is considered to be the intra-rater and inter-rater reliability. ICC of ≥0.75 is
best choice for testing data normality (Ghasemi & considered excellent, 0.40–0.74 is moderate and
Zahediasl, 2012). <0.40 is poor (Fleiss, 1999). Bland–Altman analysis
was performed to verify the intra-rater and inter-
Validity. Because FMS acquisition is developmental rater agreement (consolidated data of both raters),
(Gallahue et al., 2012), TGMD-2 scores are by examining the level of agreement between tests
expected to be positively correlated with age (intra-rater) and between raters (inter-rater). This
(Ulrich, 2000). The association of age with locomo- method plots the differences between two scores
tor and object control skills was examined using the against their mean, where ±1.96 standard deviation
Pearson product–moment correlation coefficient and of the differences provides an interval within which
multivariate analysis of covariance (ANCOVA) to 95% of the differences between the two sets of scores
verify content validity. are predicted to fall (Bland & Altman, 1999).
The established two-factor model (i.e. locomotor, Agreement is illustrated by a small range of the
object control) of TGMD-2 (Ulrich, 2000) was 95% CI of the differences between the measure-
empirically tested via confirmatory factor analysis ments (Myles & Cui, 2007).
(CFA) using maximum likelihood estimation meth-
ods. The two-factor model fit was evaluated based
on the chi-square, chi-square/degrees of freedom
Results
(df) ratio, goodness of fit index (GFI) and the root
mean square error of approximation (RMSEA). A Participants’ scores are summarised in Table I.
non-significant chi-square value supports validity of Normality of data was confirmed using Shapiro–
the two-factor model based on the inference that Wilk tests, which showed non-significant P values
there is no reliable difference between the sample for locomotor (P = 0.054) and object control skills
data and the model (Joreskog & Sorbom, 1982). (P = 0.601).
TGMD-2 in children with intellectual disability 5

Table I. Participants’ locomotor, object control and total FMS Table II. Intra-rater and inter-rater reliability indices.
scores.
ICC 95% Confidence Interval
Boys (n = 65) Girls (n = 16)
Intra-rater
Locomotora Locomotor 0.995 0.978–0.999
Mean (s) 24.58 (9.23) 22.50 (9.37) Object control 0.998 0.991–0.999
95% Confidence Interval 22.30–26.87 17.51–27.49 Total FMS 0.997 0.989–0.999
Object controlb Inter-rater
Mean 20.32 (6.65) 18.19 (7.33) Locomotor 0.996 0.984–0.999
95% Confidence Interval 18.67–21.97 14.28–22.09 Object control 0.998 0.992–1.000
Totalc Total FMS 0.998 0.991–0.999
Mean (s) 44.91 (14.79) 40.69 (15.92)
95% Confidence Interval 41.24–48.57 32.21–49.17

Notes: amastery score = 40; b


mastery score = 38; c
mastery correlations ranged from 0.309 to 0.676 for locomo-
score = 78. tor components and from 0.253 to 0.577 for object
control components, indicating no redundancy of
items.
Validity ICC for locomotor and object control test scores
Downloaded by [Temple University Libraries] at 07:59 22 April 2015

Age was found to have significant positive correla- ranged from 0.995 to 0.998, suggesting excellent
tions with locomotor (r = 0.222, P = 0.047) and intra-tester and inter-tester reliability (Fleiss, 1999).
object control skills (r = 0.356, P = 0.001). Reliability indices are summarised in Table II.
Multivariate ANCOVA further showed a significant Bland–Altman analysis confirms intra-rater and
effect of age for locomotor skills and object control inter-rater agreement (see Figure 1).
skills (F(2, 78) = 5.865, P = 0.004, η2 = 0.131).
It appears that the data fits the hypothesised two-
Discussion
factor model (locomotor and object control) of
TGMD-2 with fit indices as follows: χ2 = 33.525, While FMS are believed to form the basis of more
DF = 34, P = 0.491, χ2/DF = 0.986. Absolute fit advanced and complex motor skills (Gallahue et al.,
indices that directly assess the model fit similarly 2012; Haywood & Getchell, 2005), the value of
indicate sufficient values with GFI = 0.931. FMS proficiency has been underscored by evidence
Additionally, RMSEA = 0.000 with 90% CI of pointing to associated health benefits (Lubans et al.,
0.000–0.080 suggested good model fit. 2010). Attempts to facilitate FMS development need
Gender was a significant predictor only for object to be supported by valid and reliable measurement,
control skills (F(1, 78) = 4.446, P = 0.038, to allow monitoring and programme evaluation.
η2 = 0.054) and not for locomotor skills (F(1, This study contributes to establishing such FMS
78) = 1.831, P = 0.180, η2 = 0.023), such that measurement, particularly for Filipino children with
boys performed significantly better than girls only intellectual disability. Currently, there exists paucity
in object control skills. Participants’ mean scores in research to underpin efforts to support FMS
were significantly lower than the perfect scores that development of this population in developing coun-
represent mastery in locomotor (t(80) = −15.421, tries such as the Philippines.
P < 0.001) and object control skills (t In this study, two skills – one each for locomotor
(80) = −23.954, P < 0.001). None of the partici- and object control components – were dropped as a
pants reached the full scores that represent mastery consequence of adaptation to the study sample. With
in both locomotor and object control skills. the 10 components, the FMS scores of the Filipino
sample in this study were found to have sufficient fit
with the two-factor model proposed by Ulrich
(2000), as evident in the reported indices. This sup-
Reliability
ports the notion that these 10 components from
Cronbach’s alpha for the locomotor components was TGMD-2 constitute a valid set of tests to character-
0.830 and a range of 0.757–0.814 when each item is ise FMS proficiency of Filipino children with intel-
deleted. For object control components, Cronbach’s lectual disability. The study by Simons and
alpha was 0.792 and a range of 0.713–0.757 when colleagues (2008) among Flemish children showed
each item is deleted. Item-total correlation coeffi- comparable fit indices when using all 12 skills of
cients for locomotor components ranged from TGMD-2. In comparison, the study by Houwen
0.712 to 0.913, and for object control components and colleagues (2010) among children with visual
they ranged from 0.673 to 0.816. These findings impairment found lower fit indices, and this was
suggest acceptable internal consistency (Nunally, attributed to constraints associated with impaired
1978; Nunally & Bernstein, 1994). Inter-item visual input.
6 C. M. Capio et al.

3.00 3.00

2.00 2.00

Difference (inter-tester)
Difference (intratester)
1.00 1.00

.00 .00

–1.00 –1.00

–2.00 –2.00

–3.00 –3.00

.00 10.00 20.00 30.00 40.00 .00 10.00 20.00 30.00 40.00
Mean (intratester) (a) Mean (inter-tester)

1.00 1.50

.50 1.00

Difference (inter-tester)
Difference (intratester)

.00 .50
Downloaded by [Temple University Libraries] at 07:59 22 April 2015

–.50 .00

–1.00 –.50

–1.50 –1.00

–2.00 –1.50
30.00 40.00
.00 10.00 20.00 .00 10.00 20.00 30.00 40.00
Mean (intratester) (b) Mean (inter-tester)

Figure 1. Bland–Altman plots showing inter-rater and intra-rater agreement in locomotor (a) and object control skills (b) scores.

In interpreting the findings of this study, one has As expected, the participants in this study did not
to consider limitations associated with the rela- reach FMS mastery, and motor proficiency (or lack
tively small sample size. Nevertheless, it is worth of it) is presumably affected by their cognitive
noting that while validation studies of TGMD-2 in impairments (Hartman, Houwen, Scherder, &
typically developing populations had employed Visscher, 2010). Similar results were found among
much bigger sample sizes (e.g. Valentini (2012), Flemish children with intellectual disability who
Kim et al. (2014)), populations of children with scored significantly lower than the normative data
disability are relatively limited. Hence, other stu- from North American typically developing children
dies that had validated the instrument in children (Simons et al., 2008). In typically developing chil-
with disability had also been limited to smaller dren, it has been suggested that lack of FMS mastery
sample sizes (e.g. Simons et al. (2008), Houwen points to the value of providing opportunities for
et al. (2010)). practice during free play as well as teacher-directed
Studies of FMS proficiency in children with and training activities (Hardy et al., 2010). In children
without disability had consistently found differences with intellectual disability, this needs to be empha-
between girls and boys, particularly in object control sised just as well, if not even more so on account of
skills (Simons et al., 2008). While we acknowledge the observed drawbacks that are likely to be asso-
that the subgroup of girls in this study sample was ciated with cognitive impairments.
limited in number, the study nevertheless shows Acceptable internal consistency was found for
similar patterns of gender-related differences, pro- both components in this study and is comparable
viding further evidence of construct validity. In typi- with those found by Simons et al. (2008).
cally developing children, it had been suggested that Moreover, inter-item correlations were sufficient to
gender differences in object control skills are likely support reliability, but not reaching correlation coef-
influenced by social factors that could be related to ficient values to suggest redundancy of items. All
interaction with parents, peers and teachers, as well tests and analyses were conducted by paediatric phy-
as play interactions that lead to sufficient skill prac- siotherapists, who had previous clinical experiences
tice (Hardy et al., 2010). It is likely that in a special in using TGMD-2. The findings of this study show
school environment, similar social factors are present that given trained testers, TGMD-2 can be used in
such that the participants in this study displayed the Philippines with excellent inter-rater and intra-
similar gender differences. rater reliability. This is further supported by the
TGMD-2 in children with intellectual disability 7

Bland–Altman analysis that showed small discrepan- Hong Kong. The second author was supported by
cies in the scores between testers, and by a single an Erasmus Mundus scholarship of the European
tester performing the test repeatedly. Commission at the University of Leuven, Belgium.
While this study offers evidence to support aspects
of validity and reliability of TGMD-2 as an instru-
ment to examine the locomotor and object control
References
skills of Filipino children with intellectual disability,
future work is also recommended to explore other Barnett, L. M., Minto, C., Lander, N., & Hardy, L. L. (2014).
skills that might be of cultural relevance. For Interrater reliability assessment using the test of gross motor devel-
opment-2. Journal of Science and Medicine in Sport, 17(6), 667–670.
instance, one of the traditional games in the country Bland, J. M., & Altman, D. G. (1999). Measuring agreement in
is called “sipa”, which literally translates as “kick”. method comparison studies. Statistical Methods in Medical
The pattern of kicking in this game is different from Research, 8(2), 135–160.
that observed in TGMD-2. In “sipa”, the object that Browne, M. W., & Cudeck, R. (1992). Alternative ways of asses-
is made up of metal and plastic parts has to be sing model fit. Sociological Methods & Research, 21(2), 230–258.
Byrne, B. M. (1989). A primer of LISREL: Basic application and
directed vertically upward by hitting it with the pos- programming for confirmatory factor analytic models. New York,
terior-medial aspect of the foot (Reyes, 2010). NY: Springer-Verlag.
Hence, the movement would require a combination
Downloaded by [Temple University Libraries] at 07:59 22 April 2015

Capio, C. M., Sit, C. H., & Abernethy, B. (2011). Fundamental


of hip flexion and external rotation, knee flexion, and movement skills testing in children with cerebral palsy.
foot supination. Disability & Rehabilitation, 33(25–26), 2519–2528.
Capio, C. M., Sit, C. H., Eguia, K. F., & Abernethy, B. (2014).
The use of pictorial instructions might also be Physical activity and movement skills proficiency of young
explored as a means to adapt testing procedures for Filipino children. Pediatrics International, 56(4), 651–653.
children with intellectual disability. Moreover, stu- Capio, C. M., Sit, C. H. P., Eguia, K. F., Abernethy, B., Masters,
dies that would compare children with and without R. S. W. (2014). Movement skills training as a strategy to
disability could also lead to further understanding of promote physical activity in children with cerebral palsy.
Journal of Sport and Health Science. Advance online publication.
FMS development of Filipino children. Finally, it doi:10.1016/j.jshs.2014.05.001
must also be acknowledged that the sample con- Eguia, K. F., Capio, C. M., & Simons, J. (2015). Object control
sisted of students in privately run special schools, skills predict the physical activity of children in special schools
and the findings of this study may not be generalised in a developing country: Philippines. Journal of Intellectual and
to those in the public school system whose access to Developmental Disability, 40(3).
Engle, P. L., Black, M. M., Behrman, J. R., De Mello, M. C.,
resources may be different. Gertler, P. J., Kapiriri, L., & Young, M. E. (2007). Child
development in developing countries 3: Strategies to avoid the
loss of developmental potential in more than 200 million chil-
Conclusion dren in the developing world. The Lancet, 369(9557), 229–242.
This study aimed to examine aspects of validity and Fernald, L. C., Kariger, P., Engle, P., & Raikes, A. (2009).
Examining early child development in low-income countries.
reliability of 10 components of TGMD-2 in a sample Washington, DC: The World Bank.
of Filipino children with intellectual disability, aged Fleiss, J. L. (1999). Reliability of measurement, in the design and analysis
5–14 years old. The findings support sufficient con- of clinical experiments. Hoboken, NJ: John Wiley & Sons Inc.
tent and construct validity, internal consistency and Gallahue, D. L., Ozmun, J. C., & Goodway, J. (2012).
rater reliability (intra-rater, inter-rater). It had been Understanding motor development: Infants, children, adolescents,
adults (7th ed.). New York, NY: McGraw-Hill.
shown that there is a need to provide supportive Ghasemi, A., & Zahediasl, S. (2012). Normality tests for statistical
programmes that will develop the FMS proficiency analysis: A guide for non-statisticians. International Journal of
of Filipino children with intellectual disability. In Endocrinology and Metabolism, 10(2), 486–489.
developing programmes to address this need, Grantham-McGregor, S., Cheung, Y. B., Cueto, S., Glewwe, P.,
TGMD-2 is deemed suitable as an instrument for Richter, L., & Strupp, B., International Child Development
Steering Group. (2007). Developmental potential in the first
characterising the extent of FMS deficits, and for 5 years for children in developing countries. The Lancet, 369
programme monitoring and evaluation. (9555), 60–70.
Hardy, L. L., King, L., Farrell, L., Macniven, R., & Howlett, S.
(2010). Fundamental movement skills among Australian preschool
Disclosure statement children. Journal of Science and Medicine in Sport, 13(5), 503–508.
Hartman, E., Houwen, S., Scherder, E., & Visscher, C. (2010).
No potential conflict of interest was reported by the On the relationship between motor performance and executive
author(s). functioning in children with intellectual disabilities. Journal of
Intellectual Disability Research, 54, 468–477.
Haywood, K., & Getchell, N. (2005). Life span motor development
Funding (4th ed.). Champaign, IL: Human Kinetics.
Houwen, S., Hartman, E., Jonker, L., & Visscher, C. (2010).
This study was supported in part by the Marden Reliability and validity of the TGMD-2 in primary-school-age
Seed Funding grant of the Centre for Advancement children with visual impairments. Adapted Physical Activity
of Inclusive and Special Education, the University of Quarterly, 27(2), 143–159.
8 C. M. Capio et al.

Joreskog, K. G., & Sorbom, D. (1982). Recent developments in Simons, J., Daly, D., Theodorou, F., Caron, C., & Andoniadou,
structural equation modeling. Journal of Marketing Research, 19 E. (2008). Validity and reliability of the TGMD-2 in 7–-
(4), 404–416. 10-year-old Flemish children with intellectual disability.
Kim, S., Kim, M. J., Valentini, N. C., & Clark, J. E. (2014). Adapted Physical Activity Quarterly, 25(1), 71–82.
Validity and reliability of the TGMD-2 for South Korean chil- Slater, A., Bowen, J., Corsini, N., Gardner, C., Golley, R., &
dren. Journal of Motor Behavior, 46(5), 351–356. Noakes, M. (2010). Understanding parent concerns about
Lubans, D. R., Morgan, P. J., Cliff, D. P., Barnett, L. M., & children’s diet, activity and weight status: An important step
Okely, A. D. (2010). Fundamental movement skills in children towards effective obesity prevention interventions. Public Health
and adolescents: Review of associated health benefits. Sports Nutrition, 13(8), 1221–1228.
Medicine, 40(12), 1019–1035. Sparrow, S. S., Cicchetti, D. V., & Balla, D. A. (2005). Vineland
Maulik, P. K., Mascarenhas, M. N., Mathers, C. D., Dua, T., & adaptive behavior scales – II. Livonia, MN: Pearson
Saxena, S. (2011). Prevalence of intellectual disability: A meta- Assessments.
analysis of population-based studies. Research in Developmental Tassé, M. J., Schalock, R. L., Balboni, G., Bersani Jr, H.,
Disabilities, 32(2), 419–436. Borthwick-Duffy, S. A., Spreat, S., & Zhang, D. (2012). The
Myles, P. S., & Cui, J. (2007). Using the Bland–Altman method construct of adaptive behavior: Its conceptualization, measure-
to measure agreement with repeated measures. British Journal ment, and use in the field of intellectual disability. American
of Anaesthesia, 99(3), 309–311. Journal on Intellectual and Developmental Disabilities, 117(4),
Nunally, J. C. (1978). Psychometric theory. New York, NY: 291–303.
McGraw-Hill. Thomas, J., & Nelson, J. K. (1990). Research methods in physical
Nunally, J. C., & Bernstein, I. H. (1994). Psychometric theory. New activity (2nd ed.). Champaign, IL: Human Kinetics.
Downloaded by [Temple University Libraries] at 07:59 22 April 2015

York, NY: McGraw-Hill. Ulrich, D. (2000). Test of gross motor development (2nd ed.). Austin,
Planinsec, J., & Pisot, R. (2006). Motor coordination and intelli- TX: Pro-Ed.
gence level in adolescents. Adolescence, 41(164), 667–676. Valentini, N. C. (2012). Validity and reliability of the TGMD-2 for
Reyes, C. A. D. (2010). From physical recreation to digitisation: Brazilian children. Journal of Motor Behavior, 44(4), 275–280.
A social history of children’s games in the Philippines. In L. Walker, S. P., Wachs, T. D., Gardner, J. M., Lozoff, B.,
Hopkins, W. C. Turgeon, & M. Macleod (Eds.), Negotiating Wasserman, G. A., Pollitt, E., & Carter, J. A., International
childhoods (pp. 99–109). Oxford: Interdisciplinary Press. Child Development Steering Group. (2007). Child develop-
Schalock, R. L. (2011). The evolving understanding of the con- ment: Risk factors for adverse outcomes in developing coun-
struct of intellectual disability. Journal of Intellectual and tries. The Lancet, 369(9556), 145–157.
Developmental Disability, 36(4), 227–237. Westendorp, M., Houwen, S., Hartman, E., & Visscher, C.
Schalock, R. L., Borthwick-Duffy, S. A., Bradley, V. J., Buntinx, (2011). Are gross motor skills and sports participation related
W. H. E., Coulter, D. L., Craig, E. M., & Yeager, M. H. in children with intellectual disabilities? Research in
(2010). Intellectual disability: Definition, classification, and systems Developmental Disabilities, 32(3), 1147–1153.
of supports (11th ed.). Washington, DC: American Association Yun, J., & Ulrich, D. (2002). Estimating measurement validity: A
of Intellectual and Developmental Disabilities. tutorial. Adapted Physical Activity Quarterly, 19(1), 32–47.

You might also like