You are on page 1of 12

N U T RI TI O N RE S E ARCH 3 5 ( 2 0 15 ) 2 2 9–2 40

Available online at www.sciencedirect.com

ScienceDirect
www.nrjournal.com

Original Research

A meta-analysis of school-based obesity prevention


programs demonstrates limited efficacy of
decreasing childhood obesity

Ling-Shen Hung a , Diane K. Tidwell b,⁎, Michael E. Hall c , Michelle L. Lee d ,


Chiquita A. Briley e , Barry P. Hunt b
a
National Health Research Institutes of Taiwan, 35 Keyan Road, Zhunan Miaoli County 35053 Taiwan
b
Mississippi State University, Box 9805, Food Science, Nutrition and Health Promotion Department, Mississippi State, MS 39762 USA
c
Florida Atlantic University, Department of Exercise Science and Health Promotion, 777 Glades Road, Boca Raton, FL 33431 USA
d
East Tennessee State University, P.O. Box 70690, Department of Allied Health Sciences, Johnson City, TN 37614 USA
e
Tennessee State University, Department of Family and Consumer Sciences, 3500 John A. Merritt Blvd, Nashville, TN 37209 USA

ARTI CLE I NFO A BS TRACT

Article history: Childhood obesity is a global concern. The objectives of this meta-analytical study were to
Received 16 August 2014 evaluate the effectiveness of school-based childhood obesity prevention programs, and to
Revised 7 January 2015 examine program components (moderators). The methods included searching databases
Accepted 13 January 2015 (PubMed, Google Scholar, and the university's EBSCOhost Web service) as well as
handsearching reference lists of articles published in English. Selection criteria for studies
Keywords: to be included in the meta-analysis were limited to studies that reported body mass index
Meta-analysis (BMI) or skinfold thickness as outcome measures and were school-based obesity prevention
Moderators interventions; cross-sectional design studies were excluded. We hypothesized the meta-
Childhood obesity analysis would yield a summary effect size of magnitude which would indicate that school-
School-based programs based interventions have been effective in improving children's BMI or skinfold thickness
values. A total of 26 114 children from 27 school-based childhood obesity prevention
programs provided 54 effect sizes. A random-effects model calculated a small summary
effect size of 0.039 (95% confidence interval −0.013 to 0.092). Heterogeneity among studies
was observed which disappeared after pooling studies that used a randomized controlled
trial design with one program moderator (physical activity or nutrition). We failed to accept
our hypothesis and concluded that overall, school-based interventions have not been
effective for improving body mass index or skinfold thickness to curb childhood obesity;
however, randomized controlled trials that focused on physical activity or nutrition
appeared to produce promising results.
© 2015 Elsevier Inc. All rights reserved.

Abbreviations: BMI, body mass index; CI, confidence interval; k, number of studies (number of effect sizes in a meta-analysis); n,
number of participants in the studies; RCT, randomized controlled trial; SE, standard error; SMD, standardized mean difference.
⁎ Corresponding author. Box 9805, FSNHP, Mississippi State, MS 39762 USA. Tel.: +1 662 325 0239 (Office), +1 662 325 3200 (Department).
E-mail addresses: lhung216@gmail.com (L.-S. Hung), d.tidwell@msstate.edu (D.K. Tidwell), mhall61@fau.edu (M.E. Hall),
LEEML2@mail.etsu.edu (M.L. Lee), cbriley1@Tnstate.edu (C.A. Briley), bhunt@fsnhp.msstate.edu (B.P. Hunt).

http://dx.doi.org/10.1016/j.nutres.2015.01.002
0271-5317/© 2015 Elsevier Inc. All rights reserved.
230 N U TR I TION RE S E ARCH 3 5 ( 2 0 15 ) 2 2 9–2 40

Six school-based meta-analyses with BMI or skinfold thick-


1. Introduction
ness values as outcomes were identified [17–21]. These meta-
Childhood obesity has increased significantly worldwide, analyses [17–21] present conflicting results. Gonzalez-Suarez
which has serious consequences on children's health [1] and et al [17] reported their meta-analysis showed convincing
health care costs [2,3]. Among US children and adolescents evidence that school-based interventions were effective, at
aged 2 to 19 years, 16.9% were obese and 31.8% were either least short-term, in reducing the prevalence of childhood
overweight or obese in 2009 to 2010 [4]. The number of obesity. In addition, Sobal-Goldberg et al [18] reported more
children experiencing weight problems is alarming because it recent school-based obesity prevention programs with a ran-
places them at risk for physical and psychosocial problems domized controlled trial (RCT) design were at least mildly
[5]. Ebbeling et al [6] reported that obese children experienced effective in reducing BMI in children. However, Harris et al [19]
complications related to cardiovascular, endocrine, musculo- and Kanekar and Sharma [20] reported school-based interven-
skeletal, and gastrointestinal functions, and also pulmonary tions did not improve BMI. Katz et al. [21] concluded that school-
complications such as sleep apnea, asthma, and exercise based interventions with both nutrition and physical activity
intolerance. Dietz [7] reported the most widespread conse- interventions were effective and Lavelle et al [22] summarized,
quences of childhood obesity were psychosocial and obese “There is growing evidence that school-based interventions that
children become targets of systematic discrimination and are contain a physical activity component may be effective in
more likely to have low self-esteem. Ebbeling et al [6] also helping to reduce BMI in children.” Therefore, the objectives of
discussed psychosocial consequences of childhood obesity this study were to evaluate the effectiveness of school-based
including sadness, loneliness, and a negative self-image. childhood obesity prevention programs which reported BMI or
There are many causes of childhood obesity, including skinfold thickness as outcome measures, and to evaluate
genetic, biological, and environmental factors [6]. Although program, or intervention, components (moderators) that may
genetic and biological factors are important, they cannot fully influence the effectiveness of the program outcomes. We
explain the current global childhood obesity trends. Environ- hypothesized that the meta-analysis would yield a summary
mental and societal factors associated with food intake and effect size of magnitude which would indicate that school-based
physical activity should be the primary focus for understand- interventions have been effective in improving children's BMI or
ing the macro-level impacts on obesity [6,8,9]. Schools are skinfold thickness values. The findings of this study could
considered a primary setting for implementing childhood advance human nutrition by assisting in designing effective
obesity programs because of school meal programs and obesity prevention programs for children in school settings.
physical activity education [8–10]. Research has indicated
that students attending schools with à la carte programs (i.e.,
snack bars, vending machines, kiosks with individual food 2. Methods and materials
and beverage sales) consumed less fruits and vegetables, and
had higher intakes of calories from total and saturated fat 2.1. Search strategy, inclusion criteria, and selecting
compared to students who were not exposed to à la carte studies for the meta-analysis
programs [11]. Also, the availability of snack vending ma-
chines in schools was associated with a higher body mass Generally accepted guidelines for conducting and reporting a
index (BMI) z score [12]. Schools that offered nutrition meta-analysis were used [23]. An electronic database search was
education programs consistent with the Dietary Guidelines performed to locate school-based childhood obesity prevention
for Americans [13] had lower rates of obesity [14,15]. A health programs published in peer-reviewed English-language
education curriculum that highlights the importance of journals. The key words of childhood obesity, school-based,
nutrition and physical activity can help students adopt and intervention, physical activity, physical education, and seden-
maintain healthy lifestyles regarding eating and physical tary behavior were combined to locate potential studies. Studies
activity [16]. were retrieved from PubMed, Google Scholar, and the
School-based programs include structured interventions university's comprehensive EBSCOhost Web Service which
delivered in schools by teachers, or other professionals, that included MEDLINE, PsycINFO, ERIC, Agricola, Academic Search
focus on lifestyle factors for obesity prevention, such as Premier and Academic Search Complete databases, and also
nutrition education classes or online resources available for reference lists from childhood obesity systematic literature
students and parents, and physical activity education and reviews. The following inclusion criteria were used for selecting
activities that promote movement and exercise. The school- studies for the meta-analysis: (1) programs must be school-
based programs in the current study referred to studies based; (2) age range of boys or girls must be within 6 to 18 years
implemented in schools (from elementary to high schools) old; (3) outcome measurements must be based on BMI or
to improve students' knowledge and lifestyle behaviors for skinfold thickness values; (4) studies used research designs
healthy weight management. Some studies included out-of- such as a RCT, cohort, or interventions with control groups; and
school or at-home activities; however, the foci of the (5) pre-post intervention statistics such as means, standard
interventions were implemented at school. Hence, those deviations (SD), standard errors (SE), sample sizes, and P values
studies were included in our study. were reported that would enable the calculation of effect sizes.
There are many individual school-based childhood obesity The year of publication was not a criterion.
studies in the literature; however, there are a limited number After an initial review of the abstracts, the identified
of meta-analytical studies that examine the pooled effective- school-based programs that might be included in the meta-
ness of studies based on BMI or skinfold thickness outcomes. analysis were subjected to a rigorous evaluation for study
N U T RI TI O N RE S E ARCH 3 5 ( 2 0 15 ) 2 2 9–2 40 231

592 potential relevant studies retrieved from


electronic database search

509 studies excluded after


reviewing abstracts

83 studies evaluated

16 studies added
through manual search
and evaluated
72 studies did not fulfill all the
inclusion criteria and were
excluded

27 studies included in meta-analysis

Fig. 1 – Flowchart of the process for selecting studies for the meta-analysis.

content and data and statistical information. A protocol was small when I2 is equal to 25%, 50% as medium, and 75%
established a priori for data abstraction that included as large.
recording the first author and year of publication, country Publication bias in meta-analytical research is a problem
where the intervention was implemented, research design, that may occur due to the tendency of sometimes publishing
intervention components (moderators), participants' charac- studies which show significant or positive results and not
teristics, and outcome measurements with statistical infor- publishing studies with null or negative results. This can limit
mation for BMI or skinfold thickness values. the true findings of a meta-analysis. Publication bias can be
determined by visual examination of the funnel plot. A
2.2. Statistical analyses skewed funnel plot indicates a biased meta-analysis. The
robustness of the publication bias can be further analyzed by
2.2.1. Effect size, heterogeneity, and publication bias conducting Classic Fail-Safe N and Duval and Tweedie's Trim
The primary outcome measurement for calculating the effect and Fill analyses. The Classic Fail-Safe N test determines the
size, which was a standardized mean difference (SMD), was number of missing null studies (studies that would have an
mean change of BMI or skinfold thickness. Transforming the effect size of zero) required to add into the meta-analysis to
BMI or skinfold thickness values into a SMD scale allowed achieve an unbiased result, which is indicated by a nonsig-
data to be pooled and compared. A random effects model with nificant P value. Duval and Tweedie's Trim and Fill analysis
95% confidence interval (CI) was used to compute a weighted addresses the best estimate of the unbiased effect size by
summary effect size for all studies and to test for heteroge- determining the number of studies that should be trimmed
neity [24]. The random effects model was used due to the (removed or altered) and filled (imputed studies), which
expected variability among studies. Effect sizes were reported produces a shift in the funnel plot to correct the variance.
as SMDs and defined as small (0.20), medium (0.50), and large The visual presentation of the effect size between the
(0.80 or greater) [25]. observed and imputed studies determines how small or
To determine heterogeneity and its magnitude, the values large a shift is required to correct for bias. According to
for Q, P, and I2 were calculated. When P is less than 0.05 for the Borenstein et al [26], “If this shift is trivial, then one can have
chi-squared Q statistic, the null hypothesis for heterogeneity more confidence that the reported effect is valid” (p. 286).
is rejected and consequently, there is variance among the
studies that is greater than expected; variance is beyond 2.2.2. Subgroup analyses and moderators
sampling error or chance [26]. The I2 statistic determines the When Q is significant and the I2 value is large, variation exists
magnitude of heterogeneity, if I2 is greater than 50%, the among the studies and subgroup analysis is warranted which
meta-analysis is considered heterogeneous [24]. Huedo- may explain the heterogeneity [26]. The moderators that were
Medina et al [27] summarized heterogeneous magnitude as planned for investigation of heterogeneity using subgroup
232
N U TR I TION RE S E ARCH 3 5 ( 2 0 15 ) 2 2 9–2 40
Table 1 – Characteristics and components of school-based studies included in the meta-analysis
First Country Research Components of school-based obesity prevention programs
author design
[reference] No. of Mean age Program Nutrition Physical Parental Specialist Theory Outcome measurement,
children category duration activity involvement involvement based BMI or skinfold thickness
of children (y) (e.g., nurse, and positive (+) or negative
(y) nutritionist) (−) program effect

Alexandrov Moscow, USSR RCT 766 ≥10 ≥1 Yes Yes Yes No No BMI (+)
[23]
Angelico Italy Cohort 150 <10 ≥1 Yes Yes Yes No No BMI (−)
[24]
Bayne- New York, USA RCT 442 ≥10 ≥1 Yes Yes No No No BMI (+)
Smith [25]
Bush [26] DC, USA RCT 431 ≥10 ≥1 Yes Yes Yes Yes Yes Skinfolds (−)
Caballero Arizona, New Mexico, RCT 1409 <10 ≥1 Yes Yes Yes No Yes BMI (+)
[27] South Dakota, USA
Carrel [28] Wisconsin, USA RCT 50 ≥10 <1 Yes Yes No No No BMI (−)
Donnelly Nebraska, USA RCT 108 <10 ≥1 Yes Yes No Yes No BMI (+)
[29]
Hansen [30] Denmark North Mix of case control 132 ≥10 <1 No Yes No No No BMI (−)
and RCT
Harrell [31] Carolina, USA RCT 1274 <10 <1 Yes Yes No Yes No BMI (−)
Harrell [32] Mississippi, USA Intervention with 186 ≥10 <1 Yes Yes Yes Yes No BMI (−)
control group
James [33] England RCT 574 <10 ≥1 Yes No No No No BMI (+)
James [34] England RCT 434 ≥10 ≥1 Yes No No No No BMI (+)
Kain [35] Chile RCT 3086 <10 <1 Yes Yes Yes Yes No BMI Boys (+)
BMI Girls (−)
Killen [36] California, USA RCT 1130 ≥10 <1 Yes Yes No No Yes BMI (+)
Kriemler Switzerland RCT 502 <10 <1 No Yes No No No BMI (+)
[37]
Luepker [38] California, Louisiana, RCT 3959 <10 ≥1 Yes Yes Yes No Yes BMI (−)
Minnesota, Texas, USA
Manios [39] Greece RCT 393 <10 ≥1 Yes Yes Yes No Yes BMI (+)
Manios [40] Greece RCT 641 ≥10 ≥1 Yes Yes Yes Yes Yes BMI (+)
Nader [41] USA RCT 3660 <10 ≥1 Yes Yes Yes No Yes BMI (+)
Pangrazi Arizona, USA RCT 599 <10 <1 No Yes No No No BMI (+)
[42]
Puska [43] North Karelia, Finland RCT 851 <10 ≥1 Yes Yes Yes Yes No BMI (+)
Ritenbaugh New Mexico, USA Intervention with 102 ≥10 ≥1 Yes Yes No Yes No BMI (−)
[44] control group
Robinson California, USA RCT 192 ≥10 <1 No No Yes No Yes BMI (+)
[45]
Sallis [46] California, USA RCT 955 <10 ≥1 No Yes No No No Skinfolds: Boys (+) for both groups

N U T RI TI O N RE S E ARCH 3 5 ( 2 0 15 ) 2 2 9–2 40
Girls (+) for teacher-led
Girls (−) for specialist-led
Trevino [47] Texas, USA RCT 387 <10 <1 Yes Yes Yes Yes Yes BMI Boys (−)
BMI Girls (+)
Vandongen Australia RCT 971 <10 <1 Yes Yes Yes Yes No BMI (+) for 6 groups and (−) for 4
[48] groups
Wardle [49] London, England Cohort 2730 <10 ≥1 No Yes No No No BMI (+)

233
234
N U TR I TION RE S E ARCH 3 5 ( 2 0 15 ) 2 2 9–2 40
Fig. 2 – Forest plot of the meta-analysis. Each study is identified by first author and reference. The individual effect sizes are identified as “Std diff in means” with the standard
error, variance, lower and upper limits (confidence intervals), Z value, and P values provided for each study. The overall summary effect size of the meta-analysis (.039) is noted
on the bottom line.
N U T RI TI O N RE S E ARCH 3 5 ( 2 0 15 ) 2 2 9–2 40 235

Table 2 – Results of the overall summary effect size and the subgroup moderators
k (n) a Effect size SE Z value (2-tailed Q (df) c P (between
(95% CI) b test of null) subgroup effects) d

Summary effect size 54 (26 114) 0.039 (−0.013 to 0.092) 0.027 1.458 167.77*** (53)
Program duration 0.17 (1) .680
<1 year 28 (8509) 0.038 (−0.004 to 0.080) 0.021 1.776
≥1 year 26 (17 605 0.017 (−0.076 to 0.109) 0.047 0.357
Age 0 (1) .989
<10 years old 22 (14 229) 0.036 (−0.095 to 0.167) 0.067 0.536
≥10 years old 32 (11 885) 0.035 (0.003 to 0.067) 0.017 2.111*
Nutrition component 2.56 (1) .110
No 17 (5110) 0.088 (0.024 to 0.151) 0.033 2.690**
Yes 37 (21 004) 0.013 (−0.053 to 0.079) 0.034 0.379
Physical activity component - - - - -
No 3 (1200) 0.029 (−0.026 to 0.084) 0.028 1.038
Yes 51 (24 914)
Parental involvement 0.58 (1) .447
No 20 (9032) 0.062 (0.015 to 0.109) 0.024 2.577*
Yes 34 (17 082) 0.028 (−0.045 to 0.102) 0.037 0.755
Specialist involvement 0.27 (1) .605
No 29 (18 077) 0.052 (−0.034 to 0.137) 0.044 1.185
Yes 25 (8037) 0.026 (−0.017 to 0.069) 0.022 1.204
Theory-based program 0.95 (1) .329
No 43 (15 321) 0.013 (−0.062 to 0.088) 0.038 0.333
Yes 11 (10 793) 0.059 (0.006-0.111) 0.027 2.178*
Research Design 6.50* (1) .011*
RCT 45 (22 814) 0.050 (0.024-0.076) 0.014 3.699***
Other 9 (3300) −0.378 (−0.707 to −0.050) 0.167 −2.259*
No. of program components/moderators 5.85* (1) .016*
One 18 (5926) 0.112 (0.054-0.170) 0.030 3.792***
Two or more 36 (20 188) 0.003 (−0.064 to 0.070) 0.034 0.082

k, number of studies or effect sizes if a study has more than one effect size such as results reported separately for boys and girls.
n, number of children represented in the studies.
*P < .05; **P < .01; ***P < .001.
a
Analyses were not conducted with subgroups containing less than 5 comparisons.
b
Effect sizes are reported as weighted standardized mean differences with 95% confidence intervals.
c
Significant Q values indicate heterogeneity, df is degrees of freedom. The summary Q is the overall heterogeneity for the study and the other
Q values are the between-group results, which tested heterogeneity between the two categorical subgroup moderators.
d
A significant P value indicates a difference between the two categorical moderator subgroup effect sizes.

analysis were (1) participants' age (less than 10 years old performed based on the inclusion criteria which excluded 581
versus 10 years or older), (2) program duration (less than studies. Twenty-seven studies [28–54] were included in the
1 year versus 1 year or longer), (3) a nutrition component meta-analysis with publication dates ranging from 1982 to
versus not having a nutrition component in the intervention, 2010. The meta-analysis was completed in 2010. Among the
(4) a physical activity component versus no physical activity 27 included studies [28–54], six [30,36,43,46,51,53] required
component, (5) parental involvement versus no parental additional hand calculations for effect sizes to be computed,
involvement, (6) specialists such as the involvement of such as calculating pre-post correlations, SD, or SE with the
nutritionists, nurses, and physicians versus no involvement use of basic statistical equations using the information
of specialists, (7) research design (RCTs versus non-RCT reported in the studies.
studies), and (8) theory based versus programs that were not A total of 26 114 children represented in 27 school-based
designed based on a social science or health promotion childhood obesity prevention programs resulted in 54 effect
theory. The mixed effects model was used for subgroup sizes. Some studies yielded more than one effect size because
analysis as recommended by Borenstein et al [26]. Compre- they reported male and female BMI changes separately or
hensive Meta-Analysis software (Version 3, 2013, Biostat, Inc, measured program effect at different time points. Characteris-
Englewood, NJ, USA) was used for all statistical analyses. tics of the studies including program components and outcome
measurement information are summarized in Table 1. The
effect sizes are demonstrated in a forest plot (Fig. 2).

3. Results
3.1. Effect size and heterogeneity
The electronic database search generated 592 potential
relevant studies and a manual search of reference lists The weighted summary effect size for all 54 effects was small
added an additional 16 studies (Fig. 1). An evaluation was (d = 0.039, 95% CI −0.013 to 0.092, P = .145, Fig. 2 denotes the
236 N U TR I TION RE S E ARCH 3 5 ( 2 0 15 ) 2 2 9–2 40

Funnel Plot of Standard Error by Std diff in means


0

1
Standard Error

-4 -3 -2 -1 0 1 2 3 4
Std diff in means

Fig. 3 – Funnel plot of the meta-analysis. The hollow circles represent the studies in the meta-analysis and the dark circles
represent the imputed studies that would correct the publication bias.

effect size as “Std diff in means”). This indicated there was not magnitude with an I2 value of 93.61%. The non-RCT group
strong evidence that school-based programs have been had the largest 95% CI range (Table 2), which also did not
effective in obesity prevention. Thus, we rejected our hypoth- include absolute zero but the values were negative indicating
esis and determined that overall, school-based obesity they were the least effective programs.
prevention programs have not been effective in improving A moderator was added post hoc as the literature indicated
BMI or skinfold thickness parameters. The individual effect that having only one program component (physical activity or
sizes ranged from −3.705 (least effective) to 0.368 (most dietary intervention) may be more effective in childhood
effective). Most effect sizes for the programs were small with obesity prevention programs, although evidence was insuffi-
values less than 0.20; only three studies [44, 47 included two cient in school-based studies that a combination of diet and
of the girls PLAY groups] had interventions that produced physical activity was more effective at preventing obesity or
effect sizes greater than 0.30 (Fig. 2). This meta-analysis was overweight [55]. This led us to examine the number of
heterogeneous (Q(df) = 167.77(53), P < .001) with an I2 value of program components as a moderator and the between-
68.41%, which implied that variation existed among the group effect was significant (P = .016, Table 2). A meta-
interventions and subgroup analysis investigating the inter- analysis with interventions that contained only one program
vention components (moderators) should be conducted [26]. component (k = 18) yielded a summary effect size of 0.112
(0.030 SE, Z = 3.792, P < .001) and heterogeneity was
3.2. Subgroup analysis and heterogeneity nonexistent (Q(df) = 10.88(17), P = 0.863) with an I2 value of
0%. Conversely, a meta-analysis of interventions with two or
Results from the subgroup analysis determined that research more program components (k = 36) resulted in a very small
design had a significant between-group effect (P = .011, effect size of 0.003 (0.034 SE, P = 0.935) with extreme
Table 2). Studies using a RCT design were more effective in heterogeneity (Q(df) = 150.07(35), P < .001) of high magnitude
improving BMI or skinfold thickness values in children with an I2 value of 76.68%. Programs that contained only one
compared to non-RCT interventions. The research design moderator (physical activity or nutrition) and a RCT design
moderator was investigated further and separate meta- produced an effect size of 0.168 (95% CI = 0.085-0.252) with no
analyses were conducted using the RCTs and non-RCT heterogeneity (Q(df) = 6.08(12), P = 0.912, I2 = 0%). After
studies. The meta-analysis with the RCTs (k = 45) yielded a additional investigation with all the moderators, it was
small summary effect size of 0.050 (0.014 SE, P < .001); observed that interventions with two or more components
however, heterogeneity was deemed nonexistent as Q(df) implemented with a non-RCT research design produced the
was 39.72(44) (P = 0.656) with an I2 value of 0%. The RCT highest heterogeneity with an I2 value of 96.72%, which
studies had the least amount of variability and the narrowest indicated that it strongly contributed to overall heterogeneity
range for the 95% CI, which did not include absolute zero, and of the meta-analysis.
a significant Z value of 3.699 (P < .001) further indicated that The other between-group moderator components did not
the effect size was not zero (Table 2). In comparison, the have significantly different effect sizes (Table 2). Neither
meta-analysis of the non-RCT research designs (interventions categorical groups of interventions with a program duration of
with control groups and cohorts, k = 9) resulted in a negative less than one year or programs implemented for one year or
effect size of −0.378 (0.167 SE, P = 0.024) with extreme longer were effective in overall improvement of children's BMI
heterogeneity (Q(df) = 125.21(8), P < .001) of very high or skinfold thickness status. The between-group analysis for
N U T RI TI O N RE S E ARCH 3 5 ( 2 0 15 ) 2 2 9–2 40 237

program duration had variability between the 2 SEs; however, childhood obesity. This finding was consistent with other
the effect sizes were similar and therefore, the between-group school-based meta-analyses conducted by Harris et al [19]
analysis for program duration was not significant (P = .680). which included 18 studies and Kanekar and Sharma's meta-
Similarly, the effect sizes were not significantly different when analysis of five studies [20]. Conversely, Katz et al [21]
comparing interventions that targeted children less than concluded from their meta-analysis of eight studies that
10 years old vs interventions that targeted children 10 years or school-based interventions combining nutrition and physical
older (P = .989), although there was less variability with the older activity interventions were effective at achieving weight
children as shown by a smaller SE (Table 2). Programs that reduction. The largest meta-analysis of 43 school-based
included a nutrition intervention component did not produce a studies with 60 effect sizes reported a small summary effect
significantly different effect size than interventions without a size of -0.17 [22]. A meta-analysis of school-based obesity
nutrition component (P = .110). prevention RCTs observed that more recent, longer duration,
Subgroup analysis for studies with a physical activity and comprehensive interventions which included parental
component (k = 51) and those without a physical activity support were at least mildly effective in reducing BMI [18]. Our
component (k = 3) was not conducted due to the inadequate results indicated that school-based intervention RCTs with a
number of studies without physical activity. The Agency for physical activity or nutrition component were more effective
Healthcare Research and Quality [56] recommended that in improving BMI or skinfold measurement values compared
subgroups should have a minimum of four studies for to interventions with multi-components and a non-RCT
categorical subgroup analysis. Other subgroup analyses were research design.
not significant such as the between-group effect for parental The intervention in the present meta-analysis with the
involvement versus no parental involvement in the interven- greatest effect size of 0.368 and concomitant improvement in
tions (P = .447), and programs with specialists such as BMI was the girls PLAY and physical education intervention
nutritionists, nurses, and physicians that assisted in the conducted by Pangrazi et al [47], which was a RCT and
school-based programs did not have a greater effect com- included children less than 10 years old and focused only on
pared to programs without specialists (P = .605). Lastly, physical activity with a program duration of less than one
interventions that were based on a social science or health year. The least effective intervention with the smallest effect
promotion theory did not have a larger effect size compared size of -3.705 was computed for the study conducted by
to non-theory based programs (P = .329, Table 2). Angelico et al [29]. This study was a cohort research design
and also included children less than 10 years old but had a
3.3. Publication bias, Classic Fail-Safe N, and Duval and program duration of more than one year and included
Tweedie's Trim and Fill analysis components of nutrition, physical activity, and parental
involvement [29].
An asymmetrical funnel plot was produced by this meta- Subgroup analyses indicated duration of the intervention,
analysis (the hollow circles in Fig. 3), which indicated children's age, parental or specialists' involvement, or a
publication bias [26]. Most studies included in the meta- nutrition component did not yield significant between-group
analysis were large studies and therefore, plotted on top of effects. Other meta-analyses have reported conflicting re-
the funnel. Smaller studies were lacking in this meta- sults. Harris et al [19] reported programs with a shorter
analysis. Results of the Classic Fail-Safe N test (P = .047) duration (less than one year) produced a greater effect size
demonstrated that 2 small null studies were missing from the regarding improvement of students' BMI compared to pro-
meta-analysis to bring the P value to greater than α (.05). The grams with a longer duration. However, Kamath et al [57]
Duval and Tweedie's Trim and Fill analysis indicated that 15 demonstrated that program effect was greater for interven-
studies should be trimmed from the left side of the funnel plot tions implemented for more than six months compared to
(Fig. 3). After trimming those studies, the adjusted effect size studies with durations of less than 6 months in a meta-
would be .008, which is the best estimate of the unbiased analysis of various types of interventions that included both
effect size. As presented in Fig. 3, a small shift of the summary school-based and non-school-based interventions. Overall it
effect size is observed on the bottom of the graphic between is difficult to determine optimal program duration for
the present study (represented by hollow diamond) and the improving students' BMI due to different time periods used
estimated unbiased effect size (dark diamond) and therefore, for interventions. It would be beneficial if future studies could
the impact of publication bias for the present study may be determine optimal program durations, especially for different
considered trivial [26]. children's ages.
Although the present meta-analysis indicated that
children's age did not have an impact on program outcome,
4. Discussion Kamath et al [57] reported trials with children had a larger
reduction in sedentary activity than trials with adolescents.
This meta-analysis observed a small summary effect size of However, the meta-analysis conducted by Stice et al [58]
0.039 for the 27 studies with 54 effects, which indicated that suggested that older children were better in understanding
school-based interventions have not been effective in im- the concepts delivered in their intervention and a larger
proving BMI or skinfold thickness values to help curb effect size would be detected for programs that targeted
childhood obesity. Therefore we rejected our hypothesis and older children.
determined that overall, school-based interventions have not Unexpectedly, overall results of our meta-analysis indicat-
been effective for improving BMI or skinfold thickness to curb ed that studies promoting a healthy diet did not yield a
238 N U TR I TION RE S E ARCH 3 5 ( 2 0 15 ) 2 2 9–2 40

greater effect size than programs not targeting dietary specialists may not have been involved at the level required
improvement. The influence of physical activity could not be to produce a treatment effect, such as a nutritionist delivering
determined due to an inadequate number of school-based multiple interactive nutrition sessions versus only being able
studies without a physical activity component. Findings to provide one or two limited nutrition sessions to the
associated with dietary and physical activity components children. Overall, most of the studies used teachers to deliver
were demonstrated in a meta-analysis by Stice et al [58] with the programs to the students.
various types of school-based and non-school-based inter- Programs based on the social cognitive theory or social
ventions; they suggested the results could be due to compen- learning theory did not provide more effective constructs at
sation. Students might have positive behavior changes changing behaviors. Jeffery [59] stated that successful weight
following the interventions regarding nutrition and physical loss programs did not derive from cognitive decision-making
activity at school, but they altered their behaviors outside models, and suggested that applied theories such as classical
school toward unhealthy diet and physical inactivity behav- behavior theory, communications theory, and learning theory
iors, and consequently, the effects of the program were may be more helpful than the social cognitive theories.
negated [58]. In addition, perhaps the amount of physical Indeed, Davison and Birch [60] propose that a multifaceted
activity in interventions and the adherence of participants in theoretical system is needed such as the ecological systems
the intervention groups were not sufficient to achieve theory since childhood obesity involves a complex, interre-
significant improvements in BMI values [19]. lated set of factors.
Although our study demonstrated that overall, a nutrition The present meta-analysis had publication bias due to
component in the interventions did not yield a significant the absence of smaller studies as indicated by the funnel
impact on improving children's weight status, it should not be plot, although only a small shift of the summary effect size
abandoned from childhood obesity prevention programs. was detected in the plot [26]. Additional studies that
Maintaining a healthy body weight requires energy balance. reported BMI or skinfold thickness outcome measures
Factors related to healthy nutrition behaviors should be could not be located in the literature. In contrast, a separate
involved in obesity prevention [6,9,10]. It may be more meta-analysis conducted using only the studies with a RCT
important for future meta-analyses of childhood obesity design and one moderator produced more robust results
research to investigate factors that impede or assist healthy with no evidence of publication bias. It is well known that
or unhealthy diet and physical activity behavioral changes in RCTs are equated with strong evidence and high quality
school settings. For instance, Kamath et al [57] analyzed the research. The use of one or more components such as
effect size of different factors that increased or decreased physical activity, nutrition, or parental involvement in an
participants' healthy or unhealthy diets and physical activi- intervention for obesity prevention in children warrants
ties. Their study suggested that programs involving reinforce- additional research. When considering the overall results
ment yielded a greater program effect for increasing healthy produced by this meta-analysis and the small effect size that
dietary behaviors compared to programs that did not involve was observed, we concluded that school-based interven-
reinforcements, such as incentives and rewards [57]. Kamath tions have not been effective in combatting childhood
et al [57] advocated that interventions should include obesity. However, school-based RCTs that focused only on
reinforcement and multiple cognitive components, such as physical activity or nutrition appeared to produce promising
self-efficacy and decision making, to increase children's results for impacting childhood obesity.
physical activity. Programs that were implemented for a The majority of the school-based obesity prevention
longer duration (more than six months), targeted children programs included programs with multi-components and
versus adolescents, and involved multiple cognitive compo- the variables of the interventions were implemented using
nents versus one or no cognitive components, had a greater various methods. Therefore, it became difficult to determine
program effect regarding decreasing participants' sedentary why some variables produced effective program outcomes
activity [57]. while others did not. When comparing our study with other
Consistent with our study, Stice et al [58] also observed meta-analytic childhood obesity prevention research, we
that parental involvement did not produce a greater program discovered inconsistencies in the literature and different
effect compared to programs without parental involvement. comparison methods used for moderators, such as different
This may suggest that parental participation in the program cut-off points for program duration and participants' ages
activities was insufficient. Ebbeling et al [6] iterated that regarding younger versus older children. This made it
parental support and healthy family eating habits could lower difficult for determining the best age range of children and
children's risk for developing obesity. If parents take an active duration of the program for effective pediatric obesity
role in promoting and monitoring their children's lifestyles prevention interventions. Also, other moderators may be
regarding healthy eating and physical activity, it may help important components in interventions which were not
children maintain healthy body weights. However, the investigated in this meta-analysis, such as television and
influence of the home environment on childhood obesity computer screen viewing, food and micronutrient intakes,
prevention is not fully understood and requires more in- and family dynamics. As with all meta-analyses, the
depth research [58]. conclusions that can be drawn are limited by the robustness
Our subgroup analysis implied that specialist involvement of the studies used for the analyses. It should also be noted
was not an important program component in childhood that meta-analyses are observational studies and not
weight control interventions. The same finding was detected experimental studies; therefore, cause and effect cannot be
in the meta-analysis conducted by Stice et al [58]. The determined.
N U T RI TI O N RE S E ARCH 3 5 ( 2 0 15 ) 2 2 9–2 40 239

[18] Sobal-Goldberg S, Rabinowitz J, Gross R. School-based obesity


Acknowledgment prevention programs: a meta-analysis of randomized con-
trolled trials. Obesity 2013;21:2422–8.
The authors thank Wes Schilling for sharing his statistical [19] Harris KC, Kuramoto LK, Schulzer M, Retallack JE. Effect of
school-based physical activity interventions on body mass
expertise. This research was funded by the Department of
index in children: a meta-analysis. CMAJ 2009;180(7):
Food Science, Nutrition and Health Promotion and the
719–26.
Mississippi Agricultural and Forestry Experiment Station. [20] Kanekar A, Sharma M. Meta-analysis of school-based child-
Approved for publication as Journal Article No. J-12388 of the hood obesity interventions in the U.K. and U.S. Int Q
Mississippi Agricultural and Forestry Experiment Station, Community Health Educ 2009;29(3):241–56.
Mississippi State University. [21] Katz DL, O'Connell M, Njike VY, Yeh M-C, Nawaz H. Strategies
for the prevention and control of obesity in the school
setting: systematic review and meta-analysis. Int J Obes 2008;
32:1780–9.
REFERENCES [22] Lavelle HV, Mackay DF, Pell JP. Systematic review and meta-
analysis of school-based interventions to reduce body mass
index. J Public Health 2012;34(3):360–9.
[1] Han JC, Lawlor DA, Kimm SYS. Childhood obesity. Lancet [23] Higgins JPT, Green S, editors. Cochrane Handbook for
2010;375:1737–48. Systematic Reviews of Interventions Version 5.1.0The
[2] Kraak VI, Story M. A public health perspective on healthy Cochrane Collaboration; 2011 [Available from: http://www.
lifestyles and public-private partnerships for global cochrane-handbook.org].
childhood obesity prevention. J Am Diet Assoc 2010;110(2): [24] Borenstein M, Higgins JPT. Meta-analysis and subgroups. Prev
192–200. Sci 2013;14:134–43.
[3] Finkelstein EA, Ruhm CJ, Kosa KM. Economic causes and [25] Cohen J. A power primer. Psychol Bull 1992;112:155–9.
consequences of obesity. Annu Rev Public Health 2005;26: [26] Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Intro-
239–57. duction to meta-analysis. West Sussex, England: John Wiley
[4] Ogden CL, Carroll MD, Kit BK, Flegal KM. Prevalence of obesity & Sons Ltd.; 2009.
and trends in body mass index among US children and [27] Huedo-Medina TB, Sánchez-Meca J, Marín-Martínez F, Botella
adolescents, 1999-2010. JAMA 2012;307(5):483–90. J. Assessing heterogeneity in meta-analysis: Q statistic or I2
[5] Daniels SR. Complications of obesity in children and index? Psychol Methods 2006;11(2):193–206.
adolescents. Int J Obes 2009;33:S60–5. [28] Alexandrov AA, Maslennikova GY, Kulikov SM, Propirnij GA,
[6] Ebbeling CB, Pawlak DB, Ludwig DS. Childhood obesity: Perova NV. Primary prevention of cardiovascular disease:
public-health crisis, common sense cure. Lancet 2002;360: 3-year intervention results in boys of 12 years of age. Prev
473–82. Med 1992;21:53–62.
[7] Dietz WH. Health consequences of obesity in youth: [29] Angelico F, Del Ben M, Fabiani L, Lentini P, Pannozzo F,
childhood predictors of adult disease. Pediatrics 1998;101: Urbinati GC. Management of childhood obesity through a
518–25. school-based programme of general health and nutrition
[8] Sallis JF, Glanz K. Physical activity and food environments: education. Public Health 1991;105:393–8.
solutions to the obesity epidemic. Milbank Q 2009;87(1): [30] Bayne-Smith M, Fardy PS, Azzollini A, Magel J, Schmitz KH,
123–54. Agin D. Improvements in heart health behaviors and
[9] Koplan JP, Liverman CT, Kraak VI. Preventing childhood reduction in coronary artery disease risk factors in urban
obesity: health in the balance: executive summary. J Am Diet teenaged girls through a school-based intervention: the
Assoc 2005;15(1):131–8. PATH program. Am J Public Health 2004;94(9):1538–43.
[10] Story M, Nanney MS, Schwartz MB. School and obesity [31] Bush PJ, Zuckerman AE, Theiss PK, Taggart VS, Horowitz C,
prevention: creating school environments and policies to Sheridan MJ, et al. Cardiovascular risk factor prevention in
promote healthy eating and physical activity. Milbank Q black schoolchildren: Two-year results of the “know your
2009;87(1):71–100. body” program. Am J Epidemiol 1989;129(3):466–82.
[11] Kubik MY, Lytle LA, Hannan PJ, Perry CL, Story M. The [32] Caballero B, Clay T, Davis SM, Ethelbah B, Rock BH, Lohman
association of the school food environment with dietary T, et al. Pathways: a school-based, randomized controlled
behaviors of young adolescents. Am J Public Health 2003;93 trial for the prevention of obesity in American Indian
(7):1168–73. schoolchildren. Am J Clin Nutr 2003;78:1030–8.
[12] Fox MK, Dodd AH, Wilson A, Gleason PM. Association [33] Carrel AL, Clark RR, Peterson SE, Nemeth BA, Sullivan J, Allen
between school food environment and practices and body DB. Improvement of fitness, body composition, and insulin
mass index of US public school children. J Am Diet Assoc sensitivity in overweight children in a school-based exercise
2009;109(Suppl. 1):S108–17. program. Arch Pediatr Adolesc Med 2005;159:963–8.
[13] US Department of Agriculture, US Department of Health and [34] Donnelly JE, Jacobsen DJ, Whatley JE, Hill JO, Swift LL,
Human Services. Dietary Guidelines for Americans, 2010. 7th Cherrington A, et al. Nutrition and physical activity program
ed. Washington, DC: US Government Printing Office; 2010. to attenuate obesity and promote physical and metabolic
[14] Veugelers PJ, Fitzgerald AL. Effectiveness of school programs fitness in elementary school children. Obes Res 1996;4(3):
in preventing childhood obesity: a multilevel comparison. 229–43.
Am J Public Health 2005;95(3):432–5. [35] Hansen HS, Froberg K, Hyldebrandt N, Nielsen JR. A con-
[15] Foster GD, Sherman S, Borradaile KE, Grundy KM, Vander trolled study of eight months of physical training and
Veur SS, et al. A policy-based school intervention to prevent reduction of blood pressure in children: the Odense school-
overweight and obesity. Pediatrics 2008;121(4):794–802. child study. Br Med J 1991;303:682–5.
[16] Story M, Kaphingst KM, French S. The role of schools in [36] Harrell JS, McMurray RG, Bangdiwala SI, Frauman AC, Gansky
obesity prevention. Future Child 2006;16(1):109–42. SA, Bradley CB. Effects of a school-based intervention to
[17] Gonzalez-Suarez C, Worley A, Grimmer-Somers K, Dones V. reduce cardiovascular disease risk factors in elementary-
School-based interventions on childhood obesity: a school children: the cardiovascular health in children (CHIC)
meta-analysis. Am J Prev Med 2009;37(5):418–27. study. J Pediatr 1996;128(6):797–805.
240 N U TR I TION RE S E ARCH 3 5 ( 2 0 15 ) 2 2 9–2 40

[37] Harrell TK, Davy BM, Stewart JL, King DS. Effectiveness of [49] Ritenbaugh C, Teufel-Shone NI, Aickin MG, Joe JR, Poirier S,
a school-based intervention to increase health knowledge Dillingham DC, et al. A lifestyle intervention improves
of cardiovascular disease risk factors among rural Mis- plasma insulin levels among Native American high school
sissippi middle school children. South Med J 2005;98(12): youth. Prev Med 2003;36:309–19.
1173–80. [50] Robinson TN. Reducing children's television viewing to
[38] James J, Thomas P, Cavan D, Kerr D. Preventing childhood prevent obesity: a randomized controlled trial. JAMA 1999;282
obesity by reducing consumption of carbonated drinks: (16):1561–7.
cluster randomised controlled trial. Br Med J 2004;328:1237–9. [51] Sallis JF, McKenzie TL, Alcaraz JE, Kolody B, Faucette N, Hovell
http://dx.doi.org/10.1136/bmj.38077.458438.EE. MF. The effects of a 2-year physical education program
[39] James J, Thomas P, Kerr D. Preventing childhood obesity: two (SPARK) on physical activity and fitness in elementary school
year follow-up results from the Christchurch obesity pre- students. Am J Public Health 1997;87(8):1328–34.
vention programme in schools (CHOPPS). Br Med J 2007;335: [52] Trevino RP, Hernandez AE, Yin Z, Garcia OA, Hernandez I.
762. http://dx.doi.org/10.1136/bmj.39342.571806.55. Effect of the Bienestar health program on physical fitness in
[40] Kain J, Uauy R, Albala C, Vio F, Cerda R, Leyton B. School- low-income Mexican American children. Hisp J Behav Sci
based obesity prevention in Chilean primary school children: 2005;27(1):120–32.
methodology and evaluation of a controlled study. Int J Obes [53] Vandongen R, Jenner DA, Thompson C, Taggart AC, Spickett
2004;28:483–93. EE, Burke V, et al. A controlled evaluation of a fitness and
[41] Killen JD, Telch MJ, Robinson TN, Maccoby N, Taylor B, nutrition intervention program on cardiovascular health in
Farquhar JW. Cardiovascular disease risk reduction for tenth 10- to 12-year-old children. Prev Med 1995;24:9–22.
graders: a multiple-factor school-based approach. JAMA 1988; [54] Wardle J, Brodersen NH, Boniface D. School-based physical
260(12):1728–33. activity and changes in adiposity. Int J Obes 2007;31:1464–8.
[42] Kriemler S, Zahner L, Schindler C, Meyer U, Hartmann T, [55] Wang Y, Wu Y, Wilson RF, Bleich S, Cheskin L, Weston C,
Hebestreit H, et al. Effect of school based physical activity et al. Childhood obesity prevention programs: comparative
programme (KISS) on fitness and adiposity in primary effectiveness review and meta-analysis. Comparative effec-
schoolchildren: cluster randomized controlled trial. Br Med J tiveness review No. 115. (Prepared by the Johns Hopkins
2010;340:c785. http://dx.doi.org/10.1136/bmj.c785. University Evidence-based Practice Center under contract No.
[43] Luepker RV, Perry CL, McKinlay SM, Nader PR, Parcel GS, 290-2007-10061-I.) AHRQ Publication No. 13-EHC081-EF.
Stone EJ, et al. Outcomes of a field trial to improve children's Rockville, MD: Agency for Healthcare Research and Quality;
dietary patterns and physical activity: the Child and Adoles- 2013 [Available from: www.effectivehealthcare.ahrq.gov/
cent Trial for Cardiovascular Health (CATCH). JAMA 1996;275 reports/final.cfm].
(10):768–76. [56] Agency for Healthcare Research and Quality. Methods guide
[44] Manios Y, Kafatos A, Mamalakis G. The effects of a health for effectiveness and comparative effectiveness reviews.
education intervention initiated at first grade over a 3 year AHRQ Publication No. 10(14)-EHC063-EF. Rockville, MD:
period: physical activity and fitness indices. Health Educ Res Agency for Healthcare Research and Quality; 2014 [Available
1998;13(4):593–606. from: http://www.effectivehealthcare.ahrq.gov/ehc/
[45] Manios Y, Moschandreas J, Hatzis C, Kafatos A. Health and products/60/318/CER-Methods-Guide-140109.pdf].
nutrition education in primary schools of Crete: changes in [57] Kamath CC, Vickers KS, Ehrlich A, McGovern L, Johnson J,
chronic disease risk factors following a 6-year intervention Singhal V, et al. Behavioral interventions to prevent childhood
programme. Br J Nutr 2002;88:315–24. obesity: a systematic review and metaanalyses of randomized
[46] Nader PR, Stone EJ, Lytle LA, Perry CL, Osganian SK, Kelder S, trials. J Clin Endocrinol Metab 2008;93(12):4606–15.
et al. Three-year maintenance of improved diet and physical [58] Stice E, Shaw H, Marti CN. A meta-analytic review of obesity
activity: The CATCH Cohort. Arch Pediatr Adolesc Med 1999; prevention programs for children and adolescents: The
153(7):695–704. skinny on interventions that work. Psychol Bull 2006;132(5):
[47] Pangrazi RP, Beighle A, Vehige T, Vack C. Impact of promoting 667–91.
lifestyle activity for youth (PLAY) on children's physical [59] Jeffrey RW. How can health behavior theory be made more
activity. J Sch Health 2003;73(8):317–21. useful for intervention research? Int J Behav Nutr Phys Act
[48] Puska P, Vartiainen E, Pallonen U, Salonen JT, Pöyhiä P, Koskela 2004;1:10. http://dx.doi.org/10.1186/1479-5868-1-10.
K, et al. The North Karelia youth project: evaluation of two [60] Davison KK, Birch LL. Childhood overweight: a contextual
years of intervention on health behavior and CVD risk factors model and recommendations for future research. Obes Res
among 13- to 15-year old children. Prev Med 1982;11:550–70. 2001;2(3):159–71.

You might also like