You are on page 1of 11

PEDIATRICOBESITY

ORIGINALRESEARCH doi:10.1111/ijpo.242

Diagnostic performance of body mass index to

ORIGINALRESEARCH
identify obesity as defined by body adiposity in
children and adolescents: a systematic review
and meta-analysis
A. Javed1, M. Jumean2, M. H. Murad3, D. Okorodudu4, S. Kumar1, V. K. Somers5,
O. Sochor5,6 and F. Lopez-Jimenez5
1
Department of Pediatric and Adolescent Medicine, Division of Pediatric Endocrinology Mayo Clinic, Rochester, MN, USA;
2
Department of Cardiovascular Diseases Tufts Medical Center, Boston, MA, USA; 3Division of Preventive, Occupational, and
Aerospace Medicine, Department of Medicine, Mayo Clinic, Rochester, MN, USA; 4Department of Internal Medicine, Duke
University Medical Center, Durham, NC, USA; 5Division of Cardiovascular Diseases, Department of Medicine, Mayo Clinic,
Rochester, MN, USA; 6International Clinical Research Center – Department of Cardiovascular Diseases, St. Anne’s University
Hospital Brno, Brno, Czech Republic

Received 24 July 2013; revised 7 October 2013; accepted 19 November 2013

Summary
Background: The ideal means of identifying obesity in children and adolescents has not been deter-
mined although body mass index (BMI) is the most widely used screening tool.
Objective: We performed a systematic review and meta-analysis of studies assessing the diagnostic
performance of BMI to detect adiposity in children up to 18 years.
Methods: Data sources were EMBASE, MEDLINE, Cochrane, Database of Systematic Reviews
Cochrane CENTRAL, Web of Science and SCOPUS up to March 2013. Studies providing measures of
diagnostic performance of BMI and using body composition technique for body fat percentage measurement
were included.
Results: Thirty-seven eligible studies that evaluated 53 521 patients, with mean age ranging from 4 to 18
years were included in the meta-analysis. Commonly used BMI cut-offs for obesity showed pooled sensitivity
to detect high adiposity of 0.73 (confidence interval [CI] 0.67–0.79), specificity of 0.93 (CI 0.88–0.96) and
diagnostic odds ratio of 36.93 (CI 20.75–65.71). Males had lower sensitivity. Moderate heterogeneity was
observed (I2 = 48%) explained in meta-regression by differences across studies in race, BMI cut-off, BMI
reference criteria (Center for Disease Control vs. International Obesity Task Force) and reference standard
method assessing adiposity.
Conclusion: BMI has high specificity but low sensitivity to detect excess adiposity and fails to identify over
a quarter of children with excess body fat percentage.

Keywords: Body mass index, meta-analysis, paediatric obesity, systematic review.

Introduction Childhood obesity tracks strongly into adult-


hood with increased risk for type 2 diabetes
Obesity has become the most prevalent risk factor mellitus and cardiovascular disease (5–8). Beyond
for adverse cardiovascular outcome in children (1) implications for physical well-being, obesity is often
with 17% of American adolescents obese and 32% associated with stigmatization and poor self-
either overweight or obese as defined by being equal esteem (9).
to or greater than the 85th percentile (but less than Timely recognition is of paramount significance in
the 95th) and equal to or greater than the 95th per- mitigating these seriously adverse consequences.
centiles respectively on body mass index (BMI) The primary care provider, therefore, needs to be
growth charts (1–4). equipped with an efficient screening tool suitable for

Address for correspondence: Dr F Lopez-Jimenez, Division of Cardiovascular Diseases, Department of Medicine, Mayo Clinic, 200 First
Street SW, Rochester, MN 55905, USA. E-mail: Lopez@mayo.edu
© 2014 The Authors
Pediatric Obesity © 2014 World Obesity. Pediatric Obesity ••, ••–••
2 | A. Javed et al.

widespread office-based use, yet sufficiently reliable has been conducted. The present meta-analysis
ORIGINALRESEARCH

to detect obesity at an early stage. aims to assess an overall estimate of validity of BMI
Obesity is defined as a medical condition in which for detection of obesity as defined by excess adipos-
excess body fat accumulation can impact health ity in children and adolescents up to the age of 18
negatively (10). However, current assessment of years, while recognizing that BMI is not used to
obesity is based on BMI which relies on body weight diagnose obesity in children less than 2 years of age.
regardless of body composition, and is calculated by
dividing the individual’s weight in kilograms by the Materials and methods
height in meter squared. Due to its simplicity and Search strategy and selection criteria
epidemiologic data showing an association between
increased BMI and cardiovascular events (11), BMI The predefined inclusion criteria for study selection
has been used in the clinical setting despite carrying were: (i) the study must have assessed the diagnos-
the inherent flaw of failing to distinguish between lean tic performance of BMI to identify excess adiposity in
and fat mass (12–14), both of which contribute to children aged 0–18 years; (ii) provided a 2 × 2 diag-
BMI. Despite ethnic and racial differences in adipos- nostic table to allow for meta-analysis or information
ity, recommendations from several organizations, to calculate these values; and (iii) used a reference
including the American Academy of Pediatrics, standard for body composition (e.g. DXA, ADP, HW).
advise the use of BMI for age with national reference Studies were excluded if they only assessed
data to diagnose paediatric obesity in the clinical cardiometabolic risk factors without use of any ref-
setting (15–19). However, previous studies have erence standard methods for measuring adiposity.
highlighted the limitations of BMI, both in adults and We searched the databases EMBASE (1988 to
in the growing child (20–22). Further limitations of March 2013), MEDLINE (1950 to March 2013),
BMI as a universal screening tool include the type of Web of Science (1993 to March 2013), Cochrane,
BMI reference criteria used (e.g. National reference Database of Systematic Reviews (from inception),
for age data vs. Center for Disease Control [CDC] Cochrane CENTRAL (from inception) and SCOPUS
(23) vs. International Obesity Task Force [IOTF]) (24), (1996 to March 2013). The search was conducted by
pubertal stage and racial/ethnic differences between a librarian with expertise in meta-analyses with input
the individual patient and cohort (12,25). from investigators. Three domains were considered
The cut-off value used to diagnose obesity in chil- absolute criteria during the search: (i) BMI or equi-
dren involves working out the distribution for a par- valent (e.g. Quetelet Index, BMI); (ii) diagnostic per-
ticular population and arbitrarily choosing particular formance or equivalent (e.g. sensitivity, specificity,
values, often the 85th or 95th centiles, to categorize predictive values); and (iii) measurement of body fat
those with the highest BMIs (26). Several studies or equivalent (for example DXA, ADP, HW, BIA, body
have illustrated discrepancies between prevalence of composition). The detailed search strategy is pro-
obesity within a population using different reference vided (Supporting Information Appendix S1).
growth curves (27,28). We eliminated irrelevant articles from our primary
Previous studies in children have analysed the per- search on the basis of information in title and
formance of BMI to detect obesity when compared abstract (Fig. 1). The remaining studies were read in
with techniques considered reference standard their entirety by a single investigator (AJ) and those
methods for measurement of body adiposity, e.g. not meeting inclusion criteria were excluded. The
dual energy X-ray absorptiometry (DXA), hydrostatic search was supplemented with cross-references
weighing (HW), air-displacement plethysmography from selected articles. A particular effort was made
(ADP), isotope dilution, bioelectrical impedance to contact authors of articles with equivocal informa-
analysis (BIA) and skin-fold thickness measurement tion and investigators known to conduct research on
(29); however, these techniques are rarely used in BMI diagnostic performance asking for studies that
clinical practice because of their cumbersome nature may fulfil our inclusion criteria.
and lack of reference data on ‘normal’ cut-offs for
Quality assessment/data abstraction
body fat percentage (BF%) values in children.
While a systematic review assessing the perfor- Thirty of the studies were selected from our pri-
mance of BMI in prediction of adverse cardiovascular mary search based solely on title and abstract,
risk has been performed (11), no meta-analysis gen- and independently reviewed by another investigator
erating estimates of pooled sensitivity and accuracy (FL-J) and agreement coefficient determined. The
of BMI vs. reference standard methods of measuring Quality Assessment of Diagnostic Accuracy Studies
excess body fat or adiposity, such as BIA, DXA etc., (QUADAS) tool, a 0- to 14-point scale considering

© 2014 The Authors


Pediatric Obesity © 2014 World Obesity. Pediatric Obesity ••, ••–••
Diagnostic performance of BMI to identify obesity | 3

ORIGINALRESEARCH
Figure 1 Study flow chart illustration. Of the 1488 potentially relevant abstracts, 33 articles were included in the
meta-analysis along with four articles added via cross-reference.

Table 1 Diagnostic performance of body mass index

Pooled sensitivity Pooled specificity Positive likelihood Negative likelihood Diagnostic odds ratio
ratio ratio
Overall 0.73 (CI0.67–0.79) 0.93 (CI0.88–0.96) 10.58 (CI6.08–18.41) 0.29 (CI0.23–0.35) 36.93 (CI20.75–65.71)
Males 0.67 (CI0.56–0.76) 0.94 (CI0.84–0.98) 11.17 (4.22–29.54) 0.34 (CI0.27–0.47) 31.37 (11.53–85.31)
Females 0.71 (CI0.62–0.79) 0.95 (CI0.88–0.98) 14.56 (CI6.33–33.45) 0.30 (CI0.23–0.40) 48.02 (21.09–109.4)
CI, confidence interval.

factors that determine the validity of studies specifi- Statistical analysis


cally assessing diagnostic tests performance, was
used to review the quality of eligible studies (30). To Diagnostic data from each study were fitted in a
evaluate the quality of the study, the following criteria two-level mixed logistic regression model, with inde-
were used: (i) standardization of the index method pendent binomial distributions for the true positives
i.e. BMI measurement, (ii) the reference standard and true negatives conditional on the sensitivity
method used to assess body fat, (iii) blinding of BMI and specificity in each study, and a bivariate normal
measurement from BF% measurement, (iv) time model for the log transforms of sensitivity and
between BMI and BF% measurement and (v) details specificity between studies. We estimated pooled
of instructions given to subjects regarding diet and sensitivity, specificity, likelihood ratios (LR) and diag-
exercise before body composition measurement. nostic odds ratios (DOR). The DOR, computed as
Studies were classified as high quality (score of 10 or the positive LR (LR+) over negative LR (LR−), is
greater) or low quality (score less than 10) based on defined as the odds of having a positive test result in
this assessment. Data regarding the population patients with disease compared with the odds of a
studied, cut-off values used to define overweight or positive test result in patients without disease (31).
obesity, reference standard methods used to The heterogeneity of diagnostic test parameters
measure BF% and values of diagnostic performance was evaluated using the I2 statistic. The I2 statistic is
of BMI to detect high BF% were by a single investi- defined as the percentage of variation across studies
gator (AJ) (Table 1). as a result of heterogeneity beyond that from chance

© 2014 The Authors


Pediatric Obesity © 2014 World Obesity. Pediatric Obesity ••, ••–••
4 | A. Javed et al.

(32) with a value of 0% indicating no observed het- (Fig. 1). The concordance assessment using a
ORIGINALRESEARCH

erogeneity and >50% denoting substantial heteroge- sample of abstracts showed perfect agreement (cor-
neity. Data analysis was conducted using the relation coefficient of 1.0) between co-authors (AJ
statistical program Stata (Version 11, StataCorp, and FL-J) when selecting studies based on title and
College Station, TX, USA). abstract. The studies included in the final analysis
To explain heterogeneity, we conducted multiva- evaluated a total of 53 521 patients, with a mean age
riable meta-regression in which the outcome variable ranging from 4 to 18 years. Gender-specific data
was the log of DOR and the explanatory variables were present in 34 of the 37 studies, including
were covariates known to affect BMI (21). These 18 429 males and 22 781 females.
variables were chosen a priori as potential causes of Meta-analysis showed pooled sensitivity to detect
between-study heterogeneity and included: (i) BMI high adiposity of 0.73 (95% confidence interval [CI]
cut-off values to define obesity, (ii) BF% cut-off values 0.67–0.79) and pooled specificity of 0.93 (CI 0.88–
to define obesity, (iii) gold standard used to assess 0.96). LR+ was 10.58 (CI 6.08–18.41), LR− was 0.29
BF%, (iv) race and (v) quality assessment score. (CI 0.23–0.35) and DOR was 36.93 (CI 20.75–
Studies were grouped based on BMI definition of 65.71). Receiver operating curve of BMI to detect
excess adiposity using (i) BMI cut-off values into adiposity is shown in Fig. 2. In males, BMI showed
≥95th percentile, ≥85th percentile or other, or (ii) CDC pooled sensitivity of 0.67 (CI 0.56–0.76) and pooled
definition or national reference criteria vs. the IOTF specificity of 0.94 (CI 0.84–0.98). LR+ was 11.17
definition of obesity. When more than one BMI cut-off (4.22–29.54), LR− was 0.34 (CI 0.27–0.47) and DOR
values were reported, the diagnostic accuracy of was 31.37 (11.53–85.31). As for females, BMI
BMI using the CDC or national reference criteria was showed pooled sensitivity of 0.71(CI 0.62–0.79),
used for the overall pooled analysis. Studies were pooled specificity of 0.95 (CI 0.88–0.98), LR+ of
also grouped based on BF% groups using cut-off 14.56 (CI 6.33–33.45), LR− of 0.30 (CI 0.23–0.40)
values to define obesity by adiposity and not by BMI, and DOR of 48.02 (21.09–109.4) (Table 1).
as follows: (i) BF% of 20–25% in males and <30% in Moderate heterogeneity was observed across
females, (ii) other definitions of BF% cut-off, (iii) ≥95th studies (I2 = 48%), explored through multi variable
percentile BF% cut-off. These BF% cut-offs were meta-regression. While race, BMI cut-off value,
based on definitions of obesity by fat content previ- national or CDC vs. IOTF reference criteria, definition
ously used in study populations assessing adiposity of BMI and reference standard method used to
at the individual level, and mostly derived from adult measure adiposity explained heterogeneity, body fat
data shown to correlate with metabolic risk. Studies cut-off used or study quality did not (Appendix S2).
included in the meta-analysis used different methods The characteristics of individual studies selected for
as reference standard to assess body composition. meta-analysis are presented in Table 2.
Based on comparable accuracy, studies that used
DXA, HW, ADP and isotope dilution measurement of
Discussion
total body water were grouped together and the
pooled estimates were reported and compared with This is the first systematic review and meta-analysis
those studies that used lower accuracy measures as assessing diagnostic performance of BMI in identify-
the reference standard method (BIA and skin-fold) ing excess body fat as compared with reference
(33–35). For studies reporting diagnostic accuracy of standard techniques of measuring adiposity, e.g.
BMI when compared with more than one BF com- DXA, ADP etc., in children. The results show that BMI
position measure, data from the higher accuracy BF has high specificity in identifying paediatric obesity,
composition method were used in overall pooled but moderate sensitivity. Pooled results from the 37
analysis. Given geographic differences in body com- studies showed sensitivity of 73%, suggesting over a
position, studies were grouped based on race of the quarter of children not labelled as obese by BMI
study population into Caucasian, Asian, Hispanic or might indeed have excess adiposity.
Black. Finally, studies were categorized into two These results have implications for clinicians,
subgroups based on QUADAS score into optimal or public health and policymakers as well as the indi-
suboptimal groups (cut-off score = 10) (Table 2). vidual child. Suboptimal recognition of obesity at this
crucial time translates into missed opportunities to
institute appropriate lifestyle interventions to mitigate
Results
future health risks (65).
The search strategy yielded 1488 potential studies. Previous studies report low sensitivity and high
Subsequently, 37 articles met all inclusion criteria specificity of BMI in children (14,17,38,40,42,49,52)

© 2014 The Authors


Pediatric Obesity © 2014 World Obesity. Pediatric Obesity ••, ••–••
Table 2 Characteristics of individual studies

Author Quality Population/ n Mean age Age SD/ % % Reference Dx criteria Dx criteria Prevalence Sensitivity Specificity
score location (years) SEM± Male Female standard according according according % %
method to reference to BMI to reference
standard standard

Eto et al. (36) 9 Japan 486 4.35 0.70 47.94 52.06 BIA 20% BF (M) 90th percentile 18.07 32.98 95.95
25% BF (F)
Wickramasinghe 11 Australia 96 9.43 2.25 45.83 54.17 DD 20% BF (M) 95th percentile 50.00 11.75 100.00
et al. (37) 30% BF (F)
Sri Lankan 42 9.28 3.18 64.29 35.71 DD 20% BF (M) 95th percentile 54.76 13.40 100.00
migrants living 30% BF (F)
in Australia
da Veiga et al. (25) 11 Brazil 1540 (10–17.9) 46.5 53.5 BIA 25% BF (M) 95th percentile 16.60 28.90 99.22
30% BF (F)
Sardinha et al. (38) 10 Portugal 55 (10–11) * 100 0 DXA 25% BF 19 kg m−2 27.3% 96 86
52 (12–13) * 100 0 DXA 25% BF 19.4 kg m−2 86 76
58 (14–15) * 100 0 DXA 25% BF 24 kg m−2 50 92
54 (10–11) * 0 100 DXA 30% BF 19.6 kg m−2 44.8% 83 87
60 (12–13) * 0 100 DXA 30% BF 21.2 kg m−2 N/A 67 97
49 (14–15) * 0 100 DXA 30% BF 21.9 kg m−2 N/A 77 89
Neovius et al. (39) 10 Sweden 474 16.84 0.26 42.19 57.81 ADP 25% BF (M) 85th percentile 29.93 48.48 94.37
30% BF (F)
Reilly et al. (40) 9 United Kingdom 238 8.50 0.40 51.68 48.32 SF 25% BF in males z score = 2 ∼ 97.7th 6.72 43.75 98.65
32% BF in females percentile
Taylor et al. (41) 10 New Zealand 368 11.89 1.97 48.64 51.36 DXA 25% BF in males Male z score = 24.99 86.18 93.11
35% BF in females 0.41 ∼ 65.8th percentile
Female z score =
0.89 ∼ 79.1th percentile
Marshall et al. (42) 10 Canada 540 10.88 0.40 49.3 50.7 HW BF >20% in males, >120% value of BMI 14.10 71.10 91.60
>25% in females
Nichols & Cadogan 10 Island of Tobago 3749 14.50 1.66 42.9 57.1 BIA BF >25% in males, >95th percentile 30.11 57.12 93.58
2009 (43) >30% in females
Fu et al. (44) 10 Singapore 623 8.35 0.24 51.5 49.5 BIA BF >95th percentile IOTF criteria extrapolated 75.00 95.80
adult > 30 kg m−2
Li et al. (13) 7 China 587 9.64 0.50 47.5 52.5 BIA BF >25% males, BMI cut-off of 20 kg m−2 34.80 26.40 99.20
>30% females used
Candido et al. (45) 10 Brazil 159 pre-pubertal 6–15 47.7 52.3 BIA >85th percentile Differing cut-offs based on 87.50 99.30
girl least misclassification
121 pubertal girl 88.90 88.50
123 post-pubertal 78.00 84.90
girl
183 pre-pubertal 95.00 92.00
boy
Diagnostic performance of BMI to identify obesity

112 pubertal boy 100.00 86.60


|

74 post-pubertal 90.00 92.20


boy

© 2014 The Authors


5

Pediatric Obesity © 2014 World Obesity. Pediatric Obesity ••, ••–••


ORIGINALRESEARCH
ORIGINALRESEARCH 6
|

Table 2 Continued

Author Quality Population/ n Mean age Age SD/ % % Reference Dx criteria Dx criteria Prevalence Sensitivity Specificity
score location (years) SEM± Male Female standard according according according % %

© 2014 The Authors


method to reference to BMI to reference
standard standard

Bedogni et al. (46) 8 Italy 934 10.00 1.00 49.89 50.11 BIA 85th percentile 95th percentile N/A 39.00 99.00
A. Javed et al.

Gaskin & Walker (47) 9 Jamaica 303 7.75 55.45 44.55 Sum SF 85th percentile Predicted 25 kg m−2 at 3.63 50.10 99.12
age 18
306 11.81 0.35 55.45 44.55 Sum SF 85th percentile Predicted 25 kg m−2 9.48 72.69 97.36
at age 18
Ghosh (48) 9 India 450 7.46 1.16 0 100 SF 85th percentile 95th percentile N/A 49.00 94.00
Lazarus et al. (49) 9 Australia 230 12.17 51.74 48.26 DXA 85th percentile 95th percentile N/A 29.00 99.00
Mei et al. (50) 8 NHANES III 4285 2–5 SF 85th percentile 85th percentile N/A 78.30 88.30
NHANES III 3279 6–11 SF 85th percentile 85th percentile 92.70 91.50
NHANES III 3189 12–15 SF 85th percentile 85th percentile 84.70 90.50
America, Italy, 162 4.76 0.58 33.33 66.66 DXA 85th percentile 85th percentile 88.50 79.40
New Zealand
America, Italy, 466 8.52 1.43 41.42 58.58 DXA 85th percentile 85th percentile 98.60 67.70
New Zealand

Pediatric Obesity © 2014 World Obesity. Pediatric Obesity ••, ••–••


America, Italy, 292 14.28 2.27 46.57 53.43 DXA 85th percentile 85th percentile 100.00 72.20
New Zealand
Moreno et al. (51) 10 Spain 286 14.75 * 40.56 59.44 DXA 85th percentile 85th percentile 21.04 67.33 90.42
Sarria et al. (17) 10 Spain 175 12.80 100 0 HW 85th percentile 85th percentile N/A 50.00 91.00
Warner et al. (52) 11 United Kingdom 40 11.80 3.10 57.5 42.5 DXA 85th percentile z score = N/A 67.00 96.00
1 ∼ 84.1th percentile
United Kingdom 40 11.80 3.10 57.5 42.5 SF 85th percentile z score = 44.00 100.00
1 ∼ 84.1th percentile
Duncan et al. (53) 11 Five ethnicities 1676 11.64 0.34 0% 100% BIA >85% percentile Differing BMI cut-offs
New Zealand (age
and ethnic
specific)
Maori 216 11.50 2.60 69th 90.00 80.30
East Asian 242 12.10 2.60 68th 90.30 78.90
Pacific Island 355 11.90 2.90 69th 90.40 79.20
South Asian 183 11.30 2.50 58th 91.40 77.90
European 680 11.40 2.90 70th 92.30 66.70
Nwizu et al. (54) 10 Nigerian 753 13.59 0.29 50.1 49.9 BIA >85th percentile >85th percentile 5.40 97.50 97.19
Freedman et al. (12) 11 North America 162 11.7 3.00 100 0 DXA >84th percentile >95th percentile N/A 65.00 N/A
White males
Black 130 12.3 4.00 83.00
Hispanic 94 12.8 3.00 82.00
Asian 192 12.0 4.00 65.00
White 141 11.5 3.00 >85th percentile 72.00
females
Black 140 11.8 3.00 89.00
Hispanic 79 12.6 3.00 88.00
Asian 166 11.8 4.00 50.00
Field et al. (55) 7 North America 596 10.00 2.20 40 60 DXA 90th percentile BMI z score > 2 60.00 51.00 100.00
Himes & Bouchard 8 Canada 316 8.4–18.99 * 50.32 49.68 HW 90th percentile 85th percentile 16.13 25.47 99.48
(56) (range)
Yoo et al. (57) 9 Korea 938 9.70 1.20 51.6 48.4 BIA >35% body fat 95th percentile N/A 71.40 79.00
Ellis et al. (22) 9 North America 979 11.37 41.47 58.53 DXA 95th percentile 95th percentile 5.11 82.00 91.71
Oliveira et al. (58) 10 Brazil 418 9–18 * 100 0 DXA 95th percentile 95th percentile N/A 81.20 90.90
years
Reilly et al. (14) 11 United Kingdom 3948 7.00 * 50.91 49.09 BIA 95th percentile 95th percentile 5.00 88.00 94.00
Zimmermann et al. 10 Sweden 2431 9.80 1.77 100 0 SF 95th percentile 95th percentile N/A 91.40 96.90
(59) 1235 9.84 1.8 0 100 SF 95th percentile 95th percentile N/A 67.90 97.30
Mast et al. (60) 10 Germany 2286 6.24 0.33 50.1 49.9 BIA 90th percentile 90th percentile 5.82 82.70 94.52
2286 6.24 0.33 50.1 49.9 SF 90th percentile 90th percentile 9.80 65.62 93.00
Mei et al. (61) 11 North America 1196 12.00 3.40 52.3 47.7 DXA >95% (range of >95th percentile N/A 92.40 89.40
cut-offs)
Bartok et al. (62) 10 North America 173 9.00 * 0 100 DXA >95th percentile 19.1 kg m−2 29.00 90.00 94.00
longitudinal
study
172 11.00 * 0 100 DXA >95th percentile 20.4 kg m−2 24.00 95.00 83.00
151 13.00 * 0 100 DXA >95th percentile 22 kg m−2 20.00 93.00 88.00
160 15.00 * 0 100 DXA >95th percentile 17 kg m−2 24.00 96.00 95.00
Schaefer et al. (16) 8 Germany 2554 11.82 49.9 50.1 SF >95th percentile >95th percentile national N/A 55.00 97.00
Malina & Katzmarzyk 11 Canada (White) 275 13.13 56.36 43.64 SF >25% M >95th percentile 5.00 54.28 99.63
(63)
Neovius & 8 Sweden 3334 15.20 0.60 51.92 48.08 BIA >95th percentile IOTF 5.00 44.30 98.74
Rasmussen (64)
Reilly et al. (11) 11 North America 7722 9.90 0.50 49.24 50.76 DXA >90th percentile >95th percentile 9.40 95.32 95.47

ADP, air-displacement plethysmography; BF, body fat; BIA, bioelectrical impedance analysis; BMI, body mass index; DD, deuterium dilution; Dx, Diagnostic; DXA, dual energy X-ray absorptiometry; F, female; HW, hydrostatic weighing;
IOTF, International Obesity Task Force; M, male; NHANES, National Health and Nutrition Examination Survey; N/A, not available; SD, standard deviation; SEM, standard error of the mean; SF, skin-fold. Sensitivity results ranged from
11.75% in an Australian population [Wickramasinghe et al. (37)] to 100% in Caucasian populations [Mei et al. (50), Candido et al. (45)]. Specificity ranged from 66.7% in a New Zealand population [Duncan et al. (53)] to a value of 100%
Diagnostic performance of BMI to identify obesity

[Warner et al. (52), Field et al. (55), Wickramasinghe et al. (37)].


|

© 2014 The Authors


7

Pediatric Obesity © 2014 World Obesity. Pediatric Obesity ••, ••–••


ORIGINALRESEARCH
8 | A. Javed et al.

The practical implications of this analysis are that in


ORIGINALRESEARCH

children with a BMI denoting obesity, the child is


almost definitely obese. However, with BMI being
normal, secondary tools, such as ADP or skin-fold
measurements, may aid in reliably ruling out obesity.
Despite logistic limitations, techniques, such as ADP
(BOD-POD), could be incorporated into evaluation
of children suspected of having excess adiposity
despite normal BMI (71,72). Incorporating skin-fold
measurements in clinical practice has been sug-
gested (25,73) while others refute its benefit (11,
12,41). The incorporation of a secondary technique
may be particularly important for male children with
normal BMI, although this study cannot endorse
these for widespread clinical use without evidence
that these techniques improve identification, preven-
tion and management of childhood obesity.
Visceral fat accumulation is a risk factor for obesity-
related complications (74,75). Although it is conceiv-
able, imaging modalities may offer benefit in assess-
Figure 2 Receiver operating characteristics of body ing visceral adiposity; studies assessing the diagnos-
mass index to detect adiposity in children.
tic performance of BMI were based on the assump-
but available studies employed different definitions of tion that BMI has been intended to identify total,
excess adiposity and were conducted on varying eth- not regional, body adiposity. Furthermore, studies in
nicities and age groups (46). Obesity denotes excess obese children do not demonstrate the benefit of
body fat and BMI relies on body weight regardless of imaging modalities over anthropometry (75,76).
composition. The inherent flaws of BMI stem first from Diagnostic tests are reported as continuous variables
its reliance on the assumption that every individual therefore, there is a trade-off between sensitivity and
with normal BMI has normal body fat and secondly specificity depending on cut-off utilized with high cut-
that increase in BMI above normal is proportional to off values yielding higher specificity whereas lower
increase in BF%. Increases in BMI have been accom- cut-off values impact sensitivity favourably. Thus,
panied by larger increases in BF% and concomitant changing the cut-off BMI value to diagnose obesity is
decreases in fat-free mass according to recent inves- likely not the solution, as lowering the cut-off will be
tigations suggesting increases in adiposity may be at the expense of decreased specificity. The current
higher than indicated by BMI (66–68). In adults, coex- systematic review suggests that although BMI is an
istence of increased BF% with normal BMI, termed invaluable epidemiologic tool to assess population-
‘normal weight obesity’, has been reported to convey level risk and track national trends in obesity, it has
an increased cardiovascular risk (69). limitations in diagnosing obesity at the individual
The moderate heterogeneity observed between level.
studies (I2 = 48%) was explained by race, obesity
Limitations
definition using BMI, reference criteria of BMI and the
reference standard method to measure adiposity There is a risk for publication bias inherent to meta-
used, but not by body fat cut-off or study quality. analyses in which positive results or results with
We demonstrated modest benefit of using the IOTF ‘expected’ findings are more likely to be published
criteria over the CDC criteria. The decreased sensitiv- which we attempted to minimize by contacting
ity of BMI to detect adiposity in males speaks to the investigators in the field. Also, there was moderate
differential ability of BMI to diagnose obesity based on heterogeneity between studies explained by race,
gender. The developmental pattern of adipose tissue obesity definition using BMI, reference criteria for BMI
accumulation and distribution is gender-specific and and reference standard method to measure adipos-
changes rapidly during puberty (70). Previous studies ity. In these studies, fat mass (FM) was often reported
regarding validity of BMI report conflicting results, as rankings instead of absolute values (46,49). Large
some reporting higher sensitivity of BMI for boys than epidemiologic and prognostic studies assessing
girls (13,25,39,43–45,56,58–60) while others report value of different reference standard methods to for-
the opposite (14,22,37,47,49,51,54). mulate prediction equations in children can help

© 2014 The Authors


Pediatric Obesity © 2014 World Obesity. Pediatric Obesity ••, ••–••
Diagnostic performance of BMI to identify obesity | 9

determine if techniques, such as BIA or ADP, may 4. Rolland-Cachera MF. Towards a simplified definition of

ORIGINALRESEARCH
improve adiposity assessment (46,49). childhood obesity? A focus on the extended IOTF refer-
The diagnostic performance of BMI was not differ- ences. Pediatr Obes 2012; 7: 259–260.
ent regardless of the reference standard used, sug- 5. Whitaker RC, Wright JA, Pepe MS, Seidel KD, Dietz
WH. Predicting obesity in young adulthood from childhood
gesting that different accuracy of various methods
and parental obesity. N Engl J Med 1997; 337: 869–873.
to assess body fat does not explain limitations of
6. Steinberger J, Moran A, Hong CP, Jacobs DR Jr,
BMI. Inclusion of studies from different geographic Sinaiko AR. Adiposity in childhood predicts obesity and
areas increases applicability of findings, despite insulin resistance in young adulthood. J Pediatr 2001; 138:
increased heterogeneity. The use of methods for 469–473.
body composition assessment not well validated 7. Srinivasan SR, Bao W, Wattigney WA, Berenson GS.
in non-Caucasian populations, particularly children, Adolescent overweight is associated with adult overweight
challenges the validity of the studies performed in and related multiple cardiovascular risk factors: the
non-Caucasian populations. Another practical limita- Bogalusa Heart Study. Metabolism 1996; 45: 235–240.
tion is the current definition of obesity on a normative 8. Freedman DS, Mei Z, Srinivasan SR, Berenson GS,
curve instead of health consequences as prospec- Dietz WH. Cardiovascular risk factors and excess adiposity
among overweight children and adolescents: the Bogalusa
tive, well-controlled studies on BMI cut-off levels
Heart Study. J Pediatr 2007; 150: 12–17, e2.
posing risk to future health are lacking in children.
9. Griffiths LJ, Parsons TJ, Hill AJ. Self-esteem and quality
of life in obese children and adolescents: a systematic
Conclusion review. Int J Pediatr Obes 2010; 5: 282–304.
BMI is a very specific but less sensitive method to 10. WHO. Fact Sheet on Obesity and Overweight. World
Health Organization Media Center, Geneva, Switzerland,
assess increased body adiposity in children and fails
2006.
to identify excessive adiposity in a significant per-
11. Reilly JJ, Kelly J, Wilson DC. Accuracy of simple clini-
centage of children. There is a need for paediatric cal and epidemiological definitions of childhood obesity:
studies to develop reference values for skin-fold systematic review and evidence appraisal. Obes Rev 2010;
thickness, ADP, DXA and to assess their additive or 11: 645–655.
independent ability to predict development of 12. Freedman DS, Wang J, Thornton JC, et al. Racial/
obesity-associated comorbidities. ethnic differences in body fatness among children and
adolescents. Obesity (Silver Spring) 2008; 16: 1105–1111.
Conflict of Interest 13. Li S, Zhang M, Yang S, Okada T, Iwata F, Harada K.
Statement Age- and sex-specific body composition of Chinese chil-
dren. Acta Paediatr 2005; 94: 1139–1142.
No conflict of interest was declared. 14. Reilly JJ, Dorosty AR, Emmett PM. Identification of the
obese child: adequacy of the body mass index for clinical
Authors statement practice and epidemiology. Int J Obes Relat Metab Disord
2000; 24: 1623–1627.
This manuscript is not being submitted for publica- 15. August GP, Caprio S, Fennoy I, et al. Prevention and
tion, nor has it been published or presented in whole treatment of pediatric obesity: an endocrine society clinical
or in part, elsewhere. The text and images in the practice guideline based on expert opinion. J Clin
manuscript are the original work of the authors. Endocrinol Metab 2008; 93: 4576–4599.
We attest to the validity and legitimacy of the data 16. Schaefer F, Georgi M, Wuhl E, Scharer K. Body mass
and its interpretation, and attest to the fact that all au- index and percentage fat mass in healthy German school-
thors listed on the title page have read the manuscript children and adolescents. Int J Obes Relat Metab Disord
and agreed to its submission to Pediatric Obesity. 1998; 22: 461–469.
17. Sarria A, Moreno LA, Garcia-Llop LA, Fleta J, Morellon
MP, Bueno M. Body mass index, triceps skinfold and
References waist circumference in screening for adiposity in male chil-
1. Ogden CL, Carroll MD, Kit BK, Flegal KM. Prevalence of dren and adolescents. Acta Paediatr 2001; 90: 387–392.
obesity and trends in body mass index among US children 18. Barlow SE. Expert committee recommendations
and adolescents, 1999–2010. JAMA 2012; 307: 483–490. regarding the prevention, assessment, and treatment of
2. National Center for Health Statistics. Health, United child and adolescent overweight and obesity: summary
States, 2011: with Special Feature on Socioeconomic report. Pediatrics 2007; 120(Suppl. 4): S164–S192.
Status and Health. Hyattsville MD: Hyattsville, MD, 2012. 19. Centre for Public Health Excellence at NICE (UK),
3. Lo JC, Maring B, Chandra M, et al. Prevalence of National Collaborating Centre for Primary Care (UK).
obesity and extreme obesity in children aged 3–5 years. Obesity: the Prevention, Identification, Assessment and
Pediatr Obes 2013; [Epub ahead of print]. Management of Overweight and Obesity in Adults and

© 2014 The Authors


Pediatric Obesity © 2014 World Obesity. Pediatric Obesity ••, ••–••
10 | A. Javed et al.

Children. National Institute for Health and Clinical Excel- changes in a 16-month weight loss program. Nutr Metab
ORIGINALRESEARCH

lence: London, 2006. (Lond) 2006; 3: 32.


20. Romero-Corral A, Somers VK, Sierra-Johnson J, et al. 35. Frisard MI, Greenway FL, Delany JP. Comparison of
Accuracy of body mass index in diagnosing obesity in the methods to assess body composition changes during a
adult general population. Int J Obes (Lond) 2008; 32: period of weight loss. Obes Res 2005; 13: 845–854.
959–966. 36. Eto C, Komiya S, Nakao T, Kikkawa K. Validity of the
21. Okorodudu DO, Jumean MF, Montori VM, et al. Diag- body mass index and fat mass index as an indicator of
nostic performance of body mass index to identify obesity obesity in children aged 3–5 year. J Physiol Anthropol Appl
as defined by body adiposity: a systematic review and Human Sci 2004; 23: 25–30.
meta-analysis. Int J Obes (Lond) 2010; 34: 791–799. 37. Wickramasinghe VP, Cleghorn GJ, Edmiston KA,
22. Ellis KJ, Abrams SA, Wong WW. Monitoring childhood Murphy AJ, Abbott RA, Davies PS. Validity of BMI as a
obesity: assessment of the weight/height index. Am J measure of obesity in Australian white Caucasian and
Epidemiol 1999; 150: 939–946. Australian Sri Lankan children. Ann Hum Biol 2005; 32:
23. Kuczmarski RJ, Ogden CL, Grummer-Strawn LM, 60–71.
et al. CDC growth charts: United States. Adv Data 2000; 38. Sardinha LB, Going SB, Teixeira PJ, Lohman TG.
314: 1–27. Receiver operating characteristic analysis of body mass
24. Bellizzi MC, Dietz WH. Workshop on childhood index, triceps skinfold thickness, and arm girth for obesity
obesity: summary of the discussion. Am J Clin Nutr 1999; screening in children and adolescents. Am J Clin Nutr
70(1 Pt 2): 173S–175S. 1999; 70: 1090–1095.
25. da Veiga GV, Dias PC, dos Anjos LA. A comparison of 39. Neovius MG, Linne YM, Barkeling BS, Rossner SO.
distribution curves of body mass index from Brazil and the Sensitivity and specificity of classification systems for
United States for assessing overweight and obesity in Bra- fatness in adolescents. Am J Clin Nutr 2004; 80: 597–603.
zilian adolescents. Rev Panam Salud Publica 2001; 10: 40. Reilly JJ, Savage SA, Ruxton CH, Kirk TR. Assessment
79–85. of obesity in a community sample of prepubertal children. Int
26. Troiano RP, Flegal KM. Overweight prevalence among J Obes Relat Metab Disord 1999; 23: 217–219.
youth in the United States: why so many different 41. Taylor RW, Falorni A, Jones IE, Goulding A. Identifying
numbers? Int J Obes Relat Metab Disord 1999; 23(Suppl. adolescents with high percentage body fat: a comparison
2): S22–S27. of BMI cutoffs using age and stage of pubertal develop-
27. Flegal KM, Ogden CL, Wei R, Kuczmarski RL, ment compared with BMI cutoffs using age alone. Eur J
Johnson CL. Prevalence of overweight in US children: Clin Nutr 2003; 57: 764–769.
comparison of US growth charts from the Centers for 42. Marshall JD, Hazlett CB, Spady DW, Conger PR,
Disease Control and Prevention with other reference values Quinney HA. Validity of convenient indicators of obesity.
for body mass index. Am J Clin Nutr 2001; 73: 1086–1093. Hum Biol 1991; 63: 137–153.
28. Chinn S, Rona RJ. International definitions of over- 43. Nichols SD, Cadogan F. BMI-based obesity cutoffs
weight and obesity for children: a lasting solution? Ann and excess adiposity in a Caribbean adolescent popu-
Hum Biol 2002; 29: 306–313. lation of African origin. Eur J Clin Nutr 2009; 63: 253–
29. Sweeting HN. Measurement and definitions of obesity 258.
in childhood and adolescence: a field guide for the unini- 44. Fu WP, Lee HC, Ng CJ, et al. Screening for childhood
tiated. Nutr J 2007; 6: 32. obesity: international vs population-specific definitions.
30. Whiting P, Rutjes AW, Reitsma JB, Bossuyt PM, Which is more appropriate? Int J Obes Relat Metab Disord
Kleijnen J. The development of QUADAS: a tool for the 2003; 27: 1121–1126.
quality assessment of studies of diagnostic accuracy 45. Candido AP, Freitas SN, Machado-Coelho GL.
included in systematic reviews. BMC Med Res Methodol Anthropometric measurements and obesity diagnosis in
2003; 3: 25. schoolchildren. Acta Paediatr 2011; 100: e120–e124.
31. Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt 46. Bedogni G, Iughetti L, Ferrari M, et al. Sensitivity and
PM. The diagnostic odds ratio: a single indicator of specificity of body mass index and skinfold thicknesses in
test performance. J Clin Epidemiol 2003; 56: 1129– detecting excess adiposity in children aged 8–12 years.
1135. Ann Hum Biol 2003; 30: 132–139.
32. Higgins JP, Thompson SG, Deeks JJ, Altman DG. 47. Gaskin PS, Walker SP. Obesity in a cohort of black
Measuring inconsistency in meta-analyses. BMJ 2003; Jamaican children as estimated by BMI and other indices
327: 557–560. of adiposity. Eur J Clin Nutr 2003; 57: 420–426.
33. Warolin J, Whitaker LE, Choi L, Acra S, Buchowski 48. Ghosh A. Receiver operating characteristic (ROC)
MS. Comparative assessment of change in fat mass curve analysis in 5–10-year-old Bengalee girls from Cal-
using dual X-ray absorptiometry and air-displacement cutta, India. Ann Hum Biol 2004; 31: 364–369.
plethysmography. Clin Obes 2012; 2: 66–72. 49. Lazarus R, Baur L, Webb K, Blyth F. Body mass index
34. Minderico CS, Silva AM, Teixeira PJ, Sardinha LB, in screening for adiposity in children and adolescents: sys-
Hull HR, Fields DA. Validity of air-displacement tematic evaluation using receiver operating characteristic
plethysmography in the assessment of body composition curves. Am J Clin Nutr 1996; 63: 500–506.

© 2014 The Authors


Pediatric Obesity © 2014 World Obesity. Pediatric Obesity ••, ••–••
Diagnostic performance of BMI to identify obesity | 11

50. Mei Z, Grummer-Strawn LM, Pietrobelli A, Goulding A, of percentage body fat cutoffs exerts a large influence. The

ORIGINALRESEARCH
Goran MI, Dietz WH. Validity of body mass index com- COMPASS study. Eur J Clin Nutr 2008; 62: 1201–1207.
pared with other body-composition screening indexes for 65. Barton M. Screening for obesity in children and ado-
the assessment of body fatness in children and adoles- lescents: US Preventive Services Task Force recommen-
cents. Am J Clin Nutr 2002; 75: 978–985. dation statement. Pediatrics 2010; 125: 361–367.
51. Moreno LA, Blay MG, Rodriguez G, et al. Screening 66. Wells JC, Coward WA, Cole TJ, Davies PS. The con-
performances of the International Obesity Task Force body tribution of fat and fat-free tissue to body mass index in
mass index cut-off values in adolescents. J Am Coll Nutr contemporary children and the reference child. Int J Obes
2006; 25: 403–408. Relat Metab Disord 2002; 26: 1323–1328.
52. Warner JT, Cowan FJ, Dunstan FD, Gregory JW. The 67. Ruxton CH, Reilly JJ, Kirk TR. Body composition of
validity of body mass index for the assessment of adiposity healthy 7- and 8-year-old children and a comparison with
in children with disease states. Ann Hum Biol 1997; 24: the ‘reference child’. Int J Obes Relat Metab Disord 1999;
209–215. 23: 1276–1281.
53. Duncan JS, Duncan EK, Schofield G. Accuracy of 68. McCarthy HD, Ellis SM, Cole TJ. Central overweight
body mass index (BMI) thresholds for predicting excess and obesity in British youth aged 11–16 years: cross sec-
body fat in girls from five ethnicities. Asia Pac J Clin Nutr tional surveys of waist circumference. BMJ 2003; 326: 624.
2009; 18: 404–411. 69. Romero-Corral A, Somers VK, Sierra-Johnson J, et al.
54. Nwizu SE, Njokanma OF, Okoromah CA, David NA. Normal weight obesity: a risk factor for cardiometabolic
Relationship between bioelectrical impedance analysis and dysregulation and cardiovascular mortality. Eur Heart J
body mass index in adolescent urban Nigerians. West Afr 2010; 31: 737–746.
J Med 2011; 30: 99–103. 70. Taylor RW, Grant AM, Williams SM, Goulding A. Sex
55. Field AE, Laird N, Steinberg E, Fallon E, differences in regional body fat distribution from pre- to
Semega-Janneh M, Yanovski JA. Which metric of relative postpuberty. Obesity (Silver Spring) 2010; 18: 1410–1416.
weight best captures body fatness in children? Obes Res 71. Ma G, Yao M, Liu Y, et al. Validation of a new pediatric
2003; 11: 1345–1352. air-displacement plethysmograph for assessing body
56. Himes JH, Bouchard C. Validity of anthropometry in composition in infants. Am J Clin Nutr 2004; 79: 653–660.
classifying youths as obese. Int J Obes 1989; 13: 183–193. 72. Michels N, Huybrechts I, Bammann K, et al. Caucasian
57. Yoo S, Lee SY, Kim KN, Sung E. Obesity in Korean children’s fat mass: routine anthropometry v. air-displace-
pre-adolescent school children: comparison of various ment plethysmography. Br J Nutr 2013; 109: 1528–1537.
anthropometric measurements based on bioelectrical im- 73. Nooyens AC, Koppes LL, Visscher TL, et al. Adoles-
pedance analysis. Int J Obes (Lond) 2006; 30: 1086–1090. cent skinfold thickness is a better predictor of high body
58. Oliveira FL, Taddei JA, Escrivao MA, et al. Accuracy of fatness in adults than is body mass index: the Amsterdam
obesity diagnosis in Brazilian adolescents: comparison of Growth and Health Longitudinal Study. Am J Clin Nutr
Cole, et al and Must, et al criteria with DXA percentage 2007; 85: 1533–1539.
of fat mass. Nutr Hosp 2006; 21: 484–490. 74. Mostazir M, Jeffery A, Voss L, Wilkin T. Gender-
59. Zimmermann MB, Gubeli C, Puntener C, Molinari L. assortative waist circumference in mother-daughter and
Detection of overweight and obesity in a national sample of father-son pairs, and its implications. An 11-year longitu-
6–12-y-old Swiss children: accuracy and validity of refer- dinal study in children (EarlyBird 59). Pediatr Obes 2013;
ence values for body mass index from the US Centers for [Epub ahead of print].
Disease Control and Prevention and the International 75. Koot BG, Westerhout R, Bohte AE, et al. Ultrasonog-
Obesity Task Force. Am J Clin Nutr 2004; 79: 838–843. raphy is not more reliable than anthropometry for assess-
60. Mast M, Langnase K, Labitzke K, Bruse U, Preuss U, ing visceral fat in obese children. Pediatr Obes 2013; [Epub
Muller MJ. Use of BMI as a measure of overweight and ahead of print].
obesity in a field study on 5–7 year old children. Eur J Nutr 76. Brambilla P, Bedogni G, Moreno LA, et al.
2002; 41: 61–67. Crossvalidation of anthropometry against magnetic reso-
61. Mei Z, Grummer-Strawn LM, Wang J, et al. Do nance imaging for the assessment of visceral and subcu-
skinfold measurements provide additional information to taneous adipose tissue in children. Int J Obes (Lond) 2006;
body mass index in the assessment of body fatness 30: 23–30.
among children and adolescents? Pediatrics 2007; 119:
e1306–e1313. Supporting Information
62. Bartok CJ, Marini ME, Birch LL. High body mass index
percentile accurately reflects excess adiposity in white Additional Supporting Information may be found in
girls. J Am Diet Assoc 2011; 111: 437–441. the online version of this article at the publisher’s
63. Malina RM, Katzmarzyk PT. Validity of the body mass web-site:
index as an indicator of the risk and presence of overweight
in adolescents. Am J Clin Nutr 1999; 70: 131S–136S.
Appendix S1. Search strategy.
64. Neovius M, Rasmussen F. Evaluation of BMI-based Appendix S2. Diagnostic performance of BMI
classification of adolescent overweight and obesity: choice across predefined subgroups.

© 2014 The Authors


Pediatric Obesity © 2014 World Obesity. Pediatric Obesity ••, ••–••

You might also like