You are on page 1of 9

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/5790785

Accuracy of Adolescent Self-report of Height and Weight in Assessing


Overweight Status: A Literature Review

Article  in  Archives of Pediatrics and Adolescent Medicine · January 2008


DOI: 10.1001/archpedi.161.12.1154 · Source: PubMed

CITATIONS READS

326 744

3 authors:

Bettylou Sherry Maria Elena del Socorro Jefferds


Centers for Disease Control and Prevention Centers for Disease Control and Prevention
69 PUBLICATIONS   6,011 CITATIONS    87 PUBLICATIONS   1,877 CITATIONS   

SEE PROFILE SEE PROFILE

Laurence M Grummer-Strawn
World Health Organization WHO
186 PUBLICATIONS   26,389 CITATIONS   

SEE PROFILE

All content following this page was uploaded by Maria Elena del Socorro Jefferds on 04 August 2014.

The user has requested enhancement of the downloaded file.


REVIEW ARTICLE

Accuracy of Adolescent Self-report of Height


and Weight in Assessing Overweight Status
A Literature Review
Bettylou Sherry, PhD, RD; Maria Elena Jefferds, PhD; Laurence M. Grummer-Strawn, PhD

Objective: To examine the accuracy of self-reported mass index was based on self-reported data vs directly
height and weight data to classify adolescent over- measured data (5 of 5 studies). Females underestimated
weight status. Self-reported height and weight are com- weight more than males (ranges, −4.0 to −1.0 kg vs −2.6
monly used with minimal consideration of accuracy. to 1.5 kg, respectively) (9 of 9 studies); overweight in-
dividuals underestimated weight more than nonover-
Data Sources: Eleven studies (4 nationally represen- weight individuals (6 of 6 studies). Missing self-
tative, 7 convenience sample or locally based). reported data ranged from 0% to 23% (9 of 9 studies).
There was inadequate information on bias by age and race/
Study Selection: Peer-reviewed articles of studies con-
ethnicity.
ducted in the United States that compared self-reported
and directly measured height, weight, and/or body mass
Conclusions: Self-reported data are valuable if the only
index data to classify overweight among adolescents.
source of data. However, self-reported data underestimate
Main Exposures: Self-reported and directly measured
overweight prevalence and there is bias by sex and weight
height and weight. status. Lower sensitivities of self-reported data indicate that
one-fourth to one-half of those overweight would be missed.
Main Outcome Measures: Overweight prevalence; Other potential biases in self-reported data, such as across
missing data, bias, and accuracy. subgroups, need further clarification. The feasibility of col-
lecting directly measured height and weight data on a state/
Results: Studies varied in examination of bias. Sensi- community level should be explored because directly mea-
tivity of self-reported data for classification of over- sured data are more accurate.
weight ranged from 55% to 76% (4 of 4 studies). Over-
weight prevalence was −0.4% to −17.7% lower when body Arch Pediatr Adolesc Med. 2007;161(12):1154-1161

O
NE IMPORTANT ASPECT OF ing overweight status. How these data are
addressing pediatric collected becomes an important issue as
overweight as a national state health departments and researchers
public health priority is more actively try, with limited resources,
to document and moni- to monitor the impact of programs to re-
tor the prevalence.1 Prevalence data de- duce the obesity epidemic.
scribe the extent of the problem and show Self-reported height and weight are
trends over time; they are also useful for sometimes used to determine and/or moni-
targeting interventions to geographic areas tor overweight. The self-reported method
or subgroups with the highest preva- is chosen in preference to direct measure-
lence. Monitoring changes in prevalence ment because self-reported data are easier,
is an important component of evaluating cheaper, and quicker to collect. More-
intervention programs to prevent and treat over, direct measurement of height and
overweight; in particular, these data are weight requires appropriate training and
useful for understanding and guiding pro- monitoring of personnel and the use of ac-
gram effectiveness, improvement, and curate, well-maintained equipment. Be-
maintenance. The most commonly used cause of limited resources, self-reported
Author Affiliations: Maternal anthropometric screening tool for over- data may be the only data available. Un-
Child Nutrition Branch,
Division of Nutrition and
weight is body mass index (BMI) (calcu- fortunately, minimal attention is given to
Physical Activity, Centers for lated as weight in kilograms divided by potential inaccuracies or bias introduced
Disease Control and Prevention, height in meters squared). Thus, height with the self-reported method. More-
Atlanta, Georgia. and weight data are essential for classify- over, articles in the literature may give no

(REPRINTED) ARCH PEDIATR ADOLESC MED/ VOL 161 (NO. 12), DEC 2007 WWW.ARCHPEDIATRICS.COM
1154
Downloaded from www.archpediatrics.com at CDC-Information Center, on December 4, 2007
©2007 American Medical Association. All rights reserved.
or limited mention of the quality of self-reported data. summarized each study and resolved differences by discus-
For example, Valenti et al2 reported overweight preva- sion. We analyzed the consistency of patterns across the 11 stud-
lence of Australian children with no mention of the qual- ies for the previously listed parameters.
ity of their parental-reported data; Sen3 examined the Meta-analysis or a moderator analysis was not appropriate
to define an effect size for this review because there were only
frequency of family dinner and weight status based on
11 studies and they varied substantially in sample size and com-
self-reported data from the National Longitudinal Sur- position, study design, and definition of overweight. Several
vey of Youth. Sen cites the Strauss4 National Health and studies included small convenience samples or were locally
Nutrition Examination Survey III analysis, which re- based, making their findings nongeneralizable to the overall US
ported that 94% of adolescents had their weight status population of adolescents.
correctly classified, as justification for the accuracy of self-
reported data. As will be seen in this review, a single sum-
RESULTS
mary statistic can mask bias.
The goals of this review were to examine and summa-
rize the accuracy of using self-reported data in contrast to An overview of the 11 studies (4 based on nationally rep-
directly measured data for identifying and monitoring over- resentative samples and 7 convenience sample or lo-
weight among US adolescents. We examined consistency cally based studies) is summarized in Table 1. We strati-
across studies in the magnitude of bias by age, sex, race/ fied our summary of studies into these 2 categories to
ethnicity, and prevalence of overweight and the extent of differentiate the generalizability of their results. All stud-
prevalence bias by sensitivity and specificity. ies included children 11 years or older. Human sub-
jects’ approval was obtained for all of the 11 studies.
METHODS
DIFFERENCES IN STUDY METHODS
LITERATURE SEARCH Data for the 4 nationally representative studies were col-
lected during the early 1980s through the mid 1990s; all
We used a comprehensive literature search of the electronic da-
tabases PubMed and MEDLINE, including “in-process used standardized protocols for measurements. Inter-
MEDLINE.” The search terms included body weight, body vals between collection of self-reported and directly mea-
height, and body mass index; adolescent, youth, or teenage; self- sured data ranged from the same day8 to a few weeks.4,6,7
report, self-disclosure, and self-assessment; reproducibility of Only Himes and Faricy6 described exclusion of data with
results, sensitivity and specificity, analysis of variance, and mul- biologically implausible values: they excluded subjects
tivariate analysis; valid, reliable, and accurate; and English lan- with differences between self-reported and directly mea-
guage. We did not limit the years of our search. We identified sured height or weight values more than 5 SDs of the over-
60 articles, but only 12 studies met our inclusion criteria of peer- all mean differences.
reviewed articles conducted in the United States that com- Among the 7 convenience sample or locally based stud-
pared self-reported and directly measured height and weight
ies, data were collected over a wider period (1970s through
data or BMIs calculated from these different measures for ado-
lescents. We excluded 1 additional study5 that did not include 2000)9,10,14,15; 3 studies did not report year(s) of data col-
correlation coefficients between self-reported and directly lection.11-13 Various measurement protocols were used: 29,12
measured data or sensitivity and specificity analyses but only used referenced protocols, 214,15 used standardized but un-
presented self-reported and directly measured mean differ- referenced protocols, 111 described some procedures, and
ences. Two studies4,6 used National Health and Nutrition Ex- 210,13 did not describe. The interval between the collection
amination Survey III data for their analyses but examined dif- of self-reported and directly measured data ranged from the
ferent aspects of bias, so we included both. same day to a month or so9-11,13-15; one did not report the
interval.12 Two studies described exclusions of biologi-
CODING AND ANALYSIS OF STUDIES cally implausible values: Shannon et al,11 “zero” values and
height values greater than 400 in, and Stewart,9 height and
For each study, we identified the geographic location; study weight values 4 or more SDs from mean difference of self-
design, including sampling protocol, setting, sequence of mea- reported and directly measured data.
surements, measurement protocols, definitions of at risk for over- Moreover, these 11 studies used a variety of refer-
weight and/or overweight status, including reference sources
and exclusion of biologically implausible values; and popula-
ences and/or cutoffs to define overweight status. These
tion characteristics, including age, race/ethnicity, sample size, variations made comparisons among studies difficult.
and directly measured prevalence of overweight. For each study
we extracted percentage of missing data; differences between MISSING DATA
the self-reported and directly measured height, weight, and BMI;
stratification of these differences by age, sex, race/ethnicity, and Among the national surveys, missing data (unknown/
overweight status, when available; regression analysis to iden- unusable) for self-reported values ranged from 14% to
tify predictors of self-reported bias; differences between self- 37%.4,6-8 Himes and Faricy6 showed an effect by age: 41%
reported and directly measured prevalence for both at risk for
overweight and overweight; correlation coefficients between self-
of 12-year-olds and 25% of 13-year-olds did not report
reported and directly measured height and weight and calcu- their weight, in contrast to only 2% of the 14- to 16-year-
lated BMI; and sensitivity, specificity, and positive predictive olds. Their logistic regression model showed that younger
value data for prevalence. When data were not available, we age, being male, shorter directly measured height, and
contacted authors in an attempt to obtain complete informa- lighter directly measured weight were all independently
tion. For our review, 2 of us (B.S. and M.E.J.) independently and significantly associated with missing data.6

(REPRINTED) ARCH PEDIATR ADOLESC MED/ VOL 161 (NO. 12), DEC 2007 WWW.ARCHPEDIATRICS.COM
1155
Downloaded from www.archpediatrics.com at CDC-Information Center, on December 4, 2007
©2007 American Medical Association. All rights reserved.
Table 1. Characteristics of Studies in Reviewed Literature

Aware of DM/SR
Sample Size Data Before
Source Sample Source (Males/Females) Age Range, y a Race/Ethnicity DM b
Nationally Representative Studies
Davis and Gergen7 HHANES 829 (392/437) 12-19 Mexican American Yes/Yes
Strauss4 NHANES III 1657 (767/890) 12-16 White/Hispanic, Yes/Yes
black, other
Himes and Faricy6 NHANES III 1635 (759/876) 12-16 Non-Hispanic white, Yes/Yes
non-Hispanic
black, Mexican
American
Goodman et al8 Add Health 11 495 (5748/5747) Grades 7-12 Non-Hispanic white, NR/No
non-Hispanic
black, Hispanic,
Asian, other
Convenience Sample or Locally Based Surveys
Stewart9 6 Sites, Ohio, 428 (NA) 14-17 85% White for ages NR/Yes
Washington, 14-61 y
Massachusetts,
South Carolina c
Brooks-Gunn et al10 4 Private day 151 (0/151) 11-13 White Yes/Yes
schools, 1 city
Shannon et al11 School districts in 726 (337/389) 11-13 White NR/Yes
Pennsylvania
Himes and Story12 Indian reservation 69 (41/28) 12-19 Native American No/Yes
school in
Minnesota
Hauck et al13 3 Indian Health 536 (NA/NA) 12-19 Native American NR/Yes
Service areas
Brener et al14 Subsample, 20 2032 (957/1075) Grades 9-12 White, black, Yes/Yes
states and Hispanic, other
Washington, DC
Himes et al15 Comprehensive for 3797 (1936/1861) 12-18 White, black, NR/Yes
31 schools in Hispanic, Asian,
Minnesota d other

Abbreviations: Add Health, National Longitudinal Study of Adolescent Health; DM, directly measured; HNANES, Hispanic Health and Nutrition Examination
Survey; NA, not available; NHANES, National Health and Nutrition Examination Survey; NR, not reported; SR, self-reported.
a As reported in published articles. Includes highest year noted (eg, 12-16 includes up to 16.99 years).
b Participants aware that they would/might be measured.
c Rand Health Insurance Study.
d Project EAT (Eating Among Teens).

Only 5 convenience sample or locally based studies re- ferences of 6.6 cm for males and 6.9 cm for females. Shan-
ported missing data, which ranged from 0% to 31%.10,11,13-15 non et al11 described tall males and females underesti-
Shannon et al11 found no differences in missing self-reported mating their weight more than their shorter counterparts
data by height, weight, or sex, but they did not examine the but did not control for age.
effect by age in their study of 11- to 13-year-olds.
Weight
DIFFERENCES IN MEANS
Differences in mean self-reported and directly mea-
Table 2 shows the differences in mean (self-reported−di- sured weights for the 9 studies that stratified by sex
rectly measured) height, weight, and BMI by sex for the 9 showed that females generally underestimated their weight
studieswiththesedataavailable.Forheight,weight,andBMI, more than males (Table 2). Differences in means varied
the magnitude of mean bias by sex was greater for partici- widely: females ranged from −4.0 to −1.0 kg and males,
pants in the convenience sample or locally based studies than from −2.6 to 1.5 kg.
in the nationally representative studies.
Body Mass Index
Height
Two nationally representative studies6,8 and 3 conve-
Height was both overestimated and underestimated. For nience sample or locally based studies12,14,15 reported mean
the 7 studies for both males and females, the range of mean differences by sex for BMI (Table 2). Both males and fe-
height differences was relatively small at −1.1 cm to 2.4 males showed minimal mean differences in BMI (0 to 0.2
cm, with the exception of Brener et al14 who found dif- for males; −0.1 to −0.3 for females) in the nationally rep-

(REPRINTED) ARCH PEDIATR ADOLESC MED/ VOL 161 (NO. 12), DEC 2007 WWW.ARCHPEDIATRICS.COM
1156
Downloaded from www.archpediatrics.com at CDC-Information Center, on December 4, 2007
©2007 American Medical Association. All rights reserved.
Table 2. Sex-Specific Differences Between SR and DM Means for Height, Weight, and BMI

Differences in Means (SR − DM)

Height, cm Weight, kg BMI

Source M F M F M F
Nationally Representative Surveys
Strauss4 −0.4 −0.5 0.1 −1.0 NR NR
Himes and Faricy6 −1.0 −1.1 −0.5 −1.2 0.2 −0.1
Goodman et al8 NR NR −0.2 −1.0 0 −0.3
Convenience Sample or Locally Based Surveys a
Brooks-Gunn et al10 NA 1.4 NA −1.2 NA NR
Shannon et al11 0.5 −0.5 −2.1 −4.0 NR NR
Himes and Story12 0.9 0.0 −2.6 −2.8 −1.2 −1.0
Hauck et al13 1.5 0.5 1.5 −2.1 NR NR
Brener et al14 6.6 6.9 −1.1 −2.0 −2.3 −3.0
Himes et al15 b 1.2 2.4 −1.6 −3.8 −2.2 −2.5
All studies, range −1.0 to 6.6 −1.1 to 6.9 −2.6 to 1.5 −4.0 to −1.0 −2.3 to 0.2 −3.0 to −0.1

Abbreviations: BMI, body mass index (calculated as weight in kilograms divided by height in meters squared); DM, directly measured; F, female; M, male;
NA, not available, study included only females; NR, not reported; SR, self-reported.
a Stewart9 did not report if participants were aware of DM data or stratify by sex (height = 0.9 cm, weight = −1.1 kg).
b Means adjusted from mixed linear models by sex and included school, race, age, socioeconomic status, and categories of measured dimensions that were
specific to each of the variables (eg, schools = random, stature = 6 categories).

resentative studies, whereas there were greater underes- ling for sex and school grade in their regression analy-
timations (−1.2 to −2.3 for males; −1.0 to −3.0 for fe- sis, Brener et al14 found that white individuals overesti-
males) in the convenience sample or locally based studies. mated their height more than black or Hispanic individuals
or those of other racial or ethnic groups (␤ = 0.09;
Age or School Grade P⬍.001). Himes et al15 found significant effects for males
only, with Asian individuals more accurately self-
Bias by age or school grade was reported by 4 studies. For reporting height and underestimating weight more than
the 3 studies that statistically examined bias by increasing white, African American, or Hispanic individuals or those
age, 2 found increasing differences between self-reported of other racial or ethnic groups.
and directly measured height,14,15 2 found decreasing dif-
ferences between self-reported and directly measured Weight Status
weight,12,15 and 2 found decreasing differences between self-
reported and directly measured BMI12,14; for each of these Six of the 11 studies examined reporting bias by weight
indexes, 1 of these 3 studies found no difference. Using a status and found that overweight youth underestimated
mixed-effects general linear model, Himes and Story12 re- their weight4,7,11-13,15 and, if available, their resulting BMI,7,12
ported that age was an independent predictor of reporting more than normal-weight youth. For example, Strauss4
error for weight and BMI, but not for height, with the de- found that mean differences between self-reported and
gree of underestimation of both self-reported weight and directly measured weight were significantly greater among
calculated BMI based on self-reported data decreasing with overweight (BMI⬎95th percentile) adolescents vs those
increasing age (errors less negative for each additional year not overweight (−4.6 kg vs 0.2 kg, respectively; P⬍.001).
in age by 0.78 kg for weight and 0.35 for BMI, respec- An additional study9 found underreporting of weight in-
tively). Brener et al14 found that, after controlling for sex creased as directly measured weight increased for their
and race/ethnicity in linear regression analyses, each year’s entire sample (aged 14-61 years). Studies varied in these
increase in school grade was positively associated with an comparisons, making it impossible to examine bias by
overestimate of self-reported height (␤=0.22; P⬍.001) and percentage of underestimation of directly measured weight
inversely associated with an underestimate of BMI based by directly measured weight status.
on self-reported values (␤=−0.19; P=.002); they did not
report any difference in weight bias by school grade. DIFFERENCES IN PREVALENCE

Race/Ethnicity We examined both absolute error (absolute difference be-


tween self-reported and directly measured prevalence)
Bias by self-reported race/ethnicity was examined statis- and relative error (absolute error divided by directly mea-
tically in 3 studies. Findings were disparate. Strauss4 re- sured prevalence) in the 5 studies that had data avail-
ported no statistically significant differences in report- able (Table 3). These studies showed that adolescent
ing of height and weight by race/ethnicity (white/ self-reported height and weight data underestimated
Hispanic individuals, black individuals, and individuals prevalence of overweight, risk for overweight, or both,
of other race/ethnicity) stratified by sex. After control- with wide variability in both absolute and relative er-

(REPRINTED) ARCH PEDIATR ADOLESC MED/ VOL 161 (NO. 12), DEC 2007 WWW.ARCHPEDIATRICS.COM
1157
Downloaded from www.archpediatrics.com at CDC-Information Center, on December 4, 2007
©2007 American Medical Association. All rights reserved.
Table 3. SR and DM Prevalence of Overweight, Absolute Error, and Relative Error

Bias in Prevalence Overweight, %


Reference Used Overweight SR Prevalence DM Prevalence Absolute Error a Relative Error b
to Classify Classification
Source Weight Status by BMI M F All M F All M F All M F All
Nationally Representative Surveys
Davis and Gergen7 Internal ⱖ 85th Percentile 16.5 8.9 NR 16.9 13.4 NR − 0.4 − 4.5 NR − 2.4 − 33.5 NR
Goodman et al8 Must et al16 and ⱖ95th Percentile NR NR 8.1 NR NR 9.7 NR NR − 1.6 NR NR −16.5
Rosner et al17
Convenience Sample or Locally Based Surveys
Hauck et al13 Gelbach18 ⬎85th Percentile NR NR 28.4 NR NR 34.0 − 6.7 − 4.3 − 5.6 NR NR −16.5
Brener et al14 Kuczmarski et al19 ⱖ85th Percentile c NR NR 29.7 NR NR 47.4 NR NR − 17.7 NR NR −37.3
ⱖ85th to ⬍ 95th NR NR 14.8 NR NR 21.4 NR NR − 6.6 NR NR −30.8
Percentile d
ⱖ95th Percentile NR NR 14.9 NR NR 26.0 NR NR − 11.1 NR NR −42.7
Himes et al15 Kuczmarski et al19 ⱖ85th Percentile c 26.6 24.3 NR 32.3 33.0 NR − 5.7 − 8.7 NR − 20.9 − 26.4 NR
ⱖ95th Percentile 11.0 8.9 NR 14.8 11.8 NR − 3.8 − 2.9 NR − 25.7 − 24.6 NR

Abbreviations: BMI, body mass index; DM, directly measured; F, female; M, male; NR, not reported; SR, self-reported.
a Absolute error = SR−DM.
b Relative error = absolute error divided by DM.
c Overweight and risk of overweight.
d Risk of overweight.

Table 4. Sex-Specific Correlation Coefficients Between Self-report and Direct Measurement of Height, Weight, and BMI

Correlation Coefficient

Height Weight BMI

Source M F M F M F
Nationally Representative Surveys a
Davis and Gergen7 b 0.86 0.86 0.95 0.93 0.87 0.85
Strauss4 c 0.91 0.82 0.94 0.90 0.89 0.84
Himes and Faricy6 d 0.89 0.79 0.97 0.93 0.93 0.87
Convenience Sample or Locally Based Surveys e
Brooks-Gunn et al10 b NA 0.75 NA 0.98 NA NA
Shannon et al11 b 0.74 0.62 0.90 0.84 NA NA
Himes and Story12 c 0.91 0.71 0.96 0.91 0.90 0.80
Hauck et al13 c 0.83 0.62 0.95 0.90 0.88 0.79
Brener et al14 c 0.87 0.82 0.92 0.94 0.89 0.89
Himes et al15 c 0.90 0.80 0.96 0.94 0.89 0.85
All studies, range 0.74-0.91 0.62-0.86 0.90-0.97 0.84-0.98 0.87-0.93 0.79-0.89

Abbreviations: BMI, body mass index; F, female; M, male; NA, not available.
a Goodman et al8 not stratified by sex. Pearson coefficients for height (0.94), weight (0.95), and BMI (0.92) were all statistically significant (P ⬍ .001).
b Type of correlation coefficient not specified.
c Pearson correlation coefficients; Himes and Faricy6 refer to “r”; thus, may be Pearson coefficients.
d Intraclass correlation coefficients.
e Stewart9 not stratified by sex. Pearson coefficients for height= 0.95 and weight = 0.97. Significance was not reported.

rors. The wide variety of references and definitions of over- and BMI for 9 studies. The correlation coefficients for
weight used limited comparisons. For example, for the height, weight, and BMI were lower for females than males,
prevalence of overweight based on the Centers for Dis- with 3 exceptions. Including both males and females, cor-
ease Control and Prevention 2000 growth charts,19 for relation coefficients for height ranged from 0.62 to 0.91;
the BMI cutoff of the 95th percentile or higher, absolute for weight, 0.84 to 0.98; and for BMI, 0.79 to 0.93.
errors ranged from −1.6% to −11.1% and relative errors,
from −16.5% to −42.7% (Table 3). Age

CORRELATION COEFFICIENTS Four studies examined self-reported and directly mea-


sured correlation coefficients by age6,7,10,14 and in gen-
Table 4 shows sex-specific correlation coefficients be- eral found higher coefficients for the older adolescents,
tween self-reported and directly measured height, weight, yet none reported statistical differences. For example,

(REPRINTED) ARCH PEDIATR ADOLESC MED/ VOL 161 (NO. 12), DEC 2007 WWW.ARCHPEDIATRICS.COM
1158
Downloaded from www.archpediatrics.com at CDC-Information Center, on December 4, 2007
©2007 American Medical Association. All rights reserved.
Table 5. Classification of Overweight by Self-reported vs Directly Measured Data: Sensitivity, Specificity, and Positive Predictive Value

%
Overweight Classification Sensitivity Specificity Positive Predictive Value
by BMI (Anthropometric
Source References) M F All M F All M F All
Nationally Representative Surveys
Davis and Gergen7 ⱖ 85th Percentile (internal) 76.0 59.0 a,b NR 96.0 99.0 NR NR NR NR
Goodman et al8 ⱖ 95th Percentile16,17 74.0 70.2 a,c NR 98.9 99.3 NR 88.4 88.0 NR
Convenience Sample or Locally Based Surveys
Hauck et al13 ⬎ 85th Percentile18 76.2 70.4 d 73.6 NR NR NR 93.9 81.4 88.2
Brener et al14 ⱖ 85th Percentile19 NR NR 60.5 NR NR 98.0 NR NR 96.5
ⱖ 95th Percentile19 NR NR 54.9 NR NR 99.2 NR NR 96.0

Abbreviations: BMI, body mass index; F, female; M, male; NR, not reported.
a Not statistically different from males.
b Reported no differences by age.
c Reported no differences by race/ethnicity.
d Did not conduct statistical testing of differences between males and females.

Himes and Faricy6 reported variability by age stratified tile or higher, Davis and Gergen7 reported no significant
by sex and found lower values for 12-year-old boys and difference in sensitivity among Mexican American indi-
girls for height (0.57 vs 0.62, respectively) and BMI (0.70 viduals by sex or by age (12-14 years, 15-17 years, or 18-19
vs 0.76, respectively) compared with 13- to 16-year-old years) for males and females (values not reported). Using
boys and girls (both sexes, ⬎ 0.75 for height and ⬎ 0.83 a similar BMI cutoff for overweight, Hauck et al13 found
for BMI), whereas Brener et al14 found high correlation that sensitivity for Native American individuals was lower
coefficients (range, 0.86-0.96) for height, weight, and BMI among younger (12-14 years) than among older (15-19
for ninth- through 12th-grade adolescents. years) males, yet higher among younger vs older females.
Specificity was greater than 95% for the 4 studies, regard-
Race/Ethnicity less of the cutoff or stratification (Table 5).

Only Strauss4 and Brener et al14 examined correlation co-


COMMENT
efficients by race/ethnicity, stratified as white, black, and
Hispanic individuals; Brener et al14 also included an “other”
category. Strauss4 reported that BMI correlation coeffi- Our review identified 4 consistent patterns in bias across
cients for black individuals were significantly lower than the studies when self-reported data were used to classify
those for white or Hispanic individuals (0.79 vs 0.89 and overweight among adolescents: (1) the prevalence of over-
0.85, respectively; P⬍.05 for black vs white or black vs His- weight was consistently underestimated by self-reported
panic individuals). Brener et al14 did not carry out signifi- data, although the relative error ranged widely, from −2.4%
cance testing but reported lower height correlations for His- to −42.7%; (2) sensitivity data showed that 25% to 45% of
panic individuals than for individuals from the 3 other racial those overweight would be missed if self-reported data were
or ethnic groups (0.77 vs ⱖ0.88); BMI correlation coeffi- used; (3) females underestimated their weight and BMI more
cients for the “other” category were lower (0.79 vs ⱖ0.89). than males; and (4) overweight youth underestimated their
weight and BMI more than normal-weight youth.
SENSITIVITY, SPECIFICITY, AND POSITIVE We identified 3 additional issues, relevant to surveil-
PREDICTIVE VALUE lance, targeting, program evaluation, and research, in need
of further examination: (1) lack of or inconsistent infor-
Two nationally representative studies7,8 and 2 conve- mation on other subgroup differences; (2) lack of infor-
nience sample studies13,14 examined the validity of using mation on whether biases are consistent over time; and
self-reported height and weight-calculated BMI to iden- (3) lack of consensus regarding an acceptable level of dif-
tify overweight (Table 5). The values for sensitivity ference between self-reported and directly measured
among these 4 studies suggest that only between 55% and height and weight data and how this might vary depend-
75% of those adolescents who were truly overweight ing on purpose of use.
would be classified as overweight if their self-reported The sensitivity data show that self-reported height and
weight and height were used to determine BMI. weight are relatively weak estimates of directly mea-
Three studies reported sensitivity by sex7,8,13 (Table 5), sured values for categorizing overweight status, which
one reported by race/ethnicity,8 and another reported by is similar or slightly worse than findings for adults. In
age13; no consistent patterns emerged for these sub- comparison with adolescent data, the sensitivity data for
groups. Using a BMI cutoff of the 95th percentile or higher, adult US men and women aged 20 to 59 years are gen-
Goodman et al8 reported no difference in sensitivity by sex erally at the upper end of the range or higher than that
or race/ethnicity. Using a BMI cutoff of the 85th percen- for adolescents (Bowlin et al,20 77% and 72%, respec-

(REPRINTED) ARCH PEDIATR ADOLESC MED/ VOL 161 (NO. 12), DEC 2007 WWW.ARCHPEDIATRICS.COM
1159
Downloaded from www.archpediatrics.com at CDC-Information Center, on December 4, 2007
©2007 American Medical Association. All rights reserved.
tively; Kuczmarski et al,21 86%-95%; and Nieto-Garcı́a sible to know whether targeting based on self-reported
et al,22 74%). Furthermore, the adult data show evi- data are appropriate.
dence of lower values among certain subgroups. For ex- Program evaluation of the effectiveness of obesity pre-
ample, Bowlin et al20 found that for 20- to 29-year-old vention and treatment interventions typically occurs over
women, sensitivity was 60%, whereas Nieto-Garcı́a et al22 a relatively short time, such that it may be reasonable to
found that for 60- to 69-year-olds, sensitivity was 64%. expect that the degree of bias associated with self-
In contrast to sensitivity analysis, we found that the cor- reported data will not change between baseline and fol-
relation coefficients between self-reported and directly mea- low-up assessments. However, this expectation prob-
sured height, weight, and BMI were relatively high. How- ably depends on the nature of the intervention, and one
ever, correlation coefficients are strongly affected by extreme needs to think about the potential for bias based on the
values, and they do not examine the accuracy of the clas- content of the intervention. For example, an interven-
sification of overweight status, our goal. tion focused on BMI awareness or weekly monitoring of
Additional research needs are to assess (1) the accu- a person’s own weight would probably change that per-
racy of self-reported data by order of self-reported and di- son’s knowledge of his or her directly measured weight
rectly measured data collection; (2) whether advance knowl- and his or her ability to accurately report it. In such a
edge of directly measured data influences self-reported data; case, evaluation might show increases in overweight be-
(3) whether other potentially important factors not con- cause of the improved reporting even if the prevalence
sidered in this review, such as mental health status, socio- of overweight went down. Alternatively, there might be
economic status, or physical activity status, may also affect other factors associated with underreporting, such as the
bias of self-reported data; and (4) comparisons of data based social desirability to be thin or poor body image, so that
on standard accepted definitions of overweight status and some participants would still underreport weight de-
anthropometric reference. One example of an additional spite knowing their directly measured weight. Because
important factor could be depression. Overweight people the reasons for underreporting are multiple and com-
are more likely to be depressed,23 and we found greater un- plex, it is difficult to anticipate how an intervention might
derestimates of weight among overweight adolescents. If affect self-reported height and weight data.
depression is independently associated with underreport- Research often attempts to identify factors associated
ing of overweight status, then self-reported bias could also with overweight and nonoverweight as a dichotomous
vary by level of depression. variable. To the extent that self-reported data misclas-
Our findings raise questions about the practical im- sify adolescent overweight status and that this misclas-
plications for the use of self-reported data. The preva- sification is unrelated to the factors of interest, research
lence of overweight is assessed in populations for a va- findings will be biased toward the null hypothesis. This
riety of purposes, including identifying the problem, bias implies that important factors associated with over-
monitoring trends over time, program targeting, pro- weight will be overlooked. Where significant associa-
gram evaluation, research, and advocating for funds for tions are found, however, one can expect that a real as-
interventions. The utility of self-reported height and sociation does exist.
weight data depends on the purpose for which they are Where the estimated prevalence of overweight is high,
used. Self-reported data are almost always easier to col- the existence of self-reported height and weight data can
lect and provide documentation of the problem of over- be useful in advocating for programs and policies that
weight even if the data are underestimates. address overweight and may be a prerequisite for secur-
Prevalence based on self-reported data can be useful ing funds to address the problem. However, policy mak-
for monitoring overweight over time if the magnitude of ers and funders may be unimpressed with understated
biases remains constant over time. For short-term follow- prevalence numbers and give inadequate attention to the
up, the assumption of constant bias is probably reason- problem, particularly in the long-term as the newness of
able, but no studies examined whether there have been the obesity epidemic passes.
changes in reporting bias over long periods. The fact that One example of frequently used self-reported height
the degree of underreporting of prevalence varies widely and weight data is the Center for Disease Control and
among subgroups, from being almost undetectable in Prevention Youth Risk Behavior Surveillance System.24
some studies (eg, males in Davis and Gergen7) to miss- This surveillance system regularly collects self-reported
ing almost half of the problem in others,14 certainly raises height and weight data and is often the only source of
the concern that reporting biases among subgroups are information on the prevalence of overweight among youth
not constant across populations and settings. attending high school in a state. Without feasible alter-
The utility of self-reported data for targeting pro- native mechanisms to collect directly measured data, these
grams toward those at greatest risk depends on whether self-reported data fill an important gap and are neces-
different population subgroups underreport BMI simi- sary for documenting the problem, advocating for funds
larly. Females tend to underestimate their weight more for interventions, and monitoring trends over time.
than males, potentially leading to a false conclusion that Finally, this review has both strengths and limita-
males should be targeted more directly for overweight tions. To the best of our knowledge, this is the first lit-
prevention programs. Heavier youth underestimate weight erature review of this topic for adolescents. We identi-
more than normal-weight youth, leading to an underes- fied 4 consistent biases and described the implications
timate of the size of the target group. Other subgroup dif- of these findings for using self-reported data. As for weak-
ferences (in particular age, race/ethnicity, and missing nesses, the lack of comparability among studies for cut-
data) have not been adequately studied, so it is impos- offs and references used to define overweight status, mea-

(REPRINTED) ARCH PEDIATR ADOLESC MED/ VOL 161 (NO. 12), DEC 2007 WWW.ARCHPEDIATRICS.COM
1160
Downloaded from www.archpediatrics.com at CDC-Information Center, on December 4, 2007
©2007 American Medical Association. All rights reserved.
surement protocols, intervals between self-reported and Grummer-Strawn. Administrative, technical, and mate-
directly measured data, and data stratification and sta- rial support: Jefferds. Study supervision: Sherry and
tistical analyses made it impossible to produce overall Grummer-Strawn.
summary results. Second, the lack of adequate data in sev- Financial Disclosure: None reported.
eral studies prevented us from examining additional Additional Contributions: Nancy D. Brener, PhD, Laura
needed subgroup analyses and other potential impor- K. Kann, PhD, and Deborah A. Galuska, PhD, reviewed
tant sources of bias, such as consistency of bias over time. the manuscript.

CONCLUSIONS REFERENCES

Researchers and public health practitioners should care- 1. Institute of Medicine. Preventing Childhood Obesity: Health in Balance. Wash-
fully consider the caveats described in this article when ington, DC: National Academies Press; 2005.
interpreting results based on self-reported data. Because 2. Valenti L, Charles J, Britt H. BMI of Australian general practice patients. Aust Fam
Physician. 2006;35(8):570-571.
of the limitations of relying on self-reported height and 3. Sen B. Frequency of family dinner and adolescent body weight status: evidence
weight data for surveillance of overweight, public health from the National Longitudinal Survey of Youth, 1997. Obesity (Silver Spring).
practitioners should explore the feasibility of collecting 2006;14(12):2266-2276.
4. Strauss RS. Comparison of measured and self-reported weight and height in a
directly measured heights and weights at the state and cross-sectional sample of young adolescents. Int J Obes Relat Metab Disord.
local levels for surveillance purposes. Historically, states 1999;23(8):904-908.
collected directly measured height and weight data for a 5. Fortenberry JD. Reliability of adolescents’ reports of height and weight. J Ado-
lesc Health. 1992;13(2):114-117.
variety of purposes, particularly for screening. Arkansas 6. Himes JH, Faricy A. Validity and reliability of self-reported stature and weight of
measures the height and weight of children in schools US adolescents. Am J Hum Biol. 2001;13(2):255-260.
for screening and surveillance.25 Missouri collected height 7. Davis H, Gergen PJ. The weights and heights of Mexican-American adoles-
cents: the accuracy of self-reports. Am J Public Health. 1994;84(3):459-462.
and weight data during physical education classes as part 8. Goodman E, Hinden BR, Khandelwal S. Accuracy of teen and parental reports of
of the curriculum for surveillance purposes.26 In New obesity and body mass index. Pediatrics. 2000;106(1)(pt 1):52-58.
York, education law requires that children have health 9. Stewart AL. The reliability and validity of self-reported weight and height. J Chronic
Dis. 1982;35(4):295-309.
appraisals, including measurement of height and weight, 10. Brooks-Gunn J, Warren MP, Rosso J, Gargiulo J. Validity of self-report mea-
at school entrance, as well as when students are in the sures of girls’ pubertal status. Child Dev. 1987;58(3):829-841.
second, fourth, seventh, and 10th grades. The New York 11. Shannon B, Smiciklas-Wright H, Wang M. Inaccuracies in self-reported weights
and heights of a sample of sixth-grade children. J Am Diet Assoc. 1991;91
Department of Health and some school districts are in (6):675-678.
discussions as to how to systematically collect and re- 12. Himes JH, Story M. Validity of self-reported weight and stature of American In-
port these data to the Department of Health (Barbara A. dian youth. J Adolesc Health. 1992;13(2):118-120.
13. Hauck FR, White L, Cao G, Woolf N, Strauss K. Inaccuracy of self-reported weights
Dennison, MD, written communication, April 2006). Ex- and heights among American Indian adolescents. Ann Epidemiol. 1995;5(5):
periences with these state programs, as well as other pro- 386-392.
grams, related to data quality, representativeness, and cost 14. Brener ND, McManus T, Galuska D, Clowry R, Wechsler H. Reliability and valid-
ity of self-reported height and weight among high school students. J Adolesc
could help determine the feasibility of developing state Health. 2003;32(4):281-287.
and local systems for collecting directly measured height 15. Himes JH, Hannan P, Wall M, Neumark-Sztainer D. Factors associated with er-
and weight data for surveillance purposes. rors in self-reports of stature, weight, and body mass index in Minnesota
adolescents. Ann Epidemiol. 2005;15(4):272-278.
Self-reported data are valuable if the only source of 16. Must A, Dallal GE, Dietz WH. Reference data for obesity: 85th and 95th percen-
data. However, self-reported data underestimate over- tiles of body mass index (wt/ht2) and triceps skinfold thickness. Am J Clin Nutr.
weight prevalence and there is bias by sex and weight sta- 1991;53(4):839-846.
17. Rosner B, Prineas R, Loggie J, Daniels SR. Percentiles for body mass index in
tus. Lower sensitivities of self-reported data indicate that US children 5 to 17 years of age. J Pediatr. 1998;132(2):211-222.
one-fourth to one-half of those overweight would be 18. Gelbach S. Interpreting the Medical Literature: Practical Epidemiology for Clinicians.
missed. Other potential biases in self-reported data, such New York, NY: MacMillan; 1988:139-160.
19. Kuczmarski RJ, Ogden CL, Grummer-Strawn LM, et al. CDC growth charts: United
as differences across subgroups and inconsistency over States. Adv Data. 2000;(314):1-27.
time, need further clarification. The feasibility of collect- 20. Bowlin SJ, Morrill BD, Nafziger AN, Jenkins PL, Lewis C, Pearson TA. Validity of
ing directly measured height and weight data on a state cardiovascular disease risk factors assessed by telephone survey: the Behav-
ioral Risk Factor Survey. J Clin Epidemiol. 1993;46(6):561-571.
or community level should be explored because directly 21. Kuczmarski MF, Kuczmarski R, Najjar M. Effects of age on validity of self-
measured data are more accurate. reported height, weight, and body mass index: findings from the third National
Health and Nutrition Examination Survey, 1988-1994. J Am Diet Assoc. 2001;
Accepted for Publication: May 24, 2007. 101(1):28-34.
22. Nieto-Garcı́a FJ, Bush T, Keyl P. Body mass definitions of obesity: sensitivity and
Correspondence: Bettylou Sherry, PhD, RD, Division of specificity using self-reported weight and height. Epidemiology. 1990;1(2):
Nutrition and Physical Activity, Centers for Disease Con- 146-152.
trol and Prevention, 4770 Buford Hwy, MS K25, At- 23. Onyike CU, Crum RM, Lee HB, Lyketsos CG, Eaton WW. Is obesity associated
with major depression? Results from the Third National Health and Nutrition Ex-
lanta, GA 30341 (bsherry@cdc.gov). amination Survey. Am J Epidemiol. 2003;158(12):1139-1147.
Author Contributions: Study concept and design: Sherry, 24. YRBSS: Youth Risk Behavior Surveillance System. CDC Web site. http://www
Jefferds, and Grummer-Strawn. Acquisition of data: Sherry .cdc.gov/healthyyouth/yrbs/index.htm. Accessed December 20, 2005.
25. Centers for Disease Control and Prevention (CDC). Overweight among students
and Jefferds. Analysis and interpretation of data: Sherry, in grades K-12: Arkansas, 2003-04 and 2004-05 school years. MMWR Morb Mor-
Jefferds, and Grummer-Strawn. Drafting of the manu- tal Wkly Rep. 2006;55(1):5-8.
script: Sherry and Jefferds. Critical revision of the manu- 26. Missouri Coordinated School Health Coalition. Promoting healthy weight in Mis-
souri’s children: a guide for schools, families and communities. State of Mis-
script for important intellectual content: Sherry, Jefferds, souri Department of Health and Senior Services Web site. http://www.dhss.mo
and Grummer-Strawn. Statistical analysis: Sherry and .gov/Nutrition_School/Publications.html. Accessed December 20, 2005.

(REPRINTED) ARCH PEDIATR ADOLESC MED/ VOL 161 (NO. 12), DEC 2007 WWW.ARCHPEDIATRICS.COM
1161
Downloaded from www.archpediatrics.com at CDC-Information Center, on December 4, 2007
©2007 American Medical Association. All rights reserved.
View publication stats

You might also like