You are on page 1of 1

An official website of the United States government

Abstract
Here's how you know Full text links

Log in

Advanced

Reliability and Validity of


Commercially Available Wearable
Devices for Measuring Steps,
Energy Expenditure, and Heart
Rate: Systematic Review
Daniel Fuller et al. JMIR Mhealth Uhealth. 2020.
Free PMC article

Show details

Full text links Cite …

Abstract
Background: Consumer-wearable activity trackers
are small electronic devices that record fitness and
health-related measures.

Objective: The purpose of this systematic review


was to examine the validity and reliability of
commercial wearables in measuring step count,
heart rate, and energy expenditure.

Methods: We identified devices to be included in


the review. Database searches were conducted in
PubMed, Embase, and SPORTDiscus, and only
articles published in the English language up to
May 2019 were considered. Studies were excluded
if they did not identify the device used and if they
did not examine the validity or reliability of the
device. Studies involving the general population
and all special populations were included. We
operationalized validity as criterion validity (as
compared with other measures) and construct
validity (degree to which the device is measuring
what it claims). Reliability measures focused on
intradevice and interdevice reliability.

Results: We included 158 publications examining


nine different commercial wearable device brands.
Fitbit was by far the most studied brand. In
laboratory-based settings, Fitbit, Apple Watch, and
Samsung appeared to measure steps accurately.
Heart rate measurement was more variable, with
Apple Watch and Garmin being the most accurate
and Fitbit tending toward underestimation. For
energy expenditure, no brand was accurate. We
also examined validity between devices within a
specific brand.

Conclusions: Commercial wearable devices are


accurate for measuring steps and heart rate in
laboratory-based settings, but this varies by the
manufacturer and device type. Devices are
constantly being upgraded and redesigned to new
models, suggesting the need for more current
reviews and research.

Keywords: Apple Watch; Fitbit; Garmin; Polar;


commercial wearable devices; energy expenditure;
heart rate; step count; systematic review.

©Daniel Fuller, Emily Colwell, Jonathan Low, Kassia


Orychock, Melissa Ann Tobin, Bo Simango, Richard Buote,
Desiree Van Heerden, Hui Luan, Kimberley Cullen, Logan
Slade, Nathan G A Taylor. Originally published in JMIR
mHealth and uHealth (http://mhealth.jmir.org),
08.09.2020.

Conflict of interest statement


Conflicts of Interest: Author JL was employed by
Garmin Inc. during the publication process but after
completion of the paper. All other authors have no
conflicts to declare.

Figures

Figure 1 PRISMA flow chart for systematic…

Figure 2 Number of studies published per…

Figure 3 Line graph of studies published…

Figure 4 Mean percentage error (MPE) plots…

Figure 5 Box plots representing mean percentage…

Figure 6 Box plots representing mean percentage…

Similar articles

Systematic review of the validity and


reliability of consumer-wearable activity
trackers.
Evenson KR, et al. Int J Behav Nutr Phys Act. 2015.
PMID: 26684758 Free PMC article. Review.

Accuracy and Acceptability of Wrist-


Wearable Activity-Tracking Devices:
Systematic Review of the Literature.
Germini F, et al. J Med Internet Res. 2022.
PMID: 35060915 Free PMC article. Review.

Using Fitness Trackers and Smartwatches


to Measure Physical Activity in Research:
Analysis of Consumer Wrist-Worn
Wearables.
Henriksen A, et al. J Med Internet Res. 2018.
PMID: 29567635 Free PMC article.

Wrist-Worn Activity Trackers in Laboratory


and Free-Living Settings for Patients With
Chronic Pain: Criterion Validity Study.
Sjöberg V, et al. JMIR Mhealth Uhealth. 2021.
PMID: 33433391 Free PMC article.

Accuracy of Consumer Wearable Heart Rate


Measurement During an Ecologically Valid
24-Hour Period: Intraindividual Validation
Study.
Nelson BW, et al. JMIR Mhealth Uhealth. 2019.
PMID: 30855232 Free PMC article.

See all similar articles

Cited by
mHealth intervention delivered in general
practice to increase physical activity and
reduce sedentary behaviour of patients with
prediabetes and type 2 diabetes
(ENERGISED): rationale and study protocol for
a pragmatic randomised controlled trial.
Vetrovsky T, et al. BMC Public Health. 2023.
PMID: 36997936 Free PMC article.

Wearable and Portable Devices for Acquisition


of Cardiac Signals while Practicing Sport: A
Scoping Review.
Romagnoli S, et al. Sensors (Basel). 2023.
PMID: 36992060 Free PMC article. Review.

Project MOVE: A randomized controlled trial of


Interventions for initiating and maintaining
physical activity in depressed individuals.
Uebelacker LA, et al. Ment Health Phys Act. 2023.
PMID: 36967813

Heart rate and oxygen uptake kinetics


obtained from continuous measurements with
wearable devices during outdoor walks of
patients with COPD.
Buekers J, et al. Digit Health. 2023. PMID: 36937691
Free PMC article.

Dual-Task Training Program for Older Adults:


Blending Gait, Visuomotor and Cognitive
Training.
Nayak A, et al. Front Netw Physiol. 2021. PMID: 36925571
Free PMC article.

See all "Cited by" articles

References
1. World Health Organization Global
recommendations on physical activity for
health. World Health Organization. [2020-08-
17].
https://www.who.int/dietphysicalactivity/facts
heet_recommendations/en/
2. Conn VS, Hafdahl AR, Mehr DR. Interventions
to increase physical activity among healthy
adults: meta-analysis of outcomes. Am J
Public Health. 2011 Apr;101(4):751–8. doi:
10.2105/AJPH.2010.194381.
http://europepmc.org/abstract/MED/2133059
0 - DOI - PMC - PubMed
3. Tudor-Locke C, Craig CL, Brown WJ, Clemes
SA, De CK, Giles-Corti B, Hatano Y, Inoue S,
Matsudo SM, Mutrie N, Oppert J, Rowe DA,
Schmidt MD, Schofield GM, Spence JC,
Teixeira PJ, Tully MA, Blair SN. How many
steps/day are enough? For adults. Int J Behav
Nutr Phys Act. 2011 Jul 28;8:79. doi:
10.1186/1479-5868-8-79.
https://ijbnpa.biomedcentral.com/articles/10.1
186/1479-5868-8-79 - DOI - DOI - PMC -
PubMed
4. Schneider PL, Bassett DR, Thompson DL,
Pronk NP, Bielak KM. Effects of a 10,000
steps per day goal in overweight adults. Am J
Health Promot. 2006;21(2):85–9. doi:
10.4278/0890-1171-21.2.85. - DOI - PubMed
5. Marshall SJ, Levy SS, Tudor-Locke CE,
Kolkhorst FW, Wooten KM, Ji M, Macera CA,
Ainsworth BE. Translating physical activity
recommendations into a pedometer-based
step goal: 3000 steps in 30 minutes. Am J
Prev Med. 2009 May;36(5):410–5. doi:
10.1016/j.amepre.2009.01.021. - DOI -
PubMed

Show all 184 references

Publication types
Research Support, Non-U.S. Gov't
Systematic Review

MeSH terms
Energy Metabolism
Fitness Trackers*
Heart Rate
Humans
Reproducibility of Results
Wearable Electronic Devices*

LinkOut - more resources


Full Text Sources
Europe PubMed Central
JMIR Publications
PubMed Central

Medical
ClinicalTrials.gov

NCBI Literature Resources


MeSH PMC Bookshelf Disclaimer

The PubMed wordmark and PubMed logo are registered


trademarks of the U.S. Department of Health and Human
Services (HHS). Unauthorized use of these marks is strictly
prohibited.

FOLLOW NCBI

Connect with NLM

National Library of Medicine


8600 Rockville Pike
Bethesda, MD 20894

Web Policies
FOIA
HHS Vulnerability Disclosure

Help
Accessibility
Careers

NLM NIH HHS USA.gov

You might also like