You are on page 1of 7

J Appl Physiol 92: 162–168, 2002;

10.1152/japplphysiol.00409.2001.

Validity of pulse oximetry during maximal exercise


in normoxia, hypoxia, and hyperoxia

YOSHIKI YAMAYA, HARM J. BOGAARD, PETER D. WAGNER,


KYUICHI NIIZEKI, AND SUSAN R. HOPKINS
Department of Medicine, University of California, San Diego, La Jolla, California 92093
Received 27 April 2001; accepted in final form 29 August 2001

Yamaya, Yoshiki, Harm J. Bogaard, Peter D. Wag- oximetry either to prescreen research subjects before
ner, Kyuichi Niizeki, and Susan R. Hopkins. Validity more invasive studies or in place of direct measure-
of pulse oximetry during maximal exercise in normoxia, ment of SaO2 using cooximetry (3, 7, 8, 11).
hypoxia, and hyperoxia. J Appl Physiol 92: 162–168, 2002; Pulse oximeters use a light source and photodiode
10.1152/japplphysiol.00409.2001.—During exercise, pulse light detector to measure the amount of light passing
oximetry is problematic due to motion artifact and altered
through an arteriolar bed. SaO2 can be estimated non-
digital perfusion. New pulse oximeter technology addresses
these issues and may offer improved performance. We simul- invasively because the light-absorbing characteristics
taneously compared Nellcor N-395 (Oxismart XLTM) pulse of hemoglobin differ between oxyhemoglobin and de-
oximeters with an RS-10 forehead sensor (RS-10), a D-25 oxyhemoglobin. Although well accepted for use in rest-
digit sensor (D-25), and the Ivy 2000 (Masimo SETTM)/ ing subjects, using pulse oximetry during exercise for
LNOP-Adt digit sensor (Ivy) to arterial blood oxygen satura- accurate measurement of SaO2 has been problematic
tion (SaO2) by cooximetry. Nine normal subjects, six athletes, for several reasons. First, depending on the sensor site,
and four patients with chronic disease exercised to maximum sensors are subjected to varying degrees of motion
oxygen consumption (V̇O2 max) under various conditions [nor- resulting in signal corruption and thus inaccurate es-
moxia, hypoxia inspired oxygen fraction (FIO2) ⫽ 0.125; hy- timations of saturation (9). Furthermore, sensors
peroxia, FIO2 ⫽ 1.0]. Regression analysis for normoxia and placed on the digits are even more susceptible to this
hypoxic data was performed (n ⫽ 161 observations, SaO2 ⫽ problem during cycle exercise because gripping the
73–99.9%), and bias (B) and precision (P) were calculated.
handlebars results in weakening or even complete loss
RS10 offered greater validity than the other two devices
tested (y ⫽ 1.009x ⫺ 0.52, R2 ⫽ 0.90, B⫾P ⫽ 0.3 ⫾ 2.5). of signals (17, 19). Recently developed pulse oximeters
Finger sensors had low precision and a significant negative offer potential advantages because they utilize ad-
bias (D-25: y ⫽ 1.004x ⫺ 2.327, R2 ⫽ 0.52, B⫾P ⫽ ⫺2.0 ⫾ 7.3; vanced signal-processing methodologies in an attempt
Ivy: y ⫽ 1.237x ⫺ 24.2, R2 ⫽ 0.78, B⫾P ⫽ ⫺2.0 ⫾ 5.2). to provide continuous and accurate measurements of
Eliminating measurements in which heart rate differed by oxygen saturation when signals are weak (e.g., low
⬎10 beats/min from the electrocardiogram value improved perfusion) or corrupted by motion artifact (1, 2, 15).
precision minimally and did not affect bias substantially The purpose of this study was to evaluate new pulse
(B⫾P ⫽ 0.5 ⫾ 2.0, ⫺1.8 ⫾ 8.4, and ⫺1.25⫾4.33 for RS-10, oximeter technologies during exercise in a variety of
D-25, and Ivy, respectively). Signal detection algorithms and study populations. We tested two devices: the Ivy 2000
pulse oximeter were identical between RS-10 and D-25; thus (Masimo, Irvine, CA) with the LNOP-Adt finger sensor
the improved performance of the forehead sensor is likely and two Nellcor N-395 (Oxismart XL, Mallinckrodt, St.
because of sensor location. RS-10 should be considered for
Louis, MO) pulse oximeters equipped with either a
exercise testing in which pulse oximetry is desirable.
RS-10 forehead sensor or a D-25 digit sensor. These
oxygen saturation; cooximetry; patients; normal subjects; devices were used in normal subjects, athletes, and
athletes patients with either chronic obstructive pulmonary dis-
ease or chronic heart failure. We hypothesized that the
combination of motion-tolerant pulse oximeter and
DURING EXERCISE TESTING, it is often desirable to monitor RS-10 forehead sensor, because of the previously men-
arterial oxygen saturation of hemoglobin (SaO2), espe- tioned problems with motion artifact and digital per-
cially in the context of pulmonary or cardiovascular fusion during exercise, would provide the most valid
disease or when subjects are breathing hypoxic gas noninvasive measure of SaO2. We chose to compare
mixtures as part of research protocols. Pulse oxime- athletes and patients with normal subjects because
ters, because they are noninvasive and obviate the monitoring SaO2 in these two groups is likely to be
need for arterial catheterization, are often used in this problematic for the athletes because of poor signal
context. In addition, many researchers investigating detection caused by the diversion of large amounts of
pulmonary gas exchange during exercise utilize pulse
The costs of publication of this article were defrayed in part by the
Address for reprint requests and other correspondence: S. R. Hop- payment of page charges. The article must therefore be hereby
kins, Univ. of California, San Diego, Dept. of Medicine-0623, 9500 marked ‘‘advertisement’’ in accordance with 18 U.S.C. Section 1734
Gilman Dr., La Jolla, CA 92093-0623 (E-mail: shopkins@ucsd.edu). solely to indicate this fact.

162 8750-7587/02 $5.00 Copyright © 2002 the American Physiological Society http://www.jap.org

Downloaded from journals.physiology.org/journal/jappl (190.014.071.009) on August 7, 2020.


PULSE OXIMETRY DURING EXERCISE 163

Table 1. Subject descriptive characteristics The order of the two exercise tests was balanced in group 1,
and subjects rested for ⬃1 h between tests.
Group 1 Group 2 Group 3 Results of these preliminary tests were used to select
(n ⫽ 9) (n ⫽ 6) (n ⫽ 4) workloads that represented 30, 60, 90, and 100% of V̇O2 max in
Age 33.5 ⫾ 6.8 28.8 ⫾ 5.8 56.7 ⫾ 16.6*
Height, cm 171.0 ⫾ 3.8†‡ 173.7 ⫾ 3.9 179.7 ⫾ 9.6
Weight, kg 68.9 ⫾ 8.2 70.3 ⫾ 3.9 95.8 ⫾ 21.2*
Normoxic V̇O2 max,
l/min 3.13 ⫾ 0.56 4.12 ⫾ 0.34† 1.83 ⫾ 0.75*
Normoxic V̇O2 max,
ml 䡠 kg⫺1 䡠 min⫺1 45.6 ⫾ 8.2 58.7 ⫾ 4.0† 18.8 ⫾ 5.1*
Hypoxic (FIO2 ⫽ 0.12)
V̇O2 max, l/min 2.59 ⫾ 0.47
Hypoxic V̇O2 max,
ml 䡠 kg⫺1 䡠 min⫺1 37.2 ⫾ 6.4
Values are means ⫾ SE. V̇O2 max, maximal oxygen consumption;
FIO2, inspired oxygen fraction. * Significantly different from group 1
and 2 (P ⬍ 0.05). † Significantly different from group 1 (P ⬍ 0.05).
‡ Significantly different from group 3 (P ⬍ 0.05).

blood to working muscles during high-intensity exer-


cise and for the patients because of a potential circu-
latory compromise caused by chronic disease.
METHODS

This study was approved by the Human Subjects Commit-


tee of the University of California, San Diego. Nineteen
subjects were recruited by advertisement and, after giving
written informed consent, agreed to further study. Subjects
belonged to one of the following three groups. Group 1 was
healthy active nonsmoking adults (n ⫽ 9), group 2 was
healthy nonsmoking competitive cyclists (n ⫽ 6), and group 3
(n ⫽ 4) was patients with either chronic heart failure or
chronic obstructive pulmonary disease.
Preliminary screening. A screening history and physical
examination was performed, and female subjects were screened
for pregnancy. Maximal oxygen consumption (V̇O2 max) was
determined on an electronically braked cycle ergometer (Ex-
caliber, Quinton Instruments, Gronigen, Netherlands). After
a 5-min warm up at 25–100 W, groups 1 and 2 rode a
progressive exercise test (25–30 W/min) until they were
unable to continue. Group 3 protocol was similar except that
the work rate increment was 10–20 W/min. Heart rate was
monitored by cardiac monitor (Lifepak 6, Physio-control,
Redmond, WA). Subjects breathed through a nonrebreathing
valve (2700, Hans-Rudolph, Kansas City, MO). Expired gas
was sampled continuously from a heated mixing chamber,
and oxygen and carbon dioxide concentrations were mea-
sured (mass spectrometer-1100, Perkin-Elmer, Pomona, CA).
Expired gas flow was measured by using a pneumotach (no.
3 Fleisch) and differential pressure transducer (Validyne,
DP45-14, Northridge, CA), and electrical signals from the
mass spectrometer and pneumotach were logged at 100 Hz Fig. 1. Relationship of arterial oxygen saturation (SaO2) measured
by using a 12-bit analog-to-digital converter. Ventilation (V̇E) by pulse oximetry using the N-395/RS-10 (A), the N-395/D-25 (B),
oxygen consumption (V̇O2) and carbon dioxide production and the Ivy 2000 (C) devices compared with SaO2 measured by
(V̇CO2) were calculated by using a commercially available cooximetry. ■, Data points in which adequate pulse-rate signal
software package (Consentius Technologies, Salt Lake, UT). detection was present [heart rate measured by the device was within
V̇O2 max was calculated as the average of the four highest 10 beats/min of that measured by electrocardiogram (ECG)]; E, data
consecutive 15-s measurements of V̇O2. points in which adequate pulse-rate signal detection was not present
(heart rate measured by the device was ⱖ10 beats/min different from
All subjects fulfilled at least two of the following four
that measured by ECG). Solid lines are the lines of identity; small
criteria for V̇O2 max: 1) heart rate ⱖ age predicted maximum; dotted lines are the regression lines for all data points; large dotted
2) respiratory exchange ratio ⬎ 1.10; 3) no further increase or lines are the ⫾95% prediction limits for the regression equation (see
a decrease in V̇O2 with increasing workload; and 4) no further text for details) for all data points. Regression equations for all points
increase in heart rate despite an increase in workload. Group are y ⫽ 1.009x ⫺ 0.52 (for N-325/RS-10); y ⫽ 1.004x ⫺ 2.327 (for
1 also underwent a similar protocol, breathing 12% oxygen. N-395/D-25); y ⫽ 1.237x ⫺ 24.2 (for IVY 2000).

J Appl Physiol • VOL 92 • JANUARY 2002 • www.jap.org

Downloaded from journals.physiology.org/journal/jappl (190.014.071.009) on August 7, 2020.


164 PULSE OXIMETRY DURING EXERCISE

groups 1 and 2, and 25, 50, 75, 90, and 100% of V̇O2 max in The ⫾95% prediction limits can be thought of as the ⫾2 SD
group 3. limits of the least squares regression line at any point along
Subject preparation. Under continuous electrocardiogram the regression. To examine the effect of poor signal detection,
(ECG) monitoring (Lifepak 6), a 20-gauge arterial cannula heart rate by ECG was compared with heart rate by pulse
was placed in the radial artery of the nondominant hand by oximetry, and separate regression analyses were performed
using a sterile technique. We followed the instruction as after eliminating all SaO2 data in which the simultaneously
supplied by the manufacturer, attaching the Ivy 2000 with obtained heart rate deviated by ⱖ10 beats/min from that
Masimo’s LNOP-Adt sensor and the Nellcor N-395 with the measured by ECG. In addition, data obtained while breath-
D-25 digit sensor (N-395/D-25) to the digits of opposite ing 100% oxygen are on the flat part of the oxyhemoglobin
hands. A light-opaque shield was lightly taped over the digit equilibrium curve. These data were not included as part of
to exclude interfering ambient light. Digit placement (digits the regression analyses and were analyzed separately. Bias
2, 3, and 4) and hand selection (right or left) were randomized [or mean error; calculated as (SaO2 pulse-oximetry ⫺ SaO2
between subjects. The Nellcor N-395 with a RS-10 forehead cooximetry)/n⫺1] and precision (SD of SaO2 pulse-oximetry ⫺
sensor (N-395/RS-10) was positioned over the left eyebrow on SaO2 cooximetry; the smaller the SD, the greater the preci-
the forehead and secured with a terrycloth sweatband. sion) were calculated for each device. As for the regression
Data collection protocol. Each subject was seated on the analyses, these parameters were calculated for all data
cycle ergometer and breathed through the mouthpiece for 10 points and also after eliminating data points in which there
min before the start of resting measurements. Data collection were poor pulse rate signal detections. Significance was ac-
consisted of duplicate 3-ml samples of arterial blood, which cepted at P ⬍ 0.05, two-tailed. Data are presented as
were collected at rest and in the last 2 min of each exercise
means ⫾ SD.
level (30, 60, 90, and, in some subjects, 100% of V̇O2 max in
groups 1 and 2 and 25, 50, 75, and, in some subjects, 90–
100% of V̇O2 max in group 3). Group 1 performed the exercise RESULTS
protocol in normoxia and while breathing hypoxic gas (in-
spired oxygen fraction ⫽ 0.12), group 2 exercised in normoxia Subject descriptive data are given in Table 1. As
only, and group 3 exercised in both normoxia and 100% expected, athletes had a greater V̇O2 max than healthy
oxygen. SaO2 by pulse oximetry was obtained by interfacing normal subjects (group 1; P ⬍ 0.005) or patients (group
the three devices with a portable computer and recording 2; P ⬍ 0.0001). Patients were significantly older and
data over a 30-s period simultaneously from all three devices heavier than either the athletes (P ⬍ 0.001) or the
and synchronously with arterial blood sampling. Data in healthy normal subjects (P ⬍ 0.001).
which poor signal detection was evident (heart rate deviated SaO2 measured by pulse oximetry during exercise in
10 or more beats/min from that measured by ECG) were
identified so that analyses could be conducted with and normoxia and hypoxia is compared with results ob-
without these data points. tained by direct arterial blood measurements in Fig. 1
Blood-gas measurements. Arterial samples were main- and Table 2. Figure 1 shows the correlation between
tained on ice until analyzed for hemoglobin concentration SaO2 measured by cooximetry and by pulse oximetry for
and SaO2 using an IL 682 cooximeter (Instrumentation Lab- each device for all subjects. All three devices showed
oratories, Lexington, MA). Blood gas analyses were com- significant correlations between cooximetry and pulse
pleted within 30 min of data collection. SaO2 was measured as oximetry values. However, there were considerable dif-
FO2Hb ferences between devices. The N-395/RS-10 forehead
Sa O2 ⫽ 100 ⫻ SaO2 (Fig. 2A) was very highly correlated with SaO2
100 ⫺ 共FCOHb ⫹ FmetHb兲
measured by using cooximetry (R2 ⫽ 0.90, P ⬍ 0.0001),
where FO2Hb is the oxyhemoglobin fraction, FCOHb is the and values obtained were centered around the line of
carboxyhemoglobin fraction, and FmetHb is the methemoglo- identity (slope ⫽ 1.009, intercept ⫽ ⫺0.52). Poor pulse-
bin fraction.
Statistical analyses. We compared measured SaO2 by
rate or arterial signal detection was evident in 13
cooximetry to each of the pulse oximeters by using linear (8.1%) measurements of SaO2 and, when these data
regression (Statview 5.0, SAS, Cary, NC). Prediction limits of were eliminated, R2 increased to 0.94, although slope
⫾95% for the prediction of SaO2 by pulse oximeter as a and intercept of the relationship did not change appre-
function of measured SaO2 were generated for each device. ciably (slope ⫽ 0.998, intercept ⫽ 0.65).

Table 2. Bias and precision of SaO2 measurement by subject group and pulse oximeter
Group 1 Group 2 Group 3 Average
(Normal Subjects) (Athletes) (Patients) Across Groups

N-395/RS-10 forehead 0.4 ⫾ 3.0a,b ⫺0.3 ⫾ 1.5b,d,e 1.1 ⫾ 1.1a,b 0.3 ⫾ 2.5a,b
(n ⫽ 90) (n ⫽ 41) (n ⫽ 30) (n ⫽ 161)
N-395/D-25 finger ⫺1.4 ⫾ 7.9 ⫺3.1 ⫾ 7.1 ⫺2.1 ⫾ 5.2 ⫺2.0 ⫾ 7.3
(n ⫽ 90) (n ⫽ 38) (n ⫽ 29) (n ⫽ 157)
Ivy 2000 finger ⫺2.2 ⫾ 4.9 ⫺0.4 ⫾ 4.1b ⫺3.8 ⫾ 6.9c ⫺2.0 ⫾ 5.2
(n ⫽ 89) (n ⫽ 41) (n ⫽ 30) (n ⫽ 160)
Average across devices ⫺1.1 ⫾ 5.7 ⫺1.3 ⫾ 5.0 ⫺1.6 ⫾ 5.4
(n ⫽ 269) (n ⫽ 120) (n ⫽ 89)
Values are means of bias ⫾ precision (SD); n, number of observations. a Significantly different from Ivy 2000 finger (P ⬍ 0.05).
b
Significantly different from N-395/D-25 finger (P ⬍ 0.05). c Significantly different from groups 1 and 2 (P ⬍ 0.05). d Significantly different
from group 1 (P ⬍ 0.05). e Significantly different from group 3 (P ⬍ 0.05).

J Appl Physiol • VOL 92 • JANUARY 2002 • www.jap.org

Downloaded from journals.physiology.org/journal/jappl (190.014.071.009) on August 7, 2020.


PULSE OXIMETRY DURING EXERCISE 165

increased R2 to 0.87. However, even with this modifi-


cation, slope of the relationship was unchanged (1.20)
and intercept was still markedly negative (⫺19.9).
Thus adequate pulse-rate signal detection does not
prevent the problem of underestimating SaO2 in this
device.
The N-395/D-25 finger sensor utilized the same pulse
oximeter tested for the N-395/RS-10 but provided data
that were much less closely correlated with SaO2 mea-
sured by cooximetry (Fig. 2C; R2 ⫽ 0.52, P ⬍ 0.0001).
Although the N-395/D-25 finger sensor underesti-
mated SaO2 at all levels, measurements were not
greater during hypoxia than during normoxia (slope ⫽
1.004, intercept ⫽⫺2.32). Poor pulse-rate signal detec-
tion was present in 43 (26.9%) measurements, and
removal of these data from the regression improved the
strength of the relationship substantially (R2 ⫽ 0.87)
but did not significantly alter slope and intercept of the
relationship (1.04 and ⫺3.30, respectively).
Bias and precision of the SaO2 measurement from the
three devices compared with the cooximeter are given
in Table 2 and Fig. 2. Averaged over all subjects, the
N-395/RS-10 forehead device had significantly lower
bias and greater precision than the two finger probes
(precision ⫽ 2.5 for N-395/RS-10 vs. 5.2 and 7.3 for IVY
2000 and N-395/D-25, respectively). Eliminating data
points with poor pulse-rate signal detection had a min-
imal effect on these values (precision ⫽ 2.0 for N-395/
RS-10 vs. 4.3 and 8.4 for IVY 2000 and N-395/D-25,
respectively). The N-395/D-25 and N-395/RS-10 per-
formed similarly in all three subject groups, although
there were minor differences between athletes and
patients for the N-395/RS-10. However, the IVY 2000
was significantly worse in group 3 compared with ath-
letes and normal subjects.
Bias and precision SaO2 data from patients exercis-
ing in 100% oxygen are presented in Table 3. In this
data set, SaO2 approaches 100% [all partial pressure of
oxygen (PaO2) values were ⬎500 Torr]. This approach
essentially eliminates any variation in the indepen-
dent variable (i.e., SaO2 measured by cooximetry).
Therefore, any deviation of SaO2 measured by the three
devices is related to issues such as perfusion and/or
signal detection. Under these conditions, the N-395/
Fig. 2. Bias and precision of SaO2 measured by pulse oximetry using RS-10 forehead sensor had significantly less bias and
the N-395/RS-10 (A), the N-395/D-25 (B), and the Ivy 2000 (C) greater precision than the other two devices (P ⬍ 0.05).
devices compared with SaO2 measured by cooximetry. ■, Data points Bias and precision of the heart rate data, which can
in which adequate pulse-rate signal detection was present (heart be used as an index of the adequacy of pulse-rate signal
rate measured by the device was within 10 beats/min of that mea-
sured by ECG); E, data points in which adequate pulse-rate signal detection for the different devices, are presented in
detection was not present (heart rate measured by the device was Table 4. Averaged across all subject groups, there were
ⱖ10 beats/min different from that measured by ECG). Solid lines are significant differences between devices. The N-395/
the lines of identity; fine dotted lines are the regression lines for all RS-10 had significantly less bias and greater precision
data points.
of heart rate measurements compared with the other
two devices (P ⬍ 0.001), and the N-395/D-25 demon-
Correlation for the Ivy 2000 finger sensor was not as strated significantly less bias compared with the Ivy
close (Fig. 2B; R2 ⫽ 0.78, P ⬍ 0.0001), and there was a 2000 (P ⬍ 0.001). There were no significant differences
tendency for the device to underestimate SaO2, partic- between subject groups for the N-395/RS-10. Both the
ularly under hypoxic conditions, (slope ⫽ 1.23, inter- N-395/D-25 and Ivy 2000 significantly underestimated
cept ⫽ ⫺24.2). Many of the measurements suffered the heart rate compared with the ECG measure of
from poor pulse-rate signal detection (76 measure- heart rate. There were no significant differences in bias
ments; 48.4%), and eliminating these measurements between subject groups for the N-395/D-25, but the Ivy
J Appl Physiol • VOL 92 • JANUARY 2002 • www.jap.org

Downloaded from journals.physiology.org/journal/jappl (190.014.071.009) on August 7, 2020.


166 PULSE OXIMETRY DURING EXERCISE

Table 3. Bias and precision by pulse oximeter and 5.39% in the two devices they evaluated during
in hyperoxia exercise in normoxia and hypoxia (one pulse oximeter
equipped with an ear probe and the HP 47201A ear
N-395/RS-10 forehead ⫺0.24 ⫾ 0.57 oximeter, which analyzes light from eight wave-
(n ⫽ 27)
N-395/D-25 finger ⫺4.48 ⫾ 6.29 lengths).
(n ⫽ 26) Exercise induces potential problems related to the
Ivy 2000 finger ⫺5.20 ⫾ 11.11 accuracy of pulse oximetry. For example, motion arti-
(n ⫽ 24) fact can interfere with arterial signal detection, and
Values are means of bias ⫾ precision (SD) for group 3 only. new generation pulse oximeters such as the Masimo
Ivy 2000 and the Nellcor Oxismart incorporate ad-
vanced signal processing to deal with nonstandard
2000 had significantly greater bias in the athletes than
in the other two subject groups. signal detection (1, 2, 15). In addition, poor perfusion
states, such as those that occur with cool skin temper-
DISCUSSION ature, may induce significant bias (18). However, as
can be appreciated from Figs. 1 and 2, significant
The N-395/RS-10 offered greater validity of SaO2 and measurement errors occurred even when adequate
heart rate measurements under all conditions (nor- pulse-rate signal detection was evident. Conversely,
moxia, hypoxia, hyperoxia) and in all subject groups especially with the N-395/RS-10, many data points
(normal subjects, athletes, patients) than the other two with poor pulse-rate signal detection still provided
devices tested. This is reflected by a higher correlation
reliable data. Thus this criterion alone cannot be used
between SaO2 measured by this device and that mea-
to judge the quality of the data obtained by using these
sured by cooximetry, a smaller ⫾95% prediction limit,
devices. An estimate of the extent that a particular
less bias, greater precision, and fewer data points with
device underestimates SaO2 may be obtained by the
poor pulse-rate signal detection. This is likely due to
administration of several breaths of hyperoxic gas mix-
the position of the sensor, because the identical pulse
oximeter equipped with a digital sensor (N-395/D-25) tures (inspired oxygen fraction ⫽ 0.5–1.0) in the final
performed substantially worse than both the forehead few seconds of an exercise test. This will elevate SaO2 to
sensor and the IVY 2000 pulse oximeter equipped with ⬃100%, and any systematic bias by the device will
a finger sensor. In general, the N-395/RS-10 performed become apparent. As can be seen in Table 3, the two
similarly in all three subject groups, as did the N-395/ devices using finger probes substantially underesti-
D-25, albeit with more bias and less precision than the mated SaO2 in patients breathing 100% oxygen by an
N-395/RS-10. However, the Ivy 2000 performed signif- average of ⬃5%, which was similar to their perfor-
icantly worse in the measurement of SaO2 in the pa- mance compared with cooximetry during normoxia.
tients we studied than it did in the normal subjects or We wish to emphasize that our conclusions are
athletes. strongly influenced by the setting in which the device
There have been many validation studies of pulse was used. Clearly, pulse oximeters offer several advan-
oximetry during exercise over the last 20 years, with tages in the clinical setting. These devices are nonin-
widely varying conclusions offered on the part of the vasive, easy to use, and do not require significant
authors. For example, Powers et al. (10) tested three analysis time or maintenance of other equipment to
devices (two finger sensors and one ear sensor) and obtain data. In addition, the nature of the bias of the
found standard error of estimates (SEE; numerically devices we tested is such that, when significant errors
similar to precision) ranging from 1.43 to 1.97%, simi- are present, the tendency is toward underestimating
lar to values we found with the N-395/RS-10 forehead the true SaO2. Consequently, pulse oximetry offers a
sensor. These authors concluded that the accuracy of conservative estimate of SaO2 during clinical exer-
pulse oximetry was sufficient for use during exercise cise testing and thus is likely suitable for safety
testing. However, Symth et al. (14) found a SEE of 4.08 monitoring.

Table 4. Bias and precision of heart rate measurement by subject group and pulse oximeter
Group 1 Group 2 Group 3 Average
(Normal Subjects) (Athletes) (Patients) Across Groups

N-395/RS-10 forehead ⫺2.9 ⫾ 13.0*† 1.8 ⫾ 5.5*† 1.2 ⫾ 1.9*† ⫺0.8 ⫾ 9.8*†
(n ⫽ 90) (n ⫽ 30) (n ⫽ 56) (n ⫽ 176)
N-395/D-25 finger ⫺13.9 ⫾ 33.6 ⫺23.4 ⫾ 37.0 ⫺18.0 ⫾ 36.1 ⫺16.9 ⫾ 35.0
(n ⫽ 90) (n ⫽ 30) (n ⫽ 56) (n ⫽ 176)
Ivy 2000 finger ⫺20.5 ⫾ 33.6 ⫺49.9 ⫾ 41†‡§ ⫺33.1 ⫾ 29.6†‡ ⫺29.5 ⫾ 35.4†
(n ⫽ 90) (n ⫽ 30) (n ⫽ 56) (n ⫽ 176)
Average across devices ⫺12.5 ⫾ 29.3 ⫺23.8 ⫾ 38.4‡ ⫺16.6 ⫾ 30.3
(n ⫽ 270) (n ⫽ 90) (n ⫽ 168)
Values are means of bias ⫾ precision (SD). n, Number of observations. * Significantly different from Ivy 2000 finger (P ⬍ 0.05).
† Significantly different from N-395/D-25 finger (P ⬍ 0.05). ‡ Significantly different from group 1 (P ⬍ 0.01). § Significantly different from
group 3 (P ⬍ 0.01).

J Appl Physiol • VOL 92 • JANUARY 2002 • www.jap.org

Downloaded from journals.physiology.org/journal/jappl (190.014.071.009) on August 7, 2020.


PULSE OXIMETRY DURING EXERCISE 167

In addition to concerns related to accuracy during 37 to 39.5°C, result in a ⬃4% decrement in SaO2 in the
exercise, which we have briefly outlined, there are absence of any change in PaO2.
other issues to consider, such as sensor location. Finger Recently, Dempsey and Wagner (5) have offered a
sensors may be easier to place and to maintain in standardized definition of mild exercise-induced arte-
position in some patients. The forehead sensor offers a rial hypoxemia as a fall in SaO2 to below 95% from a
potential advantage in that it avoids the digits and the normal resting value of 98%. This value is very close to
severe effects caused by gripping and motion. Also, the the precision of the most accurate device tested (N-395/
forehead site may be better than the earlobe, as signals RS-10) and for the two finger-probe devices, both of
are usually greater and the sensor can be easily se- which had an average bias of ⫺2.0%. Many data points
cured and held in place with the addition of a head- could be expected to fit this definition on the basis of
band. However, the signal obtained from forehead sen- nonrandom measurement error alone. Ideally, if cir-
sors is susceptible to contamination from venous blood cumstances dictated the use of pulse oximetry, it would
and consequently will be biased toward low readings if be desirable to validate the pulse oximetry device
central venous pressure is raised (12, 16). This was not against direct measures on arterial blood in a repre-
observed in the present study, even in patients with sentative sample of the study population.
heart failure. However, it may be more of a problem In conclusion, the N-395/RS-10 forehead sensor of-
with certain types of exercise, such as rowing, in which fered greater validity of SaO2 measurements under all
a Valsalva maneuver is performed at the start of the conditions and in all subject groups than the other two
stroke. However, this may in part be prevented by the digital oximeters tested. Bias was negligible, however,
use of a compressive headband, such as the one used in and precision was ⫾2.5%. Both finger sensors showed
the present study (4). The forehead sensor location may significant negative bias and underestimated SaO2 dur-
also interfere with secure placement of some types of ing exercise. They also showed low precision (⬎5%).
headsets that support respiratory mouth pieces and Eliminating data points with poor pulse-rate signal
vice versa. Finally, in one of our subjects in one in- acquisition, as evidenced by an error in heart rate
stance, poor arterial signal acquisition occurred when measurement, did not substantially improve the per-
the subject altered his facial expression during maxi- formance of these devices.
mal exercise. This was accompanied by a loss of the We would like to thank our subjects for their enthusiastic partic-
pulse-rate signal and a markedly erroneous data point. ipation and Harrieth Wagner, Nick Busan, and Jeff Struthers for
As can been seen from Fig. 1, a similarly erroneous technical assistance.
This study was supported by National Center for Research Re-
data point also occurred with no obvious loss of pulse- sources Grant MO1 RR-00827, National Heart, Lung, and Blood
rate signal, and it is not possible, post facto, to deter- Institute Grant HL-17731, and Mallinckrodt.
mine the source of this error. Potential users of these
devices should also should be aware that significant REFERENCES
differences in the time to detect the onset of hypoxia 1. Baker C and Yorkey T (Inventors). Method and Apparatus for
have been reported with different sensor locations (6). Estimating Physiological Parameters Using Model Based Adap-
Because we tested healthy subjects and patients who tive Filtering. US Patent 5,853,364. St. Louis, MO: Nellcor Pu-
were ambulatory and able to complete an exercise test, ritan Bennett, 1998.
2. Barker SJ and Shah NK. The effects of motion on the perfor-
we cannot extend our findings to clinical situations mance of pulse oximeters in volunteers. Anesthesiology 86: 101–
other than exercise testing. It is possible that some 108, 1997.
devices using an ear sensor may offer similar perfor- 3. Brown DD, Knowlton RG, Sanjabi PB, and Szurgot BT.
mance to the forehead sensor, as these might be less Re-examination of the incidence of exercise-induced hypoxaemia
in highly trained subjects. Br J Sports Med 27: 167–170, 1993.
susceptible to motion artifact and poor perfusion than 4. Dassel AC, Graaff R, Sikkema M, Meijer A, Zijlstra WG, and
finger sensors. However, because we did not test any Aarnoudse JG. Reflectance pulse oximetry at the forehead im-
ear sensors, we cannot comment on their performance. proves by pressure on the probe. J Clin Monit 11: 237–244, 1995.
When precise measurement of oxygen transport is 5. Dempsey JA and Wagner PD. Exercise-induced arterial hy-
poxemia. J Appl Physiol 87: 1997–2006, 1999.
important, such as in answering research questions, 6. Hamber EA, Bailey PL, James SW, Wells DT, Lu JK, and
measurement of SaO2 alone is probably not adequate, Pace NL. Delays in the detection of hypoxemia due to site of
particularly during normoxic exercise, in which rela- pulse oximetry probe placement. J Clin Anesth 11: 113–118,
tively small changes in SaO2 are associated with large 1999.
7. Martin D and O’Kroy J. Effects of acute hypoxia on the V̇O2 max
differences in PaO2. For example, although the mean of trained and untrained subjects. J Sports Sci 11: 37–42, 1993.
bias for the N-395/RS-10 for all patient groups was 8. Martin D, Powers S, Cicale M, Collop N, Huang D, and
0.3% SaO2, the precision was ⫾2.5% SaO2. With the use Criswell D. Validity of pulse oximetry during exercise in elite
of a standard oxyhemoglobin equilibrium curve at a pH endurance athletes. J Appl Physiol 72: 455–458, 1992.
9. Plummer JL, Zakaria AZ, Ilsley AH, Fronsko RR, and
of 7.4, a PaO2 of 40 Torr and a temperature of 37°C, Owen H. Evaluation of the influence of movement on saturation
⫾2.5% SaO2 encompasses a variation of almost 40 Torr readings from pulse oximeters. Anaesthesia 50: 423–426, 1995.
in PaO2, assuming a normal resting PaO2 of 90 Torr. 10. Powers SK, Dodd S, Freeman J, Ayers GD, Samson H, and
(13). Additionally, during exercise in which SaO2 is also McKnight T. Accuracy of pulse oximetry to estimate HbO2
fraction of total Hb during exercise. J Appl Physiol 67: 300–304,
affected by temperature and pH, typical changes ob- 1989.
served in maximal exercise, such as a reduction in pH 11. Powers SK, Dodd S, Lawler J, Landry G, Kirtley M, Mc-
from 7.4 to 7.2 and an increase in the temperature from Knight T, and Grinton S. Incidence of exercise induced hypox-

J Appl Physiol • VOL 92 • JANUARY 2002 • www.jap.org

Downloaded from journals.physiology.org/journal/jappl (190.014.071.009) on August 7, 2020.


168 PULSE OXIMETRY DURING EXERCISE

emia in elite endurance athletes at sea level. Eur J Appl Physiol Nellcor N-200 and its applications in studies of variability in
58: 298–302, 1988. infant oxygenation. J Clin Monit 12: 17–25, 1996.
12. Sami HM, Kleinman BS, and Lonchyna VA. Central ve- 16. Stewart KG and Rowbottom SJ. Inaccuracy of pulse oximetry
nous pulsations associated with a falsely low oxygen satura- in patients with severe tricuspid regurgitation. Anaesthesia 46:
tion measured by pulse oximetry. J Clin Monit 7: 309–312, 668–670, 1991.
1991. 17. Trivedi NS, Ghouri AF, Shah NK, Lai E, and Barker SJ.
13. Severinghaus JW. Simple, accurate equations for human Effects of motion, ambient light, and hypoperfusion on pulse
blood O2 dissociation computations. J Appl Physiol 46: 599– oximeter function. J Clin Anesth 9: 179–183, 1997.
602, 1979. 18. Villanueva R, Bell C, Kain ZN, and Colingo KA. Effect of
14. Smyth RJ, D’Urzo AD, Slutsky AS, Galko BM, and Rebuck peripheral perfusion on accuracy of pulse oximetry in children.
AS. Ear oximetry during combined hypoxia and exercise. J Appl J Clin Anesth 11: 317–322, 1999.
Physiol 60: 716–719, 1986. 19. Webb RK, Ralston AC, and Runciman WB. Potential errors
15. Sprague D, Richardson MS, Baish JW, and Kemp JS. A in pulse oximetry. II. Effects of changes in saturation and signal
new system to record reliable pulse oximetry data from the quality. Anaesthesia 46: 207–212, 1991.

J Appl Physiol • VOL 92 • JANUARY 2002 • www.jap.org

Downloaded from journals.physiology.org/journal/jappl (190.014.071.009) on August 7, 2020.

You might also like