You are on page 1of 5

2017 IEEE International Conference on Vehicular Electronics and Safety (ICVES)

June 27-28, 2017, Vienna, Austria

The PhysioBelt: A Safety Belt Integrated Sensor


System for Heart Activity and Respiration
Lennart Leicht, Pascal Vetter, Steffen Leonhardt and Daniel Teichmann
Philips Chair for Medical Information Technology
RWTH Aachen University
52074 Aachen, Germany
Email: leicht@hia.rwth-aachen.de

Abstract—In this work, a sensor system for physiological driver (ECG), this parameter can be evaluated and be used as a stress
state monitoring is presented which is integrated onto a safety metric [4]. In previous research, non-contact capacitive ECG
belt. The system incorporates two different sensor concepts: systems have been successfully integrated into car seats [5].
An optical system intended for heart activity monitoring and
a magnetic induction (MI) system for respiration monitoring. These systems do not require the attachment of electrodes on
The optical sensor system emits infrared (IR) light from LEDs the body as in conventional ECG systems, contacting the seat
towards the body of the driver. A part of the light passes through with the back is sufficient. Under highway conditions, a high
the clothing of the driver, is reflected in the body and detected coverage rate of 94 % has been achieved. It is conceivable
by a photosensor in the optical sensor system. Light reflection to add additional sensor systems for ECG measurements to
varies during heart beat intervals and can hence be used for heart
beat detection. The MI system is composed of a high-frequency further increase the coverage rate in a data fusion process.
oscillator incorporating an embroidered coil on the safety belt. Previous research has proposed the integration of ECG systems
During inspiration, the orientation of the driver changes with into the steering wheel [6]. However, this approach has two
respect to the coil, which, due to a change in permittivity, results drawbacks: Proper contact between driver and steering wheel
in a frequency change. Hence, respiration can be detected by electrodes cannot be guaranteed, e.g. due to single-handed
observing the oscillator frequency. The belt-integrated sensor
system has been evaluated in a laboratory experiment. Using a or lazy steering. In addition, in future autonomous driving
reference ECG as heart beat reference and a piezoelectric sensor scenarios, there will probably be no contact between driver
belt strapped around the thorax as a respiration reference, the and steering wheel in autonomous mode. Apart from the seat
feasibility of the sensor system was investigated. First results and the steering wheel, another vehicle part has close contact
showed a readily apparent respiratory signal and a good heart to the driver: The safety belt. Due to the proximity to the
beat signal. It was shown that the monitoring of heart and breath
activity is indeed possible. heart and lung, it can be considered to be a good place
for the integration of physiological sensors. Other research
I. INTRODUCTION groups have integrated a ballistocardiogram (BCG) system into
The human factor is an important parameter in traffic safety. the belt which measures movements of the body surface [7].
According to the U.S. Department of Transportation, 94 % Since respiration and heart beats also cause movements of
of all critical pre-crash events are caused by the driver [1]. the body surface, they can be measured by the BCG system.
Therefore, driver state monitoring is an important research area However, due to the large amount of vibrations inside a
which attracts more and more attention. Systems for sleepiness vehicle, evaluation of the BCG signal can be expected to be
detection are already commercially available today. However, difficult, in particular in case of poor road conditions. In this
in most cases, the driver lacks proper recognition of the traffic work, an alternative safety belt sensor system for the detection
situation or makes an incorrect decision, so an assessment of of respiration and heart activity is presented. It incorporates an
e.g. driver distraction might be a more beneficial research area. optical sensor for the heart activity and a magnetic induction
Current systems rely on vehicle data (e.g. lane position) and (MI) based sensor for respiratory monitoring. These sensor
driver inputs to the vehicle (e.g. steering wheel operation [2]). concepts have been demonstrated before [9], [10] and are
Both methods share one shortcoming: They assess the driver introduced into a new application in this work.
state indirectly based on the vehicle status and the actions
II. M ATERIALS AND M ETHODS
of the driver. Both indicators can be expected to be only
loosely connected to the inner state of the driver and to present A. Measurement Principle
large variations among driver populations. Thus, unconscious 1) Magnetic Induction Sensor: The measurement of respi-
parameters, e.g. the eye lid closing for sleepiness detection ration is based on a Colpitts oscillator. For this oscillator type,
(PERCLOS metric [3]) are preferable as being closer to the a large variety of circuit implementation variants exist. The
inner driver state. Probably the approach closest to the inner variant used in this work is presented in schematic form in Fig.
driver state is the assessment of physiological parameters. For 1. The oscillator consists of two capacitors, one inductor coil, a
instance, stress will activate the sympathetic nervous system resistor and an active inverter gate. The oscillation frequency
which increases the heart rate. Using an electrocardiogram is determined by the dimensions of the capacitors, resistors

978-1-5090-5676-7/17/$31.00 ©2017 IEEE 191


as a reflectance photoplethysmography (rPPG) device: Light
is emitted by the LEDs and is partly absorbed, partly reflected
in all materials in front of the sensor, in particular the clothing
and the body of the driver. The light absorption in the clothing
depends on the number of clothing layers, the thickness and
the absorption factor in the IR spectrum. High absorption rates
in the clothing can be overcome by increasing the power of
the IR LEDs. Light absorption in the body can be separated
into a static part (e.g. due to skin pigmentation) and a variable
part that is attributed to the variable blood content in the blood
vessels during the cardiac cycle. During the systole, the heart
muscle is contracted and blood is pressed into the arterioles.
Fig. 1. Principle of the magnetic induction sensor. The two capacities, the During the following decontraction, denoted as diastole, the
coil and the inverting gate implement an oscillator circuit. In case the material
in proximity of the coil is changed, e.g. by bringing the body of the driver
arterioles empty through the capillaries into the venous system.
closer to the coil, the oscillator frequency will change. Hence, cyclic changes can be measured in the signal that
are synchronous to the heart rate. However, compared to the
static part, the changes are rather small. A comprehensive
and the coil. Apart from geometrical factors, the inductance, introduction into PPG systems can be found in [11].
resistance and capacitance of the coil are influenced by the
material close to the coil. For example, ferrite is used to B. Hardware Implementation
increase the inductance of power coils. In case the material
close to the coil is changed, a change of frequency will occur Due to regulatory and safety considerations, it was decided
in the Colpitts oscillator. If the coil is integrated into a seat not to modify the safety belt by directly integrating sensors
belt, the body of the driver will move closer to the coil during into it. Instead, a textile cover was constructed that can be
inspiration since his thorax will expand. Thus, by observing slipped over the safety belt. As material, denim fabric (cotton)
the oscillator frequency, the respiration can be monitored. To was used. The sensors are placed on the side directed towards
achieve a sufficient sensitivity, a rather high frequency has to the driver. For assembly, the cover can be opened and closed
be set - typically 10 MHz is a good choice. As a drawback of using velcro tape on the opposite side.
this sensor concept, it must be noted that every movement of
the body relative to the safety belt will affect the sensor signal.
Thus, movements e.g. during acceleration will cause artifacts,
which need to be separated from the respiration signal, e.g.
using a bandpass filter.

Fig. 3. The embroidered coil. In the left lower corner, an insulating bridge
is placed to access the inner side of the coil from the outside.

1) Magnetic Induction Sensor: Previous research has in-


troduced several possible forms of integrating the inductor
coil, e.g. by using high frequency litz [10] or as a printed
circuit board track on flexible material [9]. Here, the coil is
embroidered into the fabric using conductive thread (Elitex,
manufacturer: imbut GmbH, Greiz, Germany) as presented in
Fig. 3. The thread consists of polyamide, the conductivity is
achieved by means of a silver coating. The thread can not
Fig. 2. Drawing of the optical sensor principle. be soldered, so the two ends are sawn to patent fasteners.
The sensor electronics are integrated on a small printed circuit
2) Optical Sensor: The measurement of the heart rate board which is contacted to the coil using the counterpart of
is accomplished using an optical sensor composed of four the patent fasteners. Thus, the electronics can be exchanged,
LEDs and one photodiode. A sketch of the measurement offering flexibility in development. The sensor electronics
principle is depicted in Fig. 2. Basically, the sensor operates comprise of the components of the Colpitts oscillator and an

192
additional logic stage for conditioning the signal to transistor- electronics are connected to it using patent fasteners. The
transistor logic (TTL) levels. In addition, an optional frequency optical sensor board is placed inside the textile cover so that
divider stage to lower the frequency by a factor of up to the photodiode and LEDs are directed towards the body of
eight is available. The output signal is fed into a NI USB- the driver. Optical pathways for the LEDs and the photodiode
6210 converter card (National Instruments, Austin, Texas, were created by cutting holes in the cover which are reinforced
USA) configured as a counter system so the Colpitts oscillator by steel rivets as presented in Fig. 5. Since the rivets are made
frequency can be assessed. The converter output (counter from electrically conducting metal, epoxy resin was used for
value) is sampled at a rate of 1000 Hz. electrical insulation.
D. Reference Measurement Systems
To assess the validity of the derived optical heart activity
and respiration signal, reference measurement systems are
required. For the heart rate, a commercial ECG measurement
system (Philips MP30, Philips, Eindhoven, The Netherlands)
with three adhesive electrodes is used. In the ECG, every heart
beat can be clearly seen as a peak that originates from the
contraction of the heart muscle. For the respiration rate, a
breath activity belt (SleepSense, Elgin, USA) is used which
is strapped around the thorax. The belt incorporates a piezo-
electric element, which, under mechanical stress, generates a
Fig. 4. The optical sensor board. In the middle of the board, the photodiode voltage. Therefore, due to the expansion of the thorax during
can be seen, which is surrounded by four LEDs.
inspiration, a voltage can be measured. The output signals of
2) Optical Sensor: Fig. 4 shows a picture of the optical both reference systems are fed into the NI USB-6210 converter
sensor board. In the center of the board, the photodiode sensor for digitalization at a sampling rate of 1000 Hz.
is situated. In the four edges, IR LEDs (wavelength: 850 E. Test Procedure
nm) are placed. IR light is used since transmission through
fabric layers is better for higher wavelengths. For simplicity
of design, the LEDs are powered with constant current and
not pulsed. The signal from the photodiode is amplified in a
transimpedance amplifier, filtered in two filter stages (lowpass,
highpass, realized in Sallen-Key topology) and fed into the
same NI USB-6210 converter card for digitalization at a
sampling frequency of 1000 Hz as was done for the magnetic
induction sensor.
C. Belt Integration

Fig. 6. Placement of the sensors on the driver.

Due to regulatory and safety concerns, the sensor belt


was tested in a laboratory environment and not in a real
world driving experiment. The experiment was performed in
a static environment, i.e. no driving simulator was used. A
common car seat was equipped with a safety belt to which
the textile cover was attached. The textile cover was moved on
Fig. 5. Presentation of a section of the belt directed towards the driver. the safety belt until the embroidered coil was approximately
Rivets are placed in the textile to create optical pathways. Behind the rivets,
the photodiode and four LEDs can be seen. on the sternum. Due to the design of the textile cover, the
optical sensor system then rested on the Musculus pectoralis
As presented before, the inductor coil of the MI sensor is major, approximately above the heart. Fig. 6 shows the sensor
directly integrated into the textile cover and the associated arrangement with respect to the vehicle driver. Sensor data was

193
recorded from the optical and MI sensor, alongside with sensor clearly visible. The optical heart rate sensor presents with a
data from the two reference systems. During the experiment, different picture: During expiration, a regular pattern can be
the number of breaths taken was noted for validation purposes. observed, while during inspiration, artifacts (spikes with larger
amplitudes and fast slew rate) occur in the signal.
F. Signal Processing
B. Magnetic Induction Sensor and Respiration Reference
Signal processing of all sensor signals was done in Matlab.
Since the magnetic induction sensor measures only respiration Fig. 8 presents a signal sample of 30 sec length from the
and the optical heart rate sensor measures only heart activity, MI sensor along with the breath signal reference from the
no separation of the respiration and heart signal is required. piezoelectric belt. Both signal are from the same time period,
1) Magnetic Induction Sensor: The converter card de- so a direct comparison is possible. The oscillator operates
livered the current counter value at each sampling time. at a frequency of 21.505 MHz (maximum exhale) to 21.869
Therefore, to calculate the instantaneous frequency between MHz (maximum inhale). Hence, the frequency shift between
sampling times, the signal from the converter card was dif- inhale and exhale is 364 kHz. In both signal, typical breathing
ferentiated, i.e. consecutive counter values were subtracted. pattern can be observed. The number of breaths taken during
Since the differentiated signal presented with good quality, no the experiment matches the observable patterns. With respect
further signal processing was necessary. to signal-to-noise ratio, the performance of the MI sensor was
2) Optical Heart Rate Sensor: The signal from the optical even better than the reference sensor. Also, the peaks in the MI
sensor was lowpass filtered to remove high frequency noise. sensor signal are clearer. In the reference sensor, no clear peak,
A FIR filter with an order of 12 and a cutoff frequency of 10 but a plateau can be observed. Thus, a respiration detection is
Hz was used. definitely possible by using the embroidered MI sensor.
3) Reference Measurements: The ECG signal already pre-
sented with sufficient signal quality so no postprocessing was
performed. The breath belt sensor signal showed a significant
level of high frequency noise. Therefore, a lowpass filter was
applied to the sensor data. A FIR filter with an order of 30
and a cutoff frequency of 1 Hz was used.
III. R ESULTS
A. Availability of Data

Fig. 8. Sample signals from the safety belt integrated MI sensor (top) and
the reference sensor (bottom).

C. Optical Heart Rate Sensor and Reference ECG


Fig. 9 presents a sample signal of 4 sec length from the
optical sensor along with the reference ECG. Both signals
are from the same time period to enable a direct comparison.
The signals were recorded during expiration. The optical heart
rate sensor delivers a signal of typically between 0.326 and
0.335 V, so the signal difference between different heart beat
Fig. 7. Sample signals from the optical sensor (top) and the MI sensor
(bottom). phases is rather small. In the ECG signal distinctive spikes
can be seen which originate in the electrical heart activity.
Fig. 7 shows sample signals from the MI sensor and the Thus, every spike is associated with one heart beat. In the
optical sensor in a representative time interval. Since the op- optical signal, local maxima coincide with the peaks in the
tical sensor signal presented with only small signal variations, ECG. The local maxima are not as strong as the peaks in the
the mean value of the signal was subtracted to improve the ECG, but still clearly visible. Hence, heart activity detection
visibility of small temporal variations. For the MI sensor, using the optical sensor is feasabile during expiration. During
a good signal is available during the whole time interval. inspiration, artefacts occur in the signal, making heart rate
Inspiration (local maxima) and exspiration (local minima) are detection difficult.

194
materials, number of layers of clothing, climatic conditions
inside the car, driving conditions, vibrations, body movements.
Generally, as far as legally possible, the experiments should
be performed in public road transport to validate the sensor
system under realistic conditions which cannot be simulated
in a laboratory or simulator experiment. In particular, the
influence of e.g. vibrations and body movements on the signal
quality should be investigated. The results of the study should
also be statistically evaluated, e.g. regarding the availability
and the error rates of the sensor information.
ACKNOWLEDGMENT
The authors would like to express their gratitude to Julia
Knauel for assisting in the textile integration of the sensor
system.
R EFERENCES
Fig. 9. Sample signals from the safety belt integrated optical sensor (top) [1] U.S. Department of Transportation, ”Traffic
and the reference ECG (bottom). Safety Facts”, February 2015. Online available:
https://crashstats.nhtsa.dot.gov/Api/Public/ViewPublication/812115
[2] J. Krajewski, D. Sommer, U. Trutschel, D. Edwards and M. Golz, ”Steer-
IV. C ONCLUSION AND DISCUSSION ing Wheel Behavior Based Estimation of Fatigue”, Fifth International
Driving Symposium on Human Factors in Driver Assessment, Training
In this work, a sensor for driver state monitoring was and Vehicle Design, pp. 118-124, 2009
presented. The sensor is integrated onto a safety belt and [3] David F. Dinges and Richard Grace: ”PERCLOS: A valid psychophys-
iological measure of alertness as assessed by psychomotor vigilance.”,
incorporates two different sensor concepts. An optical sensor is US Department of Transportation, Federal Highway Administration,
used for the monitoring of heart activity, a magnetic induction Publication Number FHWA-MCRT-98-006, 1998
sensor is implemented for the monitoring of breathing activity. [4] J. Healey and R. Picard, ”Detecting Stress During Real-World Driving
Tasks Using Physiological Sensors”, IEEE Transactions on Intelligent
The feasability of breath activity monitoring using a safety- Transportation Systems, pp. 156-166, 2005
belt integrated magnetic induction system was successfully [5] M. Walter, B. Eilebrecht, T. Wartzek and S. Leonhardt, ”The smart car
demonstrated. During expiration as well as inspiration, sensor seat: personalized monitoring of vital signs in automotive applications”,
Personal and Ubiquitous Computing, vol. 15, pp. 707-715, 2011
data was available at high quality. Interestingly, the quality of [6] J. Gomez-Clapers and R. Casanella, ”A Fast and Easy-to-Use ECG
the magnetic induction sensor was better than the reference Acquisition and Heart Rate Monitoring System Using a Wireless Steering
sensor. The optical heart rate sensor system presented with Wheel”, IEEE Sensors Journal, 2012
[7] S. Hamdani and A. Fernando, ”The Application of a Piezo-Resistive
difficulties during inspiration. A closer examination of the Cardiorespiratory Sensor System in an Automobile Safety Belt”, Sensors,
phenomenon showed that the sensor position moved during vol. 15, pp. 7742-7753, 2015
inspiration, since the shoulders of the driver moved upwards [8] T. Wartzek, R. Elfring, A. Janssen, B. Eilebrecht, M. Walter and S.
Leonhardt: ”On the way to a cable free operating theater: An operating
during inspiration. It might hence be advisable to reposition table with integrated multimodal monitoring.” Computing in Cardiology
the sensor to a position less affected by motion artifacts. Conference, pp. 129-132, 2011.
[9] D. Teichmann, D. De Matteis, T. Bartelt, M. Walter and S. Leonhardt,”A
V. F UTURE WORK Bendable and Wearable Cardiorespiratory Monitoring Device Fusing Two
Noncontact Sensor Principles”, IEEE Journal of Biomedical and Health
In future work, the sensor integration should be improved. Informatics, 2015
Different positions for the optical heart rate sensor should [10] D. Teichmann, A. Kuhn, S. Leonhardt and M. Walter, ”The MAIN Shirt:
A Textile-Integrated Magnetic Induction Sensor Array”, Sensors, vol. 14,
be evaluated to address the susceptibility to motion artifacts. pp. 1039-1056, 2014
The textile cover should be replaced by an additional textile [11] J. Allen: ”Photoplethysmography and its application in clinical physio-
layer in the belt which incorporates the sensor system. Special logical measurement”, Physiological Measurement, 2007.
care must be taken to comply with safety standards, i.e.
regarding the stability of the belt. An issue that needs to
be addressed is the compatibility of the sensor electronics
with the belt reversing device. On the electronics level, the
constant current operation of the LEDs should be replaced
by a pulsed operation. By that, higher light emission from
the LEDs resulting in a better SNR are possible without
violating thermal restrictions. Also, the findings from this work
should be confirmed on a larger number of test persons in
a clinical study. For that, an ethics application and approval
from the ethics boards is required. In the study, several
aspects should be investigated: Influence of different clothing

195

You might also like