Professional Documents
Culture Documents
Abstract—In this work, a sensor system for physiological driver (ECG), this parameter can be evaluated and be used as a stress
state monitoring is presented which is integrated onto a safety metric [4]. In previous research, non-contact capacitive ECG
belt. The system incorporates two different sensor concepts: systems have been successfully integrated into car seats [5].
An optical system intended for heart activity monitoring and
a magnetic induction (MI) system for respiration monitoring. These systems do not require the attachment of electrodes on
The optical sensor system emits infrared (IR) light from LEDs the body as in conventional ECG systems, contacting the seat
towards the body of the driver. A part of the light passes through with the back is sufficient. Under highway conditions, a high
the clothing of the driver, is reflected in the body and detected coverage rate of 94 % has been achieved. It is conceivable
by a photosensor in the optical sensor system. Light reflection to add additional sensor systems for ECG measurements to
varies during heart beat intervals and can hence be used for heart
beat detection. The MI system is composed of a high-frequency further increase the coverage rate in a data fusion process.
oscillator incorporating an embroidered coil on the safety belt. Previous research has proposed the integration of ECG systems
During inspiration, the orientation of the driver changes with into the steering wheel [6]. However, this approach has two
respect to the coil, which, due to a change in permittivity, results drawbacks: Proper contact between driver and steering wheel
in a frequency change. Hence, respiration can be detected by electrodes cannot be guaranteed, e.g. due to single-handed
observing the oscillator frequency. The belt-integrated sensor
system has been evaluated in a laboratory experiment. Using a or lazy steering. In addition, in future autonomous driving
reference ECG as heart beat reference and a piezoelectric sensor scenarios, there will probably be no contact between driver
belt strapped around the thorax as a respiration reference, the and steering wheel in autonomous mode. Apart from the seat
feasibility of the sensor system was investigated. First results and the steering wheel, another vehicle part has close contact
showed a readily apparent respiratory signal and a good heart to the driver: The safety belt. Due to the proximity to the
beat signal. It was shown that the monitoring of heart and breath
activity is indeed possible. heart and lung, it can be considered to be a good place
for the integration of physiological sensors. Other research
I. INTRODUCTION groups have integrated a ballistocardiogram (BCG) system into
The human factor is an important parameter in traffic safety. the belt which measures movements of the body surface [7].
According to the U.S. Department of Transportation, 94 % Since respiration and heart beats also cause movements of
of all critical pre-crash events are caused by the driver [1]. the body surface, they can be measured by the BCG system.
Therefore, driver state monitoring is an important research area However, due to the large amount of vibrations inside a
which attracts more and more attention. Systems for sleepiness vehicle, evaluation of the BCG signal can be expected to be
detection are already commercially available today. However, difficult, in particular in case of poor road conditions. In this
in most cases, the driver lacks proper recognition of the traffic work, an alternative safety belt sensor system for the detection
situation or makes an incorrect decision, so an assessment of of respiration and heart activity is presented. It incorporates an
e.g. driver distraction might be a more beneficial research area. optical sensor for the heart activity and a magnetic induction
Current systems rely on vehicle data (e.g. lane position) and (MI) based sensor for respiratory monitoring. These sensor
driver inputs to the vehicle (e.g. steering wheel operation [2]). concepts have been demonstrated before [9], [10] and are
Both methods share one shortcoming: They assess the driver introduced into a new application in this work.
state indirectly based on the vehicle status and the actions
II. M ATERIALS AND M ETHODS
of the driver. Both indicators can be expected to be only
loosely connected to the inner state of the driver and to present A. Measurement Principle
large variations among driver populations. Thus, unconscious 1) Magnetic Induction Sensor: The measurement of respi-
parameters, e.g. the eye lid closing for sleepiness detection ration is based on a Colpitts oscillator. For this oscillator type,
(PERCLOS metric [3]) are preferable as being closer to the a large variety of circuit implementation variants exist. The
inner driver state. Probably the approach closest to the inner variant used in this work is presented in schematic form in Fig.
driver state is the assessment of physiological parameters. For 1. The oscillator consists of two capacitors, one inductor coil, a
instance, stress will activate the sympathetic nervous system resistor and an active inverter gate. The oscillation frequency
which increases the heart rate. Using an electrocardiogram is determined by the dimensions of the capacitors, resistors
Fig. 3. The embroidered coil. In the left lower corner, an insulating bridge
is placed to access the inner side of the coil from the outside.
192
additional logic stage for conditioning the signal to transistor- electronics are connected to it using patent fasteners. The
transistor logic (TTL) levels. In addition, an optional frequency optical sensor board is placed inside the textile cover so that
divider stage to lower the frequency by a factor of up to the photodiode and LEDs are directed towards the body of
eight is available. The output signal is fed into a NI USB- the driver. Optical pathways for the LEDs and the photodiode
6210 converter card (National Instruments, Austin, Texas, were created by cutting holes in the cover which are reinforced
USA) configured as a counter system so the Colpitts oscillator by steel rivets as presented in Fig. 5. Since the rivets are made
frequency can be assessed. The converter output (counter from electrically conducting metal, epoxy resin was used for
value) is sampled at a rate of 1000 Hz. electrical insulation.
D. Reference Measurement Systems
To assess the validity of the derived optical heart activity
and respiration signal, reference measurement systems are
required. For the heart rate, a commercial ECG measurement
system (Philips MP30, Philips, Eindhoven, The Netherlands)
with three adhesive electrodes is used. In the ECG, every heart
beat can be clearly seen as a peak that originates from the
contraction of the heart muscle. For the respiration rate, a
breath activity belt (SleepSense, Elgin, USA) is used which
is strapped around the thorax. The belt incorporates a piezo-
electric element, which, under mechanical stress, generates a
Fig. 4. The optical sensor board. In the middle of the board, the photodiode voltage. Therefore, due to the expansion of the thorax during
can be seen, which is surrounded by four LEDs.
inspiration, a voltage can be measured. The output signals of
2) Optical Sensor: Fig. 4 shows a picture of the optical both reference systems are fed into the NI USB-6210 converter
sensor board. In the center of the board, the photodiode sensor for digitalization at a sampling rate of 1000 Hz.
is situated. In the four edges, IR LEDs (wavelength: 850 E. Test Procedure
nm) are placed. IR light is used since transmission through
fabric layers is better for higher wavelengths. For simplicity
of design, the LEDs are powered with constant current and
not pulsed. The signal from the photodiode is amplified in a
transimpedance amplifier, filtered in two filter stages (lowpass,
highpass, realized in Sallen-Key topology) and fed into the
same NI USB-6210 converter card for digitalization at a
sampling frequency of 1000 Hz as was done for the magnetic
induction sensor.
C. Belt Integration
193
recorded from the optical and MI sensor, alongside with sensor clearly visible. The optical heart rate sensor presents with a
data from the two reference systems. During the experiment, different picture: During expiration, a regular pattern can be
the number of breaths taken was noted for validation purposes. observed, while during inspiration, artifacts (spikes with larger
amplitudes and fast slew rate) occur in the signal.
F. Signal Processing
B. Magnetic Induction Sensor and Respiration Reference
Signal processing of all sensor signals was done in Matlab.
Since the magnetic induction sensor measures only respiration Fig. 8 presents a signal sample of 30 sec length from the
and the optical heart rate sensor measures only heart activity, MI sensor along with the breath signal reference from the
no separation of the respiration and heart signal is required. piezoelectric belt. Both signal are from the same time period,
1) Magnetic Induction Sensor: The converter card de- so a direct comparison is possible. The oscillator operates
livered the current counter value at each sampling time. at a frequency of 21.505 MHz (maximum exhale) to 21.869
Therefore, to calculate the instantaneous frequency between MHz (maximum inhale). Hence, the frequency shift between
sampling times, the signal from the converter card was dif- inhale and exhale is 364 kHz. In both signal, typical breathing
ferentiated, i.e. consecutive counter values were subtracted. pattern can be observed. The number of breaths taken during
Since the differentiated signal presented with good quality, no the experiment matches the observable patterns. With respect
further signal processing was necessary. to signal-to-noise ratio, the performance of the MI sensor was
2) Optical Heart Rate Sensor: The signal from the optical even better than the reference sensor. Also, the peaks in the MI
sensor was lowpass filtered to remove high frequency noise. sensor signal are clearer. In the reference sensor, no clear peak,
A FIR filter with an order of 12 and a cutoff frequency of 10 but a plateau can be observed. Thus, a respiration detection is
Hz was used. definitely possible by using the embroidered MI sensor.
3) Reference Measurements: The ECG signal already pre-
sented with sufficient signal quality so no postprocessing was
performed. The breath belt sensor signal showed a significant
level of high frequency noise. Therefore, a lowpass filter was
applied to the sensor data. A FIR filter with an order of 30
and a cutoff frequency of 1 Hz was used.
III. R ESULTS
A. Availability of Data
Fig. 8. Sample signals from the safety belt integrated MI sensor (top) and
the reference sensor (bottom).
194
materials, number of layers of clothing, climatic conditions
inside the car, driving conditions, vibrations, body movements.
Generally, as far as legally possible, the experiments should
be performed in public road transport to validate the sensor
system under realistic conditions which cannot be simulated
in a laboratory or simulator experiment. In particular, the
influence of e.g. vibrations and body movements on the signal
quality should be investigated. The results of the study should
also be statistically evaluated, e.g. regarding the availability
and the error rates of the sensor information.
ACKNOWLEDGMENT
The authors would like to express their gratitude to Julia
Knauel for assisting in the textile integration of the sensor
system.
R EFERENCES
Fig. 9. Sample signals from the safety belt integrated optical sensor (top) [1] U.S. Department of Transportation, ”Traffic
and the reference ECG (bottom). Safety Facts”, February 2015. Online available:
https://crashstats.nhtsa.dot.gov/Api/Public/ViewPublication/812115
[2] J. Krajewski, D. Sommer, U. Trutschel, D. Edwards and M. Golz, ”Steer-
IV. C ONCLUSION AND DISCUSSION ing Wheel Behavior Based Estimation of Fatigue”, Fifth International
Driving Symposium on Human Factors in Driver Assessment, Training
In this work, a sensor for driver state monitoring was and Vehicle Design, pp. 118-124, 2009
presented. The sensor is integrated onto a safety belt and [3] David F. Dinges and Richard Grace: ”PERCLOS: A valid psychophys-
iological measure of alertness as assessed by psychomotor vigilance.”,
incorporates two different sensor concepts. An optical sensor is US Department of Transportation, Federal Highway Administration,
used for the monitoring of heart activity, a magnetic induction Publication Number FHWA-MCRT-98-006, 1998
sensor is implemented for the monitoring of breathing activity. [4] J. Healey and R. Picard, ”Detecting Stress During Real-World Driving
Tasks Using Physiological Sensors”, IEEE Transactions on Intelligent
The feasability of breath activity monitoring using a safety- Transportation Systems, pp. 156-166, 2005
belt integrated magnetic induction system was successfully [5] M. Walter, B. Eilebrecht, T. Wartzek and S. Leonhardt, ”The smart car
demonstrated. During expiration as well as inspiration, sensor seat: personalized monitoring of vital signs in automotive applications”,
Personal and Ubiquitous Computing, vol. 15, pp. 707-715, 2011
data was available at high quality. Interestingly, the quality of [6] J. Gomez-Clapers and R. Casanella, ”A Fast and Easy-to-Use ECG
the magnetic induction sensor was better than the reference Acquisition and Heart Rate Monitoring System Using a Wireless Steering
sensor. The optical heart rate sensor system presented with Wheel”, IEEE Sensors Journal, 2012
[7] S. Hamdani and A. Fernando, ”The Application of a Piezo-Resistive
difficulties during inspiration. A closer examination of the Cardiorespiratory Sensor System in an Automobile Safety Belt”, Sensors,
phenomenon showed that the sensor position moved during vol. 15, pp. 7742-7753, 2015
inspiration, since the shoulders of the driver moved upwards [8] T. Wartzek, R. Elfring, A. Janssen, B. Eilebrecht, M. Walter and S.
Leonhardt: ”On the way to a cable free operating theater: An operating
during inspiration. It might hence be advisable to reposition table with integrated multimodal monitoring.” Computing in Cardiology
the sensor to a position less affected by motion artifacts. Conference, pp. 129-132, 2011.
[9] D. Teichmann, D. De Matteis, T. Bartelt, M. Walter and S. Leonhardt,”A
V. F UTURE WORK Bendable and Wearable Cardiorespiratory Monitoring Device Fusing Two
Noncontact Sensor Principles”, IEEE Journal of Biomedical and Health
In future work, the sensor integration should be improved. Informatics, 2015
Different positions for the optical heart rate sensor should [10] D. Teichmann, A. Kuhn, S. Leonhardt and M. Walter, ”The MAIN Shirt:
A Textile-Integrated Magnetic Induction Sensor Array”, Sensors, vol. 14,
be evaluated to address the susceptibility to motion artifacts. pp. 1039-1056, 2014
The textile cover should be replaced by an additional textile [11] J. Allen: ”Photoplethysmography and its application in clinical physio-
layer in the belt which incorporates the sensor system. Special logical measurement”, Physiological Measurement, 2007.
care must be taken to comply with safety standards, i.e.
regarding the stability of the belt. An issue that needs to
be addressed is the compatibility of the sensor electronics
with the belt reversing device. On the electronics level, the
constant current operation of the LEDs should be replaced
by a pulsed operation. By that, higher light emission from
the LEDs resulting in a better SNR are possible without
violating thermal restrictions. Also, the findings from this work
should be confirmed on a larger number of test persons in
a clinical study. For that, an ethics application and approval
from the ethics boards is required. In the study, several
aspects should be investigated: Influence of different clothing
195