Driver Drowsiness Detection

Frank Sgambati, Robert Bosch LLC

January 26, 2012

Company logo of presenter

(first and last slide only)
1
 Motivation
 Fatigue is often the cause of serious automobile crashes

 Failing concentration can impair steering behavior and reduce

driver reaction time

 Driver drowsiness increases the risk of collision by factor 4 to 6

 Monotonous driving is particularly exhausting and can lead to loss

of concentration

 Transition from being fatigued to nodding off is subtle

• For these reasons, Bosch has developed Driver Drowsiness Detection

2
 Reasons for Collisions on Highways*
Vehicle Ahead 15%
Vehicel Dynamics 10% Mental Factors
Misinterpretation
Weather 10%
Miscellaneous
Lane Keeping 8% 11% Technical Factors
Stationary Car 3% 46% 5%

38%
Sleep 24%
Inattention 11%
Medical Reasons 3%

• Driver error is a major reason for fatal crashes

*Source: Gesamtverband Deutscher Versicherer
(German Insurance Association)

3
Studies related to drowsiness in road traffic

About 17 percent of all fatal crashes in the USA could be attributed to tired drivers
(the American Automobile Association (AAA), USA, 2010)

In 20 % of all crashes, drowsiness is a contributing factor.

(NHTSA, USA, 2006)

5 – 25 % of all collisions are caused by the driver falling asleep.

(Volkswagen AG, several studies, Germany, 2005)

Fatigue was the second most frequent cause of serious truck collisions
on German highways.
(Federal Highway Research Institute BASt, Germany, 2003)

4
 Driver Drowsiness - Detection Variants
Solution Basics
Steering pattern monitoring Steering angle signal from
 Detection of characteristic steering ESP or electrical power
behavior steering

Vehicle position in lane monitoring Multi Purpose Camera

 Monitoring of lane-keeping (MPC)
behavior

Driver eye/face monitoring Interior

 Analysis of eyelid closure behavior Camera
 Yawning detection
 …
Physiology measurements
 Brain activity electrocephalography (EEG)

 Heart rate
 Skin conductance Electrodermal activity (EDA)
 Electrical activity by skeletal muscles Electromyogram (EMG)

5
 Driver Drowsiness Detection
Function Benefits
 Detects driver drowsiness by  Reduction of sleep related crashes
analyzing the driving behavior
 Warns the driver if the risk is
high of falling asleep
Input
 Steering angle sensor
 Camera with lane assist
 Additional information, e.g.
vehicle speed, turn indicator
from CAN-bus
Output
 Drowsiness index

 Driver warning

6
 System Overview
High

Driver Drowsiness Detection Function

Detection of driver’s precision
steering
reduced guidance angle
ability Alternative sensor
Electric
Power
Steering
Drowsiness Index
via or
Camera w/
Lane Data

Warning via HMI

Adaption
(e.g. with a “beep”
of Driver
and/or an icon “cup”
Situational Context Additional bus data: on display of
Assistance
(Duration, Monotony……) systems
instrument panel)

Vehicle Speed, Yaw Rate

Turn Indicator,…

7
 Steering patterns as a drowsiness indicator
With decreasing concentration human fine motor skills are reduced, resulting in a lack of
small steering corrections and a less precise steering behavior.
In the extreme case of a micro-sleep event, the following sequence of human motor-related
reactions can be observed:
• Steering angle remains nearly constant
• Eyes will be closed or gazing
• Eyes will be opened again
• Re-orientation phase
• Over-reactive correction of steering angle
These steering patterns occur during normal driving conditions but appear more frequently
when drowsiness level increases
Drowsiness Driver would
Steering angle Steering patterns Index Driver
information (indicate drowsiness) fall asleep
Warning
Warning
level
situational
information Time
Dead-Band-Event

• Drowsiness warning is possible prior to occurrence of micro sleep events due to the ability to
detect and evaluate specific steering patterns

8
 Summary

 Drowsiness is one major reason for serious collisions

 The Bosch system operates by analyzing the driver’s steering behavior

 Identifies steering patterns where the driver does not steer for a brief period
and then makes an abrupt steering correction

 System combines the frequency and strength of these reactions with other
data, such as vehicle speed and duration of travel, to calculate a drowsiness
index

 Driver Drowsiness Detection identifies when a driver is at risk of falling

asleep and sends a warning