IJIRST –International Journal for Innovative Research in Science & Technology| Volume 1 | Issue 11 | April 2015

ISSN (online): 2349-6010

Detection of Drowsiness and Fatigue level of

Driver
Shreya P. Patel Bhumika P. Patel
Department of Computer Engineering Department of Computer Engineering
Shri S’ad Vidya Mandal Institute of Technology, Bharuch, Shri S’ad Vidya Mandal Institute of Technology, Bharuch,
India India

Madhu Sharma Nisha Shukla

Department of Computer Engineering Department of Computer Engineering
Shri S’ad Vidya Mandal Institute of Technology, Bharuch, Shri S’ad Vidya Mandal Institute of Technology, Bharuch,
India India

Hinaxi M. Patel
Department of Computer Engineering
Shri S’ad Vidya Mandal Institute of Technology, Bharuch, India

Abstract
Driver’s inattentiveness is one of the main causes for most accidents related to vehicle crashes. Safe driving is the major concept
in the societies to reduce accidents. Long distance driving cause driver fatigue due to which heavy accident occurs of vehicles
like cars, aero planes, trucks etc. So it is very necessary to prevent the accidents all over the world. This paper presents the
procedure of driver’s drowsiness detection system which measures the drowsiness and fatigue level of driver. An initial buzzer is
used to alert the driver after the system detects that the driver is in drowsy condition. In this system a camera is placed in front of
driver’s face in car which records the video of driver. The MATLAB will be used to detect the eye of driver that is conducted
using the process of extraction of face image from the live video and in case if it detects the eye closure for certain threshold time
period then it beeps the alarm to aware driver. We also describe the procedure to measure the open and close of eye so from that
we can accurately detect the drowsiness and fatigue level. The main criteria of this system must be that it is highly non-intrusive
and the driver should not be responsible to give any kind of feedback to system.
Keywords: Inattentiveness, fatigue, drowsiness, threshold, detection system
_______________________________________________________________________________________________________

I. INTRODUCTION
In today’s world where Science and Technology has made amazing advances, the innovations in automobile industries over
hundred years should be considered as it have made our vehicles more powerful, easier to drive and control, more-safer and
environmentally friendly[1]. But the increasing number of road vehicle accidents is the crucial problem in the world. One of the
most important factor of vehicle crashes is the driver fatigue and monotony. Furthermore, the accidents related to the driver’s
drowsiness or fatigue is more dangerous and serious than other types of accidents , as the sleepy driver do not take the correct
prior action against the collision. Generally the 20% of crashes and 30% of fatal crashes are occur due to driver’s drowsiness and
lack of concentration. Recent statistics shows that more than 1,500 deaths and around 80,000 injuries are due to fatigue related
accidents. As per the survey reports of Road Traffic Injuries (RTI) the road accident ranked fourth among the leading causes of
death in the world. Nearly 1.3 million people [2] die every year on the world's roads and 20 to 50 million people suffer non-fatal
injuries, with many sustaining a disability as a result of their injury. According to forecasting of statistics the number of road
accident will increase to 5 million in 2020 [3]. Driver’s inattention might be the result of lack of alertness while driving due to
the driver’s drowsiness and distraction. So the prevention of such crucial crashes is the main focus effort in the field of active
safety research.
The advancement in the field of computer technology has provided the means for building the intelligent drowsiness and
fatigue detection system. Driver drowsiness detection system is one of the best application of intelligent vehicle system [4]. The
main aim of this paper is to develop a prototype [5] of driver’s drowsiness and fatigue detection system with a warning alarm.
Our whole focus will be placed on designing the drowsy detection system that will accurately monitor the open and closed state
of the driver’s eye in real time [1]. By continuously monitoring the eyes, it can be seen that the symptoms of driver’s drowsy
behavior can be detected early enough to prevent the crashes. “Fig.1” shows the overall flow of our system. Based on the image
acquisition of video from camera which is placed in front of the driver’s face perform real time processing of video stream in
order to get frames from which we detect the driver’s face for the further detection of eyes from it [6]. So that we can track the

All rights reserved by www.ijirst.org 133

 Detection of Drowsiness and Fatigue level of Driver
(IJIRST/ Volume 1 / Issue 11 / 023)

blinks of driver from eyes and after as we get driver eyes closed in continuously 4-5 frames then we can say that driver is in
drowsy state and the warning alarm beeps to alert the driver and thus it avoid crucial accidents.

Fig. 1: System Flow

II. PROPOSED SYSTEM

A. Face Recognition:

Face detection is a process that aims to locate a human face in an image. Face recognition is a necessary step in all face
processing system, and its overall performance of drowsiness detection systems. To begin tracking a face, we have to first detect
it. We use vision.CascadeObjectDetector to detect the face in video frame. By this command only the face is detected from video
frame. The best Face detection is done by Viola-Jones method developed by Paul Viola and Michael Jones.

Fig. 2: Detected face from a input video

Object Detection by Paul Viola and Michael Jones can be done method like Simple rectangular features named Haar-like
features, an Integral image, AdaBoost machine-learning and Cascaded classifier [16].
1) Haar-Like Features:
This feature considers rectangular regions at a location in detection window. The advantage of haar-like features is its calculation
speed. Due to haar-like feature any size can be calculated at constant time. Haar-like features can be expressed by two or three
joins-black and white. Rectangle feature can indicate whether the border lies between dark region and light region [16].

All rights reserved by www.ijirst.org 134

 Detection of Drowsiness and Fatigue level of Driver
(IJIRST/ Volume 1 / Issue 11 / 023)

Fig. 3: Haar-like features

2) Integral Image:
Integral image is also known as summed area table. It is used to compute Haar-like rectangle feature. It is an array containing
sums of pixel. Calculating a feature is very fast and efficient. The integral value of each pixel is sum of all pixel to its top left
[16]. The formula for integral image is given below:
ii (x , y) =

where ii(x ,y) is the integral image at pixel location (x,y) and i(x,y) is the original image. To compute the sum of any
rectangular area is extremely efficient using the integral image.

Fig. 4: Summed area of integral image

3) Adaboost-Machine Leaning:
"Adaptive Boosting" is a machine learning method given by Yoav Freund and Schapire. In AdaBoost learning method, the sums
of pixel in white boxes are subtracted from the sum of pixel black areas. The machine creates a set of Haar-like features [16].

B. Eye Tracking:

The experimental results on eye detection are based on the assumption that eye regions eye regions from video frame are
corrected located. PERCLOS Percentage of Eye Closure over time) is most useful method for measuring eye blinking. We can
determine that if eyes is open, then the condition is normal and if the eyes are closed then a alarm signal is generated to alert the
driver. We need to detect the eye region because we have to examine eye to know whether the person feels sleepy or not.

Fig. 5: Tracking eyes from a input video

C. Eye Template Creation:

The eyes to be located at a proper place in the taken video frame so that the size of template is created accurate tracking. The
system will track user's open eye located in template. Eye blinking is the time difference between the beginning and the end of
the blink. Once the eye is located, a timer is started to generated whether the driver's eyes are open or closed.

Fig. 6: Eye Template

All rights reserved by www.ijirst.org 135

 Detection of Drowsiness and Fatigue level of Driver
(IJIRST/ Volume 1 / Issue 11 / 023)

D. Blink Detection:

Eye blink is a quick action of closing and opening of the eyelids. Eye blink detection has a wide range of applications in human
computer interface (HCI) systems. It can also be used in driver’s assistance systems. This proposed method detects visual
changes in eye locations using the proposed horizontal symmetry feature of the eyes. Our new method detects eye blinks via a
standard webcam in real-time.
We give overview of different techniques to the problem and describes best possible methods of eye blink detection
techniques. The main propose system is the motion analysis method and finding frame difference used for tracking intentionally
blink of eyes.
We are using some Parameters to describe the blink behaviour:
 Blink Interval
 Blink Duration
1) Blink Duration:
A common definition of Blink Duration is the time difference between the beginning and the end of the blink, where the
beginning and end points are measured at the point where half the amplitude is reached.
A better definition of blink duration is the sum of half the rise time and half the fall time in the blink complex.
2) Blink Interval:
A common definition of Blink Interval is the time difference between the beginnings of two successive blinks.

Fig. 7: Blink Templates

III. CONCLUSION
In this, a driver’s drowsiness detection system has been proposed based on fatigue detection. The proposed system is based on
eyes closer, blinking rate of eye detection of the driver. The system continuously captures the image of the subject on site and
detects face region, then eyes are detected in the face under consideration to determine if eyes are closed or open, if eyes found to
be closed for 4-5 consecutive frames or blinking rate of is found to be abnormal for long duration, for 3-4 consecutive frames
then it is concluded that the subject is falling asleep or having state of drowsiness therefore fatigue is detected and a warning
alarm issued.
The proposed system can be applied in applications like in software industries where developers works continuously for 14-15
hours to detect their vigilance level, for computer operators, operating critical operations on distant machines, hands free
interaction with computational devices/machines, controlling heavy machineries like cranes etc.

IV. FUTURE WORK

The first and foremost improvement that can be made is to make the system work in real time where the system takes the input
video directly from the camera and detect whether the driver is drowsy or not. If the driver is drowsy it gives the voice alert to
the driver. If the driver is not drowsy it will continue taking the video as input and perform the calculations.
The further improvement that could be made to the project is to determine a fixed threshold such that any face in any
illumination i.e in both light and dark could be given as input and the blink could be detected efficiently.
Another improvement that can be made is to reduce the computation time by designing an efficient and more accurate
algorithm.

A. Appendix:

Table -1:
Various Techniques of Drowsiness Detection
APPLICATION PUBLICATION
AUTHOR TITLE CENTRAL IDEA
AREA YEAR
Mitesh Patel, Sara For Driver’s eyes detection the iris is
Fatigue Detection
Lal, Diarmuid detected from the eyes using binary
Using Computer
Kavanag, Peter MAY 2010 image. Face detection takes place using
Vision
Rossiter[7] skin segmentation technique.
Cha Zhang and A Survey of Recent The Viola Jones face detector technique

All rights reserved by www.ijirst.org 136

 Detection of Drowsiness and Fatigue level of Driver
(IJIRST/ Volume 1 / Issue 11 / 023)

Zhengyou Zhang[10] JUNE 2010 Advances in Face is used in this research paper. Viola
Detection Jones technique contains three basic
idea, The integral image, classifier
learning with AdaBoost, and the
attentional cascade structure.
Drowsiness
Detection for car The purpose of this paper is to detect
assisted driver drowsiness in driver accidents. The
Huong Nice
NOVEMBER system using image vision-based system have been widely
Quan[15]
2010 processing analysis- used. Feature-based, image-based,
interfacing with template matching approaches are used.
hardware
In this paper we will present a vision-
based smart environment using in-car
Detection of Demo: Vision based cameras that can be used for real time
Drowsiness and Hariri, B. Abtahi, S.,
AUGUEST smart in-car camera tracking and monitoring of a driver in
Fatigue Level of Shirmohammadi, S,
2011 system for driver order to detect the driver's drowsiness
Driver Martel, L.[19]
yawning detection based on yawning detection. System is
built on the top of an embedded
platform, called APEX.
In This sensor utilizes multiple receiver
architecture providing electronically
steered beam of a receiving antenna. A
Driver's drowsiness SSB modulation of the transmitted signal
Staszek, K. Wincza,
monitoring system has been applied to allow for beam
K. ; Gruszczynski, MAY 2012
utilizing microwave steering at the intermediate frequency.
S.[20]
Doppler sensor Investigations of the output signal have
been carried out in order to detect and
measure eye blink duration and eye
blink frequency.
Vision-based Real- In this paper the face and eyes are
time Driver Fatigue tracked from the captured video. In this
D.Jayanthi, OCTOBER
Detection System paper Eye-tracking is done using the
M.Bommy[17] 2012
for Efficient Vehicle method of Dynamic template matching.
Control
Ashish Bodanwar,
Sensors like alcohol sensor, IR sensor,
Rahul Mudpalliwar,
Drowsy Driving accelerometer is used for drowsiness
Vikrant Pawar,
APRIL 2013 Detection System detection and consumption of alcohol by
Kaustubh
driver.
Gaikwad[5]
Efficient eyes and
mouth detection This paper presents the Viola Jones
Ijaz Khan,
algorithm using improved algorithm for face, eyes and
Hadi Abdullah and
combination of mouth detection in the image form a
Mohd Shamian Bin JUNE 2013
Viola Jones and input video frame. Viola Jones and Skin
Zainal[13]
skin color pixel color pixel technique is used.
detection
K.Subhashini Driver's fatigue and drowsiness are the
Tracking of Eyes to
Spurjeon, major causes of accidents. PERCLOS
DECEMBER detect the Driver's
Yogesh (Percent of Eyelid Closure) technique is
2013 Drowsiness
Bahindwar[14] used.
Detection is based 2 parts: 1) Based on
Mohamed A. Fighting Accident
physiological measures 2) Based on the
Mohamed, A. I. Using Eye
physical measures. System is
Abdel-Fatah, Bassant AUGUST 2014 Detection for
implemented in combination with
M.El-Den[8] Smartphones
android environment.
Monitoring of Using of eyes blink rate of driver for
Vikash, Dr. N.C.
Driver Vigilance detection. They used Haar cascade
Barwar[3] MAY 2014
Using Viola- Jones library to detect facial features. The

All rights reserved by www.ijirst.org 137

 Detection of Drowsiness and Fatigue level of Driver
(IJIRST/ Volume 1 / Issue 11 / 023)

Technique programming is done using Open CV.

Head Pose and Eye
State Monitoring This paper presents visual analysis of
Vinay K Diddi, Prof NOVEMBER (HEM) for Driver eye index (EI), pupil activity (PA), and
S.B.Jamge[18] 2014 Drowsiness head pose(HP) for alertness of vehicle
Detection: driver.
Overview
A.N.Shewale, Real Time Driver The system uses Viola Jones algorithm
Pranita DECEMBER Drowsiness which detects images. Haar-like fetaure
Chaudhari[16] 2014 Detection System technique is used to detect face and eye.

REFERENCES
[1] Singh Himani Parmar, Mehul Jajal, Yadav Priyanka Brijbhan “Drowsy Driver Warning System Using Image Processing”
[2] Ruikar M. National statistics of road traffic accidents in India. J Orthop Traumatol Rehabil 2013.
[3] Vikash, Dr. N.C. Barwar “Monitoring of Driver Vigilance Using Viola- Jones Technique” International Journal of Application or Innovation in
Engineering & Management (IJAIEM) Volume 3, Issue 5, May 2014
[4] Monali V. Rajput, J. W. Bakal, PhD. “Execution Scheme for Driver Drowsiness Detection using Yawning Feature” International Journal of Computer
Applications Volume 62– No.6, January 2013
[5] Ashish Bodanwar, Rahul Mudpalliwar, Vikrant Pawar, Kaustubh Gaikwad “Drowsy Driving Detection System” International Journal of Engineering and
Advanced Technology (IJEAT), Volume-2, Issue-4, April 2013
[6] Vandna Saini “Driver Drowsiness Detection System and Techniques: A Review” (IJCSIT) International Journal of Computer Science and Information
Technologies, Vol. 5 (3), 2014
[7] Mitesh Patel, Sara Lal, Diarmuid Kavanag, Peter Rossiter “Fatigue Detection Using Computer Vision” INTL Journal of Electronics and
Telecommunications, 2010, VOL. 56
[8] Bassant M. El-Den “Fighting Accident Using Eye Detection for Smartphones” Int. Journal of Engineering Research and Applications Vol. 4, Issue 8(
Version 2), August 2014
[9] Dr.Suryaprasad J, Sandesh D, Saraswathi V, Swathi D, Manjunath S, "Real Time Drowsy Driver Detection Using Haarcascade Samples", PES Institute of
Technology-South Campus, Bangalore, India
[10] Cha Zhang and Zhengyou Zhang, "A Survey of Recent Advances in Face Detection", June 2010.
[11] Phillip Ian Wilson, Dr. John Fernandez-Texas A&M University – Corpus Christi 6300 Ocean Dr., Corpus Christi, TX 78412 (361-877-9062), "Facial
Feature Detection Using Haar Classifier", JCSC 21, 4 (April 2006)
[12] Yasaman Heydarzadeh, Abolfazl Toroghi Haghighat, "An Efficient Face Detection Method Using Adaboost and Facial Parts", Computer, IT and Electronic
department Azad University of Qazvin Tehran, Iran
[13] Ijaz Khan, Hadi Abdullah and Mohd Shamian Bin Zainal, "Efficient Eyes And Mouth Detection Algorithm Using Combination Of Viola Jones And Skin
Color Pixel Detection", University Tun Hussein Onn Malaysia, June 2013. Volume 3, No. 4
[14] K.Subhashini Spurjeon, Yogesh Bahindwar, "Tracking Of Eyes To Detect The Driver's Drowsiness", Department of Electronics and Telecommunication
SSGI, BHILAI, Chhattisgarh, INDIA, Volume 1, Issue 5, December 2013 International Journal of Research in Advent Technology
[15] Huong Nice Quan, "Drowsiness Detection for car assisted driver system using image processing analysis-interfacing with hardware", Faculty of Electrical
& Electronics Engineering University Malaysia Pahang, November 2010
[16] A.N.Shewale, Pranita Chaudhari, "Real Time Driver Drowsiness Detection System", International Journal of Advanced Research in Electrical, Electronics
and Instrumentation Engineering, Vol. 3, Issue 12, December 2014
[17] D.jayanthi, M.bonmmy, "Vision-based Real-time Driver Fatigue Detection System for Efficient Vehicle Control", International Journal of Engineering and
Advanced Technology (IJEAT) ISSN: 2249 – 8958, Volume-2, Issue-1, October 2012
[18] Vinay K Diddi, Prof S.B.Jamge, "Head Pose and Eye State Monitoring (HEM) for Driver Drowsiness Detection: Overview", IJISET - International Journal
of Innovative Science, Engineering & Technology, Vol. 1 Issue 9, November 2014
[19] http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=7041101&queryText%3Dto+detect+drowsiness+and+fatigue+level+of+driver
[20] http://ieeexplore.ieee.org/xpl/articleDetails.jsp?tp=&arnumber=6233616&queryText%3Dto+detect+drowsiness+and+fatigue+level+of+driver

All rights reserved by www.ijirst.org 138