REAL TIME DRIVER’S CONSCIOUSNESS
DETECTOR
Saptarshi Bhattacharya Sudhanshu Ranjan
Dept. of Computing Technologies Dept. of Computing
Technologies
SRM Institute of Science and Technology SRM Institute of Science and Technology SRM Institute of Science and Technology
Kattankulathur, Tamil Nadu- Kattankulathur, Tamil Nadu-
603203, India 603203, India
Abstract—Drowsy or drunk driving poses significant risks to
drivers, passengers, and pedestrians. A research paper explores
using physiological indicators like eye size, eye openness, and
head movements to detect driver consciousness levels and signs
of drunkenness. Real-time data from onboard cameras is
analysed by the research using machine learning methods and
enhanced image processing. The study article explores
physiological indica- tions as well as the creation of an all-
encompassing framework for real-time assessment of driver
impairment. This paradigm takes into account contextual aspects
including driving patterns, vehicle dynamics, and ambient
circumstances in addition to the examination of individual
physiological signs. The objective of this study is to improve the
precision and dependability of identi- fying intoxication or
sleepiness by including these complex factors into the analysis.
The research also looks at using sophisticated feature extraction
and fusion techniques, which would allow the system to detect
minute behavioural changes in drivers that might be signs of
impairment. A coherent picture of the driving state is created by
combining pertinent characteristics extracted from the data
streams using techniques like sensor fusion and deep learning.
Thanks to this all-encompassing strategy, the system can adjust
to various driving conditions and distinguish between typical
fluctuations and indications of impairment.
The study also tackles issues like computing efficiency, re-
silience against noise in the environment, and privacy problems
that arise when implementing such systems in the real world. The
study intends to make it easier to integrate these technologies into
current automobile platforms without incurring a large overhead
by creating lightweight algorithms and optimising computing
resources.
I. INTRODUCTION
The face is a crucial physical characteristic that conveys a
great deal of information. The facial expressions of a regular
motorist differ from those of a weary driver. For example,
a tired driver may yawn and blink more often than normal.
Even if driverless cars will soon become mainstream, human
drivers will still be needed for some time to come. Studies
have shown that alcohol use results in observable changes to
the patterns of eye movement and emotions on the face[24].
Drinking alcohol is also linked to fatigue and sleepiness. It is
possible to evaluate these variances by looking at images of
people who are both sober and drunk. Being aware of the
warning symptoms of weariness and exhaustion is crucial to
reducing your risk of being involved in an accident, since
driver drowsiness is one of the most common causes of
accidents on today’s roadways. Consequently, the number of
Dr.P.Nancy
Faculty of Engineering and Technology
Kattankulathur, Tamil Nadu-603203,
India
injuries and deaths is rising.globally every year. Drunk driving
poses a serious danger to both drivers and pedestrians. Every
year, about 1.25 million people die in auto accidents. For
those between the ages of 15 and 29, traffic accidents are the
main cause of mortality [25]. Almost forty percent of traffic
accidents are the result of drunk driving [26]. Over the last
10 years, a number of image processing-based methods for
recognising intoxicated drivers have been developed and put
into use. The study’s findings have prompted the suggestion
of a strategy to reduce the number of accidents. The approach
primarily focuses on head motions and the ratios of yawning
to eye closure. Things may not be right if the driver seems to
be dozing off or intoxicated.
This research used a technique known as ”eye localization,”
which comprises analysing a face picture and identifying
the eyes using the Matlab programme. After establishing the
subject’s location, the apparatus can ascertain whether or not
their eyes are open. It could also be able to detect fatigue
indicators. The goal of this research is to identify fatigued
driving in order to improve traffic safety and reduce
collisions. Using a camera aimed straight at the driver, one
technique to gauge driver weariness is to capture a real-time
image of the driver’s face. When the video is finished, watch
for indications of fatigue in the subject’s eyes and face. The
head motions of the driver are also observed.
The gadget monitors your eyes to detect the condition of your
eyelids, including whether they are open or closed. In order to
alert drivers to the situation when drunkenness is detected, a
warning light is activated. The fraction of the whole time that
an eye is closed at any specific point may be expressed. When
the eyelid closures happen more often than a preset threshold,
the system recognises driver weariness. An alarm will thus
sound to wake them.
II. LITERATURE SURVEY
This study looked at a technique for identifying variations
in a driver’s level of eye openness. There is a strong
correlation between eye-opening variations and fatigue. This
method finds alterations in the physical characteristics of
physiological func- tions. This strategy was chosen because
early identification at the onset and a high degree of detection
accuracy comparable
to methods based on physiological indicators would be nec-
essary for a functional drowsiness detection system. This was
one of the factors in the decision to use this tactic. The device
must also have the ability to identify driver fatigue through a
noncontact approach.
In order to reduce accidents worldwide, we are currently
de- veloping an intelligent system that can correctly identify
both drunkenness and sleepiness. In order to conduct this
study, a real-time smartphone application would assess a
subject’s awareness by analyzing their facial patterns.
(Whether the individual is inebriated from alcohol, sleepy
from alcohol, or both) The following are the benefits of our
suggested system over the current one: The system
continuously monitors the user’s consciousness and allows
real-time detection; it detects fatigue or intoxication and
sounds an alarm to alert the user; The previous method was
less secure than this one since it was more straightforward to
identify drunkenness and drowsiness. The program will be
easier to use if the detecting systems are combined into a
single application. Both Studies A and B (Van Dongen et
al., 2011a and 2011b) were carried out in a laboratory
setting using a high-fidelity driving simulator (Van Dongen et
al., 2010). Since the designs of these studies are similar, we
will discuss them all together in this section. Eyelid factors
and support vector machines are used to detect driver
tiredness. The EOG experimental data is used to derive the
eyelid movement characteristics required for SVM training
and validation. The initial step involves locating eye blinks in
the EOG data. The blinks are preserved when the two EOG
vertical channels are combined into one channel during the
averaging process. 95 percent of the blinks could be reliably
identified after the combined signal was analysed. This
amount was thought to be adequate for the investigation
carried out in the section that follows.
This device uses an infrared camera to assess the driver’s
condition in both daylight and nighttime conditions.
Symmetry is used as the fundamental idea in the
recognition of faces and eyes. The choice of eye states is
made using the Hough Transform for Circles.
We looked at three driving datasets, each of which included
drivers with varying degrees of sleep deprivation and
classified every minute of driving as fatigued or awake.
HRV served as the basis for two different sleepiness detectors
that we developed. A driver’s fitness to drive was
determined by the sleep-deprivation detector, while the
drowsiness episodes detector classified each minute of driving
as ”awake” or ”drowsy” based on seven HRV-derived
parameters (positive predictive value 0.96, sensitivity 0.59,
and specificity 0.98 on 3475 min of driving). This category
was decided by how little sleep the driver had had before
the driving session began. In order to establish if a
participant was experiencing sleep deprivation, just one HRV
component was used for the first three minutes of driving
(positive predictive:-0.80, sensitivity:- 0.62, specificity 0.88
on 30 drivers).
The study offers a thorough analysis of the technologies and
procedures now in use for ethanol intoxication detection, with
an emphasis on their advantages, disadvantages, and
possible uses. The authors assess a wide range of sensor-based
techniques, such as breath analyzers, wearable biosensors,
bio- chemical assays, and computer vision systems, through a
thor- ough examination of the literature. Each sensing
technique’s guiding principles are covered in the article, with
special atten- tion paid to each one’s sensitivity, specificity,
response time, and mobility. The authors also examine the
practical aspects of ethanol detection, including cost-
effectiveness, regulatory compliance, and calibration needs.
The paper provides useful insights into developing and
deploying alcohol detection tech- nologies for various
settings, such as transportation, workplace safety, and law
enforcement, by synthesizing the current state- of-the-art in
ethanol intoxication sensing.
This offers a novel method for identifying alcohol in-
toxication by employing neural networks to analyze speech
patterns. The study explores the connection between drinking
alcohol and changes in speech traits such as pitch variation,
articulation clarity, and speech pace. Based on these attributes,
the research suggests a methodology for automatically identi-
fying drunken speech using improvements in machine learn-
ing, namely neural network models. By utilizing supervised
learning algorithms and feature extraction approaches, the
system gains the ability to accurately distinguish between
speech samples that are drunk and those that are not. The
study also addresses the usefulness of speech-based intoxica-
tion detection in a variety of settings, such as public health
campaigns, occupational safety, and law enforcement. The re-
search advances the creation of non-intrusive, real-time
alcohol intoxication detection systems that can improve safety
and reduce the hazards related to impaired behavior by
combining insights from speech analysis and artificial
intelligence.
III. METHODOLOGY
We use a simple general pattern to determine if someone is
tired or not.
1. A moving video feed is initially set up on a camera to
look for faces.
2. After locating a face, the eye regions could be retrieved
using facial landmark detection.
3. The regions around the eyes are inspected in order to
establish the eye aspect ratio, which is then utilised to assess
whether or not the eyes are closed.
4. The alarm is activated to wake the driver awake if the
eye aspect ratio shows that they have been sleeping with their
eyes closed for an extended period of time. The pillion drivers
are also notified by the indicator lights. In this instance, the
eyelids had remained closed long enough.
Face Recognition:- First, the suggested approach will take
the form of taking individual video frames. The image that
best captures the person’s face will be chosen by the
computer. The HAAR face detection algorithm is used to
complete this challenge properly. The cascade file has to load
before the resultant frame can be forwarded to an edge
identification algorithm that looks for possible objects of
various sizes. Set the edge detector to only detect objects that
fit into a specific
size range, like the face region, rather than trying to detect
features at any size.
HAAR Cascade Classifier:- It was among the first meth-
ods of recognizing a face, especially a driver’s. One of the few
methods for object identification combined with facial
recognition. Paul Viola and Michael Jones came up with
this scheme. It gains knowledge from hundreds of images of
various people’s faces taken in various lighting conditions.
The validation process for the HAAR Cascade Classifier
involved ten participants. Region of Interest:- A zone of
interest (ROI) can be used to obtain a driver’s face recognition
more accurately. T= (100-—FC/2—)/100 is the equation for
changing temperature, where FC is the face degree and T is
the temperature. The angles created when two parallel lines
intersect are known as face degrees.
Eye Detection:- The eyes identification function looks for
the driver’s eyes after the face detection function correctly
recognizes the driver’s face. Once the face has been identified,
the eye region needs to be found. Keep in mind that the eyes
are limited to the upper portion of the face. You can see the
Region of Interest (ROI) around the eyes after removing the
lips and hair from the upper edge of the face. Results are more
accurate when the processing speed is increased flow and
position estimation are two examples of algorithms that can be
used to extract useful characteristics from video footage.
Eye State and Drowsiness Detection Finding out if the
person’s eyes were open or closed during the pertinent time
period is the first step in diagnosing sleepiness. When driving,
the Eye Aspect Ratio (EAR) is used to measure whether the

driver’s eyes are open or closed. The Euclidean formula is
used to calculate the EAR using the separation between the
critical locations on the eyes. This connection is expressed by
the following equation, which is the Eye Aspect Ratio (EAR):
In this equation, the denominator indicates the distance
between horizontal eye landmarks and the numerator
indicates the distance between vertical eye landmarks.A
recommended threshold of 300 has been established for the
model. When the EAR falls below 300, the driver is
considered tired and
should not be operating a vehicle.
Head Movement Detection: To track the driver’s head
motions in real time, incorporate a head movement detection
module. Analyze changes in head orientation, tilt, and move-
ment speed using computer vision algorithms.
Fatigue detection: Use drowsiness and facial recognition
with HAAR Cascade facial markers to detect fatigue. It
identifies the temporal shift between frames in a sample and
extracts a discriminative representation for the aligned faces.
Real-time Alerting and Intervention: Put in place a real-time
alerting system to inform the driver and other passengers as
soon as indicators of weariness or intoxication are noticed.
Use visual indicators and aural alarms to notify the driver
when to take a break or give over control to a co-driver,
among other corrective measures.
CONCLUSION
In summary, the integration of head movement analysis,
intoxication detection, and tiredness detection with the driver
monitoring system aims to enhance road safety and mitigate
the potential hazards associated with intoxicated or sleep-
deprived drivers. The goal of this system is to avoid accidents
by analysing driver behaviour in real-time and delivering
timely warnings and interventions via the use of machine
learning algorithms and powerful computer vision methods.
The process of detecting impairments is facilitated by head
movement analysis, which records additional indications such
head orientation, tilt, and movement speed. In order to facil-
itate proactive intervention, intoxication detection algorithms
categorise both sober and inebriated head motions. By linking
differences in head movement patterns to tiredness-related
symptoms, fatigue detection enhances the system’s capacity to
recognise sleepiness indicators. The technology can save lives
and greatly increase road safety, but further study and
development is required to enhance its use and performance in
a variety of driving scenarios and demographics.
REFERENCES
[1] Sahayadhas, Arun, Kenneth Sundaraj, and Murugappan Murugappan.
”Detecting driver drowsiness based on sensors: a review.” Sensors 12.12
(2012): 16937-16953.
[2] Ueno, Hiroshi, Masayuki Kaneda, and Masataka Tsukino.
”Development of drowsiness detection system.” Proceedings of
VNIS’94-1994 Vehicle Navigation and Information Systems
Conference. IEEE, 1994.
[3] Ramzan, Muhammad, et al. ”A survey on state-of-the-art drowsiness
detection techniques.” IEEE Access 7 (2019): 61904-61919.
[4] Santamaria, Joan, and Keith H. Chiappa. ”The EEG of drowsiness in
normal adults.” Journal of clinical Neurophysiology 4.4 (1987): 327-382.
[5] Flores, M.J., Armingol, J.M. and de la Escalera, A., 2008, June. Real-
time drowsiness detection system for an intelligent vehicle. In 2008
IEEE Intelligent Vehicles Symposium (pp. 637-642). IEEE.
[6] Cˇ olic´, A., Marques, O. and Furht, B., 2014. Driver drowsiness detection:
Systems and solutions (p. 55). Cham, Switzerland: Springer
International Publishing.
[7] Siddiqui, H.U.R., Saleem, A.A., Brown, R., Bademci, B., Lee, E., Rus-
tam, F. and Dudley, S., 2021. Non-invasive driver drowsiness detection
system. Sensors, 21(14), p.4833.
[8] Yan, J.J., Kuo, H.H., Lin, Y.F. and Liao, T.L., 2016, July. Real-time
driver drowsiness detection system based on PERCLOS and grayscale
image processing. In 2016 International Symposium on Computer,
Consumer and Control (IS3C) (pp. 243-246). IEEE.
[9] Poursadeghiyan, M., Mazloumi, A., Saraji, G.N., Baneshi, M.M., Kham-
mar, A. and Ebrahimi, M.H., 2018. Using image processing in the
proposed drowsiness detection system design. Iranian journal of public
health, 47(9), p.1371.
[10] Ramzan, M., Khan, H.U., Awan, S.M., Ismail, A., Ilyas, M. and
Mahmood, A., 2019. A survey on state-of-the-art drowsiness detection
techniques. IEEE Access, 7, pp.61904-61919.
[11] Ngxande, M., Tapamo, J.R. and Burke, M., 2017. Driver drowsiness
detection using behavioral measures and machine learning techniques:
A review of state-of-art techniques. 2017 Pattern Recognition
Association of South Africa and Robotics and Mechatronics (PRASA-
RobMech), pp.156-161.
[12] Saini, V. and Saini, R., 2014. Driver drowsiness detection system and
techniques: a review. International Journal of Computer Science and
Information Technologies, 5(3), pp.4245-4249.
[13] Alshaqaqi, B., Baquhaizel, A.S., Ouis, M.E.A., Boumehed, M., Ouamri,
A. and Keche, M., 2013, May. Driver drowsiness detection system. In
2013 8th International Workshop on Systems, Signal Processing and
their Applications (WoSSPA) (pp. 151-155). IEEE.
[14] Deng, W. and Wu, R., 2019. Real-time driver-drowsiness detection
system using facial features. Ieee Access, 7, pp.118727-118738.
[15] Stancin, I., Cifrek, M. and Jovic, A., 2021. A review of EEG signal
features and their application in driver drowsiness detection systems.
Sensors, 21(11), p.3786.
[16] Park, S., Pan, F., Kang, S. and Yoo, C.D., 2016, November. Driver
drowsiness detection system based on feature representation learning
using various deep networks. In Asian Conference on Computer Vision
(pp. 154-164). Springer, Cham.
[17] Mohanty, S., Hegde, S.V., Prasad, S. and Manikandan, J., 2019, Novem-
ber. Design of real-time drowsiness detection system using dlib. In 2019
IEEE International WIE Conference on Electrical and Computer
Engineering (WIECON-ECE) (pp. 1-4). IEEE.
[18] Samiee, S., Azadi, S., Kazemi, R., Nahvi, A. and Eichberger, A.,
2014. Data fusion to develop a driver drowsiness detection system with
robustness to signal loss. Sensors, 14(9), pp.17832-17847.
[19] Sałapatek, D., Dybała, J., Czapski, P. and Skalski, P., 2017. Driver
drowsiness detection systems. Zeszyty Naukowe Instytutu Po- jazdo
´w/Politechnika Warszawska, 3(112), pp.41-48.
[20] Hashemi, M., Mirrashid, A. and Beheshti Shirazi, A., 2020. Driver
safety development: Real-time driver drowsiness detection system based
on convolutional neural network. SN Computer Science, 1(5), pp.1-10.
[21] Mehta, S., Dadhich, S., Gumber, S. and Jadhav Bhatt, A., 2019,
February. Real-time driver drowsiness detection system using eye aspect
ratio and eye closure ratio. In Proceedings of international conference
on sustainable computing in science, technology and management
(SUS- COM), Amity University Rajasthan, Jaipur-India.
[22] Global status report on road safety 2015. 2015. World Health Organi-
zation: Geneva, Switzerland, 2015.
[23] Drinking, Driving: A Road Safety Manual for Decision-Makers, and
Practitioners. 2007. Global Road Safety Partnership, Geneva, Switzer-
land.