DEEP LEARNING BASED INTELLIGENT DRIVER

MONITORING SYSTEM
A PROJECT SERVEY REPORT
submitted in partial fulfillment of the requirements
for the award of

BACHELOR OF TECHNOLOGY
in

ELECTRONICS & COMMUNICATION ENGINEERING

by

V. RAMYA SREE (19761A0461)

S.VENU GOPAL (19761A0451)
D.VINOD (19761A0413)

Under the Guidance of

Ms.T.KALPANA
Sr.Asst.Professor

DEPARTMENT OF ELECTRONICS & COMMUNICATION ENGINEERING

LAKIREDDY BALI REDDY COLLEGE OF ENGINEERING
(AUTONOMOUS)
L.B.Reddy Nagar, Mylavaram – 521 230.
Affiliated to JNTUK, Kakinada & Approved by AICTE, New Delhi
Accredited by NBA(under tier-I) and NAAC
Certified by ISO 21001:2018
2022- 2023
 A SURVEY REPORT ON

DEEP LEARNING BASED INTELLIGENT DRIVER

MONITORING SYSTEM

Team Members (Batch A20):

1.V.Ramya Sree(19761A0461)

2.S.Venu Gopal(19761A0451)

3.D.Vinod(19761A0413)

Under the Guidance of Head of the

Department Ms.T.Kalpana

Dr.Y.Amar Babu

Sr.Asst.Professor
Contents:

• Introduction and Motivation

• Objective

• Literature survey

• Problem Statement

• Abstract

• Block Diagram

• Reference
 Introduction and Motivation

Recently many accidents caused by driver distractions varies day by day

and can be influenced by several factors, such as the number of drivers on the
road, the time of day, weather conditions, and driver behavior. However,
according to the National Highway Traffic Safety Administration (NHTSA),
distracted driving is a significant problem on U.S. roads, and it contributes to
many accidents each day. In 2019, distracted driving was a factor in 8.7% of all
fatal crashes and 15.8% of all crashes resulting in injuries in the United States.
On average, this equates to around 10 deaths and 1,000 injuries per day caused
by distracted driving. Driver distractions can include a variety of behaviors, such
as using a cell phone or other electronic device, eating or drinking, adjusting the
radio or music, talking with passengers, or even daydreaming. These behaviors
can cause drivers to take their eyes off the road, hands off the wheel, or minds
off the task of driving, increasing the risk of accidents.

Drowsiness and using a mobile phone while driving are both significant risk
factors for accidents. Both can lead to distracted driving, reduced reaction time, and
impaired judgment, which can increase the likelihood of an accident. Driving while
drowsy can be just as dangerous as driving under the influence of drugs or alcohol.
According to the National Sleep Foundation, drowsy driving is responsible for an
estimated 100,000 accidents each year in the United States alone, resulting in 1,550
deaths and 71,000 injuries. Signs of drowsy driving include yawning, difficulty staying
focused, and drifting out of your lane. Using a mobile phone while driving is also a
major cause of accidents. According to the National Highway Traffic Safety
Administration, in 2019, distracted driving (which includes the use of mobile phones)
was a factor in 8.7% of all fatal crashes and 7.2% of all crashes resulting in injury.
Even using a hands-free device can be distracting and can take your attention away
from the road.
 Objective

Previous drowsiness discovery systems, similar as Electroencephalography

(EEG) and Electrocardiography (ECG), which gives brain frequency and measure
heart meter, independently, bear complex calculation and precious outfit that's
uncomfortable to wear while driving and isn't suitable for driving conditions. Our
proposed method is to design and develop a low-cost system for monitoring of the
driver distractions and alerting. Most existing method for driver alerting system rely
on either drowsiness detection or mobile detection or object detection. This method
combines both drowsiness and object detection systems. In this proposed system the
main objective is to increase the accuracy rate, than that of before systems.
 Literature Survey
S.NO AUTHOR METHODOLOG RESULT LIMITATION
Y

1. IEEE Amin Azizi Image processing Drowsiness The design is only

Suhaiman using OpenCV. detection with a proposed to detect
Explorer
80% accuracy the driver
(2020 rate. drowsiness not for
object detection
and gives less
accuracy due to
bad light
condition
2. IEEE Rahul Multitask Learning The accuracy 1.if the mouth and
Seetharaman with Neural rate for eyes are small
Explorer
Networks. multitask then it is difficult
(2020) learning was to detect.
above 95% for 2.the model only
all features. trained with given
dataset
3.IEEE Prabas Image Processing 80% accuracy The accuracy
Gayadeeptha using Raspberry for all functions decreased due to
Explorer
but 76% for raspberry pi
(2019) overspeed
detection
4. IEEE Chandan G Deep Learning with An average Only detects the
OpenCV accuracy of objects
Explorer
99% was
(2018) obtained for
some classes.
5 IEEE C. -Y. Lin Machine Learning Achieved 91% Only detects
accuracy drowsiness of the
Explorer
driver.
(2018)

6.  IJESC  Sampa Jana Three-Frame Using object It does not detect

algorithm using tracking and the drowsiness of
(2017)
raspberry pi detection, the driver.
different
objects on a
given video or
picture are
detected for
motion.
7. IEEE Fabio Tango Machine learning This work has Gives less
techniques SVM, provided an accuracy when
Explorer
FFNN, LRNN, and overview of wearing glasses.
(2013) ANFIS various ML-
based driver
distraction
classifiers.
8. IJRTE M. S. H. S. Bahari Deep learning with The suggested Gives less
computer vision VGG16network accuracy
(2022)
gives 96%
accuracy on the
test dataset
pictures.

9. IEEE Kriti Verma Image processing The real-time Taking more time
using viola-jones detection of eye to give alarm
Explorer
algorithm. and yawning sound and can’t
(2021)
using viola- be able to detect
jones in bad light
algorithm.
10. IEEE shruti Mohanty Python and dlib Accuracy rates It gives less
model for yawning accuracy in real-
Explorer
and eyes time.
(2019)
employing Dlib
were 93.25%
and 96.71% for
post videos.
 Problem Statement and Solution:

The major reason for road accidents is due to the driver unnecessary
distractions like drowsiness and using of mobile. According to the National Safety
Council (NSC), each year about 100,000 crashes, 71,000 injuries are happening due to
unnecessary distractions like using cell phones, drowsiness during driving. This rapid
road accidents leads to injuries, loss of properties, even deaths of people. It is essential
to monitor and analyze the driver’s behavior during driving time to detect the
distraction and to decrease the road accidents. So to detect the various kinds of
distractions like drowsiness, using of mobile , deep learning plays significant role.
 Abstract

Driver fatigue and cell phone usage are major causes of accidents, leading to
thousands of crashes and injuries each year. According to the National Safety Council, each
year about 100,000 crashes, 71,000 injuries are happening due to unnecessary distractions like
using cell phones, drowsiness during driving. Thus, it becomes necessary to develop an
intelligent driver monitoring and alerting system to reduce the accidents by analyzing and
extracting specific features from the face, such as eye closure, head position and mouth
opening. This system is not only monitors the drowsiness it also detects objects like mobile,
alcohol or water or any other bottle present in the video frames. Previously many systems are
proposed using raspberry pi, with accuracy of 72 percent and by some of the deep learning
algorithms the accuracy can be improved further. This paper explains about various detection
methods based on python, dlib, OpenCV and some of the deep learning algorithms.
 Flow Chart:

Existing system:

Proposed system:
 References

1. Amin Azizi Suhaiman, Zazilah May, and Noor A’in A Rahman. Development of an intelligent drowsiness
detection system for drivers using image processing technique. In 2020 IEEE Student Conference on
Research and Development (SCOReD), pages 233–236. IEEE, 2020.
2. Rahul Seetharaman, Sashank Sridhar, and Siddartha Mootha. Detection and state analysis of drowsiness
using multitask learning with neural networks. In 2020 Fourth International Conference On Intelligent
Computing in Data Sciences (ICDS), pages 1–8. IEEE, 2020.
3. Prabas Gayadeeptha, Tharindu Pushpitha Baddewithana, Kalpana Vijintha Pannegama, Chamari
Sandarekha Samarakkody, Pradeepa Samarasinghe, and Samanthi Siriwardana. Eyedriver: Intelligent
driver assistance system. In 2019 14th Conference on Industrial and Information Systems (ICIIS), pages
272–277. IEEE, 2019.
4. G Chandan, Ayush Jain, Harsh Jain, et al. Real time object detection and tracking using deep learning and
opencv. In 2018 International Conference on inventive research in computing applications (ICIRCA),
pages 1305–1308. IEEE, 2018.
5. Yan, L., Yin-He, S., Qian, Y., Zhi-Yu, S., Chun-Zi, W., & Zi-Yun, L.
(2021). Method of Reaching Consensus on Probability of Food Safety Based on
the Integration of Finite Credible Data on Block Chain. IEEE Access, 9,
123764–123776. doi:10.1109/access.2021.3108178
6. Sampa Jana, Shubhangi Borkar, and ME Student. Autonomous object detection and tracking using
raspberry pi. International Journal of Engineering Science, 14145, 2017.
7. Fabio Tango and Marco Botta. Real-time detection system of driver distraction using machine learning.
IEEE Transactions on Intelligent Transportation Systems, 14(2):894–905, 2013.
8. Muhammad Saiful Haqem Saiful Bahari and Lucyantie Mazalan. Distracted driver detection using deep
learning. In 2022 IEEE 18th International Colloquium on Signal Processing & Applications (CSPA), pages
198–203. IEEE, 2022.
9. Kriti Verma, Mehak Beakta, Pragati Srivastava, and Nafis Uddin Khan. A non-intrusive approach for
driver’s drowsiness detection. In 2020 Sixth International Conference on Parallel, Distributed and Grid
Computing (PDGC), pages 501–505. IEEE, 2020.
10. Sri Krishna HV, Tarun Srinivas, and Kedarnath R Gubbi. Real-time drowsiness detection (rtd2). Available
at SSRN 4221743.