Survey: Traffic light cycle
control using deep learning
Sourav Karmakar
Department of CSE
National Institute of Technology,Surathkal
Souravkarmakar.191cs252@nitk.edu.in
Abstract—Traffic problem is the main issue that we are
facing every day in our life. Our objective is to control the
whole signal system by assigning more time to the green
signal using deep reenforced learning. We plan to use
different snapshots of the vehicles and try to predict the
signal system. Study of image and their operations so that
the objects and automobiles can be studied thoroughly.
I. INTRODUCTION
[1]In this fast pace world, the problem that we are facing is
traffic overcrowding. High population and making use of
financial systems have considerably increased traffic
overcrowding. To decrease this problem of traffic the
government should encourage more public transport so that
a smaller number of vehicles are present avoid traffic
blockage in the road. Here we will discuss how we can
develop an efficient system where we can capture the images
of the vehicles, processing the data and then we can predict
when to calculate the vehicles.
II. BACKGROUND
[2]In unknown environment where we don’t know much
about data and the behaviour of the data with new results
therefore, we use Reinforcement Learning and Q-learning
Reinforcement. Feedback mechanism is performed and the
results are decided on the basis of positive and negative
results. Reinforcement learning is based on the optimal
solution not taking care of the intermediate results that are
produced while performing the actions whereas Q-learning
uses reinforcement in an incremental way and can be used
online. [3]A look up table is created where the actions that
are taken is paired with feedbacks that has been evaluated.
The final point of this learning is to minimize the errors and
maximize the profit by eliminating all other costs.
III. PROBLEM STATEMENT
Arnab Das
Department of CSE
National Institute of Technology,Surathkal
berlin.191cs210@nitk.edu.in
Traffic overcrowding is a major difficulty problem for all
people be it college, students, professionals and all those
who commute for their daily work even the daily wage
labourers. Not only wasting time there has been incidents of
accidents daily in our news due to the inefficient nature of ur
traffic system as it is mostly physical and manual work by
humans. [4]Since it is controlled by humans there is a high
risk of accidents as there may be lack of focus and
inefficiency from the human side. We can solely depend in
the signal managers as there are chances of wrong doing
while managing the traffic. Our answer for this complication
is to authorize the traffic signal timing and assign more time
length of green light to lanes that has more density of
vehicles so that that they can pass easily for the smooth flow
of the traffic using the feedback mechanism of the
reinforcement learning. [5]Since our country is developing at
a high speed more and more people are coming to the cities
for jobs and better lifestyle leading int the overcrowding int
the metropolitan cities in turn increasing the already heavy
traffic of these regions so an efficient system of traffic signal
is the utmost priority of the officials.
IV. IMPLEMENTATION
Foreground Detector (RGB to GRAY Conversion)
[6]The foreground detector is used to determine the moving
objects in a frame using the stereo matching algorithms that
analyse the data and give results. It removes all the outliers
like background features and surroundings so that we can
focus only on the automobiles. It filters the images and
creates a full depth filter image using the stereo algorithms.
This helps in further in minimizing the costs and increases the
efficiency of the overall output.
[7]This detector plays the most significant as it detects the
ground and filter the image for the further study of the
process. It also substitutes the “RGB” to “GREY” to “Binary”
by filtering at different levels of the process. Images are
 changed into pixelated format using 0s and 1s at specified
positions but the intervals are fixed at [0,1].
(A) Capturing Image
[8]For further analysis of the image, we need to have a clear
image of the automobile. Still images can be taken in a span of
10 sec but that decreases efficiency of the image so we use a
different process of videography where we record the video
and divide the frames and analyse each and every frame and
make predictions using that. For capturing the images at the
best possible we need to fix the camera so that it doesn’t
vibrate and gives signals at the steady rate.
(D) Vehicle Tracking
[13]Continuous identification of the detected
vehicle is monitored by marking the boundary of the
vehicle. It’s a very difficult job. Sudden change of
direction of vechiles can create blurry images that can
effect further analysis of the images so proper
screening is needed.
We can use different utility method too. [14]This
detects automobiles using the perimters and
distinguish them from the surroundings using the
pixels and giving proper values.

(B) Image Enhancement (E) Counting Vehicle

[9]Image enhancement is the method where the images are
improved by using pixels for further exploration. We minimize
the noise and outliers so that the object can be easily
identifiable. This enhancement are used for both the image
and video detection.
[15]It’s the penultimate step of the process where it
gives how many automobiles are present in a given
restricted boundary set by different functions.

[10]The primitive step is to eliminate the connected .

components and objects by using function using a specified
function. Those pixels are less than 10 then it is removed as
they are outliers and noise. Other remaining pixels are
retained. Removing noise is the most difficult task in image
enhancement.

The next step is to dilate the image by enlarging the white

areas and black areas near perimeters are filled. The process
of dilating is to take two parameters by setting the image
before it and the other is determined by creating a flat
structuring depending on the shape and drawing the matrix of
0s and 1s. The location of 1s and 0s are determined and the
image is set.

(C) Object Detection (Vehicle)

[11]Video surveillance, traffic monitoring and people tracking

are some of the things that are done using the object
detection(vehicle). Frame detection is used for seeing the
images and objects easily and segmentation is also used for
identification of the vehicles and automobiles such that there
is difference between current and reference frame.

[12]Optical flow is a process where the images and V. WHAT CAN BE DONE TO IMPROVE RESEARCH IN THIS
automobiles can be captured using the camera lens but used DOMAIN[16,17,18]
for the steady purpose but usually it’s much more difficulty for
technical things specially not able to remove the outliers.
 VI. RESEARCH GAPS
The following research gaps are identified for traffic
signal cycle using ML and deep learning.

Research Gap 1: Using various technique, its wasted of

energy and facings huge communication delays.

Research Gap 2: we have estimated the traffic state on a

urban road network in a large scale we need good
network connectivity and huge amount of data.

Research Gap 3: we observe that we are using various of

algorithm the things are algorithms will be further
improved to much more higher accuracy, some algorithm
are good at time management but happen long
communication delay, some of his time limitations.

XI. CONCLUSION

Traffic line control is a key method of transport to

improve the transportation system In general, traffic light
control systems only work with a fixed time and
consistency with the page.But due to the various
limitations of these methods, all these periods cannot be
given in this situation which limits the specific skills for
traffic transport and the possibility of further
improvement.That’s why we offer a traffic light control
system that achieves a completely uniform dynamic control
and the system increases power with varying efficiency and
within adaptive time. One of them is a model specifically
used for phase decision and a special timing algorithm used
for period decision making each stage of which executes
green light.We tested our system on a variety of traffic
flows and, above all, we discovered a relationship between
duration and traffic flow.We are giving our traffic a whole
day. We check the excellent performance of the traffic light
control system.Using this model we can solve traffic cycle
control problems.We use the Deep Learning Model to solve
difficult to difficult traffic light system problems.We use
different types of traffic light information as models of
vehicle network and household input.If there is a problem
with difficult traffic scenario, we use double during Q
network.This reduces the average waiting time by 20
percent.
REFERENCES
[1] J. R. Kwapisz, G. M. Weiss, and S. A. Moore, “Activity
recognition using cell phone accelerometers,” ACM SIGKDD
Explor. Newslett.,vol. 12, no. 2, pp. 74–82, May 2011.
[2] D. Anguita, A. Ghio, L. Oneto, X. Parra, and J. L. Reyes-
Ortiz, “Human activity recognition on smartphones using a
multiclass hardware-friendly support vector machine,” in
Ambient Assisted Living and Home Care. Vitoria-Gasteiz,
Spain: Springer, Dec. 2012, pp. 216–223.
[3] S. Hemminki, P. Nurmi, and S. Tarkoma, “Accelerometer-
based transportation mode detection on smartphones,” in
Proc. 11th ACM Int. Conf.Embedded Netw. Sensor Syst., Roma,
Italy, Nov. 2013, pp. 13:1–13:14.
[4] A. Jahangiri and H. A. Rakha, “Applying machine learning
techniques to transportation mode recognition using mobile
phone sensor data,” IEEE Trans. Intell. Transp. Syst., vol. 16,
no. 5, pp. 2406–2417, Oct. 2015.
[5] L. Stenneth, O. Wolfson, P. S. Yu, and B. Xu,
“Transportation mode detection using mobile phones and GIS
information,” in Proc. 19th ACM SIGSPATIAL Int. Conf. Adv.
Geograph. Inf. Syst., Chicago, IL, USA, Nov. 2011, pp. 54–63.
[6] V. Manzoni, D. Maniloff, K. Kloeckl, and C. Ratti,
“Transportation mode identification and real-time Co2
emission estimation using smartphones,”SENSEable City Lab,
Massachusetts Inst. Technol., Cambridge, MA, USA, Tech.
Rep., 2010.
[7] P. Widhalm, P. Nitsche, and N. Brändie, “Transport mode
detection with realistic smartphone sensor data,” in Proc. 21st
Int. Conf. Pattern Recognit. (ICPR), Istanbul, Turkey, Nov. 2012,
pp. 573–576.
[8] S.-H. Fang, Y.-X. Fei, Z. Xu, and Y. Tsao, “Learning
transportation modes from smartphone sensors based on
deep neural network,” IEEE Sensors J., vol. 17, no. 18, pp.
6111–6118, Sep. 2017.
[9] T. H. Vu, D. Le, and J. C. Wang, “Transportation mode
detection on mobile devices using recurrent nets,” in Proc.
24th ACM Int. Conf. Multimedia, Amsterdam, The
Netherlands, Oct. 2016, pp. 392–396.
[10] X. Song, H. Kanasugi, and R. Shibasaki, “Deeptransport:
Prediction and simulation of human mobility and
transportation mode at a citywide level,” in Proc. 25th Int.
Joint Conf. Artif. Intell., New York, NY, USA, Jul. 2016, pp.
2618–2624.
[11] L. Bao and S. S. Intille, “Activity recognition from user-
annotated acceleration data,” in Pervasive Computing. Tokyo,
Japan: Springer, Sep. 2004, pp. 1–17.
[12] B. Nham, K. Siangliulue, and S. Yeung, “Predicting mode
of transport from iPhone accelerometer data,” Mach. Learn.
Final Projects, Stanford Univ., Stanford, CA, USA, Tech. Rep.,
Dec. 2008.
[13] A. Savitzky and M. J. E. Golay, “Smoothing and
differentiation of data by simplified least squares procedures,”
Anal. Chem., vol. 36, no. 8, pp. 1627–1639, Jul. 1964.
[14] S. Reddym, M. Mun, J. Burke, D. Estrin, M. Hansen, and
Srivastava, “Using mobile phones to determine transportation
modes,” ACM Trans. Sensor Netw., vol. 6, no. 2, pp. 13-1–13-
27, Feb. 2010.
[15] I. J. Good, “The interaction algorithm and practical
Fourier analysis,” J. Roy. Stat. Soc., B (Methodol.), vol. 20, no.
2, pp. 361–372, Jan. 1958
[16] A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet
classification with deep convolutional neural networks,” in
Proc. Adv. Neural Inf. Process. Syst., Stateline, NV, USA, Dec.
2012, pp. 1097–1105.
[17] K. He, X. Zhang, S. Ren, and J. Sun, “Delving deep into
rectifiers: Surpassing human-level performance on ImageNet
classification,” in Proc. Int. Conf. Computor. Vis., Santiago,
Chile, Dec. 2015, pp. 1026–1034.
[18] S. Wager, S. Wang, and P. S. Liang, “Dropout training as
adaptive regularization,” in Proc. Adv. Neural Inf. Process.
Syst., Stateline, NV, USA, Dec. 2013, pp. 351–359.
[19] X. Liang, J. Tian, X. Ding, and G. Wang, “A risk and
similarity aware application recommender system,” J.
Comput. Inf. Technol., vol. 23, no. 4, pp. 303–315, 2015.
[20] J. Yang, “Toward physical activity diary: Motion
recognition using simple acceleration features with mobile
phones,” in Proc. 1st ACM Int. Workshop Interact. Multimedia
Consum. Electron., Beijing, China,Oct. 2009, pp. 1–10.