You are on page 1of 36

UNIVERSITY TEACHING

DEPARTMENT, KOTA
A PRACTICAL TRAINING SEMINAR ON

DIFFERENT APPLICATIONS OF SIGNAL PROCESSING IN


IMAGE PROCESSING AND MACHINE LEARNING
(15 MAY 2018 - 30 JUNE 2018)

SUBMITTED TO:- SUBMITTED BY:-


Dr. LOKESH THARANI ASHWINI SONI
ASSOCIATE PROFESSOR B. TECH VII SEM
RTU, KOTA. ELECRONICS & COMM. ENGG.
UTD, RTU, KOTA.
ROLL NO: 15/633
Contents at a glance…

Signal processing

Image processing

Signal processing in Image processing

Image compression

JPEG compression

Projects undertaken

Applications of Image processing

Machine learning

Support vector machine (SVM)

Analyze Images Using Linear SVM

Conclusions

References

Signal processing
• Digital signal processing (DSP) is the process of analyzing and modifying
a signal to optimize or improve its efficiency or performance.
• Usually encounters multi-dimensional real time performance requirements
and restriction on resources.
• Involves applying various mathematical and computational algorithms to
analog and digital signals to produce a signal that's of higher quality than
the original signal.
• Methods include following :-
a) Data compression
b) Signal and image reconstruction/restoration filtering
c) JPEG/MPEG compression algorithms etc.
Image
processing .
• Image Processing is any form
of signal processing for which
our input is an image, such as
photographs or frames of
video and our output can be
either an image or a set of
characteristics or parameters
related to the image.
• Generally refers to processing
of two dimensional picture and
by two dimensional picture we
implies a digital image.
• A digital image is an array of
real or complex numbers
represented by a finite number
of bits but now a days optical
and analog image processing is
also possible.
Purpose & Components of Image Processing
Purpose Components
• Visualization • Image Sensors
• Image sharpening and • Image Displays
restoration • Image Processing Software
• Image retrieval (MATLAB)
• Measurement of pattern • Image Processing Hardware
• Image Recognition. • Memory
Image Processing
Techniques Example
• Image
representation
• Image
preprocessing
• Image
enhancement
• Image restoration
• Image analysis
• Image
reconstruction
• Image
compression  
Benefits and Limitations of Image Processing
Benefits Limitations
• Medicines • It is more time consuming
• Astronomical Observations. as compared to the former.
• Remote Sensing • More complex program
• Geological Surveys for
detecting mineral resources
• Character recognizing
techniques
• Inspection or abnormalities
in industries.
Signal Processing in Image Processing

Image signal processing (ISP) is a method used to convert


an image into digital form while performing some
operations on them, in order to get an enhanced image or
to extract some useful information
Image Compression

• Process of encoding or
converting an image file in
such a way that it consumes
less space than the original file.
• A technique that reduces the
size of an image file without
affecting its quality to a greater
extent.
• From a mathematical view
point it is transforming a two
dimensional pixel array into the
statistically uncorrelated data
set.
• The goal is to reduce the
amount of data required to
represent a digital image
Types of Image Compression

Lossless Compression Lossy Compression


• Exact Reconstructions of Original • Decompression retrieves data
data. different from the original.
• Executable programs and source • Used to compress Multimedia
codes. data.
• Data loss cant be tolerated. • Streaming media and internet
• Methods include: telephony.
a) Run-length encoding • Methods include:
b) Huffman encoding a) Discrete Cosine Transform
(DCT)
b) Discrete Wavelet Transform
(DWT) 
Lossless vs Lossy Compression
JPEG compression
JPEG Compression Algorithm
• Stands for Joint • Divide image into 8 *8 pixel
Photographic Experts Group block.
• Lossy compression method • Apply DCT (Discrete
• Mostly used digital cameras Cosine Transformation)
& web usage. • Apply coarse quantization.
• Not suited for drawing, • Compress resulting data
textual and iconic graphics. lossless and store.
Output of JPEG Compression
On applying the JPEG Compression final compression
is 40%
Effect of varying JPEG Compression Ratio
Projects undertaken

1. Object detection and recognition


• Object detection and object recognition are similar
techniques for identifying objects, but they vary in
their execution.
• Object detection is the process of finding instances of
objects in images.
• Object recognition is a task of finding and identifying
object in an image or video sequence.
Tracking Cars Using Foreground Detection

• It shows how to detect and


count cars in a video
sequence using Gaussian
mixture models (GMMs).
• GMM method is a detection
method that compares
between foreground object
and background object,
• This approach is usually
applied for detecting object
within a video.
Results

For Light traffic condition For heavy traffic condition


• Precision value - 100% • Precision value - 75.79%
• Sensitivity - 94.44% • Sensitivity - 88.89%
• Specificity - 100% • Specificity - 70.37%
• Accuracy - 97.22% • Accuracy - 79.63%
2. Medical Image Compression
What is medical imaging?
• Process of creating visual
representations of the
interior of a body
• Useful for clinical analysis
and medical intervention.
• Visual representation of the
function of some organs or
tissues.
2D MRI with 3D
Reconstruction of
Brain
Ex. – Brain tumor is abnormal
tissue found in brain.
• MRI is a technique to
generate 2D part of
internal part of the body.
• It involves the
implementation of various
step such as image
classification and image
segmentation
• The accuracy of the
proposed registration and
reconstruction method was
78.5% / 97.2% and
95.4% / 95.8%
Register Multimodal 3-D Medical Images
3. Wheel Recognition
•The toll rate charged for the usage of facilities such as a tunnel or a bridge
is usually proportional to the number of axles possessed by a vehicle.
•It is sometimes difficult to determine the number of axles of a vehicle by
the toll-booth operator and therefore, an automatic system that can
identify the number of axles is sought.
•Instead of detecting the axle, wheels of a vehicle are tested and a method
based on the Hough transform for detecting circles is proposed.
•As the system must be able to detect the correct number of wheels in real-
time, sub-sampling based on the Haar Wavelet transform is applied.
Wheel Recognition (1)
Algorithm Image processing techniques
• Camera set up for the wheel 1. Sobel filter
detection system • Result of applying Sobel filter to
• Hough transform one of the any captured image
• Sobel Filtering to background
image
2. Canny edge detection
• Edges are used as the feature
points
• Canny edge detector apply for
detecting edges
3. Gaussian and Sobel Filtering
Capture image input
Capture image output
Based on such a phenomenon, number of wheels
captured by the camera by detecting the number of
peak from the Hough transform plot can easily be
determined.
Application of image processing

• Computer vision
• Face detection
• Optical shorting
• Feature detection
• Remote sensing
• Augmented reality
• Medical imaging
Machine Learning

• Machine learning is a field of computer science that uses statistical techniques to give
computer systems the ability to “learn” with data, without being explicitly
programmed.
• Prime categorization of machine learning tasks include:

a) Supervised learning
b) Unsupervised learning
• In Supervised learning goal is to learn a general rule that maps input to output whereas
Unsupervised learning can be a goal in itself i.e. discovering hidden patterns in data.
• Dataset consist of data and data implies the form of matrix.

• Applications include Support Vector Machine (SVM).


Support Vector Machine (SVM)
• It constructs a hyperplane or set of
hyperplanes in a high-or infinite
dimensional space, which can be
used for classification, regression, or
other tasks like outliers detection.
• SVM performs classification by
constructing an N-dimensional
hyperplane that optimally separates
the data into two categories
• Good separation is achieved by the
hyperplane that has the largest
distance to the nearest training data
point of any class.
• To keep the computational load
reasonable, the mappings used by
SVM schemes are designed to
ensure that dot products may be
computed easily in terms of the
variables in the original space.
Imagine there are two
How would data is tags: red and blue, and our data has
classified by us ??? two features named x and y. Now a
classifier is required such that, provided
with a pair of (x, y) co-ordinates,
outputs if it’s either red or blue. Already
labeled training data has been put on a
plane.
A support vector machine takes these
data points and outputs the hyperplane
that best separates the tags. This line is
the decision boundary: anything that
falls to one side of it will be classified
as blue, and anything that falls to the
other as red.
Support Vector Machine Binary Classification
There are three types of SVM Binary classifications mentioned
as:
a) Separable Data
b) Non separable Data
c) Nonlinear Transformation with Kernels
Analyze Images Using Linear SVM
Objectives
1. To determine which quadrant of an image a shape
occupies by training an error-correcting output
codes (ECOC) model comprised of linear SVM
binary learners.
2. Illustration of the disk space consumption of ECOC
models that store support vectors, their labels, and
the estimated  coefficients.
Results
The consumption of disk
space by ECOC model is
1477.5 MB
Conclusions

The practical analysis of applications of signal processing in


image processing and machine learning encountered multi-
dimensional real time performance requirements and restriction
on resources with the aim of applying the number of computer
algorithms using MATLAB to process the digital image/data for
image processing. With this the machine learning applications
that went over the basic ideas of Support vector machine and its
construction using MATLAB functions with the message that this
guide is not intend to deal with complex and non-liner object
with multiple attributes.
References
• Hing Cheung, ‘IT6303 Advances in Digital Signal Processing’ Dept. of Computer
Eng. & Information Technology City University of Hong Kong [2018]
• ‘Color Balance and Fusion for Underwater Image Enhancement’, 
IEEE Transactions on Image Processing (Volume: 27, Issue: 1, Jan. 2018),
IEEE Signal Processing Society, 05 October 2017,
https://ieeexplore.ieee.org/document/8058463/
• ‘Field Support Vector Machines’ 
IEEE Transactions on Emerging Topics in Computational Intelligence (Volume: 1, 
Issue: 6, Dec. 2017) IEEE, 21 November 2017
• Shankar K. Pal, Director and Distinguished Scientist, Indian Statistical Institute, India,
International Journal of Signal Processing, Image Processing and Pattern Recognition,
SERSC Australia, October 2017
• ‘Machine learning and its applications’,
2017 International Conference on Big Data Analytics and Computational Intelligence
(ICBDAC)
IEEE, 19 October 2017, Chirala, India https://ieeexplore.ieee.org/document/8070809/
THANK YOU!!
ANY QUERIES??

You might also like