Computer vision and image

processing
Introduction

1
 What is digital image processing?
• is defined as the use of computerized algorithms for the
analysis of image with respect to an application.
• Deals with processing digital images by means of a digital
computer.
– It is a subfield of signals and systems but focus particularly
on images.
• Main focus: developing a computer system that is able to
perform processing on an image.
• The input of that system is a digital image and the system
process that image using efficient algorithms, and gives an
image as an output. 
• Example: Adobe Photoshop

2
How it works?

3
 Signal processing
• Signal processing is a discipline in electrical engineering
and in mathematics that deals with analysis and
processing of analog and digital signals , and deals with
storing , filtering , and other operations on signals.
• These signals include transmission signals , sound or
voice signals , image signals , and other signals e.t.c.
• Out of all these signals , the field that deals with the type
of signals for which the input is an image and the output
is also an image is done in image processing.
• It can be further divided into analog image processing
and digital image processing.

4
1. Analog image processing
• Analog image processing is done on analog signals.
• It includes processing on two dimensional analog signals.
• In this type of processing, the images are manipulated by
electrical means by varying the electrical signal.
• The common example include is the television image.
• Digital image processing has dominated over analog image
processing with the passage of time due its wider range of
applications.

2. Digital image processing

• The digital image processing deals with developing a
digital system that performs operations on an digital image.

5
 What is digital Image?

• An image is nothing more than a two dimensional signal. It is

defined by the mathematical function f(x,y) where x and y are
the two co-ordinates horizontally and vertically.
• The value of f(x,y) at any point is gives the pixel value at that
point of an image.
• What is the relationship between a digital image and a signal?
• Eample of digital image

6
 How a digital image is formed?

• Since capturing an image from a camera is a physical process.

• The sunlight is used as a source of energy.
• A sensor array is used for the acquisition of the image.
Process?
• So when the sunlight falls upon the object, then the amount of
light reflected by that object is sensed by the sensors, and
• a continuous voltage signal is generated by the amount of sensed
data.
• In order to create a digital image , we need to convert this data
into a digital form.
• This involves sampling and quantization. (They are discussed
later on).
• The result of sampling and quantization results in an two
dimensional array or matrix of numbers which are nothing but a
digital image. 7
 Overlapping fields

• Machine/computer vision

• Computer graphics

• Artificial intelligence
• Signal processing

8
Computer vision

9
 Introduction

• It is an interdisciplinary scientific field that deals with how

computers can be made to gain a high level understanding of
digital images or videos.
• From the perspective of engineering, it seeks to automate
tasks that the human visual system can do.
• Computer vision tasks include method for acquiring,
processing, analyzing and understanding digital images.
• Other definition through its applications:

– Computer vision is building algorithms that can understand

the content of images and use it for other applications.
10
 How computer vision works
 Acquiring an image: Images, even large sets, can be acquired
in real-time through video, photos or 3D technology for
analysis.
 Processing the image: Deep learning models automate much
of this process, but the models are often trained by first being
fed thousands of labeled or pre-identified images.
 Understanding the image: The final step is the interpretative
step, where an object is identified or classified.

11
 There are many types of computer vision that are used
in different ways:
• Image segmentation partitions an image into multiple regions
or pieces to be examined separately.
• Object detection identifies a specific object in an image.
• Advanced object detection recognizes many objects in a single
image:
– a football field,
– an offensive player,
– a defensive
player,
– a ball and so on. T
– these models use an X, Y coordinate to create a bounding
box and identify everything inside the box.

12
• Facial recognition is an advanced type of object detection that
not only recognizes a human face in an image but identifies a
specific individual.
• Edge detection is a technique used to identify the outside edge
of an object or landscape to better identify what is in the image.
• Pattern detection is a process of recognizing repeated shapes,
colors and other visual indicators in images.
• Image classification groups images into different categories.
• Feature matching is a type of pattern detection that matches
similarities in images to help classify them.

13
 Applications of computer vision

• Optical character recognition (OCR): reading handwritten

postal codes on letters and automatic number plate
recognition.
• Machine inspection: rapid parts inspection for quality
assurance using stereo vision with specialized illumination to
measure tolerances on aircraft wings or auto body parts or
looking for defects in steel castings using X-ray vision.
• Retail: object recognition for automated checkout lanes.
• Medical imaging: registering pre-operative and intra-
operative imagery or performing long-term studies of people’s
14
• Automotive safety: detecting unexpected obstacles such as

pedestrians on the street, under conditions where active

vision techniques such as radar.

• Surveillance: monitoring for intruders, analyzing highway

traffic and monitoring pools for drowning victims;

• Fingerprint recognition and biometrics: for automatic

access authentication as well as forensic applications

15
16
17
 Applications of Digital Image Processing

• Image Correction, Sharpening, and Resolution Correction

• Medical field
• Remote sensing
• Transmission and encoding
• Machine/Robot vision
• Color processing
• Pattern recognition
• Video processing
• Microscopic Imaging
• Others

18
Image Correction, Sharpening, and Resolution Correction
• Often, we wish we could make old images better. And that
possible nowadays.
• Zooming, sharpening, edge detection, high dynamic range edits
all fall under this category.
• All these steps help in enhancing the image. Most editing
software and Image correction code can do these things easily.

19
Medical Technology :
• In the medical field, Image Processing is used for various tasks
like PET scan, X-Ray Imaging, Medical CT, UV imaging, Cancer
Cell Image processing, and much more.
• The introduction of Image Processing to the medical technology
field has greatly improved the diagnostics process.

• The image on the left is the original image. The image on the right
is the processed image.
• We can see that the processed image is far better and can be used 20
Computer / Machine Vision :
• One of the most interesting and useful applications of Image
Processing is in  Computer Vision.
• Computer Vision is used to make the computer see, identify
things, and process the whole environment as a whole.
• An important use of CV is Self Driving cars, Drones etc.
• CV helps in obstacle detection, path recognition, &
understanding the environment.
• This is how typical Computer Vision works for Car Autopilots.
The computer takes in live footage and analyses other cars, the
road, and other obstacles.

21
22
 Pattern recognition:
• Pattern recognition is a part of Image Processing that involves
AI and Machine Learning.
• Image processing is used to find out various patterns and
aspects in images.
• Pattern Recognition is used for Handwriting analysis, Image
recognition, Computer-aided medical diagnosis, and much
more.
Video Processing:
• Video is basically a fast movement of images.
• Various image processing techniques are used in Video
Processing.
• Some methods of Video Processing are noise removal, image
stabilization, frame rate conversion, detail enhancement, and
much more.
23
 Reading assignment
• how the three dimension in physical world can
be converted in to two dimensional image?
• Define the process of capturing an image on
digital camera? Elaborate it with the working
principles of human eye.

24