Computer vision and image

processing
Introduction
 What is digital image processing?
• is defined as the use of computerized algorithms for the
analysis of image with respect to an application.
• Deals with processing digital images by means of a digital
computer.
– It is a subfield of signals and systems but focus particularly
on images.
• Main focus: developing a computer system that is able to
perform processing on an image.
• The input of that system is a digital image and the system
process that image using efficient algorithms, and gives an image
as an output.
• Example: Adobe photoshop
How it works?
 Signal processing
• Signal processing is a discipline in electrical engineering and
in mathematics that deals with analysis and processing of
analog and digital signals , and deals with storing , filtering ,
and other operations on signals.
• These signals include transmission signals , sound or voice
signals , image signals , and other signals e.t.c.
• Out of all these signals , the field that deals with the type of
signals for which the input is an image and the output is
also an image is done in image processing.
• It can be further divided into analog image processing
and digital image processing.
1. Analog image processing
• Analog image processing is done on analog signals.
• It includes processing on two dimensional analog signals.
• In this type of processing, the images are manipulated by electrical
means by varying the electrical signal.
• The common example include is the television image.
• Digital image processing has dominated over analog image
processing with the passage of time due its wider range of
applications.

2. Digital image processing

• The digital image processing deals with developing a digital
system that performs operations on an digital image.
 What is digital Image?
• An image is nothing more than a two dimensional signal. It is
defined by the mathematical function f(x,y) where x and y are the
two co-ordinates horizontally and vertically.
• The value of f(x,y) at any point is gives the pixel value at that
point of an image.
• What is the relationship between a digital image and a signal?
• Eample of digital image
 How a digital image is formed?
• Since capturing an image from a camera is a physical process.
• The sunlight is used as a source of energy.
• A sensor array is used for the acquisition of the image.
Process?
• So when the sunlight falls upon the object, then the amount of
light reflected by that object is sensed by the sensors, and
• a continuous voltage signal is generated by the amount of sensed
data.
• In order to create a digital image , we need to convert this data
into a digital form.
• This involves sampling and quantization. (They are discussed
later on).
• The result of sampling and quantization results in an two
dimensional array or matrix of numbers which are nothing but a
digital image.
 Overlapping fields

• Machine/computer vision

• Computer graphics

• Artificial intelligence

• Signal processing
Computer vision
 Introduction
• It is an interdisciplinary scientific field that deals with how
computers can be made to gain a high level understanding of
digital images or videos.

• From the perspective of engineering, it seeks to automate tasks

that the human visual system can do.

• Computer vision tasks include method for acquiring, processing,

analyzing and understanding digital images.

• Other definition through its applications:

– Computer vision is building algorithms that can understand

the content of images and use it for other applications.
 How computer vision works
 Acquiring an image: Images, even large sets, can be acquired in
real-time through video, photos or 3D technology for analysis.

 Processing the image: Deep learning models automate much

of this process, but the models are often trained by first being
fed thousands of labeled or pre-identified images.

 Understanding the image: The final step is the interpretative

step, where an object is identified or classified.
There are many types of computer vision that are used in
different ways:
• Image segmentation partitions an image into multiple regions or
pieces to be examined separately.
• Object detection identifies a specific object in an image.
• Advanced object detection recognizes many objects in a single
image:
– a football field,
– an offensive player,
– a defensive
player,
– a ball and so on. T
– these models use an X, Y coordinate to create a bounding
box and identify everything inside the box.
• Facial recognition is an advanced type of object detection that
not only recognizes a human face in an image but identifies a
specific individual.
• Edge detection is a technique used to identify the outside edge
of an object or landscape to better identify what is in the image.
• Pattern detection is a process of recognizing repeated shapes,
colors and other visual indicators in images.
• Image classification groups images into different categories.
• Feature matching is a type of pattern detection that matches
similarities in images to help classify them.
 Applications of computer vision
• Optical character recognition (OCR): reading handwritten
postal codes on letters and automatic number plate recognition.

• Machine inspection: rapid parts inspection for quality

assurance using stereo vision with specialized illumination to
measure tolerances on aircraft wings or auto body parts or
looking for defects in steel castings using X-ray vision.

• Retail: object recognition for automated checkout lanes.

• Medical imaging: registering pre-operative and intra-operative

imagery or performing long-term studies of people’s brain
morphology as they age
• Automotive safety: detecting unexpected obstacles such as

pedestrians on the street, under conditions where active vision

techniques such as radar.

• Surveillance: monitoring for intruders, analyzing highway

traffic and monitoring pools for drowning victims;

• Fingerprint recognition and biometrics: for automatic

access authentication as well as forensic applications

 Applications of Digital Image
Processing
• Image Correction, Sharpening, and Resolution Correction
• Medical field
• Remote sensing
• Transmission and encoding
• Machine/Robot vision
• Color processing
• Pattern recognition
• Video processing
• Microscopic Imaging
• Others
Image Correction, Sharpening, and Resolution Correction
• Often, we wish we could make old images better. And that possible
nowadays.
• Zooming, sharpening, edge detection, high dynamic range edits all
fall under this category.
• All these steps help in enhancing the image. Most editing software
and Image correction code can do these things easily.
Medical Technology :
• In the medical field, Image Processing is used for various tasks
like PET scan, X-Ray Imaging, Medical CT, UV imaging, Cancer
Cell Image processing, and much more.
• The introduction of Image Processing to the medical technology
field has greatly improved the diagnostics process.

• The image on the left is the original image. The image on the right
is the processed image.
• We can see that the processed image is far better and can be used
for better diagnostics.
Computer / Machine Vision :
• One of the most interesting and useful applications of Image
Processing is in Computer Vision.
• Computer Vision is used to make the computer see, identify things,
and process the whole environment as a whole.
• An important use of CV is Self Driving cars, Drones etc.
• CV helps in obstacle detection, path recognition, & understanding
the environment.
• This is how typical Computer Vision works for Car Autopilots. The
computer takes in live footage and analyses other cars, the road,
and other obstacles.
 Pattern recognition:
• Pattern recognition is a part of Image Processing that involves
AI and Machine Learning.
• Image processing is used to find out various patterns and aspects
in images.
• Pattern Recognition is used for Handwriting analysis, Image
recognition, Computer-aided medical diagnosis, and much more.
Video Processing:
• Video is basically a fast movement of images.
• Various image processing techniques are used in Video
Processing.
• Some methods of Video Processing are noise removal, image
stabilization, frame rate conversion, detail enhancement, and
much more.