IE404

Digital Image Processing

Dr. Manish Khare

Lecture 2,3
LECTURE 2

Slide 2
 Nature of Image Processing

➢ Images are everywhere! Sources of Images are paintings,

photographs in magazines, Journals, Image galleries, digital
Libraries, newspapers, advertisement boards, television and
Internet.

➢ In image processing, the term ‘image’ is used to denote the

image data that is sampled, quantized, and readily available in
a form suitable for further processing by digital computers.

Slide 3
IMAGE PROCESSING ENVIRONMENT

Slide 4
 Reflective mode Imaging

➢ Reflective mode imaging represents the simplest form of

imaging and uses a sensor to acquire the digital image. All
video cameras, digital cameras, and scanners use some types
of sensors for capturing the image.

Slide 5
 Emissive type imaging

➢ Emissive type imaging is the second type, where the images are
acquired from self-luminous objects without the help of a
radiation source. In emissive type imaging, the objects are self-
luminous. The radiation emitted by the object is directly captured
by the sensor to form an image. Thermal imaging is an example
of emissive type imaging.

Slide 6
 Transmissive imaging

➢ Transmissive imaging is the third type, where the radiation

source illuminates the object. The absorption of radiation by
the objects depends upon the nature of the material. Some of
the radiation passes through the objects. The attenuated
radiation is sensed into an image.

Slide 7
 Image Processing

➢ Analog image processing is an area that deals with the processing

of analog electrical signals using analog circuits. The imaging
systems that use film for recording images are also known as
analog imaging systems.

➢ Optical image processing is an area that deals with the object,

optics, and how processes are applied to an image that is
available in the form of reflected or transmitted

Slide 8
 WHAT IS AN IMAGE ?

➢A digital image is an array of real or complex numbers

represented by a finite no. of bits.

➢An image may be defined as a two-dimensional

function f(x,y), where x & y are plane coordinates, and
the amplitude of f at any pair of coordinates (x,y) is
called the intensity or gray levels of the image at that
point.

Slide 9
What is a Digital Image?

Slide 10
Slide 11
Slide 12
 What is Digital Image Processing?

➢ Digital image processing is an area that uses digital circuits,

systems, and software algorithms to carry out the image
processing operations. The image processing operations may
include quality enhancement of an image, counting of objects,
and image analysis.

Slide 13
➢ Digital image processing focuses on two major tasks
◼ –Improvement of pictorial information for human
interpretation
◼ –Processing of image data for storage, transmission and
representation for autonomous machine perception.

➢ Some argument about where image processing ends and fields

such as image analysis and computer vision start

Slide 14
➢ The continuum from image processing to computer vision can
be broken up into low-, mid- and high-level processes

Slide 15
Why do we process images?

Slide 16
Steps of Digital Image Processing Methods

1. Improvement of pictorial information for human interpretation

2. Processing of image data for storage, transmission, and

representation for autonomous machine perception.

Slide 17
 Typical digital image processing sequence

Imaging Sample Digital Digital

object
system & storage computer
quantize

observe digitize store process

display buffer

record

Slide 18
 History of DIP

➢ Early 1920s: One of the first applications

of digital imaging was in the news- paper
industry
◼ –The Bartlane cable picture
transmission service
◼ –Images were transferred by submarine
cable between London and New York
◼ –Pictures were coded for cable transfer
and reconstructed at the receiving end
on a telegraph printer

Slide 19
Slide 20
➢ Mid to late 1920s:
Improvements to the Bartlane
system resulted in higher quality
images
◼ –New reproduction processes
based on photographic
techniques
◼ –Increased number of tones in
reproduced images

Slide 21
Slide 22
Slide 23
➢ 1960s: Improvements in computing
technology and the onset of the space
race led to a surge of work in digital
image processing
◼ –1964: Computers used to
improve the quality of images of
the moon taken by the Ranger 7
probe
◼ –Such techniques were used in
other space missions including the
Apollo landings
Slide 24
Slide 25
➢ 1970s: Digital image processing
begins to be used in medical
applications
◼ –1979: Sir Godfrey N.
Hounsfield & Prof. Allan M.
Cormack share the Nobel
Prize in medicine for the
invention of tomography, the
technology behind
Computerised Axial
Tomography (CAT) scans
Slide 26
➢ 1980s - Today: The use of digital image processing
techniques has exploded and they are now used for all kinds of
tasks in all kinds of areas
◼ Image enhancement/restoration
◼ Artistic effects
◼ Medical visualisation
◼ Industrial inspection
◼ Law enforcement
◼ Human computer interfaces

Slide 27
The Boom of Digital Images in the Last 20 Years

➢ Acquisition
◼ Digital cameras, scanners
◼ MRI and Ultrasound imaging
◼ Infrared and microwave imaging
➢ Transmission
◼ Internet, satellite and wireless communication
➢ Storage
◼ CD/DVD, Blu-ray
◼ Flash memory, Phase-change memory
➢ Display
◼ Printers, LCD monitor, digital TV
◼ Portable DVD player, PDAs, cell-phone

Slide 28
A Physical Perspective of Image Acquisition

➢ Extend the capabilities of human vision systems

◼ From visible spectrum to non-visible electromagnetic
power spectrum
◼ From close-distance sensing to remote sensing

Slide 29
Visible (I): Photography

Slide 30
Visible (II): Motion Pictures

Slide 31
Visible (III): Biometrics and Forensics

You=ID

Real or PS?

Slide 32
 Visible (IV): Light Microscopy

Taxol (250) Cholesterol (40) Microprocessor (60)

Slide 33
Visible (V): Remote Sensing

Earth at night (Only Asia/Europe shown)

Slide 34
Visible (VI): Mobile Imaging

http://en.wikipedia.org/wiki/FingerWorks

Slide 35
Visible (VII): Light Field Camera

https://www.lytro.com/camera

Slide 36
 In-Class Discussions

➢ Do you know how a smartphone camera works (e.g., CCD vs.

CMOS)?

➢ How to acquire a large view in the physical world (e.g., 360-

view of a room or grand canyon)?

➢ How to acquire a photo under low illumination conditions

(e.g., dark theatre)?

Slide 37
Beyond Visible (I): Thermal Images

Operate in infrared frequency

Human body disperses Autoliv’s night vision system

heat (red pixels) on the BMW 7 series

Slide 38
Beyond Visible (II): Radar Images

Operate in microwave frequency

Slide 39
Beyond Visible (III): MRI and Astronomy

knee spine head

Slide 40
Beyond Visible (IV): Fluorescence Microscopy

Operate in ultraviolet frequency

normal corn smut corn

Slide 41
Beyond Visible (V): Medical Diagnostics

Operate in X-ray frequency

chest head

Slide 42
Beyond Visible (VI): PET and Astronomy

Operate in gamma-ray frequency

Cygnus Loop in the

Positron Emission Tomography constellation of Cygnus

Slide 43
Other Non-Electro-Magnetic Imaging Modalities

➢ Acoustic imaging
◼ Translate “sound waves” into image signals
◼ Ultrasound imaging
➢ Electron microscopy
◼ Shine a beam of electrons through a specimen
◼ Transmission electron microscopy (TEM) vs. scanning
electron microscopy (SEM)
➢ Synthetic images in Computer Graphics
◼ Computer generated (non-existent in the real world)

Slide 44
LECTURE 3

Slide 45
 Electron Microscope

2500 Scanning Electron Microscopy (SEM) image of

damaged integrated circuit
(white fibers are oxides resulting from thermal destruction)
http://physics.unt.edu/stm-sem-and-afm

Slide 46
Cartoon Pictures (Non-photorealistic)

Hayao Miyazaki’2008

Slide 47
Synthetic Images in Gaming

League of Legends (MOBA)

Slide 48
Virtual Reality (Photorealistic)

Slide 49
 Graphics in Art

What is wrong with this picture?

Slide 50
Graphics in Medicine

Virtual surgery (surgery simulator)

Slide 51
Mixture of Graphics and Photos

Morgantown, WV in Google Map

Slide 52
 Application of DIP
➢ Some of the major fields in which digital image processing is widely used are
mentioned below
◼ Image sharpening and restoration
◼ Medical field
◼ Remote sensing
◼ Transmission and encoding
◼ Machine/Robot vision
◼ Color processing
◼ Pattern recognition
◼ Video processing
◼ Microscopic Imaging
◼ Others

Slide 53
 Applications of DIP

➢ Image Enhancement: One of the most common uses of DIP

techniques: improve quality, remove noise etc

Slide 54
 Applications of DIP

➢ The Hubble Telescope: Launched in 1990 the Hubble

telescope can take images of very distant objects However, an
incorrect mirror made many of Hubble’s images useless then
Image processing techniques were used to fix this

Slide 55
 Applications of DIP

➢ Artistic Effects: Artistic

effects are used to make
images more visually
appealing, to add special
effects and to make composite
images

Slide 56
 Applications of DIP

➢ Medicine: Take slice from MRI scan of canine heart, and find
boundaries between types of tissue
◼ Image with gray levels representing tissue density
◼ Use a suitable filter to highlight edges

Slide 57
 Applications of DIP

➢ GIS:
➢ Geographic Information Systems
◼ Digital image processing techniques are used extensively to
manipulate satellite imagery
◼ Terrain classification
◼ Meteorology

➢ Night-Time Lights of the World data set

◼ Global inventory of human settlement
◼ Not hard to imagine the kind of analysis that might be done
using this data
Slide 58
Applications of DIP

Slide 59
Applications of DIP

Slide 60
 Applications of DIP

➢ Industrial Inspection:

➢ Human operators are expensive,

slow and unreliable Make
machines do the job instead
Industrial vision systems are
used in all kinds of industries

➢ Can we trust them?

Slide 61
 Applications of DIP

➢ PCB Inspection: Printed Circuit Board (PCB) inspection

◼ Machine inspection is used to determine that all
components are present and that all solder joints are
acceptable
◼ Both conventional imaging and x-ray imaging

Slide 62
 Applications of DIP

➢ Law Enforcement:
➢ Image processing techniques are
used extensively by law
enforcers
◼ Number plate recognition for
speed cameras/automated toll
systems
◼ Fingerprint recognition
◼ Enhancement of CCTV
images

Slide 63
 Applications of DIP

➢ HCI:
➢ Try to make human computer
interfaces more natural
◼ Face recognition
◼ Gesture recognition

Slide 64
Image Processing and Related Fields

Slide 65
 Relations with other branches

➢ Image processing deals with raster data or bitmaps, whereas

computer graphics primarily deals with vector data.

➢ In digital signal processing, one often deals with the processing

of a one-dimensional signal. In the domain of image processing,
one deals with visual information that is often in two or more
dimensions.

Slide 66
 Relations with other branches

➢ The main goal of machine vision is to interpret the image and to extract
its physical, geometric, or topological properties. Thus, the output of
image processing operations can be subjected to more techniques, to
produce additional information for interpretation.

➢ Image processing is about still images. Thus, video processing is an

extension of image processing. In addition, images are strongly related
to multimedia, as the field of multimedia broadly includes the study of
audio, video, images, graphics, and animation.

Slide 67
 Relations with other branches
➢ Optical image processing deals with lenses, light, lighting conditions,
and associated optical circuits. The study of lenses and lighting
conditions has an important role in the study of image processing.

➢ Image analysis is an area that concerns the extraction and analysis of

object information from the image. Imaging applications involve both
simple statistics such as counting and mensuration and complex
statistics such as advanced statistical inference. So statistics play an
important role in imaging applications.

Slide 68
Types of Images

Slide 69
 Types of Images Based on Colour

➢ Grey scale images are different from binary images as they

have many shades of grey between black and white.

➢ These images are also called monochromatic as there is no

colour component in the image, like in binary images.

➢ Grey scale is the term that refers to the range of shades

between white and black or vice versa.

Slide 70
 Binary Images

➢ In binary images, the pixels assume a value of 0 or 1. So one bit

is sufficient to represent the pixel value. Binary images are also
called bi-level images.

Slide 71
 True Colour Images

➢In true colour images, the pixel has a colour that is

obtained by mixing the primary colours: red, green, and
blue. Each colour component is represented like a grey
scale image using eight bits. Mostly, true colour images
use 24 bits to represent all the colours.

Slide 72
Slide 73
 Indexed Image

➢ A special category of colour images is the indexed image. In

most images, the full range of colours is not used. So it is
better to reduce the number of bits by maintaining a colour
map, gamut, or palette with the image.

Slide 74
Slide 75
 Pseudocolour Image

➢ Like true colour images, Pseudocolour images are also used widely in
image processing. True colour images are called three-band images.

➢ However, in remote sensing applications, multi-band images or multi-

spectral images are generally used. These images, which are captured
by satellites, contain many bands.

➢ A typical remote sensing image may have 3-11 bands in an image, and
this information is beyond the human perceptual range.

Slide 76
Slide 77
Types of Images based on Dimensions

➢ Types of Images Based on Dimensions

2D and 3D

➢ Types of Images Based on Data Types

Single, double, Signed or unsigned.

Slide 78
 DIP Operations

➢ Operation on images are: brightness, enhancement, contrast

manipulation etc..

Slide 79
Slide 80
Key Stages in Digital Image Processing

Slide 81
Key Stages in Digital Image Processing

Slide 82
➢ This step aims to obtain the digital image of the object.

Slide 83
Key Stages in Digital Image Processing

Slide 84
 Image Enhancement

➢ Here objective is to accentuate certain image features for subsequent

analysis or for image display.

➢ The principal objective of enhancement is to process an image so that

the result is more suitable than the original image for a specific
application.

➢ enhancement process itself does not increase the inherent information

content in the data.

➢ It simply emphasizes certain specified image characteristics.

➢ Examples- contrast & edge enhancement, noise filtering, magnifying.

Slide 85
Key Stages in Digital Image Processing

Slide 86
 Image Restoration

➢ It refers to removal or minimization of known degradations in

an image.

➢ In other words it is concerned with filtering the observed

image to minimize the effect of degradations.

➢ This includes deblurring of images degraded by the limitations

of a sensor or its environment, noise filtering, and correction
of geometric distortion or nonlinearities due to sensors.

Slide 87
Difference between image restoration and
image enhancement
➢ Image enhancement process
an image so that the result is
more suitable than the
original image.
➢ This criteria is difficult to
represent mathematically.
➢ Enhancement techniques are
much more image
dependent.
➢ Image restoration is
concerned with filtering the
observed image to minimize
the effect of degradations.
➢ Restoration problem can be
quantified precisely.
➢ Restoration techniques often
depend only on the class or
ensemble properties of data
set.
Slide 88
Key Stages in Digital Image Processing

Slide 89
Key Stages in Digital Image Processing

Slide 90
➢ This step divides the image into many sub-regions and
extracts the regions that are necessary for further analysis.

➢ The portions of the image that are not necessary, such as

image backgrounds (dictated by the image requirement), are
discarded.

Slide 91
Key Stages in Digital Image Processing

Slide 92
Key Stages in Digital Image Processing

Slide 93
➢ Imaging applications use many routines for extraction of
image features that are necessary for recognition. This is
called image feature extraction step.

➢ This extracted object features are represented in meaningful

data structures and the objects are described

Slide 94
Slide 95
Slide 96
 Digital Imaging System

➢ A digital imaging system is a set of devices for acquiring,

storing, manipulating, and transmitting digital images.

Slide 97
Nature of Light

Slide 98