Вовед во предметот PDF

ФАКУЛТЕТ ЗА ИНФОРМАТИЧКИ НАУКИ И КОМПЈУТЕРСКО ИНЖЕНЕРСТВО
Обработка на слики
Introduction to Digital Image Processing
вон. проф. д-р Ивица Димитровски

ФАКУЛТЕТ ЗА ИНФОРМАТИЧКИ НАУКИ
И КОМПЈУТЕРСКО ИНЖЕНЕРСТВО
General Information
 5 assignments, Python / Open CV
 Solve individually
 Develop, implement and test an image processing algorithm
 Final project or Final exam

 Individual or group project (max. 2 students per group)
 Grading
 Homework's: 50% (10% each)
 Final project/ Final exam: 50%
 Scale
 51 – 60 = 6
 61 – 70 = 7
 71 – 80 = 8
 81 – 90 = 9
 91 – 100 = 10
Обработка на слики 2
Digital Image Processing

(3rd Edition)
Rafael C. Gonzalez,
Richard E. Woods
The first photograph in the world

Joseph Nicéphore Niépce, View from the Window at Le Gras, 1826.
A Historical Overview of DIP

1920: One of the first applications
of digital imaging was in the news-
paper industry
The Bartlane cable picture

transmission service
Images were transferred by

Using the Bartlane system,
submarine cable between London
images could be transmitted and New York
across the Atlantic in less than
three hours
Pictures were coded for cable
transfer and reconstructed at the
receiving end on a telegraph printer
Early Improvement
The number of distinct gray levels coded by Bartlane system

was improved from 5 to 15 by the end of 1920s
New reproduction processes based on photographic
techniques – Increased number of tones in reproduced images
History of DIP
 The images in previous slides are digital; but
they are NOT considered as the results of DIP
 What do we mean by Digital Image Processing
 Processing digital images by a digital computer
 DIP has been dependent on the development of
digital computers and other supporting
technologies (e.g., data storage, display and
transmission)
Soar Into Outer Space

1960s: Improvements in computing
technology and the onset of the
space race led to a surge of work in
digital image processing
1964: Computers used to improve
the quality of images of the moon
taken by the Ranger 7 probe
Such techniques were used in other

space missions including the
The first picture of moon by US spacecraft Ranger 7
Apollo landings
on July 31, 1964 at 9:09AM EDT
8
History of DIP (cont…)

1970s: Digital image processing
begins to be used in medical
applications
1979: Sir Godfrey N. Hounsfield &

Prof. Allan M. Cormack share the
Nobel Prize in medicine for the
invention of tomography, the
technology behind Computerised
Axial Tomography (CAT) scans
9
History of DIP (cont…)
The Boom of Digital Images in the Last 20 Years
 Acquisition
 Digital cameras, scanners
 MRI and Ultrasound imaging
 Infrared and microwave imaging
 Transmission
 Internet, satellite and wireless communication
 Storage
 CD/DVD, Blu-ray
 Flash memory, Phase-change memory
 Display
 Printers, LCD/LED monitor, digital TV
 Portable DVD player, PDAs, cell-phone
A Physical Perspective of Image Acquisition
 Extend the capabilities of human vision

systems
 From visible spectrum to non-visible
electromagnetic power spectrum
 From close-distance sensing to remote
sensing
Visible (I): Photography
13
Visible (II): Motion Pictures
Visible (III): Biometrics and Forensics
You=ID
Visible (IV): Light Microscopy
Taxol (250) Cholesterol (40) Microprocessor (60)
Visible (V): Remote Sensing
Earth at night (Only Asia/Europe shown)
Visible (VI): Mobile Imaging
http://en.wikipedia.org/wiki/FingerWorks
Visible (VII): Light Field Camera
https://www.lytro.com/camera
Beyond Visible (I): Thermal Images

Operate in infrared frequency
Human body disperses Autoliv’s night vision system

heat (red pixels) on the BMW 7 series
Beyond Visible (II): Radar Images

Operate in microwave frequency
Beyond Visible (III): MRI and Astronomy
knee spine head
Beyond Visible (IV): Fluorescence Microscopy

Operate in ultraviolet frequency
normal corn smut corn
Beyond Visible (V): Medical Diagnostics

Operate in X-ray frequency
chest head
Beyond Visible (VI): PET and Astronomy

Operate in gamma-ray frequency
Cygnus Loop in the

Positron Emission Tomography constellation of Cygnus
Other Non-Electro-Magnetic Imaging Modalities
 Acoustic imaging
 Translate“sound waves” into image signals
 Ultrasound imaging
 Electron microscopy
 Shine a beam of electrons through a specimen
 Transmission electron microscopy (TEM) vs.
scanning electron microscopy (SEM)
 Synthetic images in Computer Graphics
 Computer generated (non-existent in the real world)
Acoustic Imaging
visible seismic
potential locations of oil/gas
Electron Microscope
2500 Scanning Electron Microscopy (SEM) image of

damaged integrated circuit
(white fibers are oxides resulting from thermal destruction)
http://physics.unt.edu/stm-sem-and-afm
Cartoon Pictures (Non-photorealistic)
Hayao Miyazaki’2008
Synthetic Images in Gaming
League of Legends (MOBA)
Virtual Reality (Photorealistic)
Visit NIOSH when you have a chance

Graphics in Medicine
Virtual surgery (surgery simulator)

Mixture of Graphics and Photos
Morgantown, WV in Google Map

Toward the Future: Nano-scale Imaging
New imaging
technology that
can reveal fine
structures at the nano
scale is going to be
useful In biology (e.g.,
protein sequencing
and folding)
Image Display and Perception

 Display
 CRT, LCD, DLP, Plasma, LCOS, D-ILA
 HDTV, display wall
 PDA, cellular phone, Gameboy
 Stereoscopic (3D)
 Perception
 Human Vision System (HVS)
 Vision-related diseases and healthcare
LCD: Liquid Crystal Display
Philips 42FD9954 Flat Screen Future: bigger, faster, cheaper

LCD Display
LED: Light-Emitting Diode

Difference: Backlighting
LED TV LCD TV
Virtual Wall
NASA Space Shuttle on the Princeton display wall, March 1999
Display on Mobile Devices
Gameboy
cell phone
portable DVD PDA
39
High-Dynamic-Range Display
http://www.sim2.com/HDR/tech/hdr_technology
40
3D Display
LG Autostereoscopic 3D TV without glasses at CES 2011

The Ultimate Display: Virtual Retinal Display?
Human Vision System
Simultaneous contrast
Fascinating Optical Illusions
Fraser Spiral Illusion. The overlapping black arcs appear to form a

spiral; but, the arcs are simply a series of concentric circle
Focus on the dot in centre...

Focus your eyes on the dot in the centre of the circle and then
move your head backwards and forwards. The outer wheels of
the circle should begin to rotate in opposite directions.
Try and count the black dots....
Motion illusion, rotating snakes

Interpretation Ambiguity
Is it seal or donkey? Is it duck or hare?
Why do we process images?

 Acquire an image!
 Correct aperture and color balance
 Reconstruct image from projections
 Prepare for display or printing!
 Adjust image size
 Color mapping, gamma-correction, halftoning
 Facilitate picture storage and transmission!
 Efficiently store an image in a digital camera
 Send an image from space
 Enhance and restore images!
 Touch up personal photos
 Color enhancement for security screening
 Extract information from images!
 Read 2-d bar codes
 Character recognition
 Many more ... image processing is ubiquitous
Topics
 Continuous-tone images, point operations, color, histograms
 Image segmentation
 General linear image processing
 Linear processing, 2-d signals and systems, sampling, filtering
 Feature detection
 Edge detection, keypoint detection!
 Morphological image processing
 Image transforms, multiresolution image processing
 Image registration, image matching
 Mobile image processing
 Android image processing, Open CV
Image Processing and Related Fields
What is an image?
 Image: a visual representation in form of a function f(x,y) where f is
related to the brightness (or color) at point (x,y)
 Most images are defined over a rectangle
 Continuous in amplitude and space
What is a Digital Image?

 A digital image is a representation of a two-dimensional
image as a finite set of digital values, called picture
elements or pixels
Digital Images and Pixels

 Digital image: discrete samples f [x,y] representing
continuous image f (x,y)
 Each element of the 2-d array f [x,y] is called a pixel or
pel (from “picture element“)
What is a Digital Image? (cont…)

 Pixel values typically represent gray levels,colours, heights,
opacities etc
 Remember digitization implies that a digital image is an
approximation of a real scene
What is a Digital Image? (cont…)

 Common image formats include:
 1 sample per point (B&W or Grayscale)
 3 samples per point (Red, Green, and Blue)
 4 samples per point (Red, Green, Blue, and “Alpha”, a.k.a. Opacity)
Color Components
Key Stages in Digital Image Processing
Key Stages in Digital Image Processing:

Image Aquisition

Image Enhancement

Image Restoration

Morphological Processing

Segmentation

Object Recognition

Representation & Description

Image Compression

Colour Image Processing
Image Processing Examples

Restoration of image from Hubble Space Telescope
Launched in 1990 the Hubble telescope can take images of very distant
objects However, an incorrect mirror made many of Hubble’s images useless
Image processing techniques were used to fix this

Color photo enhancement
Original Automatic Enhancement

Noise reduction
Degraded image Noise-reduced image

Special Effects
Photo Simulated Simulated

color pencils oil painting

Halftoning

Pseudocolor enhancement for security screening

Extraction of settlement area from an aerial image

Earthquake Analysis from Space
Image shows the ground displacement due to Landers earthquake in CA, 1992

Face Detection

Image Segmentation

Mosaic from 33
source images
Mosaic from 21 source images


Face morphing

Face Blurring for Privacy Protection!

Handwriting recognition - OCR

License plate readers

Biometrics: Fingerprint recognition
FBI’s
Integrated
Automated
Fingerprint
Identification
System
IAFIS

Biometrics: Iris recognition
Login without a password…
Face recognition systems now

Fingerprint scanners on
beginning to appear more widely
many new laptops, http://www.sensiblevision.com/
other devices
Object recognition (in mobile phones)
Google Goggles
Interactive Games: Kinect
Mobile robots
NASA’s Mars Spirit Rover

http://en.wikipedia.org/wiki/Spirit_rover http://www.robocup.org/
Saxena et al. 2008

STAIR at Stanford

Mugshot retrieval
Video Summarization
Only send out “important” motion pictures such as home-runs
Content-based Image Retrieval
retrieved building images


Вовед во предметот PDF

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Вовед во предметот PDF

Uploaded by

Copyright:

Available Formats

ФАКУЛТЕТ ЗА ИНФОРМАТИЧКИ НАУКИ И КОМПЈУТЕРСКО ИНЖЕНЕРСТВО

вон. проф. д-р Ивица Димитровски

 Final project or Final exam

Digital Image Processing

The first photograph in the world

A Historical Overview of DIP

The Bartlane cable picture

Images were transferred by

The number of distinct gray levels coded by Bartlane system

Soar Into Outer Space

Such techniques were used in other

History of DIP (cont…)

1979: Sir Godfrey N. Hounsfield &

History of DIP (cont…)

The Boom of Digital Images in the Last 20 Years

A Physical Perspective of Image Acquisition

 Extend the capabilities of human vision

Visible (I): Photography

Visible (II): Motion Pictures

Visible (III): Biometrics and Forensics

Visible (IV): Light Microscopy

Taxol (250) Cholesterol (40) Microprocessor (60)

Visible (V): Remote Sensing

Earth at night (Only Asia/Europe shown)

Visible (VI): Mobile Imaging

Visible (VII): Light Field Camera

Beyond Visible (I): Thermal Images

Human body disperses Autoliv’s night vision system

Beyond Visible (II): Radar Images

Beyond Visible (III): MRI and Astronomy

knee spine head

Beyond Visible (IV): Fluorescence Microscopy

normal corn smut corn

Beyond Visible (V): Medical Diagnostics

Beyond Visible (VI): PET and Astronomy

Cygnus Loop in the

Other Non-Electro-Magnetic Imaging Modalities

potential locations of oil/gas

2500 Scanning Electron Microscopy (SEM) image of

Cartoon Pictures (Non-photorealistic)

Synthetic Images in Gaming

League of Legends (MOBA)

Virtual Reality (Photorealistic)

Visit NIOSH when you have a chance

Virtual surgery (surgery simulator)

Mixture of Graphics and Photos

Morgantown, WV in Google Map

Toward the Future: Nano-scale Imaging

Image Display and Perception

LCD: Liquid Crystal Display

Philips 42FD9954 Flat Screen Future: bigger, faster, cheaper

LED: Light-Emitting Diode

NASA Space Shuttle on the Princeton display wall, March 1999

Display on Mobile Devices

portable DVD PDA

LG Autostereoscopic 3D TV without glasses at CES 2011

The Ultimate Display: Virtual Retinal Display?

Human Vision System

Fascinating Optical Illusions

Fraser Spiral Illusion. The overlapping black arcs appear to form a

Fascinating Optical Illusions

Focus on the dot in centre...

Fascinating Optical Illusions