You are on page 1of 38
Digital Image Processing I. Introduction Hamid Laga hamid@img.cs.titech.ac.jp Institut Telecom / Telecom Lille1
Digital Image Processing
I. Introduction
Hamid Laga
hamid@img.cs.titech.ac.jp
Institut Telecom / Telecom Lille1
http://www.img.cs.titech.ac.jp/~hamid/
Hamid Laga hamid@img.cs.titech.ac.jp Institut Telecom / Telecom Lille1 http://www.img.cs.titech.ac.jp/~hamid/

Presenter

Presenter 2 Hamid Laga PhD in Computer Science (2006), Tokyo Institute of Technology • Previuously: Assistant

2

Hamid Laga PhD in Computer Science (2006),

Tokyo Institute of Technology

Previuously: Assistant Professor, Tokyo Institute of Technology (Japan)

Since October 1 st , 2010: Associate Professor Telecom Institute / Telecom Lille1

Homepage:

Research fields

Image processing, Computer Vision,

3D Digital Geometry Processing,

Multimedia Information Retrieval

fields – Image processing, Computer Vision, – 3D Digital Geometry Processing, – Multimedia Information Retrieval

Course description

Target

Learn the fundamentals of digital image processing

Theoretical concepts, hands-on practice

Background

No prior knowledge of Image Processing is required

Basic linear algebra, signal processing, and probability theory.

Language

English (preferred)

French

Questions in French are accepted too.

Programming (TP)

Matlab (recommended)

Other languages (such as Java or C++) can be also used but NOT recommended.

3

– Matlab (recommended) – Other languages (such as Java or C++) can be also used but

Evaluation

In the class

(Very) Short assignments (home works)

Active participation

TP

Programming assignments

Final exam

4

(home works) • Active participation • TP – Programming assignments • Final exam 4

Course outline

Lecture 1: Introduction

Lecture 2: Digital Image Fundamentals

Lecture 3: Intensity transformations

TP1: Introduction to Matlab, Image manipulation with Matlab.

Lecture 4: Spatial filtering, convolution, and enhancement

Lecture 5: Image restoration

Lecture 6: Wavelet and multi-resolution processing

Lecture 7: Scale-space image processing

Lecture 8: Morphological image processing

Lecture 9: Image segmentation I

TP2: to be announced later

Lecture 10: Image segmentation II

TP3: to be announced later.

Summary and open discussion

5

later – Lecture 10: Image segmentation II – TP3 : to be announced later. – Summary

Resources

• Recommended textbooks • Others 6
Recommended textbooks
Others
6
Resources • Recommended textbooks • Others 6

Resources

Related online courses and tutorials

Digital Image Processing 2009-2010 (Prof. Bernd Gerod)

Rendering and image processing (Alexei Efros)

Computer Vision at CMU

Foundations of Computer Vision

L.Fei-Fei lectures notes

7

– L.Fei-Fei lectures notes http://vision.stanford.edu/teaching/cs223b/syllabus.html 7

A short survey

8

A short survey 8

What is digital image processing (DIP)

Processing digital images by the mean of a digital computer

Other related areas

Computer graphics:

Generate images with computers

Image analysis, Computer vision

The boundaries are not clear !!

Common distinction

Image processing is a discipline in which the inputs and

the outputs are images

9

clear !! • Common distinction • Image processing is a discipline in which the inputs and

Image processing vs. computer vision

Low-level

Preprocessing:

reduce noise, contrast enhancement, image sharpening.

Both input and outputs are images

10

• Preprocessing: • reduce noise, contrast enhancement, image sharpening. • Both input and outputs are images
• Preprocessing: • reduce noise, contrast enhancement, image sharpening. • Both input and outputs are images
• Preprocessing: • reduce noise, contrast enhancement, image sharpening. • Both input and outputs are images

Image processing vs. computer vision

Mid-level

Segmentation (Partitioning an image into regions or objects)

Description of the segmented objects

Classification / recognition of individual objects.

Inputs are images, outputs are attributes extracted from these images

(edges, contours, identity of individual objects).

are images, outputs are attributes extracted from these images (edges, contours, identity of individual objects). 11

11

are images, outputs are attributes extracted from these images (edges, contours, identity of individual objects). 11

Image processing vs. computer vision

High-level

Making sense of an ensemble of recognized objects

• Making sense of an ensemble of recognized objects Four Latin persons looking a little girl

Four Latin persons looking a

little girl

12

of an ensemble of recognized objects Four Latin persons looking a little girl 12 People with

People with umbrellas,

Rainy weather

of an ensemble of recognized objects Four Latin persons looking a little girl 12 People with

Image processing vs. computer vision

In this lecture

Low level

vs. computer vision • In this lecture Low level Mid level High level Four Latin persons

Mid level

vs. computer vision • In this lecture Low level Mid level High level Four Latin persons

High level

vision • In this lecture Low level Mid level High level Four Latin persons looking a

Four Latin persons looking a little girl

level Mid level High level Four Latin persons looking a little girl Image processing Image analysis,

Image processing

level Mid level High level Four Latin persons looking a little girl Image processing Image analysis,

Image analysis, computer vision

13

level Mid level High level Four Latin persons looking a little girl Image processing Image analysis,

The origins of digital image processing

1920 (newspaper industry)

Bartlane cable picture transmission system

Pictures were sent through a submarine cable between

London and New York

were sent through a submarine cable between London and New York 1920 Five levels of gray

1920

Five levels of gray

14

were sent through a submarine cable between London and New York 1920 Five levels of gray

1922

were sent through a submarine cable between London and New York 1920 Five levels of gray

1929

15 levels of gray

were sent through a submarine cable between London and New York 1920 Five levels of gray

The origins of digital image processing

1964 (Space applications, JPL California)

Pictures of the moon taken by Ranger7 processed to correct distortions inherent to on-board TV cameras

15

Pictures of the moon taken by Ranger7 processed to correct distortions inherent to on-board TV cameras

Courtesy of NASA

Pictures of the moon taken by Ranger7 processed to correct distortions inherent to on-board TV cameras

The origins of digital image processing

Late 1960s Early 1970s:

Medical imaging (invention of the Computerized Tomography - CT)

Remote earth resources observation, astronomy

1970s to now

Medicine, biological sciences, geography, archaeology, physics, nuclear medicine, law enforcement, defense, industry, …

2005 to now

internet !!

16

archaeology, physics, nuclear medicine, law enforcement, defense, industry, … • 2005 to now • internet !!

Image processing examples

Restoration of images from Hubble space telescope

examples Restoration of images from Hubble space telescope Source: Digital Image Processing 2009-2010 (Prof. Bernd
examples Restoration of images from Hubble space telescope Source: Digital Image Processing 2009-2010 (Prof. Bernd

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)

17

http://www.stanford.edu/class/ee368/, Courtesy of :IVPL Northwestern University, Chicago

(Prof. Bernd Girod) 17 http://www.stanford.edu/class/ee368/ , Courtesy of :IVPL Northwestern University, Chicago

Image processing examples

Color photo enhancement

Image processing examples Color photo enhancement Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)
Image processing examples Color photo enhancement Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)

18

photo enhancement Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/ 18

Image processing examples

Noise reduction

Image processing examples Noise reduction Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)
Image processing examples Noise reduction Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)

19

Noise reduction Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/ 19

Image processing examples

Image processing examples Input photo Special effects Simulated color pencils Simulated oil painting Source: Digital Image

Input photo

Special effects

Image processing examples Input photo Special effects Simulated color pencils Simulated oil painting Source: Digital Image

Simulated color pencils

examples Input photo Special effects Simulated color pencils Simulated oil painting Source: Digital Image Processing

Simulated oil painting

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)

20

oil painting Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/ 20

Image processing examples

Pseudo-color enhancement for security screening

examples Pseudo-color enhancement for security screening Source: Digital Image Processing 2009-2010 (Prof. Bernd

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)

21

security screening Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/ 21

Image processing examples

Extraction of settlement areas from aerial photos

examples Extraction of settlement areas from aerial photos Source: Digital Image Processing 2009-2010 (Prof. Bernd

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)

22

from aerial photos Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/ 22

Image processing examples

Detecting / assessing earthquake damages

processing examples Detecting / assessing earthquake damages Haiti earthquake. Source: http://www.disasterscharter.org/

Haiti earthquake. Source: http://www.disasterscharter.org/

23

examples Detecting / assessing earthquake damages Haiti earthquake. Source: http://www.disasterscharter.org/ 23
examples Detecting / assessing earthquake damages Haiti earthquake. Source: http://www.disasterscharter.org/ 23

Image processing examples

Image mosaics

A mosaic from 33 images
A mosaic from
33 images

24

A mosaic from 21 images Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)
A mosaic from 21 images
Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)
http://www.stanford.edu/class/ee368/

Image processing examples

Image processing examples Face detection Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)

Face detection

Image processing examples Face detection Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)

25

Face detection Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/ 25

Image processing examples

Face morphing

Image processing examples Face morphing Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)

26

Face morphing Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/ 26

Image processing examples

Biometrics

Image processing examples Biometrics Fingerprint recognition Iris recognition Source: Digital Image Processing 2009-2010

Fingerprint recognition

Image processing examples Biometrics Fingerprint recognition Iris recognition Source: Digital Image Processing 2009-2010

Iris recognition

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod)

27

Iris recognition Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/ 27

Quick tour of digital image processing

Image acquisition L3 Intensity transforms (Statistics, histogram, filtering, enhancement) L4, L5 Image

Image acquisition

L3

Intensity transforms

(Statistics, histogram, filtering, enhancement) L4, L5

Image restoration

L6

Wavelets & multiresolution analysis (L7)

Scale-space

processing (L8)

Morphological image processing

(L9)

Output are generally images

28

Segmentation (points, lines, edges, regions) - L10

Representation

Descriptors

Object Recognition

Output are attributes

Segmentation (points, lines, edges, regions) - L10 Representation Descriptors Object Recognition Output are attributes
Segmentation (points, lines, edges, regions) - L10 Representation Descriptors Object Recognition Output are attributes

Image acquisition

Image acquisition 29

29

Image acquisition 29

Intensity transforms

Intensity transforms 30 Original Blurring Sharpening

30

Original

Intensity transforms 30 Original Blurring Sharpening

Blurring

Intensity transforms 30 Original Blurring Sharpening

Sharpening

Intensity transforms 30 Original Blurring Sharpening

Image restoration

Image restoration 31 Original Restored

31

Original

Image restoration 31 Original Restored

Restored

Image restoration 31 Original Restored

Multi-resolution analysis

Multi-resolution analysis 32

32

Multi-resolution analysis 32

Scale-space processing

Scale-space processing 33

33

Scale-space processing 33

Morphological image processing

Morphological image processing 34

34

Morphological image processing 34

Image segmentation

Image segmentation 35
Image segmentation 35

35

Image segmentation 35
Image segmentation 35
Image segmentation 35
Image segmentation 35
Image segmentation 35
Image segmentation 35
Image segmentation 35

Requirements

Math

Linear algebra, Probability theory, Optimization

Signal processing

Fourier transforms, sampling theory

Machine learning

Data analysis

mainly Principal Component Analysis (PCA)

Pattern recognition

36

theory • Machine learning – Data analysis • mainly Principal Component Analysis (PCA) – Pattern recognition

Overview of this course

Overview

Lecture 1: Introduction

Lecture 2: Digital Image Fundamentals

Lecture 3: Intensity transformations

TP1: Introduction to Matlab, Image manipulation with Matlab.

Lecture 4: Spatial filtering, convolution, and enhancement

Lecture 5: Image restoration

Lecture 6: Wavelet and multi-resolution processing

Lecture 7: Scale-space image processing

Lecture 8: Morphological image processing

Lecture 9: Image segmentation I

TP2

Lecture 10: Image segmentation II

TP3

Summary and open discussion

37

9: Image segmentation I – TP2 – Lecture 10: Image segmentation II – TP3 – Summary

What is next

Review of some Mathematical concepts

38

What is next • Review of some Mathematical concepts 38