Image Analysis: An

emerging tool for data

analysis
PROF. VICTOR M. ROMERO II
Faculty of Computer Science
Division of Natural Sciences and Mathematics
UPV Tacloban College

28/10/2019 1st Eastern Visayas Data Festival 1

28/10/2019 1st Eastern Visayas Data Festival 2
Light and Vision

28/10/2019 1st Eastern Visayas Data Festival 3

28/10/2019 1st Eastern Visayas Data Festival 4
The Human Visual System

28/10/2019 1st Eastern Visayas Data Festival 5

Electromagnetic Spectrum

28/10/2019 1st Eastern Visayas Data Festival 6

Digital Image Reproduction

28/10/2019 1st Eastern Visayas Data Festival 7

What is a [Digital] Image?
• An image is represented by a
rectangular array of pixels.

174

62

28/10/2019 1st Eastern Visayas Data Festival 8

 Digital Colored Images
• Pixels as triples of values

(153,123,169)

(84,11,51)
(Red, Green, Blue)

28/10/2019 1st Eastern Visayas Data Festival 9

Additive Color
Mixing
All colors in modern display devices are
represented as a combination of three
individual colors red, green, blue in
different itnensities.

28/10/2019 1st Eastern Visayas Data Festival 10

Additive Color
Mixing
All colors in modern display devices are
represented as a combination of three
individual colors red, green, blue in
different itnensities.

28/10/2019 1st Eastern Visayas Data Festival 11

Image Processing
• An image processing operation typically defines a new image
g in terms of an existing image f.

Image f Image g

28/10/2019 1st Eastern Visayas Data Festival 12

Grayscale Conversion

28/10/2019 1st Eastern Visayas Data Festival 13

Resize (Reduce)

28/10/2019 1st Eastern Visayas Data Festival 14

Resize (Enlarge)

28/10/2019 1st Eastern Visayas Data Festival 15

Quantization
Reducing the number of possible
intensities in a pixel.

256 gray levels 32 gray levels 16 gray levels

8 gray levels 4 gray levels 2 gray levels

28/10/2019 1st Eastern Visayas Data Festival 16

Image Enhancement

28/10/2019 1st Eastern Visayas Data Festival 17

Image Analysis
• Image analysis is the extraction of meaningful information
from (mainly digital) images by means of digital image
processing techniques.
• Goal-oriented image processing.

28/10/2019 1st Eastern Visayas Data Festival 18

Image Segmentation

Original Blue-channel Grayscale Binary Image

Image Image Image Mask

Figure: From scaled to segmented image

Segmented
Image
28/10/2019 1st Eastern Visayas Data Festival 19
 Image analysis allows us to
treat images as data from
which we can draw useful
insights and information.
28/10/2019 1st Eastern Visayas Data Festival 20
 Image analysis allows us to
treat images as data from
which we can draw useful
insights and information.
28/10/2019 1st Eastern Visayas Data Festival 21
Information on Images

{a0, a1, a2, a3, a4, a5, a6}

• Contrast (a0)
• Inverse Difference Moment(a1)
• Sum Average(a2)
• Sum Variance(a3)
• Difference Variance(a4)
• Difference Entropy(a5)
• Information Measures of Correlation(a6)
Segmented Grey-level Co-occurrence
Image Matrix 7 Haralick Features

28/10/2019 1st Eastern Visayas Data Festival 22

Information on Images

28/10/2019 1st Eastern Visayas Data Festival 23

Machine Learning in Image Analysis

+ Learning
Algorithm
= Trained
Model
Training Input

28/10/2019 1st Eastern Visayas Data Festival 24

Machine Learning in Image Analysis
• Applying machine learning in images allows the development
of automation systems.

Trained
Classification
Model (plant1, plant2, …, plantn)
Input Output

Figure: From image input to corresponding classification

28/10/2019 1st Eastern Visayas Data Festival 25

Signature Verification

28/10/2019 1st Eastern Visayas Data Festival 26

Signature Verification
• Learning features from sample signatures and use them for
verification.

Trained
Classification
Model (real, fake)
Input Output

28/10/2019 1st Eastern Visayas Data Festival 27

Biometrics
• Learn features from sample fingerprint(s) and use them for
identification.

Trained
Classification
Model (person1, person2, …, personn)
Input Output

28/10/2019 1st Eastern Visayas Data Festival 28

Today’s Drivers

Internet Access Cheaper and

More Powerful Democratized
Hardware Access to
Trainings and
Development
Tools

28/10/2019 1st Eastern Visayas Data Festival 29

Growth in number
of Internet Users

28/10/2019 1st Eastern Visayas Data Festival 30

Growth in number
of Internet Users

28/10/2019 1st Eastern Visayas Data Festival 31

Computing Power
through the Years

28/10/2019 1st Eastern Visayas Data Festival 32

Image Quality

28/10/2019 1st Eastern Visayas Data Festival 33

Image Analysis and Machine
Learning Tools

Sci-kit learn
Python Library

ImageJ Image
analysis
software
28/10/2019 1st Eastern Visayas Data Festival 34
Image Analysis and Machine
Learning Tools

Machine
Learning in
TensorFlow Online Tutorials
for TensorFlow

28/10/2019 1st Eastern Visayas Data Festival 35

Style Transfer

Input Image Reference Image Output Image

28/10/2019 1st Eastern Visayas Data Festival 36
Style Transfer

Input Image Reference Image Output Image

28/10/2019 1st Eastern Visayas Data Festival 37
Automated Image Colorization

28/10/2019 1st Eastern Visayas Data Festival 38

Image Synthesis

28/10/2019 1st Eastern Visayas Data Festival 39

Land Cover Classification

28/10/2019 1st Eastern Visayas Data Festival 40

Biodiversity Estimation

28/10/2019 1st Eastern Visayas Data Festival 41

Traffic Analysis and Self-driving Cars

28/10/2019 1st Eastern Visayas Data Festival 42

China’s Social
Credit System
Assigns a score to each
individual based on his
actions in society.

28/10/2019 1st Eastern Visayas Data Festival 43

28/10/2019 1st Eastern Visayas Data Festival 44
Summary
• Image analysis is a powerful tool which allows us to treat
images as actual data from which we can draw useful insights.
• These insights and information can be used to support
evidence-based decision making.
• Potentials of image analysis is further expanded when
combined with other tools (e.g., Machine Learning)

28/10/2019 1st Eastern Visayas Data Festival 45