Computer Vision and Image Processing

CoSc4113

Chapter 1
Introduction to Computer Vision and Image Processing

1
 Contents
 What is a computer vision?
 What is image?
 Related fields in computer vision
 Computer vision vs image processing
 Elements of visual perception
 Mathematical tools used in digital image processing
 Application of CV and IP
 Different image processing examples
 Fundamental steps in image processing
 Image sensing and acquisition
 Image sampling and quantization
 Representation of different image type’s: linear and nonlinear representation
 Digital image representation

2
“One picture is worth more than ten thousand words”
3
 What is a Digital Image?
• A digital image is a representation of a two-dimensional image
as a finite set of digital values, called picture elements or pixels

4
 What is a Digital Image? cont..
• Pixel values typically represent gray levels, colours, heights,
opacities etc
• Remember digitization implies that a digital image is an
approximation of a real scene

1 pixel

5
 What is a Digital Image? cont..
• Common image formats include:
 1 sample per point (B&W or Grayscale)
 3 samples per point (Red, Green, and Blue)
 4 samples per point (Red, Green, Blue, and “Alpha”,
Opacity)

6
7
 What is Digital Image Processing? cont..
• Digital image processing focuses on three major tasks
 Improvement of pictorial information for human interpretation
 Image processing for autonomous machine application
 Processing of image data for storage, transmission and
representation
• Some argument about where image processing ends and fields such
as image analysis and computer vision start

8
 What is Digital Image Processing? cont..

Human perception
Employ methods able to enhance pictorial information for
human interpretation and analysis such as:
• Noise filtering
• Content enhancement
- Contrast enhancement
- Deblurring
• Remote sensing

9
10
The pattern is defined is a coordinate system whose origin is
conventionally defined as the upper-left corner of the image .
We can describe the pattern by a function f(x,y).

(0,0)

Value f(x,y,z, ,t)

11
12
13
14
Structure of the Human Eye

15
16
Structure of the Human Eye

17
Structure of the Human Eye

18
Structure of the Human Eye

19
Image formation in the Eye

20
Image formation in the Eye

21
Video on Human Eye Image Formation

22
Issue of Contrast

23
Issue of Illumination

24
 The border of the
square is visible There seems to be
despite there is no a circle in the
border line middle

The short lines

seems to be slant
The horizontal but actually
line of the lower parallem
line seems longer

25
26
27
28
29
Issue of Illumination

30
Key Stages in Digital Image Processing

31
 Key Stages in Digital Image Processing:
Image Aquisition
• The action of retrieving an image from some source, usually a hardware-based
source, so it can be passed through whatever processes need to occur afterward.

32
 Key Stages in Digital Image Processing:
Image Enhancement
• Bring out detail that is obscured, or simply to highlight certain
features of interest in an image.

33
 Key Stages in Digital Image Processing:
Image Restoration
• Image Restoration is the operation of taking a corrupt/noisy image
and estimating the clean, original image.
• Corruption may come in many forms such as motion
blur, noise and camera mis-focus.
• Image restoration is performed by reversing the process that
blurred the image and such is performed by imaging a point source
and use the point source image to restore the image information
lost to the blurring process.
• Image restoration is different from image enhancement in that the
latter is designed to emphasize features of the image that make the
image more pleasing to the observer, but not necessarily to produce
realistic data from a scientific point of view.
• Image enhancement techniques provided by imaging packages use
no a priori model of the process that created the image

34
Key Stages in Digital Image Processing:
Image Restoration cont..

35
 Key Stages in Digital Image Processing:
Morphological Processing
• Deals with tools for extracting image components that are useful in the representation and
description of shape.

36
 Key Stages in Digital Image Processing:
Segmentation
• Partition an image into its constituent parts or objects.

37
 Key Stages in Digital Image Processing:
Object Recognition
• The process of assigns a label to an object based on its descriptors.

38
 Key Stages in Digital Image Processing:
Representation & Description
• Converting the data to a form suitable for computer processing.
Almost always follow the output of a segmentation stage.

39
 Key Stages in Digital Image Processing:
Image Compression
• Deals with techniques for reducing the storage required to save an
image.

40
 Key Stages in Digital Image Processing:
Colour Image Processing
• Color image processing is the analysis, transformation, and
interpretation of visual data presented in color.

41
42
43
44
45
46
47
48
49
50
Versus

51
52
53
On Facebook on NEWS

54
55
56
57
58
Lane departure warning, collision warning, traffic sign recognition,
pedestrian recognition, blind spot warning
59
https://www.theguardian.com/technology/2018/mar/31/tesla-car-crash-autopilot-
mountain-view
60
61
62
 Digit recognition, AT&T labs License place recognition
http://www.research.att.com/~yann

63
Tennis review system

64
65
66
67
68
69
What do these
numbers represent?

70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
n n/2 n/4

n/8 n/16 n/32

88
89
 256
16
shades
shades

8
shades
2
shades

90
End of chapter 1

91