CH.Venkanna EC104018 M.Tech (E.


Introduction to image segmentation
y The purpose of image segmentation is to partition an

image into meaningful regions with respect to a particular application y The segmentation is based on measurements taken from the image and might be greylevel, colour, texture, depth or motion


Introduction to image segmentation
y Usually image segmentation is an initial and vital

step in a series of processes aimed at overall image understanding y Applications of image segmentation include
y Identifying objects in a scene for object-based

measurements such as size and shape y Identifying objects in a moving scene for object-based video compression (MPEG4)


Introduction to image segmentation
y Example 1 y Segmentation based on greyscale y Very simple model of greyscale leads to inaccuracies in object labelling


Different Methods of image segmentation
y There are different types of segmentation methods are

proposed. These are
y Thresholding y Clustering

y Relaxation labelling y EM algorithm(Proposed Algorithm)

The Expectation/Maximization (EM) algorithm
y In general we may imagine that an image comprises L

segments (labels)


Within segment l the pixels (feature vectors) have a probability distribution represented by pl ( x | U l ) U l represents the parameters of the data in segment l y Mean and variance of the greylevels y Mean vector and covariance matrix of the colours y Texture parameters


The Expectation/Maximization (EM) algorithm
y The incomplete data are just the measured pixel greylevels or feature vectors y We can define a probability distribution of the incomplete data as pi ( x;U1 ,U 2 .....U L ) y The complete data are the measured greylevels or feature vectors plus a mapping function f (.) which indicates the labelling of each pixel y Given the complete data (pixels plus labels) we can easily work out estimates of the parameters l : l ! ..L y But from the incomplete data no closed form solution exists

The Expectation/Maximization (EM) algorithm
y The algorithm is as follows:

Initialize an estimate of l : l ! 1..L Repeat Step 1: (E step) Obtain an estimate of the labels based on the current parameter estimates Step 2: (M step) Update the parameter estimates based on the current labelling Until Convergence

The Expectation/Maximization (EM) algorithm
y A recent approach to applying EM to image

segmentation is to assume the image pixels or feature vectors follow a mixture model
y Generally we assume that each component of the

mixture model is a Gaussian y A Gaussian mixture model (GMM)
l 1

pl ( x | U l ) !

1 1 exp( ( x  Ql )T 7l1 ( x  Ql )) (2T ) d / 2 det(7 l )1/ 2 2



l !1

El ! 1


p ( x | 5)



E l pl ( x | U l )

The Expectation/Maximization (EM) algorithm
y Our parameter space for our distribution now includes

the mean vectors and covariance matrices for each component in the mixture plus the mixing weights

5 ! Q , 7 , E ,..........Q L , 7 L , E L
y We choose a Gaussian for each component because the

ML estimate of each parameter in the E-step becomes linear


The Expectation/Maximization (EM) algorithm
y Define a posterior probability P(l | x j ,U l ) as the

probability that pixel j belongs to region l given the value of the feature vector x j y Using Bayes rule we can write the following equation
P (l | x j , U l ) !

E l pl ( x j | U l )


L k !1

E k pk ( x | U k )

y This actually is the E-step of our EM algorithm as

allows us to assign probabilities to each label at each pixel

The Expectation/Maximization (EM) algorithm
y The M step simply updates the parameter estimates

using MLL estimation
( m 1) l

1 n ! § P(l | x j U l( m ) ) n j !1

x j P (l | x j , U l( m ) ) §

Ql( m 1) !

j !1 n

P (l | x j , U l( m ) ) §
j !1

§ P (l |
7 l( m 1) !
j !1


, U l( m ) ) ( j


Ql( m ) )( j
, U l( m ) ) j 

Ql( m ) )T a j

§ P(l |
j !1


Fig : Original image

Fig : (Right column) The proposed image segmentation, (left column) direct segmentation

Extraction of object from an image
y After partition an image into meaningful

regions and sometimes it is required extract object from an image y Extraction founds many applications in Biometric image processing and face recognition. y Face Feature Extraction(voronoi Diagram method) 
Detecting eyes  Detecting nose and mouth

Fig : Extraction of eyes ,nose and mouth from an image

Extraction of alphabet from number plate

Fig : Original image and segment image,extracting alphabet .

y The EM algorithm is general image segmentation

technique in computer vision with many applications. y Extraction found many applications in security system and biometric image processing.