Face Detection and Recognition

Technology
Facial recognition (or face recognition) is a type
of biometric software application that can identify a specific
individual in a digital image by analyzing and comparing
patterns.

Facial recognition systems are commonly used for

security purposes but are increasingly being used in a variety of
other applications. For example, Facebook uses facial
recognition software to help automate user tagging in
photographs.
Biometrics
A biometric is a unique, measurable characteristic of a human
being that can be used to automatically recognize an individual
or verify an individual identity. Biometrics can measure both
physiological and behavioral characteristics.
Physiological biometrics (based on measurements and
data derived from direct the human body) include:
a. Finger-scan ,
b. Facial Recognition,
c. Iris-scan ,
d. Retina-scan and
e. Hand-scan.
Behavioral biometrics (based on measurements and data
derived from an action) include:
a. Voice-scan ,
b. Signature-scan and
c. Keystroke-scan .
 Face recognition processing
Face recognition is a visual pattern recognition
problem.
A face is a three-dimensional object subject to
varying illumination, pose, expression is to be
identified based on its two-dimensional image (
or three- dimensional images obtained by laser
scan).

A face recognition system generally consists of 4

modules - detection, alignment, feature
extraction, and matching.

 Localization and normalization (face detection

and alignment) are processing steps before face
recognition (facial feature extraction and
matching) is performed.
 HOW FACE RECOGNITION SYSTEMS
WORK
Facial recognition software is based on the ability to first
recognize faces, which is a technological feat in itself
There are about 80 nodal points on a human face. Here are few nodal
points that are measured by the software.

• Distance between the eyes

• Width of the nose
• Depth of the eye socket
• Cheekbones
• Jaw line and
• Chin

These nodal points are measured to create a numerical code,

a string of numbers that represents a face in the database. This code is
called face print.
Only 14 to 22 nodal points are needed for faceit software to
complete the recognition process
Skin detection

skin

• Skin pixels have a distinctive range of colors

• Corresponds to region(s) in RGB color space
• Skin classifier
• A pixel X = (R,G,B) is skin if it is in the skin (color) region
• How to find this region?

CSE 576, Spring 2008 Face Recognition and Detection 7

Skin classifier

• Given X = (R,G,B): how to determine if it is skin or not?

• Nearest neighbor
• find labeled pixel closest to X
• Find plane/curve that separates the two classes
• popular approach: Support Vector Machines (SVM)
• Data modeling
• fit a probability density/distribution model to each class
CSE 576, Spring 2008 Face Recognition and Detection 8
Bayes rule

what we measure domain knowledge

(likelihood) (prior)
• In terms of our problem:

what we want normalization term

(posterior)

What can we use for the prior P(skin)?

• Domain knowledge:
– P(skin) may be larger if we know the image contains a person
– For a portrait, P(skin) may be higher for pixels in the center
• Learn the prior from the training set. How?
CSE 576, Spring 2008 – P(skin) is proportion
Face
ofRecognition
skin pixelsand Detection
in training set 9
Face recognition processing flow.
 The Viola/Jones Face Detector

•A seminal approach to real-time object detection

•Training is slow, but detection is very fast
•Key ideas
Integral images for fast feature evaluation
Boosting for feature selection
Attentional cascade for fast rejection of non-face
windows
Image Features

“Rectangle filters”

Value =
∑ (pixels in white area) –
∑ (pixels in black area)
Template Matching Methods

• Store a template
• Predefined: based on edges or regions
• Deformable: based on facial contours
(e.g., Snakes)
• Templates are hand-coded (not
learned)
• Use correlation to locate faces
COMPONENTS OF FACE RECOGNITION SYSTEMS

The 3 main components of face recognition systems, they are as

follows

 Enrollment module,
 Database and
 Identification module.
Detection Results
 CONCLUSION

Face recognition technologies have been

associated generally with very costly top secure
applications. Today the core technologies have
evolved and the cost of equipment is going
down dramatically due to the integration and the
increasing processing power. Certain
applications of face recognition technology are
now cost effective, reliable and highly accurate.
THANK
YOU