Advanced Forensic Research by Multi- Model

Human Verification using Face and Speech

Prof(Dr.) Pramod K. Pal

Dept. of Computer Science & Engineering
Bengal College of Engineering & Technology
(West Bengal University of Technology, Kolkata)
Durgapur – 713212
West Bengal INDIA
Pramod.pal27@gmail.com
 How are people identified?

• People are identified by three basic means:

– Something they have (identity document or token).

– Something they know (password, PIN).

– Something they are (human body).

 Automatic Identification
• Different means of automatic identification:
– Possession-based (credit card, smart card)
• “something that you have”

– Knowledge-based (password, PIN)

• “something that you know”

– –Biometrics-based (biometric identifier)

• “something about or produced by your physical make-up”
 Problems with Possession- or
Knowledge-based Approaches
• Card may be lost, stolen or forgotten.

• Password or PIN may be forgotten or guessed by the imposters.

• 25% of people seem to write their PIN on their ATM card.

• Estimates of annual identity fraud damages:

– $1 billion in credit card transactions.

– $1 billion in fraudulent cellular phone use.

– $3 billion in ATM withdrawals.

• The traditional approaches are unable to differentiate between an

authorized person and an impostor.
 Biometrics
• Biometrics is a general term alternatively used to
describe a characteristic or process.

• As a characteristic:
– A measurable biological (anatomical or physiological) and
behavioral characteristic that can be used for automated
recognition.

• As a process:
– Automated methods of recognizing an individual based on
biological (anatomical or physiological) and behavioral
characteristic.
 Face recognition &
Authentication
Recognition differs from face Authentication Face authentication has
become a potential a research field related to face recognition. Face
recognition differs from face authentication because the former has to
determine the identity of an object, while the latter needs to verify the
claimed identity of a user. Speech is one of the basic.
 Face Recognition
• Humans efficiently recognize each other by face.

• In security applications, it is difficult for a security officer

to remember and recognize the faces of all the authentic
individuals.

• Challenges
– Automatic face localization.
– Recognizing the face from a general view point under
different illumination conditions, facial expressions, and
aging effects
 Problem determine Who is who
from a database, is gaining more and
more attention in the area of
computer vision
• Detection
• Representation
• Identification
Why is Face Recognition Hard?

false
Four Major Components in our face
recognition System

• Modeling
• Feature Detection
• Normalization
• Identification
Face feature extraction and
recognition
Face detection and building database
using multi-layered relative edge map
 Speech Analysis and Feature
Extraction
• LPC processing for speech recognition
A simulation result of LPC in the
proposed method
 HMM for speech recognition and
verification
Feature extraction and verification for speech 450 Face Recognition
 Personal verification using
multimodal biometric
The entire verification process
 Code book of personal face and
speech information
Created personal code book
Proposed fuzzy logic for improved
verification
 Experimental results
The process to recognize face and speech Accepted results
 Conclusions
• we present a human verification method using combined face and
speech
• information in order to improve the problem of single biometric
verification. Single biometric verification has the fundamental
problems of high FAR and FRR. So we present a multimodal,
biometric human verification method to improve the verification
rate and reliability in real-time. We use PCA for face recognition
and HMM for speech recognition for real-time personal verification.
As a result the proposed verification method can provides stable
verification rate, and it overcomes the limitation of a single mode
system. Based on the experimental results, we show that FRR can be
reduced down to 0.0001% in the human multimodal interface
method using both face and speech information.
Thank you.