!

ro$uc's)+vervie/
Currentlydeployedfield
provenBiometricSpeaker
Identificationand
VerificationTechnology.
October 2008
Index
! VOICE BIOMETRICS
! BATVOX
! ASIS
! BS3
! CONCLUSIONS
October 2008 A12ITI+!ro$uc')s+vervie/
Voice Biometrics: Key Technology for Security
! Use of voice evidence in court.
! Identification of unknown intercepted voices
! Intelligence and crime prevention using phone conversations
monitoring.
! Protection against Identity fraud
Voice Biometrics
October 2008 A12ITI+!ro$uc')s+vervie/
What is Voice Biometrics?
Voice Biometrics
Extraction of unique characteristics of vocal tract,
from voice sound waves.
A12ITI+!ro$uc')s+vervie/
What is in the voice?
! Information layer:
! Whatthepersonissaying.Thecontentofthespeech.
! Canbeautomaticallyobtainedusingclassicalspeechrecognitiontechnologies.
! Behavioral layer:
! HowdoyousayitAYouraccent,youremotions,yourculture,yourcountryDlanguageE,
the context.
! This is the level used by impersonators, and the level the brain mainly uses to identify
a person Dand obtain additional informationE
Voice Biometrics
THE BIOMETRIC LAYER:
Physicalinformationembeddedintovoicewavescomingfrom
yourvocaltract.
Notmodifiedbyyouremotionalstate,thelanguageyouuse,
etc..
October 2008 October 2008
How Voice Biometrics works?
! 5oicemo$el8akaas;voice<rin'>?
! Usingaminimumof40secondsofnetspeech,avoicemodeliscreatedforeach
individual.
! Containsinformationrelatedtovocaltractcharacteristics.Uniqueandindependentof
languageandtext.
! Scoringor;voicema'cB>
! UsingaminimumofMsecondsofnetspeech,wecomparetheutterancewiththemodel
and obtain a "score: The higher the score the more probable it is that the unknown voice
belongstothesameperson.
! Results
! Depending on the application, different techniques are used to "normalize the scores
Dset a scale common to all individuals and channelsE and set thresholds to make a
decision.
October 2008 A12ITI+!ro$uc')s+vervie/
Voice Biometrics
October 2008 A12ITI+!ro$uc')s+vervie/
Voice Biometrics: Key Competitive Advantages
Driver& Increasing internationa0
terroris1 and cri1e using di44erent
t56es o4 6hones8 the Internet8 and in
1u0ti60e 0anguages9
Voiceistheonlybiometriccharacteristic
obtainedremotely
Itisalreadyavailableinabundance.
Includesvaluableinformationbesides
biometricinformation
Easytointegrateinexisting
infrastructure:Telephonenetworks,VoIP,
etc..
Voice Biometrics
Agni'io)sCniDueA<<roacB
October 2008 A12ITI+!ro$uc')s+vervie/
Voicematchisdoneindependentlyofwhatthepersonissaying
TextIndependent
Voiceprintcanbeobtainedinonelanguage,andmatchedwith
voicesampleinanotherlanguage
CrossLanguagecapabilities
Microphone,landlinetelephone,cellularphones,VoIP,..
Workswithanyvoicechannel
ForensicLabs,Lawenforcement,Intelligence.
Proveninthemostdemandingenvironments.
Voice Biometrics
Agnitio: Pioneering Products
for Voice HLS Applications
October 2008 A12ITI+!ro$uc')s+vervie/
Present Voice
Evidence in court
Identification of
unknown voice during
police investigation
Speaker spotting to
filter mass phone
interceptions.
Voice Biometrics
1. Forensic Evidence in Court Hearings
October 2008 A12ITI+!ro$uc')s+vervie/
Forensic Labs relying only on Phonetic and
Linguistic techniques have limitations:
Impossible to handle unknown languages,
difficult to handle great number of calls,
etc.
Intercepted phone
conversations are used as
evidence in court. Experts
are required to perform
Speaker Verification
MARKET NEED
SOLUTION
Tool for biometric voice verification
designed for Forensic Experts. It
provides the precision and
reliability required in court hearings
PROBLEM
BATVOX
Speaker ID in Forensics
!Classical Approach: Linguistic/phonetics
! An expert in languages and phonetics compares both voice samples
(Suspect and unknown)
!Semiautomatic
! Using computer voice analysis programs, sonograms, formants and other
technical information are compared.
!Voice Biometrics
! Computer generates voice print, unique to speakers physical vocal tract.
! Computer compares suspect and unknown voice samples and provides a
matching score.
October 2008 A12ITI+!ro$uc')s+vervie/
BATVOX
A$$e$5alue)of5oiceGiome'ricsinHorensics
! Speaker ID verification using physical characteristics of the
vocal tract, instead of the way the person speaks
! Vocal tract "leaves unique features in voice sound waves.
! Voice Biometrics adds new and relevant information to
classical techniques.
! DependingonthecaseDLanguage,uniquephoneticfeatures,..Eitismoreorless
relevant.
October 2008 A12ITI+!ro$uc')s+vervie/
BATVOX
October 2008 A12ITI+!ro$uc')s+vervie/
BATVOX: Pioneering Product for Forensic
Laboratories
! Entry Product
! WidelyusedinEurope,LatinAmerica
andAsia
! FirstworkingsysteminSpanish
PoliceDIdentivox2000E
! Expertreportspresentedinmany
courtsglobally
Dr. Knzel (Univ. Marburg, Germany) formerly the key expert of the
German Federal Police. One of the most respected specialists world-
wide.
I have been using the BATVOX automatic system ...in more than 100 cases,
ranging 4ro1 : to ;<== individua0 voice co16arisons999 Looking @ack 4ro1 toda5
I 1ust sa5 that without the he06 o4 the s5ste1 I wou0d have had to dec0ine
1ost o4 the cases8 es6ecia005 when the5 invo0ved 0anguages unknown to 1e 0ike
Albanese or Turkish..
2008
BATVOX
October 2008 A12ITI+!ro$uc')s+vervie/
BATVOX reduces learning curve, guiding the new user
with a wizard, qualifying results and helping
interpretation of data
BATVOX
October 2008 A12ITI+!ro$uc')s+vervie/
"BATVOWprovidesthe
expertLikelihoodRateDLRE
results
"LR is the `stateoftheart
metrictomeasureevidence
strengthincourthearings
BATVOX
Success Story: Combating Corruption
! Prominent lawyer in Malaysia
was taped brokering the
appointment of top Judges
! Video posted on YouTube
created a turmoil in Malaysian
politics
October 2008 A12ITI+!ro$uc')s+vervie/
Malaysian Anti Corruption Agency used AGNTO's products and
support to verify the voice identity, and present evidence in court
BATVOX
Success Story:
Combating International Organized Crime
! Albanian Gang acting in Germany committed identity fraud
through the telephone.
! AffectingmorethanZ00Germanelderciti\ens
! German police recorded more than 3,000 phone
conversations both among the gang members themselves,
and of gang members swindling their victims.
! ConversationswereinGerman,English,AlbanianandSinto.Someof
thegangmembersspokethreedifferentlanguagesinvarioustaped
conversations.
October 2008 A12ITI+!ro$uc')s+vervie/
German Forensic Experts verified the identity of the gang members
involved in the crime using AGNTO's products, with 4 of the
defendants pleading guilty after hearing the Forensic Audio evidence.
BATVOX
Whats next?: 1: N Identification Capabilities
October 2008 A12ITI+!ro$uc')s+vervie/
1:1Forensic
evidence
verifications
1:NforLaw
enforcement
identifications
ASIS
2. Law Enforcement: Criminal Identification
using Voice
October 2008 A12ITI+!ro$uc')s+vervie/
Police have a large amount of voices
captured but identification was not possible.
Traditional methods not suitable for large
voice database searches. Sometimes voice
is the only available personal characteristic
of a criminal
Police obtains voice from
unknown person involved in
crime. (Bomb threat, lawful
phone interception, terrorist
video). Identification is
needed
MARKET NEED
SOLUTION
Tool for unknown speaker
identification using voice
biometrics. Automatic biometric
search easy to perform with
basic training
PROBLEM
ASIS
ASIS: Voice Biometric Database for Law
Enforcement
October 2008 A12ITI+!ro$uc')s+vervie/
Deployed in 3
customers, 4 more
pending this year.
In the following years 20-
40 countries will deploy
ASIS
$130M/yr in US only
Deployed in 25 countries
Fingerprint databases DNA
databases
ASIS
Voice Databases
$500M/yr market
25% Annual Growth
Almost every country
AFIS CODIS
! AGNITIOfollowsthesuccessof
otherprovenbiometric
technologies
ASIS
ASIS: Modular and scalable
October 2008 A12ITI+!ro$uc')s+vervie/
ASIS
DB Manager
GUI
Browser 1
Engine 1
DB
Task Manager
Application
Server
Presentation Tier
GUI
Browser 2
GUI
Browser N
Business Logic
Logic Tier
Data Tier
Engine Manager
Engine 2
Engine N
Queue
ASIS: Modular and scalable
October 2008 A12ITI+!ro$uc')s+vervie/
Browser 1
Browser 2
Browser 3
<HTTP>
<Ethernet>
<HTTP>
<Ethernet>
<Ethernet>
<HTTP>
<Ethernet>
Engine 1
Engine 2
Engine N DB Server
<HTTP>
Internet
Application Server
Task Manager Engine Manager
ASIS MULTICORE
Active MQ
<Ethernet>
<Ethernet>
<Ethernet>
October 2008 A12ITI+!ro$uc')s+vervie/
From 1,000upto100,000voicemodelsperminute.
SPEED
From^0,000upto200,000voicesstoredDBithout
6er4or1ance degradationE
From^upto1,000simultaneousconnections.
Maximumcapacity
Optimi\edforHPandLinuxSuse
Engines:ProliantDL320withWeonQuadcores
TaskManager:Integrity3a00withItaniumDual
core.
Hardware/OS
ASIS
ASIS Performance: CMC
October 2008 A12ITI+!ro$uc')s+vervie/
AGNITIO s forensic bench test Database.
Howtomeasure
performanceon1:N
systemsA
CMC:CumulativeMatching
Characteristic
Probabilityofyourtarget
beingamongthefirstN
candidates
ASIS
Ius'omersareS'ar'ing'oTes'an$'oCsei'
October 2008 A12ITI+!ro$uc')s+vervie/
A Latin A1erican securit5
organiDation9 Ehe 0argest :Fn
voice test 6er4or1ed unti0
now9 A01ost :G8=== voices
and 1ore than :9HM tria0s
!"
!#
$"
$#
1""
1 11 21 '1 (1 #1 )1 *1 !1 $1
1'+("" ,-./01
1#"23/131
4-52162!17
4-52#62$#7
4-521"62$*7
4-52829:23;/20913 <=->?>9093@
4-521 *27
4-52' $'7
4-52#2 $)7
An Euro6ean 6o0ice
organiDation9 Eest with rea0
4orensic audios9 S1a00er
data@ase9
ASIS
October 2008 A12ITI+!ro$uc')s+vervie/
BATVOX ASIS
Precision Maximum
accuracyina
1:1verification
Obtainalistof
candidate.The
verificationcanthenbe
refinedinaforensic
laboratory
Errors Minimi\efalse
positives
Minimi\efalsenegatives
Usability Forexpertswith
animportant
backgroundin
forensics
Foroperativeswithno
backgroundinaudioand
biometrics
Speed Notcritical Critical:thousandsof
identificationsper
minute
ASIS
ASIS: Voice Identification
! Launched from any authorized terminal, and
user
! MinimumMsecondsofspeech
! SearchcanbeguidedDoverasubsetEorgeneral
! Results
! BestNcandidates,withscoringandacolourcode,areshownto
theuser
! Ifuserisauthori\ed,originalvoicecanbeheard
! ThereisalinktotheCriminalInformationDatabase,
connectedtootherbiometricsystems
October 2008 A12ITI+!ro$uc')s+vervie/
ASIS
3. INTELLIGENCE: Speaker Spotting
October 2008 A12ITI+!ro$uc')s+vervie/
Traditional method are not useful for this
kind of real time massive task. Speed,
performance and fully automatic
implementation is required
Intelligence organizations do
passive interceptions that
need to be filtered and
classified. A key advantage
is to filter by key target
speakers
MARKET NEED
SOLUTION
Tool for biometric speaker spotting.
To be integrated into passive
interception systems. Detects
when specific target speakers are
involved in a conversation
PROBLEM
BS3
BS3: Key filtering tool for Intelligence Agencies
! SPEAKER DETECTION IN
MASS TELEPHONE
INTERCEPTIONS
! Spotaparticularspeakerina
continuousflowoftelephone
conversations
! Complement `Keyword
spotting and other `Artificial
Intelligence filtering systems.
October 2008 A12ITI+!ro$uc')s+vervie/
BS3 drastically reduces time spent scanning voice
in mass voice interception systems.
BS3
October 2008 A12ITI+!ro$uc')s+vervie/
BS3
October 2008 A12ITI+!ro$uc')s+vervie/
BATVOW
ASIS BS3
AFIS
CODIS
IBIS
Central
CriminalData
Other
Identification
Databases
SelectedAudios
Data
crunching
Keyword
spotting
BS3
BS3
October 2008 A12ITI+!ro$uc')s+vervie/
BATVOX ASIS BS3
Precision Maximum
accuracyina
1:1
verification
Obtainalistof
candidate.The
verificationcan
thenberefinedina
forensiclaboratory
Obtainalistof
candidatescalls
wherethetargetis
speaking.
Errors Minimi\efalse
positives
Minimi\efalse
negatives
Minimi\efalse
negatives
Usability Forexperts
withan
important
backgroundin
forensics
Foroperativeswith
nobackgroundin
audioand
biometrics
ForIntelligence
Agenciesdoing
criminalprevention.
Speed Notcritical Critical:thousands
ofidentifications
perminute
Critical:Severalcalls
perminute.
Thanks for
your attention.
For further information, please contact:
EmilioMartdne\CEO
emartine\eagnitio.es
EmmanuelDeromeVPHLSBusinessDevelopment
ederomeeagnitio.es
ChristianMorenoHLS BusinessDevelopment
chmorenoeagnitio.es
Beatri\Gon\fle\Siggen\aHLS BusinessDevelopment
bgon\ale\eagnitio.es
October 2008