Professional Documents
Culture Documents
A Correlation-Based Fingerprint
Verification System
Asker M. Bazen, Gerben T.B. Verwaaijen, Sabih H. Gerez,
Leo P.J. Veelenturf and Berend Jan van der Zwaag
University of Twente, Department of Electrical Engineering,
Laboratory of Signals and Systems,
P.O. box 217 - 7500 AE Enschede - The Netherlands
Phone: +31 53 489 3827 Fax: +31 53 489 1060
E-mail: a.m.bazen@el.utwente.nl
ProRISC 2000 Workshop on Circuits, Systems and Signal Processing, Veldhoven, The Netherlands, November 2000.
2
0.9
0.8
0.7
0.6
FRR
0.5
0.4
0.3
(a) Ridge-ending (b) Bifurcation
0.2 EER
0
0 0.2 0.4 0.6 0.8 1
FAR • thresholding to obtain a binary fingerprint image,
• morphological operations like thinning to obtain ridges
Fig. 2. Example of a receiver operating curve (ROC), in which the
possible operating modes are indicated by the stars. that are only one pixel wide,
• minutiae extraction from the thinned image,
• application of heuristics to reduce the number of false
Fingerprints are slightly different each time they are cap- minutiae,
tured. Therefore, matching cannot be carried out by sim- • registration of minutiae templates by Hough trans-
ply calculating the crosscorrelation of two prints. There are form,
two types of distortions when comparing one fingerprint to • matching score computation.
another print of the same finger. The main drawback of the minutiae-based approach is
• Noise is caused by the capturing device or by e.g. dirty
the error propagation from the minutiae extraction to the
fingers. This noise can be reduced by application of
decision stage. In general, the extracted minutiae tem-
appropriate filters.
plates contain a number of false minutiae, while also some
• Shape distortions are caused by pressing the convex
minutiae will be missed. This is especially the case when
elastic fingerprint surface on a flat sensor. This may
using bad-quality fingerprints. The heuristics do not catch
result in stretch, rotation and shear, which also might
all spurious minutiae, while they might reject some of the
be present only in certain parts of the fingerprint due
genuine minutiae. As a result, the decision stage has to
to non-uniform finger pressure. Shape distortions can-
compare two affected sets.
not be compensated easily.
The minutiae sets of the primary and secondary finger-
Most fingerprint recognition systems first extract the
prints are registered, which means aligned, by means of
minutiae from fingerprints, and then compare the minutiae
a Hough transform. This transform searches for the pa-
sets of two prints. The standard minutiae-based fingerprint
rameter set (Tx , Ty , ϕ, S) that aligns the minutiae sets as
verification system is discussed in Section II. To eliminate
well as possible. For this purpose, the number of match-
some of the drawbacks of the minutiae based systems, we
ing minutiae pairs is used as an evaluation measure. In
have chosen to design a system that directly uses the gray-
the parameter set, Tx and Ty are translations in x and y
level information. This correlation-based fingerprint veri-
direction, ϕ is rotation and S is scale.
fication system is discussed in Section III. In Section IV,
some experimental results of the application of this system Minutiae sets of prints that originate from the same fin-
to fingerprint databases are discussed, and in Section V, ger do in general not contain the same minutiae, due to
the conclusions of this paper are given. errors in the first stages of the algorithm. Because of false
and missed minutiae, it is even possible that both sets do
II. Minutiae-Based Approach not even contain the same number of minutiae. Obviously,
this decreases the performance of registration and match-
Most fingerprint verification systems follow a minutiae-
ing. Shape distortions decrease the performance even more.
based approach, see e.g. [1]. Minutiae-based fingerprint
In the presence of these distortions, the perfectly register-
verification systems first extract the minutiae, shown in
ing transformation does not exist, even for sets that only
Figure 3, from the fingerprint images. Then, the decision
contain corresponding minutiae.
is based on the correspondence of the two sets of minutiae
locations.
III. Correlation-Based Fingerprint Matching
Minutiae-based fingerprint verification systems use a
large number of successive processing steps. In general, In order to deal with some of the problems of the
the following steps can be identified in a minutiae-based minutiae-based approach, we have chosen an alternative
system: approach. Instead of only using the minutiae locations, our
• directional field estimation, method directly uses the gray-level information from the
• adaptive filtering for noise reduction, fingerprint image, since a gray-level fingerprint image con-
ProRISC 2000 Workshop on Circuits, Systems and Signal Processing, Veldhoven, The Netherlands, November 2000.
3
tains much richer, more discriminatory, information than are only parallel lines, the coherence is very high, while in
only the minutiae locations. Those locations only charac- noisy areas, the coherence is low [6], [7].
terize a small part of the local ridge-valley structures [2], Templates that are chosen in regions of high coherence
[3], [4]. values cannot be located reliably in a second fingerprint
The correlation-based fingerprint verification system is [8]. However, at locations around minutiae, more gray-
inspired by [5]. It first selects characteristic templates in scale gradient orientations are present, resulting in a sig-
the primary fingerprint. Then, template matching is used nificantly lower coherence. Therefore, the coherence can be
to find the positions in the secondary fingerprint at which used as an appropriate measure that indicates the presence
the templates match best. Finally, the template positions of minutiae as well as a measure that indicates how well a
in both fingerprints are compared in order to make the template can be located in the secondary fingerprint.
decision whether the prints match. At first sight, this template selection criterion seems to
conflict with segmentation [6]. While segmentation chooses
A. Template Selection the regions of low coherence values as noise or background
The first step in the template matching algorithm is the areas, now the regions that have low coherence values have
selection of appropriate templates. This is a crucial step, to be chosen as reliable templates. However, this contra-
since good templates will be easily localized in the sec- diction is solved by the notion of scale [9]. Segmentation
ondary print at the right position, while bad templates will selects a large, closed area as foreground, in which holes and
not. More generally, the templates should be uniquely lo- other irregularities are filled by means of morphology. In-
calized in the secondary fingerprint. The template should stead, the coherence based template selection only searches
fit as well as possible at the same location, but as badly as for local coherence dips in this foreground area.
possible at other locations. The drawback of this method is that noisy areas show
The first template property to consider is the size of the coherence dips as well, while these are certainly not reliable
templates. There must be an optimal template size, as can templates. This problem may be solved by using appropri-
be seen from two extreme situations. When the entire fin- ate filters.
gerprint is taken as template, any attempt to align specific
corresponding positions will lead to misalignments at other A.3 Correlation-Based Template Selection
positions due to shape distortions. On the other hand, if The third method satisfies the template requirements
templates of only 1 by 1 pixel are chosen, it is clear that most directly. In this method, templates are selected by
the templates do not offer enough distinction. Experiments checking how well they fit at other locations in the same
have shown that a template size of 24 by 24 pixels is a good fingerprint. If a template fits almost as well at another
compromise. location as it does at its original location, it is not a use-
The second problem in selecting the right templates is ful template. However, if a template fits much worse at
which template positions to chose. Research has shown for all other locations in the fingerprint, it is a template that
instance, that a template that contains only parallel ridge- offers a lot of distinction. Therefore, the ratio of fit at
valley structures cannot be located very accurately in the a template’s original location to the fit at the next best
secondary fingerprint. In this paper, three template selec- location can be used as a template selection criterion.
tion criteria are proposed, being minutiae-based, coherence- Since the correlation-based checking is carried out by
based and correlation-based. means of template matching, this method consumes a lot
of computational power. This makes it a less attractive
A.1 Minutiae-Based Template Selection method to use. However, it is for instance possible to com-
As mentioned before, templates that only contain par- bine this approach with the previous two methods. In that
allel ridge-valley structures do not offer much distinction. case, possible template locations are extracted by one of
On the other hand, when a template contains one or more the methods of the previous subsections. Then, the corre-
minutiae, it will be much easier to find the correct location lation characteristics of those locations are checked as an
in the secondary print. Using this assumption, one possible additional selection criterion.
approach to select template locations is to extract minutiae
from the fingerprint image and to define templates around B. Template Matching
the minutiae locations. Once the templates have been selected in the primary
A drawback of this technique is that it suffers from most fingerprint, their corresponding positions in the secondary
of the problems of minutiae-based systems. Still, many fingerprint have to be found. This can be done using stan-
false minutiae are extracted, causing at least a part of the dard template matching techniques.
templates to be rather unreliable. The template is shifted pixelwise over the secondary
print. At each position, the gray-level distance between
A.2 Coherence-Based Template Selection
the template and the corresponding area in the secondary
The coherence of an image area is a measure that in- print is determined by summing the squared gray-level dif-
dicates how well the local gradients are pointing in the ferences for each pixel in the template. After having shifted
same direction. In areas where the ridge-valley structures the template over the entire finger, the location where the
ProRISC 2000 Workshop on Circuits, Systems and Signal Processing, Veldhoven, The Netherlands, November 2000.
4
or
?
(ϕsji − ϕski , ρsji /ρski ) ≈ (ϕpji − ϕpki , ρpji /ρpki )
? for 1 ≤ i, j, k ≤ n, i 6= j 6= k (9)
(∆xsij , ∆yij
s
) ≈ (∆xpij , ∆yij
p
for 1 ≤ i, j ≤ n, i 6= j
)
(4) However, there is one practical drawback to this method.
using the notations that are illustrated in Figure 4. Instead The template locations are obtained by means of template
of comparing n template positions, now n(n − 1)/2 RTPs matching. If a template is scaled or rotated more than some
are classified, of which n − 1 are independent. constant, it is not possible anymore to localize it in the
ProRISC 2000 Workshop on Circuits, Systems and Signal Processing, Veldhoven, The Netherlands, November 2000.
5
T1
p(ω̂0,T |ω1,F ) = 0.2 (11)
T1
Rho1 Rho1
p(ω̂1,T |ω0,F ) = 0.02 (12)
T0 Phi1
C.2 Combining Elementary Decisions
T0 Phi1 Phi2
Phi2 Rho2 We now have to classify the two fingerprints as being a
Rho2
T2
match or not. This decision is based on n(n − 1)/2 relative
T2
template positions. This can be solved using the theory of
Bernoulli experiments, which combine n independent ex-
(a) Primary fingerprint (b) Secondary fingerprint periments using binominal distribution. The probability
P (X = k) for k positive outcomes when doing n indepen-
Fig. 5. Use of 3 templates to allow rotation and scaling. dent experiments that all have a probability of success p is
given by:
n k
P (X = k) = p (1 − p)n−k (13)
k
where
n n!
= (14)
k k! (n − k)!
is the binominal coefficient and n! denotes factorial.
The n(n − 1)/2 RTPs are certainly not independent. If
(a) Matching fingerprints (b) Non-matching finger- we choose one template as reference, all template positions
prints are fixed by only n − 1 distances, while all other distances
can be calculated. Therefore, only n−1 independent RTPs
Fig. 6. Scatter diagrams of the (ln ρs /ρp , φs − φp ) pairs. are available.
The choice of the reference template is rather important.
If one template is not localized at the right position in the
secondary image. Furthermore, the same holds, to some secondary fingerprint, and this template is chosen as ref-
extent, for scaling. This makes the tolerance of any amount erence template, all RTPs will be classified non-matching.
of rotation and scaling less useful. This results in a false rejection of the fingerprint. There-
Since the test of Expression 8 uses one more indepen- fore, we chose the reference template as the one that has
dent classification than the test of Expression 9, and the the most RTP matches.
last step does not add much value, we adopt the test of Ex- Once the reference template has been chosen, there are
pression 8 for the rest of the paper. The scatter diagrams n − 1 RTPs that are in principle independent. This means
of the (ln ρsij /ρpij , ϕsij −ϕpij ) pairs, both for matching finger- that the combination of all RTP matches can be considered
prints and for non-matching prints, are given in Figure 6. as a Bernouilli experiment, and Expression 13 can be ap-
These pairs are classified by applying an elliptical thresh- plied. A threshold kT is set for the final fingerprint match
old: or non-match classification, resulting in:
ρs 2 !2
ln ρij FAR = p(ω̂1,F |ω0,F )
p ϕsij − ϕpij
ij
+ <1 (10) = P (X ≥ kT | non-match)
ρT ϕT
X n − 1
n−1
= p(ω̂1,T |ω0,F )k ·
where ρT and ϕT are the parameters determining the shape k
k=kT
of the ellipse. (1 − p(ω̂1,T |ω0,F ))n−k−1 (15)
The result of this procedure is a match or non-match
classification for all n(n−1)/2 template combinations. The and
probability that an RTP is classified non-matching while
the prints match, is given by p(ω̂0,T |ω1,F ), while the prob-
ability that a template distance is classified matching while FRR = p(ω̂0,F |ω1,F )
the prints don’t match is denoted by p(ω̂1,T |ω0,F ). Here, = P (X < kT | match)
the subscripts T and F denote template and fingerprint T −1
kX
n−1
respectively. = p(ω̂0,T |ω1,F )n−k−1 ·
k
The thresholds that provide the best discrimination of k=0
matching and non-matching RTPs, give for this database: (1 − p(ω̂0,T |ω1,F ))k (16)
ProRISC 2000 Workshop on Circuits, Systems and Signal Processing, Veldhoven, The Netherlands, November 2000.
6
2
4
1 2
4
2 3 1
4
1
5
3 3
5
5
In order to meet the commonly used requirements for shape distortions in the fingerprint, unlike the minu-
fingerprint verification systems, being F AR = 10−4 and tiae templates for which the optimal global transform
F RR = 10−2 , and using the values given in Expressions 11 is searched.
and 12, it can be calculated that the use of n = 10 tem- The disadvantages of the correlation-based fingerprint ver-
plates with threshold kT = 4 satisfies the required per- ification method are:
formance. For these parameters, the exact performance is • Template matching is a method that demands a rather
given by: high computational power, which makes the method
less applicable for real time applications.
• The method is at the moment not capable of dealing
FAR = p(ω̂0,F |ω1,F ) = 1.8 · 10−5 (17) with rotations of more than about 10 degrees. This
FRR = p(ω̂1,F |ω0,F ) = 3.1 · 10−3 (18) is caused by the fact that, for larger rotations, the
templates don’t match well anymore, causing incorrect
An example of the results of this method, using only positions to be found. A solution to this problem is
5 templates, is given in Figure 7. The figure shows that rotating the templates and then performing the match-
for matching prints, indeed the relative template positions ing again. However, this is a solution that requires a
are about equal, while for non-matching prints, they are lot of additional computational power.
completely different. • Problems might arise if the minutiae-based or
coherence-based template selection methods are used
D. Discussion of the Method while 2 minutiae surroundings resemble a lot. In this
The correlation-based fingerprint verification that is case, there is a probability that template matching will
proposed in this section, is compared to the traditional find the incorrect template position, which degrades
minutiae-based methods. The advantage of the correlation- the matching performance. Use of the correlation-
based method are: characteristic template selection will solve this prob-
lem.
• The method uses the much richer gray-level informa-
tion of the fingerprint image instead of only positions IV. Experimental Results
of minutiae.
• The method is also capable of dealing with fingerprints The correlation based fingerprint verification system that
of bad image quality from which no minutiae can be is described in this paper has participated in FVC2000, a
extracted reliably. Fingerprint Verification Competition [11] which was part of
• False and missed minutiae do not decrease the match- the ICPR2000 conference. This section will present some
ing performance. of the results of this competition as well as a discussion
• Unlike the minutiae templates, the template locations how to interpret these results.
are already paired, which results in much simpler
matching methods. When registering minutiae sets, A. Experiment Setup
it is not known in advance which minutiae from both Although many research groups have developed finger-
sets should correspond. print verification algorithms, only a few benchmarks are
• The first decision stage only classifies relative template available. Developers usually perform tests over self-
positions. This method tolerates non-uniform local collected databases, since in practice, the only available sets
ProRISC 2000 Workshop on Circuits, Systems and Signal Processing, Veldhoven, The Netherlands, November 2000.
7
ProRISC 2000 Workshop on Circuits, Systems and Signal Processing, Veldhoven, The Netherlands, November 2000.
8
Fig. 8. Results of the correlation based fingerprint verification system. In this figure, FAR is called false matching rate (FMR) and FRR is
called false non-matching rate (FNMR).
0.9 1
0
10
0.8 0.9
−1
0.8 10
0.7
0.7 10
−2
0.6
0.6
−3
0.5 Impostor Genuine 10
FRR
0.5 FAR FRR
0.4 −4
0.4 10
0.3
0.3 −5
10
0.2 0.2
−6
10
0.1 0.1
−7
0 0 10 −20 −15 −10 −5 0
0 0.2 0.4 0.6 0.8 1 0 0.2 0.4 0.6 0.8 1 10 10 10 10 10
Threshold Threshold FAR
dized by the European Commission, The Netherlands and [7] M. Kass and A. Witkin, “Analyzing oriented patterns,” Com-
Nordrhein-Westfalen, in the scope of the Interreg Program. puter Vision, Graphics, and Image Processing, vol. 37, no. 3,
pp. 362–385, Mar. 1987.
[8] M. Schrijver, A.M. Bazen, and C.H. Slump, “On the reliability
References of template matching in biomedical image processing,” in Pro-
[1] A.K. Jain, L. Hong, S. Pankanti, and R. Bolle, “An identity- ceedings of SPS2000, IEEE Benelux Signal Processing Chapter,
authentication system using fingerprints,” Proc. of the IEEE, Hilvarenbeek, The Netherlands, Mar. 2000.
vol. 85, no. 9, pp. 1365–1388, Sept. 1997. [9] T. Lindeberg, Scale-Space Theory in Computer Vision, Kluwer
[2] S. Prabhakar, A.K. Jain, J. Wang, S. Pankanti, and R. Bolle, Academic Publishers, Boston, 1994.
“Minutia verification and classification for fingerprint match- [10] G.T.B. Verwaaijen, “Fingerprint authentication,” M.S. the-
ing,” in Proceedings of ICPR2000, 15th Int. Conf. Pattern sis, Faculty of Electrical Engineering, University of Twente, En-
Recognition, Barcelona, Spain, Sept. 2000. schede, The Netherlands, May 2000, EL-S&S-002N00.
[3] A.K. Jain, S. Prabhakar, L. Hong, and S. Pankanti, “Filterbank- [11] D. Maio, D. Maltoni, R. Cappelli, J.L. Wayman, and A.K. Jain,
based fingerprint matching,” IEEE Transactions on Image Pro- “Fvc2000: Fingerprint verification competition,” in Proceedings
cessing, vol. 9, no. 5, pp. 846–859, May 2000. of ICPR2000, 15th Int. Conf. Pattern Recognition, Barcelona,
[4] D. Maio and D. Maltoni, “Minutiae extraction and filtering Spain, Sept. 2000.
from gray-scale images,” in Intelligent Biometric Techniques [12] R. Cappelli, A. Erol, D. Maio, and D. Maltoni, “Synthetic
in Fingerprint and Face Recognition, L.C. Jain et al., Ed., pp. fingerprint-image generation,” in Proceedings of ICPR2000,
155–192. CRC Press LLC, 1999. 15th Int. Conf. Pattern Recognition, Barcelona, Spain, Sept.
[5] A.R. Roddy and J.D. Stosz, “Fingerprint feature process- 2000.
ing techniques and poroscopy,” in Intelligent Biometric Tech-
niques in Fingerprint and Face Recognition, L.C. Jain, U. Halici,
I. Hayashi, S.B. Lee, and S. Tsutsui, Eds., pp. 37–105. CRC
Press, 1999.
[6] A.M. Bazen and S.H. Gerez, “Directional field computation for
fingerprints based on the principal component analysis of local
gradients,” in Proceedings of ProRISC2000, 11th Annual Work-
shop on Circuits, Systems and Signal Processing, Veldhoven,
The Netherlands, Nov. 2000, to be published.
ProRISC 2000 Workshop on Circuits, Systems and Signal Processing, Veldhoven, The Netherlands, November 2000.