SELFI ID MATCH

A PROJECT REPORT

Submitted by

Jhelam Rout(220720100335)

in partial fulfillment for the award of the

degree of

MASTER IN COMPUTER APPLICATION

in
COMPUTER SCIENCE AND ENGINEERING

DEPARTMENT OF MCA

SCHOOL OF ENGINEERING AND TECHNOLOGY

BHUBANESWAR CAMPUS
CENTURION UNIVERSITY OF TECHNOLOGY AND MANAGEMENT
ODISHA

NOVEMBER 2023
 SPECIMEN CERTIFICATE

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING

SCHOOL OF ENGINEERING AND TECHNOLOGY
BHUBANESWAR CAMPUS

BONAFIDE CERTIFICATE

Certified that this project report “Selfi_id_match” is the bonafide work of

“JHELAM ROUT” who carried out the project work under my supervision. This is
to further certify to the best of my knowledge that this project has not been carried
out earlier in this institute and the University.

SIGNATURE
Dr. Saneev Kumar
Das
ASST. PROFESSOR,
DEPT. OF MCA

Certified that the above-mentioned project has been duly carried out as per the norm
of the college statutes of the university

SIGNATURE

Prof. Rakesh Kumar Ray

HEAD OF THE DEPARTMENT MCA, CUTM

DEPARMENTAL SEAL
 DECLARATION

I hereby declare that the project entitled “SELFI_ID_MATCH” submitted for the

“Minor Project” of 3rd semester M.C.A in Computer Science and Engineering is

my original work and the project has not formed the basis for the award of any

Degree / Diploma or any other similar titles in any other University / Institute.

Name of the Student: Jhelam Rout

Registration No: 220720100335

Place:

Date:

ACKNOWLEDGEMENT
 I wish to express my profound and sincere gratitude to Prof. Saneev Kumar
Das, Department of Computer Science and Engineering, SoET, Bhubaneswar
Campus, who guided me into the intricacies of this project nonchalantly with
matchless magnanimity.

I thank Prof. Rakesh Kumar Ray, Head of the Dept. of Department of

Computer Science and Engineering, SoET, Bhubaneswar Campus and Prof. Sujata
Chakravarty, Dean, School of Engineering and Technology, Bhubaneswar Campus
for extending their support during Course of this investigation.

I would be failing in my duty if I don’t acknowledge the cooperation

rendered during various stages of Selfi id match.

I am highly grateful to Dr. Saneev Kumar Das, who evinced keen interest
and invaluable support in the progress and successful completion of my project
work.

I am indebted to Selfi id match for their constant encouragement, co-

operation and help. Words of gratitude are not enough to describe the
accommodation and fortitude which they have shown throughout my endeavour.

Jhelam Rout (220720100335)

TABLE OF CONTENTS

CHAPTER NO TITLE
 1 CERTIFICATE 2
2 DECLARATION 3

3 ACKNOWLEDGEMENT 4

4 PROBLEM STATEMENT 6

5 ABSTRACT 7

6 INTRODUCTION 8

7 REQUIRMENTS 9

8 USES 11

9 SOURCE CODE 12

10 OUTPUT 13

11 CONCLUSION 22

12 REFERENCES
23

PROBLEM STATEMENT
Id-Selfie matching system is used to verify person’s identity by using face
recognition techniques. Here, a system is constructed which can efficiently
authenticate the user. A live image (selfie) of a person is taken and it is compared
with the photo on their ID, provided by them at the time of verification process.
There are many issues involved in the process of face recognition.

A number of automated ID-selfie matching systems have been deployed at

international border crossings. Deployed in 2007, SmartGate in Australia is the
earliest of its kind. Due to an increasing number of travelers to Australia, the
Australian government introduced SmartGate at most of its international airports as
an electronic passport check for ePassport holders. To use the SmartGate, travelers
only need to let a machine read their ePassport chips containing their digital photos
and then capture their face images using a camera mounted at the SmartGate.

ABSTRACT
Technology has been growing at a very fast pace as the world is moving towards a
digital world. Identity verification plays a very important role whether you want to
open a bank account or want to travel from one place to other. The aim of this paper
is to develop a system which is going to verify a person using face recognition
techniques. The system would be using MTCNN technique for image alignment, face
detection and feature extraction. It would be trained using python libraries such as
tensorflow, keras with triplet loss as an error function. The verification steps are 1)
Take scanned image of ID document(pan card) and a live selfie of the person as input
2) Do preprocessing and generate embeddings which are compared using cosine
similarity, 3) Display the verification status as the output. This system can overcome
the flaws of manual process for identity verification as such as time consuming,
unreliable, etc.

INTRODUCTION
The traditional approach for verifying person’s identity involves manual checking
of ID cards. In this case it is possible that the person with similar looks can bypass
the verification system. This may lead to many frauds since unauthorized user will
get access to the system. When it comes to banking sector it is very important that
the accurate verification should be done in order to protect users’ data and privacy
to avoid any fraud. We have developed a system which will accurately identify the
person using his/her ID photo and the person’s live photo. The system will use face
recognition techniques to match the two pictures. At first face from live photo and
ID face image will be detected and it will be pre-processed to extract some
important face features which will be used for matching task. Matching would be
done using Cosine Similarity and if this distance is less than the threshold (defined
by the user) then matching would be successful (both pictures belong to same
person) otherwise it would fail. This system is mainly useful for banking sector.
They can use this system for verifying their customers and improve the security
standards. This project has wide scope in many sectors like in civil applications and
law enforcement, security application in electronic transactions to list a few.

SOFTWARE REQUIREMENTS OF SELFI_ID_MATCH

 Operating System: Windows 2000 Professional

  Environment: Jupyter Notebook

 Framework: Version 1.0

 Language: Python

HARDWARE REQUIREMENTS OF SELFI_ID_MATCH

 Processor: 11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz 2.42 GHz

 Processor Speed: 250 MHz to 833 MHz

 Ram: 512 Mb Ram

 Hard Disk: 40 Gb
USES

Pandas

Pandas is an open-source library authorized under the Berkeley Programming

Conveyance (BSD). This well-known library is frequently utilized in the field of data
science. They're generally utilized for examination, control, and cleaning of
information, in addition to other things. Without having to switch to another
programming language like R, Pandas enables us to carry out straightforward data
modelling and analysis.

NumPy

When it comes to scientific computing, NumPy is one of the fundamental packages

for Python, providing support for large multidimensional arrays and matrices along
with a collection of high-level mathematical functions to execute these functions
swiftly. NumPy relies on BLAS and LAPACK for efficient linear algebra
computations. NumPy can also be used as an efficient multi-dimensional container of
generic data.

Seaborn

This package makes statistical model visualization possible. The library, which is
largely based on Matplotlib, makes statistical graphics possible by:

1. Variable examination by means of a Programming interface in view of datasets.

2. Make complex representations effortlessly, including multi-plot frameworks.
3. To compare data subsets, univariate and bivariate visualizations are utilized.
4. A wide range of color schemes are available for pattern displays.
5. Direct relapse assessment and plotting are done consequently.
Matplotlib

This library is responsible for the plotting of numerical data. It is utilized in data
analysis for this reason. An open-source library plots superior quality figures, for
example, pie outlines, scatterplots, boxplots, and diagrams, in addition to other things.

SciPy

Scipy is a Python library. Scientific computing, information processing, and high-

level computing are the primary uses for this open-source library. The library contains
a large number of easy-to-use methods and functions for quick and easy computation.
Scipy can be utilized for numerical calculations close by NumPy.

Some of SciPy's subpackages include cluster, fftpack, constants, integrate, io, linalg,
interpolate, ndimage, odr, optimize, signal, spatial, special, sparse, and stats.

Scikit- learn

Additionally, Scikit-learn is a Python-based open-source machine learning library.

This library supports both supervised and unsupervised learning methods. This library
already comes pre-installed with a number of well-known algorithms as well as the
SciPy, NumPy, and Matplotlib packages. Spotify music recommendations are the
Scikit-most-learn application that is most widely used.
Conclusion

In this project, we have proposed an ID - Selfie matching system for authentication

purpose. We have trained and tested the system using different methods as mentioned
previously. After all the training and testing we have reached the accuracy of 73.52%
and arrived at a conclusion that the system is able to match blur images and the
rotated images more efficiently. Whereas it shows poor result for other factors such
as facial expression, large age gap. More work needs to be done for overcoming these
factors.
We compare the proposed system with existing general face recognition systems
on our private dataset and see a significant improvement with our system,
indicating the necessity of domain-specific modelling of ID-selfie data. Finally,
we compare the performance of different matchers on the Public-IvS dataset and
find that although this dataset is similar to a general face dataset, our system still
generalizes well.
References

1. https://ieeexplore.ieee.org/document/8636237

2. https://www.kaggle.com/code/jamilistiaq/selfi-id-match-vgg-100-accuracy

3. ://efaidnbmnnnibpcajpcglclefindmkaj/https://www.irjet.net/archives/V7/i6/IRJET-

V7I61038.pdf