Krishna Engineering College, Ghaziabad

Department of Information Technology

SYNOPSIS REPORT
(2023-24)

Project Title: Face Sketch Construction and Recognition

Project Type: Application

Name Roll Number Section Signature

Group member (1) Deeksha Agrawal 2001610130023 A

Group member (2) Manoj Yadav 2001610130043 A

Group member (3) Swastika Pawar 2001610130077 B

Group member (4) Tanisha Gupta 2001610130080 B

Project Guide Remarks:

Signature

Date of submission
Contents of Synopsis Report

The following sections will provide insights on the goal of the project, scope
of the project, software and hardware requirements of the project.

1. Problem Introduction

Forensic face sketch recognition has become a popular area of research in

computer vision, mainly due to increasing security demands, forensic
investigation for criminal suspects and its potential, commercial and law
enforcement applications. It is a very challenging problem and up to date
and there is no feasible technique that provides a robust solution to all
situations and different applications that forensic face sketch recognition
may encounter. Hence, this study focuses on developing a technique that
provides a solution for an efficient face sketch identification system in
forensic applications.

1.1 Motivation
Face sketch recognition can significantly assist law enforcement agencies
in solving crimes. When witnesses provide sketches of suspects, an
automated recognition system can help identify potential matches from
databases, expediting the investigation process and increasing the chances
of capturing suspects.

In cases of missing persons or abductions, sketches are often the primary

source of visual identification. An accurate face sketch recognition system
can be a crucial tool for locating and reuniting missing individuals with
their families.

1
Face sketch recognition can be integrated into access control systems to
provide secure and convenient authentication. This technology can replace
or complement traditional methods such as passwords or PINs, reducing
the risk of unauthorized access.

Developing accurate face sketch recognition systems presents a challenging

problem in the fields of artificial intelligence and machine learning.
Researchers and engineers are motivated to push the boundaries of these
technologies by solving this complex task.

Face sketch recognition has the potential to make a significant global

impact by helping solve crimes, locate missing persons, improve artistic
creativity, and enhance security, ultimately contributing to safer
communities and more creative and efficient industries.

1.2 Project Objective

The primary objective of the project is to design and implement a face
sketch recognition system that can accurately match hand-drawn or
digitally sketched facial images to their corresponding photographs,
achieving a high level of recognition accuracy. Divide the dataset into
training, validation, and test sets to train and fine-tune the recognition
system. The objective is to optimize model hyperparameters, prevent
overfitting, and ensure robust performance.

If applicable to the project's scope, develop a real-time face sketch

recognition system that can process input in real-time, making it suitable
for applications requiring instant recognition, such as surveillance or
interactive systems. Identify areas for future research and improvements,

2
such as scalability, adaptability to different artistic styles, and potential
integration of additional biometric features.

Create an intuitive and user-friendly graphical interface (GUI) using Java

to allow users to interact with the system easily. The interface should
enable users to upload sketches or photographs and receive recognition
results. Implement security and privacy features to ensure the responsible
use of the recognition system, addressing concerns related to data
protection and potential misuse.

1.3 Scope of the Project

The project will focus on recognizing faces from hand-drawn or digitally
sketched images and matching them with their corresponding photographs.
The primary objective is to achieve accurate recognition, with a focus on
the core technical aspects of feature extraction and machine learning model
development.

Gather and preprocess a diverse dataset of face sketches and photographs to

be used for training and evaluation.
Data preprocessing will include alignment, noise reduction, and
normalization. Divide the dataset into training, validation, and test sets for
model training and evaluation.
Optimize model hyperparameters and ensure that the system does not
overfit.
Develop a real-time face sketch recognition system, enabling quick
processing of input for applications that require instant recognition.

3
2. Related Previous Work
.

There are lot of studies on face sketch construction and recognition using
various approaches. Dr. Charlie Frowd along with Yasmeen Bashir,
Kamran Nawaz and Anna Petkovic designed a standalone application for
constructing and identifying the facial composites, the initial system was
found to be time consuming and confusing as the traditional method, later
switching to a new approach in which the victim was given option of faces
and was made to selected similar face resembling the suspect and at the end
the system would combine all the selected face and try to predict
automatically the criminal’s facial composite.
The Results where promising and 10 out of 12 composite faces where
named correctly out of which the results 21.3% when the witness was
helped by the department person to construct the faces and 17.1% when the
witness tried constructing faces by themselves.

Xiaou Tang and Xiaogang Wang proposed a recognition method of photo-

sketch synthesized using a Multiscale Markov Random Field Model the
project could synthesis a give sketch into photo or a given photo in to
sketch and then search the database for a relevant match for this the model
divided the face sketch in to patches.
In this they first synthesized the available photos in to sketch and then
trained the model making the model to decrease the difference between
photos and sketch this enhanced the overall efficiency of the recognition
model. For testing this they took few samples in which the photos where
synthesized in to sketch and the same faces were drawn from sketch artist
and then the model was trained from 60% data and remaining 40% data for
testing the model. The overall results where impressive but not up to the
mark as expected.

4
3. Software and Hardware requirements
Here are some common software components and technologies that are
used for developing the Face Sketch Recognition application:

Software Operating System Windows

Requirements
Programming Language Java FX and java
maven, AWS, Machine
Learning and Deep
Learning

Integrated Development Visual Studio Code

Environment

Hardware Processor i3
Requirements
RAM 4 GB

Storage 256 GB

5
4. Proposed Method
The following steps are required to achieve the objective of this project:

Step 1: Requirements Gathering: Start by understanding the specific

requirements of the face sketch recognition application. Defining the use
cases, target audience, and any special features or constraints.

Step 2: Data Collection: Collecting diverse dataset of face sketches and

corresponding reference images, and ensuring that the dataset covers different
ages, genders, ethnicities, and facial expressions.

Step 3: Data Preprocessing: Cleaning and preprocessing the data by resizing,

cropping, and standardizing the images and sketches. This step is crucial for
improving the model's performance.

Step 4: Model Selection: Choosing an appropriate model for face sketch

recognition. Convolutional Neural Networks (CNNs) are commonly used.

Step 5: Model Training: Training the selected model on the preprocessed data.
By using a portion of the dataset for training and a separate portion for
validation to monitor the model's performance and prevent overfitting.

Step 6: User Interface (UI) Development: Developing a user-friendly interface

that allows users to input sketches, images, or use a drawing tool. This UI will
also display recognition results.

Step 7: Backend Development and Integration: Creating the backend

infrastructure to serve the model, manage user requests, and process data and
then integrating the trained model with the backend system to make real-time
predictions based on user inputs.

Step 8: Testing and Deploying : Finally conducting comprehensive testing and

testing the application under different scenarios and with various types of
sketches and images and then deploying the model.

6
5. Deliverables

The core deliverable is a fully functional face sketch recognition system that
can accurately match hand-drawn or digitally sketched facial images with
their corresponding photographs. This system should demonstrate the ability
to recognize faces from a wide range of sketch styles and artistic
interpretations.

Trained machine learning models, such as Convolutional Neural Networks

(CNNs), Support Vector Machines (SVMs), that have been fine-tuned on the
dataset and are capable of making accurate face recognition predictions. A
diverse and well-organized dataset of face sketches and corresponding
photographs. This dataset serves as the foundation for training and evaluating
the recognition system and should be documented comprehensively.

Reports and data on the performance of the recognition system, including

accuracy, precision, recall, F1 score, and Receiver Operating Characteristic
(ROC) curves, demonstrating the system's capabilities and limitations. If real-
time recognition is within the project's scope, a functional real-time
recognition system should be developed and delivered.

The platform includes features that are unique and different when compared to
related studies on this field, enhancing the overall security and accuracy by
standing out among all the co-related studies and proposed systems in this
field.

7
6. Stakeholders
Recognizing and involving these stakeholders is essential for a comprehensive
and successful Face Sketch Recognition project, as it ensures that the
technology is developed, deployed, and used in a manner that meets the needs
and expectations of its various users and adheres to ethical and legal
standards.

• Technology companies: The technology companies that develop and

market face sketch recognition systems are also important stakeholders
and are responsible to ensure that their systems are accurate and reliable,
and that they are used in a way that respects the privacy of individuals.

• Crime victims: Crime victims and witnesses to crime can benefit from
face sketch recognition technology by providing them with a way to help
identify perpetrators of crime. For example, a crime victim may be able
to provide a description of the perpetrator to a police sketch artist, who
can then create a sketch of the suspect. This sketch can then be used to
generate leads and identify the suspect.

• Law enforcement: Law enforcement agencies are the primary users of

face sketch recognition technology. They are interested in using this
technology to improve their ability to identify and track suspects and
victims of crime. For example, face sketch recognition could be used to
generate a sketch of a suspect based on eyewitness testimony, which
could then be used to identify the suspect in databases of known
criminals.

• Government agencies: Government agencies at the local, state, and

federal levels are also stakeholders in face sketch recognition
technology.

8
7. Gantt Chart

9
8. References
• Hamed Kiani Galoogahi and Terence Sim, “Face Sketch Recognition By
Local Radon Binary Pattern: LRBP”, 19th IEEE International
Conference on Image Processing, 2012.

• B. Klare and A. Jain, “Sketch to photo matching: a featurebased

approach”, SPIE Conference on Biometric Technology for Human
Identification, 2010.

• W. Zhang, X. Wang and X. Tang, “Coupled information theoretic

encoding for face photo-sketch recognition”, in Proc. of CVPR, pp. 513-
520, 2011

• F.-L. Zhang, J. Wang, E. Shechtman, Z.-Y. Zhou, J.-X. Shi, and S. M.

Hu, “PlenoPatch: Patch-based plenoptic image manipulation,” IEEE
Trans. Vis. Comput. Graph., vol. 23, no. 5, pp. 1561–1573, May2017.

10