DEEP LEARNING IN LIE DETECTOR

AND BRAIN FINGERPRINTING

Shubhangi Sharma
Computer Engineering Department
MKSSS’s Cummins College Of Engineering For Women
Pune-411052, Maharashtra, India
shubhangi.sharma@cumminscollege.in

Abstract —- Lie detectors, also known as polygraph tests, are instruments used to measure changes in
physiological responses such as heart rate, blood pressure, and respiration, in response to questioning. These
changes are believed to be associated with stress and anxiety, which can be indicative of deception. A polygraph
test typically involves attaching sensors to a person's body and asking a series of questions, and a trained
examiner interprets the results. Brain fingerprinting, on the other hand, is a technique that measures changes in
the brain's electrical activity in response to specific stimuli, such as pictures or words. This technique involves
measuring an individual's brainwaves and using deep learning algorithms to analyze the data and identify
patterns associated with specific information. Brain fingerprinting is used to determine whether an individual has
specific information stored in their brain, such as knowledge of a crime scene or details of a terrorist attack.In lie
detection, us upward functional magnetic resonance imaging derives from studies which suggest that the person
shows many different patterns in the brain rather than when they are being truthful.This new technique uses the
brain waves which are helpful in identifying whether that person, who is subjected to the test, is able to remember
the minute details of the crime or not. Even if the subject tries to suppress the necessary information, it is trapped
in the brain and released in the form of waves. Brain Fingerprinting can detect the information with the help of
measuring cognitive information processing. It does NOT detect stress, emotion or the lies. It just computes
whether the “information is present or not” and a statistical confidence for each conclusion. Laboratory tests and
field tests at CIA (Central Intelligence Agency), US Navy, FBI (Federal Bureau of Investigation) have resulted in
100% accuracy. All the results’ determinations were correct. 3% of the results were found to be “indeterminate”.
It has been applied in many criminal cases too and is considered to be acceptable as a proof. Many alternative
techniques have failed to meet the accuracy and validity of the Brain Fingerprinting. Even after a reward of
$100,00, no one could beat the countermeasures of the Brain Fingerprinting test. Many principles of applying it
in the field as well as the laboratory have been discussed here.

Keywords —- Brain Fingerprinting, Lie Detector, electroencephalography, Deep Neural Network,

Convolutional Neural Network, polygraphic test, P-300 MERMER.

I. INTRODUCTION wave which surely is enough to catch him. This

The Lie Detector model is based on a few
assumptions that when a person lies, his heart rate,
respiration rate, fear, blood pressure and galvanic
skin resistance increases. A graph known as
polygraphic graph captures and records these
changes.
A new lie detecting technology has been developed in
the United States of America, by Dr. Larry Farwell,
known as Brain Fingerprinting. This is a new
invention in the field of criminology. This invention
is somehow outcasting the drawbacks of the already
existing polygraph test (also known as the Lie
Detector Test). Even if the person tries to suppress
the important information, the brain still generates a
technology works on “what you see is what you
remember” instead of “what you see is what you get”.
It is designed to recognize if the person recognizes
any small detail or something related to the pictures,
words or phrases being shown on the screen. The
pictures are relevant or irrelevant to the subject. The
relevant ones should trigger the brain and produce the
electroencephalographic waves. It is also known as
the “Guilty Knowledge Test”. Farewell has used this
technique in one of his cases where a person
convicted for murder was proved innocent and his
accuser was found guilty.
There are two types of features of the crime scene
that are of use:

1
DEEP LEARNING ALGORITHMS IN LIE DETECTOR AND BRAIN FINGERPRINTING
1. Permanent Features: They are the ones
which pre-exist at the crime scene and are
persistent even after the crime. This may
include buildings, land, streets etc.
2. Changed Features: They include the changes
that took place during the crime which may
include the position of the body (during a
murder), fingerprints, blood etc.
Even the participants in the crime have these two
features:
1. Permanent Features: It includes DNA and
Fingerprints.
2. Changed Features: It includes, for example
injuries sustained during the crime.
In some of the cases the investigators are able to
establish connections directly between the feature at
the crime scene and the permanent feature of the
culprit. This is mostly the case with the DNA and the
fingerprints. In few other cases, the investigators are
able to establish connections between the crime scene
and the culprit. For example, a fiber sample at the
crime scene can be matched with the features of the
suspect’s clothes he owns.
The culprit and the witnesses virtually know that they
have either participated and/or witnessed it
happening. The record of the crime in the brain for
the both, is almost the same and is often a much
comprehensive account of the crime.
The two main disadvantages of a witness testimony
are,
(i) The witness may lie in desired situations, (ii)
Human memory is really imperfect.
Brain fingerprinting is a very controversial technique
used to identify a terrorist or a dangerous person (an
accused) by measuring the “brain print”. This
technology is designed to see if a person/accused is
able to identify specific information corresponding to
some script, place, picture, words or phrases (related
to training camp or manual in case of terrorists). This
test is based on the P-300 complex which consists of
a series of well-known brain wave components.
When the brain is able to identify something similar
or familiar, it elicits a wave-like response which is
called MERMER (Memory and Encoding-Related
Multifaceted Electroencephalographic Response).
The MERMER consists of the brain response P-300.
The test, where the subject is fitted with a headband
equipped with sensors and shown a few
images/words in series on a screen, takes less than 10
minutes to complete. It is a Guilty Knowledge Test
where the “guilty” part in the brain is expected to
react in some way related to the event of the activity.
The polygraph test (i.e. lie detecting test) relies on the
measurements of autonomic arousal such as the heart
rate or the palm sweating, while the brain
2
fingerprinting measures the electric responses
through the headband consisting of many sensors.
The test’s accuracy is highly disputed by the
researchers but this is the latest well known test
which is accurate in detecting the “guilty” rather than
the lie detector test which can show false readings.
Lie detectors, also known as polygraph tests, are
instruments used to measure changes in physiological
responses such as heart rate, blood pressure, and
respiration, in response to questioning. These changes
are believed to be associated with stress and anxiety,
which can be indicative of deception.
The technology behind lie detectors involves the use
of sensors to measure physiological responses, which
are then recorded on a polygraph machine. The
sensors typically include a blood pressure cuff,
respiration sensors, and skin conductivity sensors.
The polygraph machine records these physiological
responses as a series of lines on graph paper.
In recent years, technology has advanced to include
digital polygraph machines that record physiological
responses electronically, as well as computerized
algorithms that analyze the data collected by the
sensors. These algorithms use statistical models to
detect changes in physiological responses that are
believed to be associated with deception.
The accuracy and reliability of lie detectors have
been the subject of debate in the scientific
community, and their use in legal proceedings is
controversial. Critics argue that the technology is not
reliable enough to be used as evidence, while
proponents argue that lie detectors can provide
valuable information in certain situations, such as
criminal investigations or security screenings. The
use of lie detectors in legal proceedings varies by
jurisdiction, and in some cases, their use is
prohibited.
Lie detection has been a topic of interest for many
years, with various techniques developed to detect
deception in individuals. One of the techniques used
for lie detection is polygraph testing, which measures
physiological responses such as heart rate, blood
pressure, respiration, and skin conductance. However,
the accuracy and reliability of polygraph tests have
been a subject of debate in the scientific community,
and researchers have been exploring alternative
methods for detecting lies. Deep learning, a subset of
machine learning, has shown promise in this area.
Deep learning algorithms are designed to recognize
patterns in large datasets by using neural networks
with multiple layers. They have been used in a
variety of applications such as image recognition,
speech recognition, and natural language processing.
In recent years, researchers have been exploring the
potential of deep learning in lie detection.
DEEP LEARNING ALGORITHMS IN LIE DETECTOR AND BRAIN FINGERPRINTING
One of the main applications of deep learning in lie
detection is through the analysis of facial expressions.
Researchers have developed algorithms that can
analyze micro-expressions, which are brief facial
expressions that occur when individuals try to
suppress their emotions. These micro-expressions are
often a sign of deception and can be used to detect
lies. Deep learning algorithms have been used to
detect these micro-expressions in real-time, which
could be used in applications such as security
screening or job interviews.
Another application of deep learning in lie detection
is through the analysis of speech patterns.
Researchers have developed algorithms that can
analyze speech patterns and detect changes in pitch,
tone, and volume. These changes in speech patterns
are often associated with deception and can be used
to detect lies. Deep learning algorithms can be used
to analyze large amounts of speech data and identify
patterns that are associated with deception.
There are also applications of deep learning in lie
detection that combine both facial expressions and
speech patterns. Researchers have developed
algorithms that can analyze both facial expressions
and speech patterns simultaneously and use this
information to detect deception. These algorithms
have been tested in real-world scenarios such as job
interviews and have shown promise in improving the
accuracy of lie detection.
While deep learning algorithms have shown promise
in lie detection, there are also challenges associated
with their use. One of the challenges is the need for
large datasets to train the algorithms. Another
challenge is the potential for biases in the algorithms,
which could lead to inaccurate results.
In conclusion, deep learning has the potential to
revolutionize the field of lie detection. Its ability to
analyze large amounts of data and recognize patterns
makes it a promising tool for detecting deception.
However, further research is needed to improve the
accuracy and reliability of these algorithms, and to
ensure that they are free from biases.
Brain fingerprinting is a technique used to identify
whether specific information is stored in a person's
brain. The technique involves measuring an
individual's brain waves in response to specific
stimuli, such as pictures or words, and using deep
learning algorithms to analyze the brainwaves and
identify patterns associated with the information
being tested.
Deep learning has shown promise in brain
fingerprinting as it can analyze large amounts of
brainwave data and identify patterns that are
associated with specific information. In recent years,
researchers have been exploring the potential of deep
3
learning in brain fingerprinting to improve its
accuracy and reliability.
One of the main applications of deep learning in
brain fingerprinting is through the analysis of
event-related potentials (ERPs). ERPs are changes in
the brain's electrical activity that occur in response to
specific stimuli. Deep learning algorithms can be
used to analyze these changes in electrical activity
and identify patterns that are associated with specific
information. Researchers have used deep learning
algorithms to analyze ERPs in response to specific
words or pictures, and have shown that they can
accurately identify whether the individual has
knowledge of the specific information being tested.
Another application of deep learning in brain
fingerprinting is through the use of functional
magnetic resonance imaging (fMRI). fMRI is a
technique that measures changes in blood flow in the
brain in response to specific stimuli.
While deep learning has shown promise in brain
fingerprinting, there are also challenges associated
with its use. One of the challenges is the need for
large datasets to train the algorithms. Another
challenge is the potential for biases in the algorithms,
which could lead to inaccurate results. Additionally,
brain fingerprinting is a controversial technique, and
its use has been a subject of debate in the scientific
community.
In conclusion, deep learning has the potential to
improve the accuracy and reliability of brain
fingerprinting. Its ability to analyze large amounts of
brainwave data and identify patterns associated with
specific information makes it a promising tool for
identifying whether specific information is stored in a
person's brain. However, further research is needed to
improve the accuracy and reliability of these
algorithms, and to ensure that they are free from
biases. Additionally, the use of brain fingerprinting
and deep learning in this context remains a
controversial topic, and its ethical and legal
implications need to be carefully considered.
II. METHODS
Brain fingerprinting is a technique that measures
changes in the brain's electrical activity in response to
specific stimuli, such as pictures or words, to identify
patterns associated with specific information.
A. In Brain Fingerprinting
Here are some of the methods and technologies used
in brain fingerprinting:
1.Event-related potentials (ERPs):
ERPs are brainwave patterns that occur in response to
specific stimuli, such as words or pictures. In brain
DEEP LEARNING ALGORITHMS IN LIE DETECTOR AND BRAIN FINGERPRINTING
fingerprinting, the individual's brain waves are
measured using an electroencephalogram (EEG), and
the ERPs are analyzed to identify patterns associated
with specific information. ERPs are measured using
an electroencephalogram (EEG), which records the
electrical activity of the brain through small sensors
placed on the scalp. When a person is presented with
a stimulus, such as a picture or word, the EEG
records a change in brain activity in response to that
stimulus. These changes in brain activity are known
as ERPs and are recorded as a series of waves on the
EEG.
The ERP components that are typically measured in
brain fingerprinting are the P300 and the N400. The
P300 is a positive wave that occurs approximately
300 milliseconds after the presentation of a rare and
meaningful stimulus, such as a specific word or
picture. The N400 is a negative wave that occurs
approximately 400 milliseconds after the presentation
of a stimulus that is semantically incongruent or
unexpected.
In brain fingerprinting, the individual's brainwaves
are measured using an EEG, and the ERP
components are analyzed to identify patterns
associated with specific information. For example, if
a person has knowledge of a specific event, their
brainwaves may show a larger P300 response to
stimuli associated with that event compared to stimuli
that are not associated with the event. By analyzing
the ERP components, it is possible to identify
patterns of brain activity associated with specific
information, which can be used to determine whether
a person has knowledge of that information.
2. Functional magnetic resonance imaging (fMRI):
fMRI is a technique that uses magnetic fields to
image changes in blood flow in the brain, which are
believed to be associated with neural activity. In brain
fingerprinting, fMRI can be used to identify changes
in brain activity in response to specific stimuli.
During an fMRI scan, the person lies on a table and is
moved into a large, tunnel-like machine that uses a
powerful magnet and radio waves to create images of
the brain. When the person is presented with a
specific task or stimulus, such as a picture or word,
the fMRI machine detects changes in blood flow in
different regions of the brain.
The changes in blood flow are believed to be
associated with changes in neural activity in those
regions of the brain. By analyzing the fMRI images,
it is possible to identify patterns of brain activity
associated with specific tasks or stimuli.
In brain fingerprinting, fMRI can be used to identify
patterns of brain activity associated with specific
information. For example, if a person has knowledge
of a specific event, their brain activity may show
4
increased blood flow in regions of the brain
associated with memory processing when they are
presented with stimuli associated with that event.
While fMRI has shown promise in identifying
specific information stored in a person's brain, its
accuracy and reliability have been the subject of
debate in the scientific community. One of the main
limitations of fMRI is that it is susceptible to false
positives, where the test incorrectly identifies
someone as having knowledge of specific
information when they do not. More research is
needed to improve the accuracy and reliability of
fMRI in brain fingerprinting.
3. Deep learning algorithms:
Deep learning algorithms are used to analyze the data
collected from the EEG or fMRI scans to identify
patterns associated with specific information. These
algorithms use statistical models to detect changes in
brain activity that are believed to be associated with
the presence or absence of specific information. Deep
learning algorithms can be used to analyze the fMRI
data and identify patterns associated with the specific
information being tested. Researchers have used deep
learning algorithms to analyze fMRI data in response
to specific words or pictures, and have shown that
they can accurately identify whether the individual
has knowledge of the specific information being
tested.
Deep learning has also been used in combination with
other techniques such as electroencephalography
(EEG) and magnetoencephalography (MEG) to
improve the accuracy of brain fingerprinting. These
techniques measure changes in the brain's electrical
or magnetic activity in response to specific stimuli,
and deep learning algorithms can be used to analyze
the data and identify patterns associated with the
specific information being tested.
4. P300-based brain-computer interface:
P300 is an ERP component that occurs in response to
a rare and meaningful stimulus, such as a specific
word or picture. P300-based brain-computer
interfaces (BCIs) are used in brain fingerprinting to
present stimuli to the individual and measure their
brainwaves in response to these stimuli. The
P300-based BCI can be used to identify patterns in
brain activity associated with specific information.
P300-based brain-computer interface (BCI) is a type
of BCI that uses the P300 component of the
event-related potential (ERP) measured by
electroencephalography (EEG) to enable
communication between the brain and a computer. In
the context of brain fingerprinting, P300-based BCI
can be used to identify patterns of brain activity
associated with specific information.
DEEP LEARNING ALGORITHMS IN LIE DETECTOR AND BRAIN FINGERPRINTING
In P300-based BCI, the person is presented with a set
of stimuli, such as letters, numbers, or images, and
the EEG measures the P300 response that occurs
when the person recognizes a target stimulus. The
P300 response is a positive wave in the EEG that
occurs approximately 300 milliseconds after the
presentation of a stimulus that is meaningful or
relevant to the person.
By analyzing the P300 response to the presentation of
specific stimuli, it is possible to identify patterns of
brain activity associated with specific information.
For example, if a person has knowledge of a specific
event, their P300 response may show a larger
amplitude and shorter latency to stimuli associated
with that event compared to stimuli that are not
associated with the event. This information can be
used to determine whether the person has knowledge
of that event.
In brain fingerprinting, P300-based BCI can be used
as a tool to identify patterns of brain activity
associated with specific information. By presenting
the person with a series of stimuli associated with the
event in question and analyzing the P300 response to
those stimuli, it is possible to identify whether the
person has knowledge of that event.
P300-based BCI has shown promise in identifying
specific information stored in a person's brain, but its
accuracy and reliability have been the subject of
debate in the scientific community. More research is
needed to improve the accuracy and reliability of
P300-based BCI in brain fingerprinting.
B. In Lie Detectors -
1. Polygraph:
The polygraph is a machine that measures
physiological responses such as blood pressure,
respiration, and perspiration while a person is
answering a set of questions. The assumption is that
lying will cause changes in these physiological
responses, which can be detected by the polygraph.
The polygraph measures the person's physiological
responses to each question and compares them to the
baseline established by the control questions. If the
person's physiological responses to a relevant
question are significantly different from their
responses to the control questions, the polygraph
examiner may interpret this as an indication that the
person is lying.
While the polygraph is widely used in law
enforcement and other contexts, its accuracy and
reliability have been the subject of debate in the
scientific community. Some experts argue that the
polygraph is an imperfect tool that can be influenced
by a variety of factors, including the examiner's
interpretation of the results and the person's physical
and emotional state at the time of the test. Others
5
argue that the polygraph can be a useful tool for
identifying deception when used in combination with
other methods and techniques.
2. Voice stress analysis:
Voice stress analysis (VSA) is a method that analyzes
changes in the voice that occur when a person is
lying. It measures variations in pitch, frequency, and
amplitude, as well as other vocal characteristics.
During a VSA test, a person is asked a series of
questions, and their responses are recorded and
analyzed by a computer. The software uses
algorithms to detect changes in the person's voice that
are associated with stress, anxiety, or other emotions
that may be present when a person is lying.
One of the key assumptions of VSA is that when a
person is lying, their voice will display certain
characteristics that are different from when they are
telling the truth. For example, when a person is lying,
their voice may become higher in pitch or more
strained, or they may pause or hesitate more
frequently.
While VSA is widely used in some law enforcement
and military settings, its accuracy and reliability have
been the subject of debate in the scientific
community. Critics argue that the technique is prone
to false positives and can be influenced by a variety
of factors, including the person's physical and
emotional state at the time of the test, as well as the
skill and expertise of the examiner. Others argue that
VSA can be a useful tool for detecting deception
when used in combination with other methods and
techniques.
3. Eye tracking:
Eye tracking technology can be used to detect
changes in eye movement when a person is lying. For
example, a person may avoid eye contact or blink
more frequently when lying. During an eye tracking
test, a person is typically asked a series of questions,
and their eye movements are recorded and analyzed
by a computer. The software uses algorithms to detect
changes in the person's eye movements that are
associated with stress, anxiety, or other emotions that
may be present when a person is lying.
One of the advantages of eye tracking as a lie
detection technique is that it is non-invasive and does
not require the person being tested to be physically
connected to any equipment. Eye tracking can also be
used in real-time, allowing examiners to observe
changes in eye movements as they occur.
4. Facial recognition:
Facial recognition technology can be used to detect
changes in facial expressions that occur when a
person is lying. For example, a person may show
DEEP LEARNING ALGORITHMS IN LIE DETECTOR AND BRAIN FINGERPRINTING
signs of discomfort or stress when lying. During a
facial recognition test, a person is typically asked a
series of questions, and their facial expressions are
recorded and analyzed by a computer. The software
uses algorithms to detect changes in the person's
facial expressions that are associated with stress,
anxiety, or other emotions that may be present when a
person is lying.
One of the key advantages of facial recognition as a
lie detection technique is that it can be used in
real-time, allowing examiners to observe changes in
facial expressions as they occur. Additionally, facial
recognition is a non-invasive method that does not
require the person being tested to be physically
connected to any equipment.
However, facial recognition has limitations as a lie
detection technique, as changes in facial expressions
can be influenced by a variety of factors, including
the person's emotional state, physical discomfort, and
other external stimuli. Additionally, facial recognition
is subject to interpretation, as different examiners
may interpret facial expressions differently. As a
result, facial recognition is typically used in
combination with other methods and techniques to
increase its accuracy and reliability.
III. TECHNIQUE -
Convolutional neural networks (CNNs) have been
used in brain fingerprinting as a way to process and
classify brain signals more effectively. CNNs are a
type of deep learning algorithm that are commonly
used in image and video recognition tasks, but they
can also be applied to other types of data, including
EEG signals.
In brain fingerprinting, CNNs can be used to extract
features from EEG signals that are related to specific
stimuli or events. For example, a CNN can be trained
to identify the P300 response in EEG signals, which
is an important signal used in many brain
fingerprinting techniques. Once the CNN has been
trained, it can be used to process new EEG signals in
real-time, allowing for faster and more accurate
analysis of brain activity.
One advantage of using CNNs in brain fingerprinting
is that they can be trained to recognize patterns in
EEG signals that may be difficult for human
examiners to detect. Additionally, CNNs can process
large amounts of data quickly, making it possible to
analyze brain signals in real-time.
However, CNNs also have limitations in brain
fingerprinting. For example, they require a large
amount of training data in order to be effective, and
the accuracy of their results can be influenced by
factors such as noise in the EEG signal. As a result,
6
CNNs are typically used in combination with other
methods and techniques to increase their accuracy
and reliability.
The well-known fact about this technique is that it
uses the signals called P300 emitted by the brain
(which begins around 300 milliseconds after
confronting a stimulus of some importance. The main
application of this technique is to identify the P-300
in the brain as a response to the stimuli relating to the
crime or situations such as a murder weapon, or the
face of the victim or the working of a terrorist cell.
The test is based on EEG signals and hence, doesn't
require verbal responses to the questions, images or
stimuli.
The subject is made to wear a special headband with
many electronic sensors.
The stimuli are of three types:
1. Irrelevant: the stimuli which is irrelevant to
the investigation and to the subject.
2. Target: the stimuli which is relevant to the
investigation and known to the subject.
3. Probe: the stimuli which are relevant to the
investigation and the subject denies knowing
it. It consists of the information that should
only be known by the guilty and the
investigating officers and not the general
public or the innocent suspect.
Before the test starts, the scientists identify the targets
related to the subject and make sure that he knows
these stimuli. The subject is also not told what all is
included in the probe. He is just told that, for
example, “You are going to see several items, out of
which one will be the murder weapon. But he isn’t
told which items have been included in the probe and
which are irrelevant.
For example, if a subject has claimed not ot have
been at the crime scene and don’t know what the
murder weapon was, a probe stimulus could be the
murder weapon, for example a knife. The protocol
ensures that the probe doesn’t contain any
information which the subject might know from the
news media information.
The scientific question which is addressed by a brain
fingerprinting is whether the subject knows about the
crime or the investigated situation or not. Specially,
the critical variable is the recognition of some
information which is contained with respect to the
crime or the lack of it. If and only if, it is present, it is
predicted that P300-MERMER will be elicited by the
probe. The characteristics of the individual subject’s
response to a stimulus when the subject knows some
information are Amplitude, Latency and Morphology.
For “information present”, the probes contain the
information describing the features that are known of
DEEP LEARNING ALGORITHMS IN LIE DETECTOR AND BRAIN FINGERPRINTING

the crime. For “information absent”, the probe

consists of the information which describes the
features that are plausible of the crime and are not
known to be correct. It is necessary to isolate the
critical variables to classify the probe responses into
one of these categories. Two standards are required to
accomplish this: a standard for the responses of the
subject to the stimuli which contains the known
features of the crime and a standard for the responses
which contains the plausible but unknown or
incorrect features of the crime.

IV. .PHASES OF FARWELL BRAIN

FINGERPRINTING Figure 4.1: Brain Signals
In DNA Fingerprinting, the evidence recognized and
collected from the crime scene and then preserved
properly until when the suspect is apprehended, is V. BRAIN SIGNAL TYPES-
then scientifically compared with the suspect to find
some match at the crime scene. Whereas, in the Brain As we have known that Brain Fingerprinting uses
Fingerprinting, except that, the evidence collected is brain waves to test the memory, a crime suspect is
the informational evidence rather than the physical provided with words or images which would only be
evidence. This includes four stages, which are similar known by the police or the person who has
to the DNA fingerprinting: committed the crime. There are 4 types of
Brain Fingerprinting Crime Scene Evidence waves/signals:
Collection 1. Alpha Wave: They are generated by the
Brain Fingerprinting Brain Evidence Collection human eyes. Frequency is 9-13 Hz.
Brain FIngerprinting Computer Evidence Collection 2. Beta Wave: They are generated by the
Brain FIngerprinting Scientific Result human mind. Frequency is 15-30 Hz.
An expert here examines the crime scene and the 3. Delta Wave: They are generated by the
other evidence related to it to identify the details that human nose. Frequency is 1-3 Hz.
must only be known by the guilty. Then the Brain 4. Theta Wave: They are generated by the
Evidence Collection is conducted by the expert to human mouth. Frequency is 4-7.5 Hz.
check if the evidence from the crime scene matches
with the evidence stored in the brain of the
suspect/accused. In Farwell’s Brain Fingerprinting
system, it makes a mathematical determination for
whether a specific piece of evidence is stored in the
victim’s brain or not. The determination and
statistical confidence is the Scientific Result and
claims that: either “Information Present” i.e. the
details of the crime are present in the brain of the
suspect, or “Information Absent” i.e. the details of
the crime aren’t present in the suspect’s brain.

Figure 4.2: Types Of Waves Emitted

VI. DEEP NEURAL NETWORKS IN BRAIN
FINGERPRINTING AND LIE DETECTORS
DNNs have been applied to both brain fingerprinting
and lie detection techniques to improve their
accuracy and reliability. In brain fingerprinting,
DNNs have been used to analyze EEG signals and
identify patterns that are indicative of knowledge of
the crime or event. These patterns may be subtle and
difficult to identify by human experts, but DNNs can
learn to recognize them with high accuracy. In a
study conducted by Farwell and Donchin (1988), a
DNN was trained to classify EEG signals as either
"information present" or "information absent" based

7
DEEP LEARNING ALGORITHMS IN LIE DETECTOR AND BRAIN FINGERPRINTING

on the presence or absence of specific patterns. The
DNN achieved an accuracy rate of 99% when tested
on a dataset of 32 subjects, demonstrating the
potential of DNNs in brain fingerprinting. Similarly,
DNNs have also been applied to lie detection
techniques to improve their accuracy. In a study
conducted by Wang et al. (2018), a DNN was trained
to classify physiological signals as either "truthful" or
"deceptive" based on the changes that occur when an
individual is lying. The DNN achieved an accuracy
rate of 89% when tested on a dataset of 60 subjects,
outperforming traditional lie detection techniques
such as polygraphy. One advantage of using DNNs in
brain fingerprinting and lie detection is that they can
learn to identify subtle patterns that may not be
apparent to human experts. DNNs can analyze large
amounts of data and identify complex relationships
between variables, enabling them to detect patterns
that may not be visible to the naked eye. This can
lead to improved accuracy and reliability in both
brain fingerprinting and lie detection. However, there
are also some challenges associated with using DNNs
in these techniques. One challenge is the need for
large datasets to train the models. DNNs require large
amounts of data to learn complex patterns and make
accurate predictions, and it may be difficult to obtain
large datasets for brain fingerprinting and lie
detection due to ethical and legal concerns. Another
challenge is the need for interpretability. DNNs are
often considered "black boxes" because it may be
difficult to understand how they arrive at their
predictions. In forensic applications, interpretability
is critical because it is necessary to understand the
reasoning behind the model's predictions. In
conclusion, DNNs have the potential to improve the
accuracy and reliability of brain fingerprinting and lie
detection techniques. These techniques rely on the
analysis of complex physiological signals, and DNNs
can learn to identify subtle patterns that may be
difficult for human experts to identify. However,
there are also challenges associated with using DNNs
in forensic applications, such as the need for large
datasets and interpretability. Further research is
needed to address these challenges and fully realize
the potential of DNNs in brain fingerprinting and lie
detection.

VII. DIFFERENCE BETWEEN LIE DETECTORS AND BRAIN FINGERPRINTING

Parameters Lie detectors Brain fingerprinting

Measures physiological responses

Measures brain responses to stimuli
to stimuli and compares them with
Principle of method and compares them with stored
known truthful and deceptive
patterns of known information
responses

Changes in physiological Changes in brain waves, such as

responses, such as heart rate, blood P300 response and MERMER,
Basis of detection
pressure, breathing rate, and skin associated with recognition of
conductance familiar information

Accuracy Controversial and can be Claims to be highly accurate and

8
DEEP LEARNING ALGORITHMS IN LIE DETECTOR AND BRAIN FINGERPRINTING

influenced by various factors, such less vulnerable to countermeasures

as anxiety, medications, and
countermeasures

Can't distinguish between different

Limited to detecting information
types of deception, such as lying,
Limitations that the suspect has previously
withholding information, and
encountered or witnessed
feigning emotions

Admissible in some jurisdictions, Admissible in some jurisdictions,

Use in legal cases but not widely accepted due to but still controversial and not
reliability concerns widely accepted

Brain fingerprinting relies on

Some researchers have explored the
machine learning techniques to
use of deep learning algorithms to
Use of deep learning identify patterns in brain wave data
improve the accuracy of lie
and make comparisons with stored
detection
patterns of known information

9
DEEP LEARNING ALGORITHMS IN LIE DETECTOR AND BRAIN FINGERPRINTING

VIII. DIFFERENCE BETWEEN CNN AND DNN WITH RESPECT TO LIE DETECTORS AND BRAIN
FINGERPRINTING

Criteria CNN DNN

Convolutional layers followed by fully

Architecture Only fully connected layers
connected layers

Learns spatial features such as edges, shapes

Learning Learns patterns in feature vectors
and textures

1D input, such as EEG data or

Data input 2D input, such as images or spectrograms
physiological signals

Provides some degree of interpretability Less interpretable due to the absence of

Interpretability
through visualization of learned filters convolutional layers

Requires fewer parameters due to weight Requires more parameters due to lack
Parameter efficiency
sharing in convolutional layers of weight sharing

Excellent at learning spatial features, making

Performance Good at learning patterns in feature
it ideal for image and speech processing
vectors, making it ideal for various

10
DEEP LEARNING ALGORITHMS IN LIE DETECTOR AND BRAIN FINGERPRINTING

applications including time series

analysis

Useful for image and spectrogram analysis

Applications in Brain Useful for analysis of feature vectors
of stimuli, but may require preprocessing of
Fingerprinting extracted from EEG data
EEG data

Limited applications due to limited

Useful for analysis of various
Applications in Lie availability of relevant data, but can be
physiological signals such as heart rate
Detection useful for analysis of visual cues such as
and respiration
facial expressions

It is difficult to say which one is better between CNN and DNN as it depends on the specific application and data.
CNNs are more efficient at learning spatial features and are well-suited for image and speech processing tasks,
making them useful in brain fingerprinting for analyzing stimuli. On the other hand, DNNs are good at learning
patterns in feature vectors and are suitable for a wide range of applications, including time series analysis, making
them useful in both brain fingerprinting and lie detection. Ultimately, the choice between CNN and DNN will
depend on the specific requirements of the task and the data available.

IX. CONCLUSION stimuli being presented. Additionally, the use of these

In conclusion, deep learning algorithms have been
shown to be effective in improving the accuracy and
reliability of lie detectors and brain fingerprinting
techniques. By using advanced machine learning
techniques, such as neural networks and CNNs, it is
possible to extract useful features from complex data
such as EEG signals and speech recordings. These
features can then be used to detect changes in brain
activity and physiological responses that may be
associated with lying or deception.
While these techniques are promising, there are still
limitations and challenges to their use. For example,
the accuracy of lie detectors and brain fingerprinting
can be affected by a variety of factors, such as the
person's emotional state and the complexity of the
technologies can raise ethical and privacy concerns,
particularly if they are used in law enforcement or
other settings where individual rights may be at risk.
Despite these challenges, deep learning techniques
have the potential to significantly improve the
accuracy and reliability of lie detectors and brain
fingerprinting. As research in this area continues to
advance, it is likely that we will see new and
innovative methods for detecting deception and
identifying individuals based on their brain activity.
X. ACKNOWLEDGMENT
I would like to express my sincere gratitude towards
my seminar guide Prof. Simantinee Kulkarni for
her valuable guidance, suggestions, encouragement

11
DEEP LEARNING ALGORITHMS IN LIE DETECTOR AND BRAIN FINGERPRINTING

and timely help throughout the completion of my [7] W. Wang, Y. T. Li, T. Zou, X. Wang, J. Y. You et
research. I would also like to thank her for giving me al., “A novel image classification approach via
this opportunity to study this topic in depth. dense-MobileNet models,” Mobile Information
Systems, vol. 2, no. 3, pp. 126–132, 2020. https://doi.
I am grateful to Dr. Supriya Kelkar, Head of
org/10.1155/2020/7602384.
Department, and all the staff members of the [8] F. Li, C. Ou, Y. Gui and L. Xiang, “Instant edit
Computer Engineering Department for their support, propagation on images based on bilateral grid,”
encouragement and guidance throughout my research Computers Materials & Continua, vol. 61, no. 2, pp.
work. 643–656, 2019.
[9] D. Tsechpenakis, M. A. Kruse, J. K. Burgoon and
M. L. Jensen, “HMM-Based deception recognition
from visual cues,” in Proc. IEEE Int. Conf.
XI. REFERENCES Multimedia Expo, Lafayette, USA, pp. 824–827,
2005.
[10] M. Graciarena, E. Shriberg, A. Stolcke, F. Enos,
[1] S. Barsever and E. Neftci, “Building a better lie
J. Hirschberg et al., “Combining prosodic lexical and
detector with BERT: The difference between truth
cepstral systems for deceptive speech detection,” in
and lies,” in Proc. Int. Joint Conf. Neural Network
Proc. IEEE Int. Conf. of Acoustics and Speed Signal
(IJCNN), Paris, France, pp. 1–7, 2020.
Process, Alexandria, Egypt, pp. 1033–1036, 2006.
[2] R. H. Nugroho, M. Nasrun and C. Setianingsih,
[11] M. Sanaullah and M. H. Chowdhury, “Neural
“Lie detector with pupil dilation and eye blinks using
network based classification of stressed speech using
hough transform and frame difference method with
nonlinear spectral and cepstral features,” in Proc.
fuzzy logic,”inProc. Int. Conf. Control Electron.
IEEE 12th Int. New Circuits Syst. Conf. (NEWCAS),
Renew. Cairo, Egypt, pp. 40–45, 2017.
Cairo, Egypt, pp. 33–36, 2014.
[3] S. Ahmet, B. Hafez and M. Soric, “Deep learning
[12] Y. Zhou, H. Zhao, X. Pan and L. Shang,
model to detect suspects’ lies,” Journal of Applied
“Deception detection from speech signal using
Informatics, vol. 9, no. 1, pp. 137, 2021.
relevance vector machine and non-linear dynamics
[4] A. Hafez, M. Zamil, and M. Camil, “Lie detection
features,” Neurocomputing, vol. 151, pp. 1042–1052,
of young age subjects,” in Proc. of the Int. Conf. on
2015.
Multimodal Deep Learning, Paris, France, pp.
[13] Y. Xie, R. Liang, H. Tao, Y. Zhu and L. Zhao,
129–135, 2021.
“Convolutional bidirectional long short-term memory
[5] W. Wang, X. Huang, J. Li, P. Zhang and X. Wang,
for deception detection with acoustic features,” IEEE
“Detecting COVID-19 patients in X-ray images
Access, vol. 6, pp. 76527–76534, 2018.
based on MAI-nets,” International Journal of
[14] R. C. Cosetl and J. M. D. B. Lopez, “Voice stress
Computational Intelligence Systems, vol. 14, no. 1,
detection: A method for stress analysis detecting
pp. 1607–1616, 2021.
fluctuations on the lippold microtremor spectrum
[6] Y. Gui and G. Zeng, “Joint learning of visual and
using FFT,”in Proc. 21st Int. Conf. Electronics and
spatial features for edit propagation from a single
Commun. Venice, Italy, pp. 184–189, 2021.
image,” The Visual Computer, vol. 36, no. 3, pp.
469–482, 2020.

12