VARDHAMAN COLLEGE OF ENGINEERING, HYDERABAD

Autonomous institute, affiliated to JNTUH

Major Project – A4444

Domain: Signal Processing & Image Processing

Team No. – S & IP : 03 

Deepfake Detection Using Neural

Networks   
By
18881A0424 – K . Sai Kiran Reddy
18881A0449 – S . Aravind Goud
Under the guidance of
Dr. D. Krishna
Associate  Professor, Dept. of ECE
10/09/202 Dept. of Electronics and Communication Engineering 1
2
 Deepfake Detection using Deep Neural
Networks

Outline:
• Objectives

• Motivation

• Introduction

• Literature Survey

• Proposed Design

• Results

• References

10/09/202 Dept. of Electronics and Communication Engineering 2

2
 Deepfake Detection using Deep
Neural Networks

Objectives:

 To design and develop a deep learning algorithm to

classify the video as deepfake or real.

10/09/2022 Dept. of Electronics and Communication Engineering 3

 Deepfake Detection using Deep
Neural Networks

Motivation:
 With recent developments in free deep learning based
software tools ,creation of credible face exchanges are
accessible to everyone.
 This led to drastic increase in realism  of fake
content. With deepfakes blackmailing, social media
memes, celebrity unusual video, politician videos,
Intruding online meetings and conferences have
become regular. 
 Even though Awareness and preventive measures are
being taken deepfakes have become widely spread
mainly in social media .So detection is the best
solution.
10/09/202
2 Dept. of Electronics and Communication Engineering 4
 Deepfake Detection using Deep
Neural Networks

Introduction:
 Deepfakes are computer generated media which are
hard to detect with our naked eyes.

 Deepfakes are generated using Generative

Adversarial Network (GAN).

 GAN takes as input a video and an image of a specific

individual (‘target’), and outputs another video with
the target’s faces replaced with those of another
individual (‘source’).

Deepfakes are posing an increasing threat to integrity

of the society as well
10/09/2022
for the security of the nation.
Dept. of Electronics and Communication Engineering 5
 Deepfake Detection using Deep
Neural Networks

Literature Survey: 01
Paper Title​ Detecting GAN generated Fake Images
using Co-occurrence Matrices
​
authors​  Nataraj, L., et al

Proposed work​ Extracting  co-occurrence matrices on three

​ color channels in the pixel domain and train
a model using a deep convolutional neural
network (CNN) framework.

conclusion​ The model proposed achieved good results

and accuracy when trained on one dataset
and tested on other.​
​

10/09/2022 Dept. of Electronics and Communication Engineering 6

 Deepfake Detection using Deep
Neural Networks

Literature Survey: 02
Paper Title​ Transferable Deep-CNN Features for
Detecting Digital and Print-Scanned
Morphed Face Images
​
authors​ R. Raghavendra; Kiran B. Raja; Sushma
Venkatesh; Christoph Busch
Proposed work​ proposed approach is based on the feature
​ level fusion of the first fully connected
layers of two D-CNN (VGG19 and AlexNet)
that are specifically fine-tuned using the
morphed face image database.
conclusion​ This model demonstrates  improved
detection performance on  both the digital
and the print-scanned morphed face image
database.
​

10/09/20 Dept. of Electronics and Communication Engineering 7

22
 Deepfake Detection using Deep
Neural Networks

Literature Survey: 03
Paper Title​ Exposing DeepFake Videos By Detecting
Face Warping Artifacts
​
authors​ Yuzu Li, Siwei Lyu

Proposed work​ Distinctive artifacts in the  DeepFake videos

​ are  captured by convolutional neural
networks (CNNs).

conclusion​ The model proposed detects artifacts  that

deepfake transformations leave with good
accuracy .
​

10/09/20 Dept. of Electronics and Communication Engineering 8

22
 Deepfake Detection using Deep
Neural Networks

Literature Survey: 04
Paper Title​ Emotions Don’t Lie: An Audio-Visual
Deepfake Detection Method Using
Affective Cue
authors​ Mittal, T., Bhattacharya, U., Chandra, R.,
Bera, A. and Manocha, D.
Proposed work​ extract and analyze the similarity between
​ the two audio and visual
modalities(Affective cues) from within the
same video​using CNNs.

conclusion​ The model proposed has  high accuracy but

applicable only to datasets that include
modalities.
​

10/09/20 Dept. of Electronics and Communication Engineering 9

22
 Deepfake Detection using Deep
Neural Networks 

Training Workflow:
Pre Processing (split
Dataset (real Splitting test Frames, face detection
and deepfake and train data and cropping)
videos)

LSTM ResNeXt CNN

Real fake 

10/09/2022 Dept. of Electronics and Communication Engineering 10

 Deepfake Detection using Deep
Neural Networks 

Prediction Workflow:
Pre Processing (split
Frames, face
Upload a video detection and
cropping)

ResNeXt CNN
LSTM

Real Fake

10/09/2022 Dept. of Electronics and Communication Engineering 11

 Deepfake Detection using Deep
Neural Networks 

Preprocessing:
• Splitting video into frames.
• Face detection and cropping the frame with detected face.

ResNeXt CNN:
• Extracting features .
• Detecting Frame Level Features.

LSTM:
• Used to Process frames in a sequential manner.
• Compares frames at ‘t’ second with frame of ‘t-n’ second.

10/09/202 Dept. of Electronics and Communication Engineering 12

2
 Deepfake Detection using Deep
Neural Networks 

Results:

10/09/202 Dept. of Electronics and Communication Engineering 13

2
 Deepfake Detection using Deep
Neural Networks

References:
 [1] Nataraj, L., et al. (2019) Detecting GAN Generated Fake Images
Using Co-Occurrence Matrices. Electronic Imaging, 2019.

 [2]Yuezun Li, Siwei Lyu, “ExposingDF Videos By Detecting Face

Warping Artifacts,” in arXiv:1811.00656v3.

 [3]  Mittal, T., Bhattacharya, U., Chandra, R., Bera, A. and

Manocha, D. (2020) Emotions Don’t Lie: An Audio-Visual Deepfake
Detection Method Using Affective Cues. Proceedings of the 28th
ACM International Conference on Multimedia, Seattle, 12-16
October 2020, 2823-2832 .

[4] R. Raghavendra, K. B. Raja and C. Busch, "Detecting morphed

face images," 2016 IEEE 8th International Conference on Biometrics
Theory, Applications and Systems (BTAS), 2016.
10/09/202 Dept. of Electronics and Communication Engineering 14
2
 Deepfake Detection using Deep
Neural Networks

Thank You !!!

10/09/2022 Dept. of Electronics and Communication Engineering 15