ProjectWork-II(19AI703) – Review 1

Deepfake detection using cnn

Submitted by:
KUMARAVEL V (212220230027)

2020-2024 Batch
TEAM NO: 27
Under the guidance of:
Mrs.Surya S
Assistant Professor (OG),Department of AIDS

DEPARTMENT OF ARTIFICIAL INTELLIGENCE AND DATA SCIENCE

SAVEETHA ENGINEERING COLLEGE
(Autonomous Institution – UGC, Govt. of India)
(Affiliated to Anna University, Approved by AICTE - Accredited by NBA & NAAC – ‘A’ Grade - ISO 9001:2015 Certified)
Saveetha Nagar, Thandalam, Chennai-602 105, TamilNadu, INDIA.
 Agenda
1. Introduction
2. Statement of the Problem
3. Purpose of your project
4. Proposed Methodology
5. Expected results and its Implications
6. Literature review
i. Summary and Outcome
7. Project Plan
8. Conclusion
9. References
 Introduction

• Definition of deepfakes: AI-generated media manipulating

audio, video, or images.
• a term derived from "deep learning" and "fake," refer to
manipulated videos or images generated by artificial intelligence
techniques, particularly deep learning algorithms
• Growing concern: Potential for misinformation, identity fraud,
and other malicious uses.
• Importance of detection: Safeguarding trust in digital media and
combatting harmful effects.
 Statement of the Problem
• Detecting deepfakes, which are AI-generated synthetic
media where a person in an existing image or video is
replaced with someone else's likeness, presents a
significant challenge due to their increasingly
sophisticated quality.

• Deepfake technology has advanced rapidly, enabling

the creation of highly convincing fake videos and
images.

• Deepfake detection involves distinguishing between

authentic and manipulated media
 Purpose of the project
• Objectives: developing a deepfake detection
system using convolutional neural networks
• Importance: Explain why detecting deepfakes is
crucial for maintaining trust, integrity, and
security in digital media content
• Target Audience: Identify the intended users
and beneficiaries of your project, including
individuals, organizations, and platforms
concerned about deepfake threats
 Proposed Methodology
• Methodology for - Classification of brain tumors
– 1.Data Collection
– 2. Data Preprocessing
– 3. CNN EfficientNet Model Development
– 4. Streamlit Web App Development
– 5. Integration and Testing:
– 6. Deployment and Maintenance
 Expected Results and Implications
• A highly effective deepfake detection system would
ideally achieve a high accuracy rate, correctly
identifying the majority of both real and fake media
• The system's effectiveness should extend beyond the
training data to generalize well to new and unseen
deepfake variations
• To stay ahead of evolving deepfake techniques, the
detection system should incorporate mechanisms for
continuous improvement and adaptation.
 Literature Review-Reference Paper 1
• 1.DeepFake Detection: A Review" by Zheng et al. (2022)
Problem Statement: With the proliferation of deepfake technology,
the need for robust detection mechanisms to combat misinformation
and preserve digital trust has become paramount.

Problem Approach: The paper reviews various deepfake detection

techniques, including traditional methods and state-of-the-art deep
learning approaches, to identify effective strategies for detecting
manipulated visual content.
Advantages: Deep learning-based approaches demonstrate
promising results in detecting deepfakes due to their ability to
automatically learn discriminative features from data, offering higher
accuracy and scalability compared to traditional methods.
Drawbacks: Challenges such as generalization to unseen
manipulation techniques and vulnerability to adversarial attacks pose
limitations to current deepfake detection methods.
Future Scope: Future research directions include enhancing model
robustness, addressing ethical considerations, and developing
transparent and accountable detection systems.
 Literature Review-Reference Paper 1
• Advantages: Deep learning-based approaches demonstrate
promising results in detecting deepfakes due to their ability to
automatically learn discriminative features from data, offering higher
accuracy and scalability compared to traditional methods.

Drawbacks: Challenges such as generalization to unseen

manipulation techniques and vulnerability to adversarial attacks pose
limitations to current deepfake detection methods.

Future Scope: Future research directions include enhancing model

robustness, addressing ethical considerations, and developing
transparent and accountable detection systems.
 Literature Review- FaceForensics++
• FaceForensics++: Learning to Detect Manipulated Facial
Images" by Rossler et al. (2021)
• Problem Statement: The increasing prevalence of deepfake
technology underscores the need for reliable detection
mechanisms to identify manipulated facial images and videos.
• Problem Approach: The paper introduces the FaceForensics+
+ dataset and evaluates various detection methods to assess
their performance in detecting manipulated facial content.
 Literature Review- FaceForensics++
• Advantages: Deep learning-based approaches, such as
Convolutional Neural Networks (CNNs), demonstrate
superior performance in detecting manipulated facial
images, leveraging large-scale datasets for training and
evaluation.
• Drawbacks: Traditional image forensics techniques often
struggle to generalize across different manipulation
techniques and are prone to false positives.
• Future Scope: Future research directions include
improving dataset diversity, enhancing model
robustness, and developing standardized evaluation
protocols for deepfake detection methods.
 Literature Review-Reference Paper 3
• Deep Fakes and Beyond: A Survey of Face
Manipulation and Fake Detection by Wang et al.
(2023):
• Problem Statement: The proliferation of face
manipulation techniques poses challenges for
detecting manipulated visual content and
preserving digital trust.
• Problem Approach: The paper surveys various face
manipulation techniques and detection strategies
to provide insights into the landscape of face
manipulation and fake detection research.
 Literature Review-Reference Paper 3
• Advantages: The survey offers a comprehensive overview
of the underlying technologies and challenges in face
manipulation and fake detection, guiding future research
efforts in combating the spread of manipulated visual
content.
• Drawbacks: Ethical considerations, including privacy,
consent, and misinformation, underscore the need for
interdisciplinary research and collaboration to address the
societal impacts of deepfake technology.
• Future Scope: Future research directions include advancing
detection methods, exploring interdisciplinary approaches,
and developing countermeasures against the misuse of
deepfake technology.
Summary of Literature Review
Summary of Literature Review
Summary of Literature Review
 Outcome of the LR - Scope of the project
• "DeepFake Detection: A Review" by Zheng et al. (2022):
• Outcome: Provides a comprehensive review of deepfake detection techniques,
covering traditional methods and state-of-the-art deep learning approaches.
• Contribution: Offers insights into the evolution of deepfake technology, challenges
in detection, and potential future directions for research.
• Impact: Advances understanding of deepfake detection methods and informs the
development of more effective countermeasures against manipulated visual
content.
• "FaceForensics++: Learning to Detect Manipulated Facial Images" by
Rossler et al. (2021):
• Outcome: Introduces the FaceForensics++ dataset for deepfake detection in facial
images and evaluates detection methods on the dataset.
• Contribution: Establishes benchmark evaluations for deepfake detection
algorithms, highlighting strengths and limitations of existing methods.
• Impact: Provides a standardized evaluation framework for researchers, facilitating
the comparison of different detection approaches and driving advancements in
the field.
 Outcome of the LR - Scope of the project
"Learning to Detect Fake Face Images in the Wild" by Li et al. (2023):
• Outcome: Proposes a deep learning framework for detecting manipulated face images in
real-world scenarios, achieving high accuracy and robustness.
• Contribution: Addresses challenges associated with detecting deepfakes in diverse and
uncontrolled environments, demonstrating the effectiveness of deep learning techniques.
• Impact: Offers a promising solution for detecting manipulated face images across different
domains, laying the foundation for more reliable deepfake detection mechanisms in real-
world applications.
"DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detection" by Wang
et al. (2023):
• Outcome: Provides an extensive survey of face manipulation techniques and detection
strategies, addressing concerns surrounding the proliferation of manipulated visual
content.
• Contribution: Offers insights into the underlying technologies, challenges, and ethical
considerations related to deepfake technology.
• Impact: Advances understanding of face manipulation and fake detection research,
fostering interdisciplinary collaboration and informing efforts to combat the spread of
manipulated content.
 WBS NUMBER TASK TITLE TASK OWNER START DATE DUE DATE

Project Plan

Project
1 Conception and
Initiation

1.1 Project Charter Team member1 12/03/24 12/03/24

Project Charter
1.1.1 Team member1 13/03/24 13/03/24
Revisions
Project
2 Definition and
Planning
Scope and Goal
2.1 Team member1 14/03/24 14/03/24
Setting
 WBS NUMBER TASK TITLE TASK OWNER START DATE DUE DATE

Project Plan
Project
3 Conception and
Executoin
3.1 Project design Team member1
3.2 Collection of Data
Project Coding
3.2.1
module1
Project Coding
3.2.2
module2
3.2.3 Project Integration
Project Build and
3.2.4
Execution
4 Project Testing
 Conclusion
• In conclusion, the proliferation of deepfake
technology presents a significant challenge to
the integrity of digital content and the
trustworthiness of media platforms. Throughout
this presentation, we have explored the
complexities of deepfake detection and the
strategies employed to mitigate its impact.
• Simply Safeguarding Reality in the Age of
Deepfakes
 References
• Rossler, Andreas, et al. "FaceForensics++: Learning to Detect Manipulated Facial
Images." IEEE/CVF International Conference on Computer Vision (ICCV). 2021.
• Li, Yuezun, et al. "Learning to Detect Fake Face Images in the Wild." Proceedings of the
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2023.
• Wang, Chaofan, et al. "DeepFakes and Beyond: A Survey of Face Manipulation and Fake
Detection." arXiv preprint arXiv:2101.08316. 2023.
• Zhu, T., et al. "DeepFake Detection Using Attention Mechanism and Capsule Network."
International Conference on Digital Forensics and Watermarking (ICDFW). Springer,
Cham, 2023.
• Cao, Y., et al. "Deepfake Detection in Videos via Optical Flow Fields Analysis."
International Conference on Multimedia Modeling (MMM). Springer, Cham, 2020.
• Zheng, C., et al. "DeepFake Detection: A Review." IEEE Access, vol. 8, pp. 137894-
137914, 2020.
• He, X., et al. "Face Manipulation Detection: A Survey." arXiv preprint arXiv:2107.02387.
2021.
• Guan, J., et al. "Detecting GAN-Generated Fake Images Over the Deep Web Using
Model-Based Approach." IEEE Transactions on Information Forensics and Security, vol.
16,