Personalized Quantification

of Facial Normality using

Artificial Intelligence
Team 7: Layan Al-Huneidi, Salma Aboelmagd,
Khalid Al-Emadi, Sara Mohamed
 Introduction
What the Code Does in a Nutshell
Proposed Solutions

Outline Performance Criteria

Technical Standards & Design Constraints

Existing vs proposed solutions

Timeline for Next Semester
Conclusion
 • The importance of facial expressions in a
social setting i.e., in conveying expressions
[1]
• Motive behind correcting facial
Introduction disfigurement in fetuses
• Challenges faced by surgeons when it comes
to objectively assessing the results of their
work
• Our proposed solution
• Project benefits
• Final generated prototype
What the Code Does in a Nutshell
Our Objectives and the Challenges
Our Goal:
• Create an application that could be used by medical practitioners on
their smartphones

Database Challenges
• Collecting a database of abnormal and normal images to train the network

Interpreting Facial Images [2]

• The program has difficulty in differentiating between racial features
• The program may target differences in features by age as a deformity
The Proposed Solutions

Computing A powerful laptop will be used to run the code

Intensive
Haar-Cascade Algorithm will be used to code the software
Code

Interpreting Run more images that are “normal” through the code
Facial • The images running through the code will have a rating between 1-7
• A survey of images with different levels of deformity will be run
Images [2]
 The application is not cloud-based - does
not require WiFi to function
• The dataset is stored locally
• The application will be heavy in terms of storage
Technical • More difficult to share results with other doctors
Standards, than cloud-based applications
Constraints, Privacy - The photos scanned into the
and Risks application will only be visible to the user
• The weakest link in any security feature is the
human
• If the phone is not password protected, the
scanned photos are prone to be leaked
 Performance Criteria

Economic
Environmental
Cultural Factors

Global Factors
Public Welfare

• Compare • Privacy and • Different parts • Does not • More affordable

different anonymity of the world require a large due to it being
medical require different amount of runnable on a
• Only images
institutions training samples power to run smartphone,
provided with rather than a
based on the
resulting rating explicit supercomputer
• Allows for consent are to
comparison be used
between
different
surgical
techniques
 Existing Solutions Compared to the
Proposed Design
Previous Project [4]
• Generate a normalized facial
image pre reconstructive surgery
• To be used as reference during
surgery
• Slow & inefficient algorithm
• Takes 20 minutes to run on a
supercomputer
Proposed Design
• Measure the normality of a facial
image and deliver an abnormality
score pre- and post-reconstruction
• To be used as a standard to how
successful a surgery was
• Haar-cascade method
• Takes 20 seconds to run on the
laptop ordered
 Progress Made

Working on an algorithm
Collected around 50
that will automatically
images of children with
save images from
deformities to train our
thispersondoesnotexist
algorithm
website.
Simplified Project Timeline
 Develop a survey for optimal quantization of facial
scoring

Train the algorithm by feeding it a large database of

Spring images [2]

Semester Automatic scoring of images from 1 (abnormal) to

5 (normal) [3]

Plans Development into a smartphone application

Testing and validation of the network by inputting

novel images into the program [4]
 • The code outputs a normality score for a facial
image before and after a surgery
• Thus, producing a delta value which can help
show the improvement objectively
Conclusion • The goal is to optimize the code to run on a
smartphone
• The code will learn to differentiate between
natural differences and anomalies
References

• [1] Q. Xu, Y. Yang, Q. Tan, and L. Zhang , “Facial Expressions in Context: Electrophysiological
Correlates of the Emotional Congruency of Facial Expressions and Background Scenes,”
Frontiers in Psychology, vol. 8, 2017.
• [2] O. Boyaci, E. Serpedin, and M. A. Stotland, “Personalized quantification of facial
normality: A machine learning approach,” Scientific Reports, vol. 10, no. 1, Dec. 2020.
• [3] D. G. M. Mosmuller, J. P. W. D. Griot, C. L. Bijnen, and F. B. Niessen, “Scoring systems of
cleft-related facial deformities: A review of literature,” The Cleft Palate-Craniofacial Journal,
vol. 50, no. 3, pp. 286–296, 2013.
• [4] O. Atout, Facial Generation and Anomaly Detection Software, 2019. [Online]. Available:
https://omaratout.wixsite.com/facialgenerationapp. [Accessed: 12-Nov-2021].
THANK YOU
DO YOU HAVE ANY QUESTIONS?