AL-SAEED FACULTY OF ENGINEERING &

INFORMATION TECHNOLOGY

DEPARTMENT OF MECHATRONICS
TAIZ UNIVERSITY

FACE TRACKING AND AUTOMATIC ATTENDANCE MANAGEMENT

SYSTEM USING FACE RECOGNITION TECHNIQUES

BY:
01 Amer Al-basser
02 Amr Al-sabaeei
03 Hesham Al-khateeb
Supervisor:
04 Mohammed Moghalies Dr/ Ghazi Alnowaini
05 Alaa Alshargaby
 Outline
01 Introduction
Overview, Problem statement, Objectives, Importance

02 Related Work
Review of The Previous Studies

03 Method and Material

Steps of project, LBPH Algorithm

04 Design of the project and Results

M

05 Conclusion
What did We Conclude from Results

06 Future Work
1. Introduction
1.1 Overview

One of the most principle objective of computer vision is to make

such a face acknowledgment framework that can imitate and at last
outperform this ability of people. Lately we can see that investigates
in face acknowledgment strategies have acquired critical energy.
Face recognition is a technique through which it is possible to identify
a person present in a picture or taken from a video clip.
1. Introduction
1.2 Problem Statement

❖ Traditional methods of tracking faces and attendance includes

human involvement and cooperation, which is time consuming.
❖ Data scientists, neuroscientists, and psychologists all use image
processing methods to manipulate this human trait for
commercial and law enforcement purposes.
❖ Human's mistake occurs in recognizing, making the attendance
and tracking faces.
1. Introduction
1.3 Objectives
➢Main Objective
❖Using the benefits of AI methods for developing and designing more secure
systems to take attendance and tracking faces in real time by face recognition
algorithm.

➢Secondary Objectives
❖Looking for an algorithm that can be used in attendance systems with the right
methods.
❖Allow the use of today's most advanced computer vision techniques and secure
software systems in any facility.
❖Real time detecting, recognizing and tracking faces.
1. Introduction

1.3 Scope

❖Using deep learning algorithms for detecting, recognizing and tracking faces in
real time.

❖Automated attendance that can perceive face and information accurately.

❖Tracking faces using camera, microcontroller and electrical actuators.

3. Method and Material
3.1 Steps of Our Project

01 FACE DETECTION

02 DATA GATHERING

04 TRAINING DATA

FACE TRACKING, RECOGNITION

05 AND ATTENDACE
3. Method and Material
FACE DETECTION
Access the Attendance Management System
Website
The attendance taking session can be started after
the lecturer selected the related date and timetable
ID for the current class session
Face Detection
The captured image will first undergo a face
detection algorithm to ensure the system can
identify a face in every portrait.
DATA GATHERING
Portrait Pre-processing
Captured image with a confirmed face detected in it
will then undergo cropping, color conversion before
actually being stored into the files.
Creation of CSV file
Then, by using the path of the stored image, a csv
file is created with each image being labelled
accordingly. The csv file is created to aid the
process of list insertion of the portraits with their
corresponding labels.
3. Method and Material
TRAINING DATA
Training the Recognizer
The images in the created list retrieved from the csv will
then be pumped into a recognizer which is the LPBH
Recognizer (a library provided by OpenCV) to do the
training.
Save the Trained Data
After the training process is done, the trained sets of
data will be stored into a (.yml) file which will be
retrieved during the recognition process to ensure the
training process are only done for the minimum time.
FACE TRACKING, RECOGNITION
AND ATTENDACE
Tracking and Recognition
Face Tracking generally works when the camera catches
the person face. After tracking a face or faces, the
haarCascade recognizer uses data from the
(Trainner.yml) file to predict whose face it is. The
LBPHFaceRecognizer in OpenCV takes a captured
portion of the face to be analyzed as a parameter and
returns its likely owner, including its id and how
confident the recognizer is in this match.
Taking Attendance
After it recognize the face, the date and time when the
face first appeared will be registered in a database and
an excel sheet.
3. Method and Material

3.2 Method ( Algorithm )

Local Binary Patterns Histogram (LBP) is defined as an ordered

collection of binary comparisons of pixel intensities between the
center pixel and its surrounding pixels. LBP essentially recreates the
local structure of a picture by matching each pixel to its immediate
surroundings. Take a pixel as the center and set a threshold for its
neighbors.
3. Method and Material

3.2 Employing the LBPH operation

❖As we have a facial image in grayscale, each histogram (from each grid) will contain only
256 positions (0~255) representing the occurrences of each pixel intensity.

❖Then, we need to focus each histogram so that we can create a new histogram. Supposing
we’ve 8x8 grids, we will have 8x8x256=16.384 positions in the final histogram. The final
histogram represents the better characteristics of the initial image.
4. Design of the project and Results

4.1 Mechanical parts

Wooden Box
4. Design of the project and Results

4.2 Electrical parts

Board

Board
4. Design of the project and Results

4.2 Electrical parts

Servomotor
❑ Current Drain (4.8V):

❑ Operating Voltage: 4.8-6.0 Volts

❑ Operating Temperature Range: -20 to +60 Degree C

Servomotor
4. Design of the project and Results

4.2 Electrical parts

Arduino

❑ Operating voltage: 5V

❑ Input Voltage(limit): 6-20V

❑ DC Current per I/O Pin: 40 mA

❑ DC Current for 3.3V Pin: 50 mA

Arduino
4. Design of the project and Results

4.3 Software

Front-End-Design

System Interface
4. Design of the project and Results

4.4 Results

Information of the persons

Result 1
4. Design of the project and Results

4.4 Results

Attendance of the persons

Result 2
5. Conclusion

➢Face tracking and attendance system, using deep learning based on face detection

and recognition algorithms.

➢HOG and CNN layers, were used for feature extraction and detecting faces in an image
or video respectively.

➢LBPH and OpenCV were combined together to successfully introduce face recognition.

➢Arduino Uno controls the motion of servo motors while camera tracks the face.

➢The Attendance process is done automatically and saved in excel sheet as a csv file.
6. Feature Work

➢Develop this system to become more secure by recognizing only 3D faces.

➢For academic facilities we will add an electronic lock circuit to work with the proposed
system to be used in gates and doors.

➢Training a model to be able to recognize along with gender.

 Thank you

Any Question?