HCMC University of Technology and Education

FACULTY OF HIGH QUALITY TRAINING

FINAL PROJECT

INTERNET OF THINGS
Face Recognition Door Lock System
Instructor: Mr. Dinh Cong Doan

Participants – Group 4:
Huỳnh Thị Mỹ Duyên - 18110009
Nguyễn Tấn Thành - 18110046
Phan Ngọc Bảo Tuyền - 18110062

--------------------
HO CHI MINH CITY, April 30, 2022
Contents
ACKNOWLEDGEMENTS.........................................................................................................................3
CHAPTER 1: OVERVIEW OF THE TOPIC..............................................................................................4
1. Give out the problem.......................................................................................................................4
2. Research Content............................................................................................................................5
CHAPTER 2: THEORETICAL BASIS......................................................................................................6
1. Hardware........................................................................................................................................6
1.1. ESP 32 ( Board ESP-EYE )....................................................................................................6
1.2. 12V Solenoid Lock..................................................................................................................8
1.3. Module Relay 5V.....................................................................................................................9
1.4. FTDI Board..........................................................................................................................10
FT232RL . Features and Specifications.............................................................................................11
1.5. Charging data cable..............................................................................................................12
1.6. Jump wire..............................................................................................................................12
1.7. Buzzer....................................................................................................................................13
2. Arduino IDE Software..................................................................................................................15
3. Principle of operation...................................................................................................................16
CHAPTER 3: DESIGN AND BUILD THE SYSTEM..............................................................................16
1. Design...........................................................................................................................................16
2. Build the System...........................................................................................................................17
CHAPTER 4: CONCLUSION.....................................................................................................................19
1. Result............................................................................................................................................19
 Difficulties encountered: Due to illness, we couldn't buy electronic components easily,
communication with team members was also limited but our team tried our best to do........................19
2. Pros and cons................................................................................................................................19
2.1. Pros.......................................................................................................................................19
2.2. Cons.......................................................................................................................................19
3. Future Development Direction.....................................................................................................19
 ACKNOWLEDGEMENTS

During the implementation of this project, we have received a lot of help,

suggestions and enthusiastic guidance from teachers and friends, so we would like to
sincerely thank:
- The management board of Ho Chi Minh City University of Technology and
Education has created the best conditions for students to study and research.
- The school's teachers have enthusiastically enjoyed the guide and the school
library has provided textbooks and reference materials throughout the student's learning
process.
- Especially, the guidance and dedicated help of teacher Dinh Cong Doan has
taught, helped and clearly analyzed the problems students still have.
We have tried our best in the process of researching and implementing it, but
because my limited knowledge makes this project unsatisfactory, I hope to receive
suggestions, comments and evaluations on the content and presentation form from teacher
to be able to complete the report better.
Sincerely thank!
 CHAPTER 1: OVERVIEW OF THE TOPIC
1. Give out the problem

Currently, our country is developing in the direction of industrialization and

modernization, people's demand for convenience in life is increasing, along with
the use of smart technologies is also increasing. One of them is the Face
Recognition Door Lock System. It helps to make your house modern, convenient
and especially effective against theft.

Home security systems have become important to every home in Viet Nam.
In the past, most doors could be opened by traditional means, such as a key,
security card, password, or pattern. However, incidents like lost keys have led to
many disturbing cases such as theft and identity fraud. This has become an
important issue. To overcome this problem, facial recognition using deep learning
techniques has been introduced, and the Internet of Things (IoT) is also used to
implement an effective access control system. Raspberry Pi is a small computer
board that is programmable and is used as the main controller for facial
recognition, youth system, and locking system. The camera is used to record the
image of the person in front of the door. The IoT system allows the user to control
the entrance to the door.

Therefore, Face Recognition Door Lock System is a topic that my group

researches.
2. Research Content
 Study the documentation about Arduino & ESP32.
 Design the identification camera, transmission block, power block, reader
and central processing block.
 Design, calculate and build hardware.
 Write code for Arduino.
 Assemble and connect the central processing unit and other units.
 Display data.
 Run system tests.
 Fix control errors, programming errors and errors of devices.
 Write project report.
 CHAPTER 2: THEORETICAL BASIS

1. Hardware
1.1. ESP 32 ( Board ESP-EYE )
 Overview:
ESP-EYE is a development board for image recognition and audio
processing, which can be used in various IoT applications. It features an
ESP32 chip, a 2-Megapixel camera and a microphone. ESP-EYE offers
plenty of storage, with an 8 Mbyte PSRAM and a 4 Mbyte flash. It also
supports image transmission via Wi-Fi and debugging through a Micro-
USB port.
 Block Diagram:
  Parameters:

Manufavturer Espressif

Product category Video IC Development Tools

Product Development Boards

Type Camera

Chip camera on board OV2640

For use with ESP32

Datasheet ESP32_DevKitC

 Features:

 Evaluates image recognition and audio processing used in

various AIoT applications
 Features an ESP32 chip, a 2-Megapixel camera and a
microphone
 8Mbyte PSRAM and a 4Mbyte flash storage
 Supports image transmission via Wi-Fi
 Supports debugging through a Micro-USB port
1.2. 12V Solenoid Lock
 Product image:

 Specifitcations:
 Material: Stainless Steel
 Power supply: 12VDC
 Working current: 1.2A
 Power: 14.5W
 Power Requirements: 12VDC/2A
 Dimensions: L54 x D38 x H28
 Power supply time: Less than 5s
 Weight: 150g
  Product dimensions

1.3. Module Relay 5V

Picture of Relay 5V Pinout of Relay 5V Circuit of Relay 5V

No Parameter Value
1 Operating voltage 5 VDC
2 Current Consumption 80mA
3 Relay Current Trigger 5mA
4 Size 43mm x 17.3mm x 17mm

Relay 5V Spectifications Sheet

Input:
 Supply voltage: 5VDC.
 Control input signal: 0V.
+ Signal is 0V: the relay is closed.
+ The signal is 5V: the relay is open.
Output:
 NC: Normally closed.
 NO: Normally open.
 COM: Common pins.
 Source symbol:
 VCC, GND are power supplies for Relay.
 In is the control signal pin.

1.4. FTDI Board

Leg type Function Description

DTR Data Terminal Ready status pin, used to

 control signal flow

RX Serial data receive pin

TX Serial data pin

VCC Power supply pins

CTS Input pin clears data to send, used to control

data

GND GND . pins

FT232RL . Features and Specifications

 Operating voltage: 5V / 3.3V DC

 Maximum current: 5V – 500mA; 3.3V – 50mA
 Connection: Mini USB port
 Built-in 1024bit EEPROM storage and CBUS I/O . configuration
 Data transfer rate from 300 baud to 3 Mbaud (RS422, RS485, RS232) at
TTL signal level
 128byte receive buffer and 256 byte transmit buffer
 Transmit and receive LED control signal
 Built-in clock without an external quartz oscillator

The FTDI Basic Breakout (5V) is a basic breakout board for the FTDI
FT232RL USB to serial IC. The pinout of this board matches the FTDI
cable to work with official Arduino and cloned 5V Arduino boards. It
can also be used for general serial applications. The DTR pin allows an
 Arduino target to auto-reset when a new Sketch is downloaded. This
board will auto reset any Arduino board that has the reset pin brought
out to a 6-pin connector.

1.5. Charging data cable

 Transfer rate: 480MMbps

 Material: Aluminum shell + TPE + thick nylon braid
 Product features: Full protection SR
 Current:100cm: 2.4A
1.6. Jump wire
Fiber optic patch cord is used for patch cord from device to fiber link. It has a
thicker layer in use in optical transceivers and connections between terminal
boxes.

1.7. Buzzer

Pinout of Buzzer Circuit of

 Buzzer

No Parameter Value
1 Operating voltage 3.5 - 5.5 VDC
2 Current Consumption < 25 mA
3 Resonance frequency 2300Hz  ± 500Hz
4 Sound amplitude > 80 dB
2. Arduino IDE Software
The Arduino IDE (Arduino Integrated Development Environment) is a text
editor. help write code to load into arduino board. Arduino can run on
Windows, MAC OS and Linux.
A program written by the Arduino IDE is called sketch, the sketch is saved
in .ino format.
After starting the Arduino IDE, we get the interface as shown below:

Arduino IDE User Interface

Arduino programs are written in C or C++. The Arduino IDE comes with a
software library called 'Wiring'.The user needs to define two functions to
execute a program:
 Setup () : function run only once at the start of a program used to
initialize the settings.
 Loop() : the function is called repeatedly until the board is turned off.
3. Principle of operation

FACE RECOGNITION ENGINEERING EVENT

Once the correct face recognition has been learned, the RelayPin pin will be
pulled to the HIGH level. After 5 seconds have passed, if there is no
recognition face, the pin is set to LOW. The code in the rzoCheckForFace()
function can be changed to whatever function you require when it comes to
face detection.
 CHAPTER 3: DESIGN AND BUILD THE SYSTEM

1. Design
o Feature:
 Face recognition.
 Automatic unlock.

o Design:

The Circuit Diagram for ESP32-CAM Face Recognition Door Lock

System is given below:
2. Build the System
2.1. Implementation
In this tutorial we will explain how to save the registered image (eroll
face) in memory, and then we can use these saved identifiers to compare
with the image obtained from the ESP32. There are three steps:
 Create a new partition scheme to enable persistent storage
 Modify CameraWebServer example sketch to save face data to
new partition
 Use these saved identities to control devices connected to the
ESP32
2.2. repartition ESP32 memory
2.3. Add the following three lines below the available partitioning options
for the esp32wrover board in this board.txt file.

2.4. Collect face data for storage

2.5. Delete face data from memory
 CHAPTER 4: CONCLUSION

1. Result
 After researching and manufacturing, our face recognize lock door sytem
has been working stably.
 About design: Compact, simple and accurate.
 About purpose: high versatility.
 Difficulties encountered: Due to illness, we couldn't buy electronic
components easily, communication with team members was also limited
but our team tried our best to do.
2. Pros and cons
2.1. Pros
 Suitable for all ages.
 Suitable for forgetful people.
 Use quickly.
 Convenient

2.2. Cons
 Lack of security should only be used for unlocking bedroom doors
or locking applications for things of moderate importance.
 High price.
 Requires skilled workers.
 Use existing images for identification.

3. Future Development Direction

 Use high precision components to improve system stability and guarantee.
 Integrate more fingerprint processing for the system, enhancing security.
 Incorporating more alarm bells when false identification, in order to detect
thieves early.
 Combined with high-strength doors.