(Permanently Affiliated to University of Mumbai)

DEPARTMENT OF ELECTRONICS & TELECOMMUNICATION ENGINEERING

(2021-22)

IOT BASED HOME AUTOMATION SYSTEM USING

AUGMENTED REALITY

Class: BE (EXTC)
Subject Name: Project-I
Subject Code: ECL-704

By:
Saylee Surve (B1-748)
Aaditya Auti (B1-758)
Bharat Kolekar (B1-759)
Tejas Lad (B1-760)

Under the Guidance of

Prof. Shrikrishna D. Patil
 INTRODUCTION
• Our project presents a low cost and flexible Home Automation system.
• It employs an embedded micro-web server in ESP32 for accessing devices and appliances
remotely.
• People's expectations regarding automation and security have changed to large extent
during the course of time due to the advancement of technology and services.
• Different automation systems over the time tried to provide efficient, convenient and safe
way for inhabitants to access their workplace.
• Many existing systems still uses Bluetooth module instead of the Wi-Fi module so the
area of operation is greatly reduced.
• AR implementation in this project brings user executing direct interactions to manipulate
all objects in the surrounding world.

IoT Based Home Automation System using AR 2

OBJECTIVES
• Door Lock will be controlled by using R305 Fingerprint sensor along with ESP32. and it’ll also
store the visitors data into google sheets with timestamps and visitor’s ID.
• With the IoT-based smart home system the ESP32 is connected with Wi-Fi. It will control the
household appliances. When the Wi-Fi is available the ESP32 will automatically connect with
Wi-Fi and indicate the real time status on PCB.
• Our Mobile App uses a standard AR enabled IoT service, here the user finds and connects to the
IoT devices and the app shows an AR-based control interface.
• This project will be fully based on low cost and reliable home control monitoring system for
accessing and controlling devices and appliances remotely using Smart phone application and
Internet.

IoT Based Home Automation System using AR 3

 LITERATURE SURVEY
Author Title Year Outcomes
H. Singh IOT based smart home 2018 The Arduino is connected to the Bluetooth module, all the
automation using appliances can be controlled using the Arduino but it needs to be
Sensor node. within a small distance for it to connect to the Bluetooth.

Jolan Baccay, Bluetooth Based 2019 By using this method, home appliances can be controlled to
Shaik Irfan Automation System avoid the dangerous of electric shock and convenience for users.
The Bluetooth client was tested on different android phones from
different manufacturers, and its working based on its desired
functions.

P.J.Rani Voice Controlled home 2017 The devices connected to the Arduino board can be controlled by
automation system. voice commands, eliminating the need to control using the
application interface.
N. Vikram A low cost Automation 2017 The system can be controlled directly from the Wi-Fi module
System which eliminates the need of using Arduino board, the command
can directly be provided by the user to the module to control the
appliances accordingly.

IoT Based Home Automation System using AR 4

 LITERATURE SURVEY
Author Title Year Outcome
Ravi Kodali, IoT based smart security and 2016 This IoT project focuses on wireless home security
Vishal Jain home automation system system which sends alerts to the owner by using
Internet via Microcontroller

N.Sriskanthan, Home automation System- 2002 The objective of this proposal was to develop a home
F.Tan, Electronics Controlled via automation system which was based on Bluetooth,
A.Karande Bluetooth Microcontroller, Serial Communication RS232.

Md.Wasif Bin Arduino Based Home 2020 Smart Home System designed and created by
Hafiz Automation System Using utilizing WLAN network based on Arduino
Android Application microcontroller.

Rituparna Halder, Artificially Intelligent Home 2016 It gives basic idea of how to control various home
Susmit Sengupta, Automation System Based on appliances and provide a security using Arduino Uno
Sudipta Ghosh, Arduino as the Master and MATLAB GUI. The concept of this home
Debasish Kundu Controller automation can also be used for grid automation in
smart grids in power systems.

IoT Based Home Automation System using AR 5

SOFTWARE REQUIREMENTS
SOFTWARE:
• EasyEDA: EasyEDA is a web-based EDA tool suite that enables hardware engineers to
design, simulate, share - publicly and privately - and discuss schematics, simulations and
printed circuit boards.
• Unity: A framework purpose-built for AR development allows you to develop your app
once, then deploy it across multiple mobile and wearable AR devices.
• IFTTT: IFTTT can automate web-application tasks, such as posting the same content on
several social networks. Marketing professionals can use IFTTT to track mentions of
companies in RSS feeds. IFTTT also is used in home automation, for instance switching on a
light when detecting motion in a room.

IoT Based Home Automation System using AR 6

HARDWARE REQUIREMENTS
HARDWARE:
• R305 Fingerprint Sensor: This is an optical biometric fingerprint reader/sensor (R305)
module with TTL UART interface for direct connections to a microcontroller UART.
• ESP32: ESP32 is a series of low-cost, low-power systems on chips with integrated Wi-Fi
and dual-mode Bluetooth.
• Relay: A relay is an electrically operated switch. Many relays use an electromagnet to
mechanically operate a switch, but other operating principles are also used, such as solid-
state relays.
• Solenoid Lock: A solenoid is a coil of insulated or enamelled wire wound on a rod-shaped
form made of solid iron, solid steel, or powdered iron.

IoT Based Home Automation System using AR 7

 BLOCK DIAGRAM

IoT Based Home Automation System using AR 8

SCHEMATIC DIAGRAM

IoT Based Home Automation System using AR 9

SCHEMATIC DIAGRAM

IoT Based Home Automation System using AR 10

METHODOLOGY
o AR (AUGMENTED REALITY)
• What is AR?
• AR as an enhanced version of reality created by using technology to overlay digital
information onto live camera feed. In simpler terms, AR allows digital content to look like it
is part of the physical world.
• How does AR work?
• Every AR system comprises 3 components - Hardware, Software, and the Application. I will
use the example of our smartphones to expound the concept.

• Hardware
• Software
• Application
IoT Based Home Automation System using AR 11
METHODOLOGY

o IOT (Internet of Things)

• IoT enabled home or a Smart home is basically a wireless smart control and operation of all
home appliances like lights, fans, heaters, air conditioners, refrigerators, washing machines
and other such appliances.
• When these devices are connected to the internet they are a part of Internet of Things. The
backbone of this automation system is a basic (SoC) System on Chip, connected to the
internet via USB serial or ESP32 WIFI Module. Models can be integrated as and when
required and also to ease human efforts.

IoT Based Home Automation System using AR 12

WORK DONE

IoT Based Home Automation System using AR 13

 WORK DONE

IoT Based Home Automation System using AR 14

WORK DONE

IoT Based Home Automation System using AR 15

FUTURE WORK TO BE DONE IN 8th SEMESTER
Week Work to be done

31st December, 2021 PCB testing and troubleshooting

7th January, 2022 Implementation of Blynk on assembled PCB

14th January, 2022 Start working on Unity Application

21st January, 2022 Configuring the Vuforia Engine for backend database

28th January, 2022 Integrating Backend and Frontend in Unity.

4th February, 2022 Diagnose the occurred errors and troubleshooting the errors

11th February, 2022 Testing the final project with “Blynk” & “ARwithIOT” Application.

18th February, 2022 Designing & printing the outer enclosure for PCB in Fusion-360

24th February, 2022 Report and Blackbook

IoT Based Home Automation System using AR 16

REFERENCES
[1] H. Singh, V. Pallagani, V. Khandelwal and U. Venkanna, "IoT based smart home
automation system using sensor node," 2018 4th International Conference on Recent Advances
in Information Technology (RAIT), Dhanbad, 2018, pp. 1-5.
[2] Jolan Baccay Sy, Shaik Irfan, “Bluetooth Based Automation System Using Android App,”
International Journal of Engineering Research and Technology. ISSN 0974-3154, Volume 13,
Number 12 (2020), pp. 5190-5195.
[3] P.J. Rani, Jason Baktha kumar, “Voice controlled home automation system using Internet
of Things (IoT),” 2017 Third International Conference on Science Technology Engineering &
Management (ICONSTEM) DOI:10.1109/ICONSTEM.2017.8261311.
[4] N. Vikram, K. S. Harish, M. S. Nihal, R. Umesh, A. Shetty and A. Kumar, "A Low Cost
Home Automation System Using Wi-Fi Based Wireless Sensor Network Incorporating Internet
of Things(IoT)," 2017 IEEE 7th International Advance Computing Conference (IACC),
Hyderabad, 2017, pp.174-178.
[5] https://techiesms.com/iot-projects/internet-and-manual-home-automation-using-blynk/
IoT Based Home Automation System using AR 17
REFERENCES
[6] N. Kushiro, S. Suzuki, M. Nakata, H. Takahara and M. Inoue, "Integrated residential
gateway controller for home energy management system," in IEEE Transactions on Consumer
Electronics, vol.49, no. 3, pp. 629-636, Aug. 2003.
[7] Ravi Kishore Kodali, Vishal Jain, Suvadeep Bose and Lakshmi Boppana, “IoT Based
Smart Security and Home Automation System,” International Conference on Computing,
Communication and Automation (ICCCA2016).
[8] N. Sriskanthan*, F. Tan, A. Karande, “Bluetooth based home automation system,” School
of Computer Engineering, Nanyang Technological University, Nanyang Avenue, Singapore,
Singapore 639798.
[9] Md. Wasif Bin Hasif, “Arduino Based Home Automation System Using Android
Application,” DO - 10.13140/RG.2.2.20219.03360.
[10] Rituparna Halder, Susmit Sengupta, Sudipta Ghosh, Debasish Kundu, “Artificially
Intelligent Home Automation System Based on Arduino as the Master Controller,” The
International Journal Of Engineering And Science (IJES), ISSN (e): 2319 – 1813 ISSN (p):
2319 – 1805.
[11] https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6806197/
[12] https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7374396/
IoT Based Home Automation System using AR 18
THANK YOU…!
IoT Based Home Automation System using AR 19