ABSTRACT

This paper presents the design and the development of an interactive, futuristic Smart Mirror with artificial intelligence for the ambient home environment as well as

for commercial uses in work and public environments. The project collects real world machine data based on user requirements, and this data is displayed to the user.
The entire working of the Smart Mirror system is controlled and managed by a Raspberry Pi. The Smart Mirror implemented, is a personalised digital device equipped
with peripherals, namely - a microphone, speakers, an LCD monitor covered with a sheet of two-way acrylic mirror, and is powered by a Raspberry Pi. It provides basic
common functionalities such as weather of the city, latest updates of news and headlines, and local time corresponding to the location. Using speech processing
techniques the user, therefore, interacts with the Smart Mirror through verbal commands. A Remote Configuration Tool (RCT) is also created to help the user with the
working of the Smart Mirror when the user’s voice commands result in false positives and true negatives. The Smart Mirror listens to the user’s commands and performs
the corresponding functions.

KEYWORDS: Smart Mirror, Raspberry Pi, Internet of Things, Ambient Artificial Intelligence, Web Programming ,
 CHAPTER 1
INTRODUCTION

Interactive raspberry pi is programmed using python and connects to a monitor with inbuilt speaker so as to provide an onscreen interface and voice assistance as well.
Section 2 focuses computing, with wirelessly connected embedded devices that are being used in various day today activities, are changing and improving the standards of
the quality of life. Based on this interactive computing and communication technologies, many devices/products are now emerging and with this multimedia intelligence it is
providing comfortable, secure and convenient personal services everywhere whether it is home or various industries and making a lot of users comfortable .We look at the
mirror daily and interact with it psychologically to find out how we look and how our attire is. The interactive mirror is a development effort to augment the mirror with
proper embedded intelligence for offering enhanced features such as weather of the city, latest updates of news and head-lines and local time corresponding to the location.
The Smart Mirror would help in developing smart houses with embedded artificial intelligence, as well as finding its applications in industries.  The remainder of this paper is
organized as follows. Briefly comments on theory and some related works. This is followed by the description of the smart mirror including the design and architecture of the
proposed Smart Mirror in Conclusion and some thoughts on future work are presented at last. Smart mirrors are straight from science fiction. They’re part of an optimistic
vision of the future that imagines a world where screens and data are everywhere, ready to feed you whatever information you need at a moment’s notice. Basically, the
mirror is looks like normal mirror but when someone stand in front of it the scene changes. The mirror provides a functional, user friendly and interactive UI to its user for
accessing their social sites, messengers,etc. It has widgets for displaying the current whether conditions, Time, Events, Latest news headlines The Smart Mirror would help in
developing smart houses with embedded artificial lintelligence, as well as finding its applications in industries. Switching home appliances becomes easy with mirror. Virtual
dressing, a smart way of having trial
1.1 OVERVIEW:

Needs Statement:
Over 1 million #selfies are taken every day with 30% of photos taken by people between the ages of 18 and 24 being#selfie1. In total, 28% of time spent online is on social
media2. According to A today AOL survey, women spend an average of 6.4 hours/week while men spend 4.5hours/week working on their appearances3. The Smart Mirror is a
system that combines these tasks in an efficient and enjoyable way to provide time savings for the use.

1.2 Objective Statement:

The objective of this project was to design and prototype a device that acted as a “Smart Mirror” by displaying the user’s image and providing customizable information on the
display. A “Smart Mirror” is a device that acts as a traditional mirror while also superimposing informational data which can be customized by the user. The mirror also allows
for touch free user interaction with some of the data displays. Users are able to create a profile and customize the visual interface to display what specific data feeds they want.

1.3 Product Description:

The “Smart Mirror” consists of an electronic display along with a one

-way mirror for the informational display. It uses a camera to track movement and provide facial recognition with the use of an embedded computer. Users can create their
customized display through a smartphone interface. Some informational displays contain information aggregated from third party APIs, such as social media feeds, news feeds,
and weather updates.
 CHAPTER 2
PROPOSED SMART MIRROR

The mirror is eventually a technologically augmented interaction device. The objective of designing the mirror is to provide a natural interface in the ambient home
environment for accessing various services such as location based weather, time, calendar etc. as well as provide access to YouTube, Soundcloud, maps etc. The project
includes downloading the Raspbian operating system based on Debian and extracting the image on SD card, inserting the card in the Raspberry Pi SD slot an then
performing the required steps. We plan to deliver a working prototype i.e. design and development of a futuristic Smart Mirror on Raspberry Pi 3 for the ambient home
environment as well as for commercial uses in various industries. Most people have mirrors at home, so the concept of a smart mirror that you can interact with is
attractive and can be fantasized by anyone .At times no one has time to read the newspaper or switch on the TV right in the morning to check the news headlines or the
weather forecast. If a mirror serves to this purpose, one can imagine the amount of time it will save and be of such a great use. The device was to look like a regular
mirror but would have a screen inside. The project which would collect real world machine data such as location based latest news and headlines, weather reports, and as
well as show us the local time. The data would be transmitted from the machine and would be managed in a central database. We have also worked on including
Artificial Intelligence in the Smart Mirror wherein a Voice enabled assistant will cater to the needs of the user.

FIG 1.1 CIRCUIT DIAGRAM OF SMART MIRROR

3.1 PROJECT MOTIVATION AND GOALS
The motivation behind this project was building a device that is interesting to the team. We wanted to design something that excited us, and that we would want to use.
Because our team is two electrical engineers and two computer engineers, not one area of interest was focused on. We wanted to learn more in our respective fields from
this project, including designing hardware circuits and also computer vision. There was a large interest in the group for computer vision software, which lead to the
addition of the facial recognition software. While the Smart Mirror is a DIY project that already exists, we saw an opportunity to make it better. This device was
interesting to us from the start, but the additions we thought of adding such as facial recognition and gesture control are what drove us to pursue this project. On the
electrical engineering side, this would allow us to design our own circuits, including a power supply circuit and supporting circuits for various sensors and a
microcontroller. It will give us the chance to learn more about the process of searching for specific components and parts needed to fulfill certain requirements. On the
software side, improvements are being implemented to both the existing open source framework as well as adding support through additional modules. By adding the
software support for the additional subsystems, the final product will implement additional features outside those which are currently released. Motivations for adding
the additional software were fueled by the desire to practice the engineering related concepts which have been taught throughout the past four years in higher education.
Between concepts learned through various internships in the corporate engineering environment, to specialized technical elective courses outlining additional details in
the field, practicing these select skills to fully realize a full system’s prototype will collectively reinforce the key skills required by the industry. As each team member
approaches graduation, leaving lasting impressions on the faculty and guests of the senior design showcase will assist in developing an extensive network of industry
professionals. By selecting a project which highlights both computer and electrical engineering within the college, it is believed that the impression left based on the
technology used in this project will be a positive one. By developing this network, potential full time engineering positions may be obtainable and solidified further
down the career paths of each contributing team member. The team saw an opportunity to improve an existing idea. The idea of a Magic Mirror had been shown with
date, time, compliments and facial overlays.
3.2 OBJECTIVES
The main objective of the Smart Mirror project is to design and retrofit a mirror with supplemental technology which will provide the user with relevant information during
day to day life. Meeting this objective will entail creating a complete system to meet the project specifications in a manner which also remains user friendly. By
implementing various features which have yet to be implemented on commercial smart mirrors, the final product will be a culmination of subsystems working in unison to
provide a unique experience and addition to the lives of potential proponents. The project’s secondary objective entails implementing face recognition software to detect and
identify the user. This will allow personalized information to be provided on screen based on the current person using the mirror by utilizing preconfigured credentials to
retrieve information from social media news feeds. The third objective is to implement power saving technology into the Smart Mirror in an effort to make it as efficient as
possible. While other relevant projects have strived for practicality when designing similar products, this team is determined to create one that is both practical and efficient.
Thus, making it a marketable product by making it appealing in more than just one way. The final objective is to create a system which responds to user input. Rather than
implementing a passive system, the project will utilize various sensors to respond to the environment. User presence detection, adaptive lighting control, and gesture
interpretation will be designed into the system to create the next level of available smart mirror features.

3.3 REQUIREMENT SPECIFICATIONS

The following requirement specifications outline details for various components and subsystems which are to be implemented in the final design. By first creating a list of
specifications, the team was able to properly compare and contrast various products existing on the market before making final decisions. Understanding the role that each
component played within both the subsystem and the system as a whole allowed for a culmination of key requirements to properly ensure that the project requirements
could be met. Additionally, compatibility among devices is an important consideration further solidifying the necessity of developing strong requirement specifications early
in the design stage.

3.4 HOUSE OF QUALITY ANALYSIS

The House of Quality is a unique tool used to visualize how the product or service will relate to the consumer. It contains market desires, customer desires, relationships
between the two and sometimes more. The main aspect of this tool is to show the correlations between these wants and requirements from the customer, market and
provider. These correlations can help give the producer of a good or service a good idea of how their product could be designed or delivered.
 CHAPTER 3
RESEARCH

Before beginning such an involved project, research is required in order to build up a good background and understanding of what is needed. Research done by each
engineer will be determined on what parts of the project they are responsible for or interested in. For the electrical engineers this consists of all hardware components, as
well as design techniques. The computer engineers researched various techniques for communication, facial recognition, and the architecture that will ferry messages
between the hardware and the Internet. Time was also taken to look into devices are products that already exist that are similar to ours. This is an important aspect not only
to generate ideas for our own mirror, but also to make sure our device is different from the others and provides benefits that they cannot.

4.1 EXISTING TECHNOLOGIES

When designing any project, it is important to keep in mind any similar existing products. The Smart Mirror is not an original concept. A popular DIY version exists as
well as a few consumer products. The following section will look at a few of these existing devices and how they influence our design.

Magic mirror
Magic Mirror is a DIY project designed by Michael Teeuw. This design was the main influence of our Smart Mirror. The Magic Mirror allows users to view the weather in
their area, their calendar, the local news, and provide a compliment. The mirror works by having a display monitor display information behind a two-way mirror. The
two-way mirror allows the information (white text) to be seen from the other side, while still reflecting the user’s appearance. Teeuw designed a webpage that would
constantly update with all the information to be displayed. The webpage is a simple design, white text on a black background, in order to be seen through the mirror. A
Raspberry Pi is used in connection with the display monitor to show the webpage. In order to power the project, Teeuw found a monitor with USB ports and used that to
power the Raspberry Pi. The biggest influences of the Magic Mirror on this project are the mirror design and the open source software.
4.2 Relevant Technologies

The following research section highlights the relevant technologies and engineering related concepts which may be utilized within the development and implementation of the Smart
Mirror. While an explanation of each technology is present, initial decisions regarding the different implementations may also be found, playing a part later in component selection.
By first researching and understanding the existing technology which can be utilized in the system, the team has been able to make educated decisions with respect to technical
concepts and options available.

TTL Serial Logic Levels

When working with embedded devices which must communicate with one another over a physical connection, considering the voltage logic level at which they operate is crucial.
As a computing device, calculations are completed by both driving transistors in the circuit to a high voltage and pulling them low to ground, representing the 0 and 1 bits. One
differentiating factor between devices is the transistor-transistor logic (TTL) voltage ranges which are used to differentiate the value of the bit. If logic levels were implemented
where 0 bits are represented by only 0v, and 1 bit are represented by only Vcc, numerous false readings and false transmissions would occur on the transistor level. Due to
imperfections in circuitry and outside noise interfering with the system, it cannot be guaranteed that the voltage levels will be accurate in such a precise sense. Instead, an
acceptable level of voltage ranges must be defined in which the device will accept a 0 bit as existing within a predefined range around the 0v ground. Similarly, an acceptable range
for the 1 bit must be established as a range around Vcc.

I2C
The I2C communication protocol is a popular technology due to its robust nature of acknowledgments between a master and slave devices. The protocol relies on just two wires
for communicating with up to ~112 devices. Two signal wires, SCL and SDA, are used for communication. The two signal wires are considered to be open drain since pull up
resistors are used to pull the signal high when the devices are not communicating, and the devices will pull the signal low during communication. During design, a master device
must be selected as the device which initiates all communication between itself and the slave devices. With I2C communication, every device is designated as a Master or a Slave.
In most implementations, a system will consist of a single master device which drives the SCL clock line and initiates all communication with slave devices. Slave devices act as
responders to the requests being made by the master device.
 CHAPTER 4
Related Standards and Realistic Design Constraints

The following sections describe various standards and constraints associated with this project. It is important to keep standards in mind during the design process in
order for our project to be up to industry par. It is also pertinent to understand the constraints involved so that the process can go smoothly with no sudden surprises.

5.1 Related Standards and Impact

There are a multitude of standards that must be abided by in the process of designing a project, and many constraints that must be recognized and worked with. Our
group took the time to research a few of the standards that directly impact our project and they can be seen in the Standards section below. We recognized what kind of
constraints may arise from the project based on the nature of the required components and operation of the various subsystems. Within the corporate engineering
environment, numerous standards must be applied to the new technology and devices developed by the engineering and technical employees. By abiding with the set of
standardized rules, product safety, compatibility, consistency, and repeatability are enforced for these products. As a precursor to industry development, it is crucial to
understand the research process required to develop a new product compliant with the established legal standards.

USB 2.0

Universal Serial Bus (USB) is the standard that details the cables, connections and communication protocols for a bus that can be used for communication and/or power
supply between electronic devices. The Raspberry Pi is powered using a Micro USB cable so this standard is relevant to the project. For this project the USB Power
Delivery section of the standard is most applicable. This standard offers some useful features in regards to the power delivery capabilities of USB. It can deliver up to
100W, power flow is bidirectional, optimizes the flow of power, and can also be used in low power situations. The most useful feature for this project is the optimized
flow of power. This means that only the power needed to run a device is sent through the cable. When the mirror is not in use, the Raspberry Pi will draw less power is
less of the devices connected to it will be using energy. Once the mirror is in use, the Pi will need more power drawn for the power supply.
RS232

RS232 is the standard set by Electronic Industries Association (EIA) that relates to serial communication transmission of data. The standard defines signal characteristics
such as voltage levels, timing, slew rate, signaling rate, short circuit reactions, and cabling standards. This standard is applicable to the project as the ATmega328
microcontroller and Raspberry Pi microcomputer will communicate with each other via serial communication. The selected components, to be later discussed, implement
the RS232 standard natively through the UART embedded modules.

IEEE 802.11
(Wi-Fi) 802.11 is the standard set by IEEE regarding the use of Wi-Fi. The standard allows the transmission of signals over the 2.4 GHz ISM band in the US. This
standard allows all 23 devices, regardless of manufacturer, to communicate with each other wirelessly. This project will use a Raspberry Pi that has a Wi-Fi chip, so this
standard is applicable. We will use the Wi-Fi connection to connect to the local network to obtain data from multiple sources for display on the mirror. Adherence to this
standard has been met through association as the manufacturers of the Raspberry Pi have developed the board with a 802.11 compliant chip. Specific implementations of
the standard will not require design from the ground up and are reliant on the certified compliance of the device when it was released to the market.

IEC 60269
IEC 60260 is the engineering standard that applies to the use of fuses to protect a circuit. The volume that is applicable to the project is “IEC 60269-5 – Guidance for the
Application of Low Voltage Fuses”. This section explains how to apply fuses to your circuits in order to protect your electronic equipment or electrical devices. This is the
first time the engineers in the team have designed a power distribution system so a fuse will help to ensure protection in case there is a fault in the design. When the PCB
is designed, circuit protection will be kept in mind, and a fuse will most likely be used in this way.
5.2 Realistic Design Constraints

When taking on any project, one must always consider the constraints involved. These are what will limit the project in ways that typically cannot be controlled. Due to the
nature and setting of this project many constraints arise. The following sections will discuss these constraints in detail.

Economic and Time Constraints

The economic and time constraints are two of the strictest involved with this project. At the beginning of the semester the team met to decide on an appropriate budget by
listing all known needed components and their estimated price. The totals came out to approximately $700. Due to the fact that the project is to be financed by the four
members of the team, with no outside sponsors, it is pertinent that the budget is followed. This constraint will be considered when selecting specific parts, and the pros and
cons of more expensive components will be evaluated before a decision is made. Time constraints of a project typically involve relevancy or strict deadlines that need to be
met. Our project is constrained by the former, as it must be completed in the time frame of Senior Design’s two semesters. This gives about eight months of time to complete
the project, not including the time that must be taken to maintain good standings in other classes and to fulfill work and internship commitments. This short time frame is
shorter than a typical product development timeline, which means the group must work efficiently and diligently.

Environmental, Social, and Political Constraints

There are no environmental constraints involved in this project due to the device being used indoors. There are also no political constraints involved. Social constraints arise
from the presentation of social media and information related to users. The device will display information associated with the user interacting with it, but it should not show
information about other users of the Smart Mirror for privacy reasons.

Manufacturability and Sustainability Constraints

The manufacturability constraints of the project involve the limited access to resources and machinery. Material must be budget friendly and the project is assembled by hand,
not machine, so precision is not guaranteed. As for sustainability constraints, the device should be easily repaired with replacement parts if needed