Project Report

On

HOME AUTOMATION USING CORTANA

Submitted By

Bhushan Nagpure
Renuka Samarth
Karishma Manake
Sagar Kumar

Guided by
Prof. Mrs. N. R. Hatwar

DEPARTMENT OF INFORMATION TECHNOLOGY

PRIYADARSHINI COLLEGE OF ENGINEERING, NAGPUR
SESSION 2016-17
 Certificate
This is to certify that the BE project entitled

HOME AUTOMATION USING CORTANA

Submitted By

Bhushan Nagpure
Renuka Samarth
Karishma Manake
Sagar Kumar

In the partial fulfillment of the requirement for the degree of

‘Bachelor of Engineering’ in Information Technology of
Priyadarshini College of Engineering, Nagpur
is bonafide work carried under guidance and supervision.

Prof. N. R. Hatwar Prof. N. R. Hatwar Dr. M. P. Singh

Guide H.O.D(IT) Principal
P.C.E., Nagpur
 Acknowledgement

We have a great honor to acknowledge Dr. M. P. Singh, Principal, Priyadarshini

College of Engineering, Rashtrasant Tukdoji Maharaj Nagpur University, Nagpur, who
had given us his consent to carry out this project.
We are very much delighted to voice my gratitude and indebtedness to Prof. N. R.
Hatwar, Head of Department of Information Technology, Rashtrasant Tukdoji Maharaj
Nagpur University, Nagpur, who had given us his consent to carry out this Project.
We feel immense pleasure and privilege in expressing my deep sense of gratitude
towards my Guide Prof. Mrs. N. R. Hatwar and Project Incharge Prof. Mrs. M. M.
Gudadhe, whose valuable guidance and critical analysis of my result has led to successful
completion of our project.
Our special thanks to all my friends for giving me incentive support in this report
work.
We express our indebtedness and our gratitude to our affectionate and loving family and
friend for encouragement and enthusiastic support throughout this study.
We thank to our respected parents, whose patience and support was instrumental
in accomplishing this task.

Bhushan Nagpure
Renuka Samarth
Karishma Manake
Sagar Kumar
 CONTENT

1. Index…….…………………………………………………………. I
2. List of Figure ………….…..……………………………………... II
3. List of Tables ……………………………………………………… III
4. List of Abbreviations ……………………………………………… IV
 INDEX

1. INTRODUCTION

2. PROBLEM DEFINATION

2.1 6

2.2 7

3. REQUIREMENT SPECIFICATIONS

3.1 9

3.2 10

4. PLANNING

5. IMPLIMENTATION AND SOURCE CODE

6. USER MANUAL

7. TESTING

8. APPLICATIONS

9. FUTURE ENHANCEMENT

10. CONCLUSION

11. REFERENCES
12. ANNEXURE
 LIST OF FIGURES

Sr. No. Figure Name Page No.

Fig 2.1 Examples of Apriori Algorithm 9

 LIST OF ABBREVIATIONS

Sr.No Abbreviations Full Forms

1 sup Support count

LIST OF TABLES

Sr.No Table Name Page No.

2.1 Frequent item set 10

 ABSTRACT
With the increasing development of modern technology and Smartphone, smart way
of living has turned out to be a major part in the present era of human life. Due to
rapid growth in Technology, mobile phones has brought a revolutionary change.
Mobile communication is playing a vital role in the domain of automation.Windows
phones are powered with application programs to automate the required devices.This
study focused to automate the home appliances using the cortana. Cortana is a voice
recogniser virtual assistant for windows 8.1 and above. In this paper we presented
one of its day to day application i.e.., Home automation,which is controlled by
cortana,voice recogniser for the physically challenged people suffering from
quadriplegia or paraplegia(who cannot move their limbs but can speak and listen) to
control the various home appliances.
The proposed system consists of a voice recognition module, Raspberry
microcontroller.The accuracy of voice recognition module is also measured in
different conditions. The Experimental results validate the functions of the proposed
system.The results show the system can provide great assistant to the physically
challenged people without any third person’s assistances.
INTRODUCTION
 PROBLEM
DEFINITION
There are so many problems that can be solved using Home Aut
REQUIREMENT SPECIFICATIONS
● Software Requirements
● Visual Studio Enterprise Edition 2016
● Cortana API
● Phone With Windows 10.0 or higher
● Azure SDK

● Hardware Requirements
● Windows Phone
● Raspberry Pi 3 model B
● LED

Software Requirements

Visual Studio Enterprise Edition 2016

Microsoft Visual Studio is an integrated development environment (IDE)

from Microsoft. It is used to develop computer programs for Microsoft
Windows, as well as web sites, web apps, web services and mobile apps.
Visual Studio uses Microsoft software development platforms such as
Windows API, Windows Forms, Windows Presentation Foundation, Windows
Store and Microsoft Silverlight. It can produce both native code and managed
code. Visual Studio includes a code editor supporting IntelliSense (the code
completion component) as well as code refactoring. The integrated debugger
works both as a source-level debugger and a machine-level debugger. Other
built-in tools include a code profiler, forms designer for building GUI
applications, web designer, class designer, and database schema designer.
Visual Studio supports different programming languages and allows the code
editor and debugger to support nearly any programming language, provided a
language-specific service exists. Microsoft provides a free version of Visual
Studio called the Community edition that supports plugins and is available at
no cost for all users.

Cortana API

Cortana offers a robust and comprehensive extensibility framework that

enables you to seamlessly incorporate functionality from your app or service
into the Cortana experience. One of the strengths of Cortana is its ability to
understand and respond to voice commands. The Windows Runtime API
enables you to integrate your app with Cortana and make use of Cortana’s
voice commands, speech recognition, and speech synthesis. It is also possible
to voice-enable your apps by implementing speech recognition and TTS
capabilities.

Azure SDK
Azure is a cloud computing service created by Microsoft for building,
deploying, and managing applications and services through a global network of
Microsoft-managed data centers. It provides software as a service, platform as
a service and infrastructure as a service and supports many different
programming languages, tools and frameworks, including both
Microsoft-specific and third-party software and systems.Azure was announced
in October 2008 and released on February 1, 2010 as Windows Azure, before
being renamed to Microsoft Azure on March 25th 2014.

Hardware Requirements

Raspberrry Pi Kit
The Raspberry Pi is a series of small single-board computers developed in the
United Kingdom by the Raspberry Pi Foundation to promote the teaching of
basic computer science in schools and in developing countries. The original
model became far more popular than anticipated, selling outside of its target
market for uses such as robotics. Peripherals (including keyboards, mice and
cases) are not included with the Raspberry Pi. Some accessories however have
been included in several official and unofficial bundles.

Windows Phone
Windows Phone 8.1, rolled out at Microsoft's Build Conference in San
Francisco, California, on April 2, 2014, is the third generation of Microsoft's
Windows Phone mobile operating system, succeeding Windows Phone 8. It
was released in final form to Windows Phone developers on April 14, 2014
and reached general availability on July 15, 2014. All Windows Phones
running Windows Phone 8 can be upgraded to Windows Phone 8.1, with
release dependent on carrier rollout dates.Windows Phone 8.1 is also the last
version that uses the Windows Phone brand name as it was succeeded by
Windows 10 Mobile. Some Windows Phone 8.1 devices are capable of being
upgraded to Windows 10 Mobile. Microsoft delayed the upgrade and reduced
the supported device list from their initial promise.
 PLANNING

IMPLEMENTATION AND
SOURCE CODE
USER MANUAL
1] Raspberry Pi

Because it's a bit more popular compared to Windows Phone

and Azure, I won't be going too in depth on setting up your Raspberry
Pi and wiring it all together. There are also a lot of great tutorials out
there already to help you get started. Make sure you can ssh into one,
know your basic Linux commands, and feel comfortable putting a
circuit together (a very basic one).

Step I] Install Raspibian on Raspberry pi

i) Insert the SD card into your SD card reader. You can use the SD card slot
if you have one, or an SD adapter in a USB port. Note the drive letter
assigned to the SD card. You can see the drive letter in the left hand column
of Windows Explorer, for example G:
 ii) Download the Win32DiskImager utility from the Sourceforge Project
page as an installer file, and run it to install the software.

iii) Run the Win32DiskImager utility from your desktop or menu.

iv) Select the image file you extracted earlier.

v) Select the drive letter of the SD card in the device box. Be careful to
select the correct drive: if you choose the wrong drive you could destroy the
data on your computer's hard disk! If you are using an SD card slot in your
computer and can't see the drive in the Win32DiskImager window, try using
an external SD adapter.

vi) Click 'Write' and wait for the write to complete.

vii) Exit the imager and eject the SD card.

Step II] Install Python

i) Enter command “ Sudo apt_get upgrade” to the terminal.

ii) Enter command “ Sudo apt_get update” to the same terminal.

iii) Enter command “Sudo apt install python” to the terminal.

Step III] Check Installation

i) Enter “Python” to the check installation in terminal.

ii) if “ <<” flashes on screen , then Python has been successfully installed.

Step IV] Install Azure_Sdk in Python

The Azure SDK for Python includes components that allow you to develop,
deploy, and manage Python applications for Azure. Specifically, the Azure
SDK for Python includes the following:

● Management libraries. These class libraries provide an interface

managing Azure resources, such as storage accounts, virtual machines.
● Runtime libraries. These class libraries provide an interface for accessing
Azure features, such as storage and service bus.

INSTALLATION

You can install each library individually for each Azure service:

$ pip install azure-batch # Install the latest Batch runtime library

$ pip install azure-mgmt-storage # Install the latest Storage management
library

Preview packages can be installed using the --pre flag:

$ pip install --pre azure-mgmt-trafficmanager # will install the latest Traffic

Manager

You can also install a set of Azure libraries in a single line using the azure
meta-package. Since not all packages in this meta-package are published as
stable yet, the azure meta-package is still a release candidate and not final
yet. However, the core packages, from code quality/completeness
perspectives can at this time be considered "stable" The azure package will
be officially labeled stable in sync with other language SDKs as soon as
possible. We are not planning on any further major changes until then.

Since it's a preview release, you need to use the ``--pre`` flag:

$ pip install --pre azure

or directly

$ pip install azure==2.0.0rc6

The azure meta-package 1.0.3 is deprecated and no longer properly functions.

The full list of available packages and their latest version can be found on our
installation page on ReadTheDocs.

If you want to install all packages of the repo from source:

git clone git://github.com/Azure/azure-sdk-for-python.git

cd azure-sdk-for-python
python setup.py install
 Step V] Check Installation

i) check Azure Sdk

ii) Enter “Python” to the terminal.

iii) If “>>>” flashes on screen, then import Azure

Step VI] Download listners Script.pg.

2] Azure

Step I] Create your Azure Service Bus

i). Create Your Azure Account

Chances are you don't have an Azure Account, so you will need to sign up
for their free trial. It's fairly straight forward, although you will need to enter a
credit card

Worried about paying monthly for this? Don't. The service bus we will set up
will likely receive less than 1 million calls a month. It currently costs about
$1.00 for 30 million. You'll be paying a few dimes at most. If you want to
continue past the free trial, however, be prepared to shell out about $11 a
month.

ii). Create A Service Bus

● Log into the Azure Management Portal after you have created your
account.
● Figure 1: Click on 'Service Bus' to go to the 'Service Bus'
Dashboard.
● Figure 2: Click on 'Create' In the lower pane.
● Figure 3: Enter in a name for your namespace (Must be Unique!).
Note that my Region is Central US because that's where I am.
Azure will likely put in whatever region it thinks is best, and you
should just leave it. Click on the Checkmark in the lower right
 corner to continue.
● Your Namespace will be "activating" for a short bit, and then Boom!
Your Service Bus has been Created!
● ***NOTE***For this guide, I have named my Namespace
"CustomNamespace". Anywhere you see that String, you should
replace it with your own Namespace name.

Recap
So basically all we did here was get started with Azure. We created an
account and then a Service Bus. Remember that a Service Bus provides us
with a Cloud "Mail Sorting Facility", but right now that Facility doesn't really
have any direction. In our next step we will work on adding actual logic with
Topics and Subscriptions.

Step II) Creating Topics and Subscriptions

Conceptual Setup
Before we just start hacking away, let's take a step back and remember what
exactly we are doing. Look at Figure 1 and make sure you have an idea of
what's going on. We won't be creating that exact model today, but it is
definitely something you could do further down the road. We have a
LightTopic which is going to be where we send commands dealing with
turning off the lights. We then have our LightSubscription which we will label
DeskLightSubscription because it's what we want the Desk lights (the led we
have hooked up to the Pi) to listen to.

i). Create the 'LightTopic' Topic

● Figure 2. Click on your Service Bus to go to the Service Bus
Dashboard
● Figure 3. Click on 'TOPICS' on the upper panel to go to the Topics
Page
● Figure 4. Click on 'CREATE A NEW TOPIC'
● Figure 5. Type in 'LightTopic' (Or whatever you want to call it) Then
Click 'CREATE A NEW TOPIC'
Great! We've created our first Topic. This is where we will send all of our
commands from Cortana.

ii). Create the 'LightSubscription' Subscription

● Figure 6. Click on 'New Subscription' At the bottom of your Topics
page (Where you should have left off)
● Figure 7. Enter 'LightSubscription' into the TextBox and click on the
Arrow in the Lower Right Corner.
● Figure 8. You'll be taken to a 'Details' Page. Leaving everything at
the Defaults will be fine, so simply click on the arrow again.
● Figure 9. Once you go back to the Topic Dashboard, you'll notice
that there is now 1 Subscription attached to the topic.
Recap
Yup. We're done. It really is that simple. Now, navigating through Azure can
be a little daunting at first, especially with all the different terms which we
may not all be familiar with. As we saw though, the process is actually pretty
simple. I know it doesn't really feel like we've done anything yet because
there isn't really anything tangible or code, and unfortunately there won't be
for a while. But we have created an essential and important part of our
project!
3] Windows Phone App

Step I] Install Jarvis App from windows store

Step II] Launch App first time by directly opening rather than using cortana. After launching
wait for voice command.

Step III] Use Cortana to give voice command to Jarvis(Windows App).

Cortana is an intelligent personal assistant created by Microsoft for Windows 10, Windows
10 Mobile, Windows Phone 8.1 (where it now supersedes Bing Mobile), Microsoft Band, Xbox One,
iOS and Android

Cortana can set reminders, recognize natural voice without the requirement for keyboard input,
and answer questions using information from the Bing search engine.

Step IV] Give command to cortana

For e.g. give command “Jarvis turn on the lights” and wait until the command reaches
to the app . Once the app get the command from cortana, cortana flashes response on itz own
screen showing app icon and response message.
TESTING
APPLICATIONS
● The applications are limited by your imaginations, like whatever
the home appliances you want to control you can control through
your voice command.
● There is an increasing demands for smart phones these days,
where appliances react automatically to the changing
environmental condition and can be easily controlled through
common device.
● This is basically required when a human make some mistakes
and forget to switch off the appliances when in no use and in this
case, they are useful in order to utilize the power effectively and
also in a secured manner, thus optimizing use of the low cost
electricity.
● Turning lights or radio on / off when someone approaches the
house, simulating occupancy thus it saves your time and your
power consumption.
● For the elder most section of the society,this system will bring
them to an ease of operating the home appliances without
exhausting much of themselves. Sometimes it becomes difficult
for them to operate fans(regulation of speed too fluently as the
weather changes every now and then),lights(switching it on or off
 when day turns to evening and then to night) etc at their facile
level.
● Each time we see a handicap we think how had have he/she
been doing all the daily works with this physical incapability.This
system will bring out a whole lot of change in their lives by getting
them to reach to switchboards,remotes and sockets just by their
commands of speech on their phones which they can use round
the clock.
● The people who is injured, and cannot walk or move, this project
will help them to do their work according to the instructions
provided by them. Work will be implemented in real time and
appliances will be controlled according to the command given by
them through their smart phones.
● This methodology is implemented in any location to automate the
devices. The house or office is safeguard from the fire accidents,
this mechanism will keep the entire house or office in monitoring
state.
CONCLUSION
REFERENCES
ANNEXURE
PHOTOS DETAILS

Name - Bhushan Nagpure

Email-Id -bhushannagpure059@gmail.com

Contact No - 9175434856

Name :- Renuka Samarth

Email-Id :- @gmail.com

Contact No :- 8805742388

Name :- Karishma Manake

Email-Id:-dikshathakre131@gmail.com

Contact No :- 8421273386

Name :- Poonam Tidke

Email-Id :- poonamtidke15@gmail.com

Contact No:- 9403125024

Name :- Hemlata Waghmare

Email-Id :-
hemlatawaghmare000@gmail.com

Contact No:- 9970723164

Prof. Mrudula Gudadhe (Guide)

Prachi Jugade

Ruchika Gaikwad

Diksha Thakre

Poonam Tidke

Hemlata Waghmare
 Publications

Sr.No Title of Paper Name of Project Place and Date Accepted /

Competition / Published /
Conference / Journal Presented /
(vol) Awared /
Participated

CUSTOMER
1. BEHAVIOUR JIGYASA17, Priyadarshini 1st PRIZE
PREDICTION FOR SHODHA a project College Of
E-COMMERECE competition Engineering ,
WEBSITE Nagpur

11/03/2017