"Performance evolution and fabrication of Gesture & Voice

Controlled Drone"
CONTENTS
 Abstract
 Introduction
 Literature survey
 Design calculation
 Working of gesture and voice control
 Board used for gesture and voice controlled drone
 Why it is used
 APM Flight controller
 Reference
Abstract
 Drones & Unmanned Aerial Vehicle are the future
developing technology. Everyday scientist try to
optimize and increase usage of drones in day to day
activity. We try to combine the voice command control
and gesture movement for controlling of the drone. It
will reduce the need of the skilled operator. This makes
the operation of the drone easier than use of joystick.
Every one can operates these kind of operation and it
help to perform the complex maneuvering.
INTRODUCTION:
Gesture controlled drone

Gesture recognition technology helps to communicate

or control any other devices we have your hand gesture.
From this technology we can control the drone simply by
moving your hands
Now we can control the drone by doing the gesture
where you don’t need to have the transmitter. An
accelerometer will be fixed over on the hand that will detect
the movement of the body then its sense the signal to the
micro controller. That signal will be send to the drone with
the help of telemetry.
Voice controlled drone
The drone which operate by the voice commands the
voice command will be received by the micro controller
then it will generate the output signal to the Bluetooth
module, that signal will be received by the mobile. The
ground telemetry is connected to the mobile through which
you can send the signal to the air module which is
connected to the drone
Flight controller receives the signal from the air
telemetry and gives the signal to the all ESC’s which
controls the motor speed. Based on the voice command
drone will be control.
Combination of gesture and voice command
The combination of the gesture movement and voice
command to control the drone
The basic drone yawing and rolling moment will be
controlled by the gesture movement which the
accelerometer recognize and the data send to
microcontroller and transfer to the air telemetry
The complex movements or takeoff, landing will be
controlled by the voice command, that command received
by micro controller and transfer to Bluetooth module then
output signal will be transfer to air telemetry.
Working of Gesture and voice command
device
 Accelerometer (ADXL 335).
The accelerometer sensor works on the principle of piezoelectric
Effect . whenever we tilt the sensor the ball is suppose to move in the
direction because of gravitational force.
The walls are made of piezoelectric elements .whenever the ball
touch the wall electric current which will be interpreted I the form of
values in any 3D space.
Flex sensors.
Flex sensor used to measure the deflection or the bending
. Sensor placed on a surface varied by bending the surface .
Controlling of drone
Gesture control
control the roll of quad-copter : rotate the hand left and right
• control the pitch : rotate the hand up and down
• control the speed : fingers motion change the speed (throttle).
Voice command
 Lift off
 Landing
 Ascend
 Descend
Voice command :Lift off
The voice command “lift off” will be received by the microcontroller then
it generate output signal to the Bluetooth module , that signal will be received by
laptop .
The ground telemetry is connected to the PC through which signal sent to
Air module.
Flight controller will receive the signal & the ESC send signal to motors
to rotate at equal RPM that will “lift“ the drone,
PROBLEM IDENTIFICATION:
 The main problem identify in this project is combining of gesture and voice
control.
 The coding for the gesture & voice are different in small ways, maintaining the
control switching is hard.
 Due to combining, arudino board can’t be used as microprocessor it will create
some unstable condition
Choice of arduino board
 We have chosen our arduino board as Arduino 101.
ABOUT ARDUINO 101:
 This board recognizes the gesture and feature a six axis accelerometer and
gyroscope.
 Controls is done with your phone over Bluetooth connectivity
TECH SPECS:
OPERATING VOLTAGE 3.3 V
INPUT VOLTAGE 7 – 17 V
DIGITAL I/O PINS 14
DC CURRENT PER I/O PIN 20mA
FEATURES BLUETOOTH, 6 Axis
accelerometer/gyroscope
LENGTH 68.5mm
WIDTH 53.4mm
WEIGHT 34 gr.
 REFERENCES
 1]AR Drone Developer guide. (n.d.). Retrieved May 1, 2016, from
http://www.msh-tools.com/ardrone/ARDrone_Developer_Guide.pdf
 [2]GUI without the G: Going Beyond the Screen with the Myo™
Armband. (n.d.). Retrieved May 1, 2016, from
http://developerblog.myo.com/gui-without-g-going-beyond-screen-
myotm-armband/
 [3]Leap
Motion Controller Adds Motion Controls to Any Mac or
Windows Computer. (n.d.). Retrieved May 1, 2016, from
http://www.techforanyone.com/leap-motion-controller-adds-motion-
controls-mac-windows-computer/
 [4]Myo developer forum thread. (n.d.). Retrieved May 1, 2016, from
https://developer.thalmic.com/forums/topic/2707/?page=13#post-11886
 [5]Myo On stage with Armin Van Buuren. (n.d.). Retrieved May 1,
2016, from https://www.myo.com/arminvanbuuren/