Professional Documents
Culture Documents
VEHICLE
BACHELOR OF TECHNOLOGY
IN
ELECTRONICS AND COMMUNICATION ENGINEERING
SUBMITTED BY
Name Univ. Roll No.
ROHIT KUMAR JASHWARA 10800319070
GOURAV RAJ 10800319077
SACHIN KUMAR 10800319076
ADITI RAJ 10800319041
MUKESH KUMAR SAW 10800319083
RITESH ANAND 10800319008
DEPARTMENT OF ECE
ASANSOL ENGINEERING COLLAGE
AFFILIATED TO
MAULANA ABUL KALAM AZAD UNIVERSITY OF TECHNOLOGY
MAY 2023
DEPARTMENT OF ECE ENGINEERING
ASANSOL ENGINEERING COLLEGE
Vivekananda Sarani, Kanyapur, Asansol, West Bengal – 713305
Certificate of Recommendation
…………………………………
Mrs. Swati Bhattacharjee
Countersigned:
……………………………… ………………………………
Mr. Sujit Goswami, AP, ECE Dr. Kuntal Ghosh
(Project Coordinator) (Head of the Department)
ECE Department ECE Department
Asansol Engineering College, Asansol Engineering College,
Asansol-713305 Asansol-713305
ii
DEPARTMENT OF ECE ENGINEERING
ASANSOL ENGINEERING COLLEGE
Vivekananda Sarani, Kanyapur, Asansol, West Bengal – 713305
Certificate of Approval
…………………………………
iii
Acknowledgement
We would like to convey my sincere gratitude towards Dr. Kuntal Ghosh, Head of the
Department of ECE, Asansol Engineering College for providing us the requisite support
for time completion of our work. We would also like pay my heartiest thanks and
gratitude to all the teachers of the Department of ECE, Asansol Engineering College for
various suggestions being provided in attaining success in our work.
I would like to express my earnest thanks to my other colleagues along with all
technical staffs of the Department of ECE, Asansol Engineering College for their
valuable assistance being provided during my project work.
Finally, I would like to express my deep sense of gratitude to my parents for their
constant motivation and support throughout my work.
………………………………… ……………………………
(Rohit Kumar Jashwara) (Ritesh Anand)
…………………………………
(Gourav Raj)
…………………………………
(Sachin Kumar)
…………………………………
(Aditi Raj)
…………………………………
(Mukesh Kumar Saw)
iv
Abstract
In this final report I will mention about Our Final Year project. Our project is a Arduino
based voice controlled Robot Vehicle. In this project our aim is to control the Robotic
Vehicle with our speech. We are going to use a Phone to take Our voice Command
through the app which will be made by us specifically and then just simply provide it to
the Arduino to process it and match the pre-provided codes for the command the then
moves the vehicle according to the command provided. We will just use the Bluetooth to
transmit the voice command from the phone to the Arduino and process it accordingly.
We want to understand how to make speech recognition program and sending this
program result to a Robotic Vehicle wirelessly and real time. The Processed command
will be sent to the motor driver and the motor driver will move the robotic vehicle
according to the provided command with the help of the 4-motor connected to each
wheel.
v
Table Of Contents
Abstract...................................................................................................................................
Table of contents....................................................................................................................
List of figures........................................................................................................................iii
1. Introduction.......................................................................................................................
1.1 Literature
Survey………………………………………………………………..2
vi
2.3.4 DC Motor Controlling Plan..........................................................................41
2.3.5 Arduino Controlling Plan.............................................................................41
2.3.6 Bluetooth Communication Plan...................................................................42
2.3.7 Deliverables..................................................................................................43
CONCLUSION………………………………………………………………………….45
FUTURE WORK………………………………………………………………………..46
REFERENCES.....................................................................................................................47
vii
LIST OF FIGURES
Fig1.Circuit Diagram 10
viii
Figure 2.27: Bluetooth master and slave network. [23] 31
Fig.3.Developed Robot 32
Fig.7. Tapping on the mic symbol will enable this dialog box 34
ix
1. INTRODUCTION
Our aim is to make a robot vehicle which can be controlled by the voice command of a
person. Normally these types of systems are called as Speech Controlled Automation
System (SCAS). Our design is a prototype of the above-mentioned system. The idea is to
create a sort of robot which going to be driven by voice commands. The robot is
remotely controlled by a mobile phone; there are many articles that show the
communication between a robot and smart phone. In this design, an android application
with a micro controller is used for the required task. The connection between the
application and the robot is facilitate with Bluetooth technology. The commands issued
will be relayed over through the channel and will be received by the module. The
objective of voice controlled robotic vehicle (VCRV) is to listen and act on the
commands of the user. Here the system requires accent training, post which the device
will start understanding the commands issued; and the commands have been added by
codes. The main goal is to control the robotic vehicle in a desired position and also to
control the robot by the voice or push buttons. Human Robotic Interaction is achieved.
The goal of voice-controlled Robot is to listen and act on the commands received from
the user.
Speech signals are the most important means of communication in human beings.
Almost every conversation to interact is done by means of voice signals. Sounds and
various speech signals can be converted into electrical form using a microphone. Voice
recognition is a technology which is used to convert the speech signals into a computer
text format. This voice recognition technology can be used to control and generate
speech acknowledgement using some external server. Robot voice has the ability to
understand thousands of voice commands and perform required action. The voice
recognition is a bit difficult task because each person has his own accent.
For that, Robot voice uses Bit Voicer Server which supports 7 languages from 26
countries and regions. These robotic assistants can be used for shaping, manufacturing
and tooling purposes in various sectors such as manufacturing, defence etc. In hospitals,
these robotic assistants can be used for the purpose of performing surgeries and
x
operations with high precision. In this paper, we develop an assistant robot that can be
operated using speech commands.
In the research work [1] authors proposed a Voice Controlled Robot is operated by using
ZIGBEE module and a camera is set on the head of the vehicle to get the live feed of the
actions commanded and At mega 2560 is used to drive the servo motors”.
In another work [2] we find that a Voice Controlled Robotic Car is operated by using
Bluetooth Module and four motors are used to operate the vehicle by the motor driver
and the command pre-fed in the Arduino Uno and the command are given through the
software.
In another work [3] we find that the Voice Controlled Robotic Vehicle is based on Texas
Board MSP432P401R is connected to TI-RSL kit and is Communicated through Wi-Fi
Module CC3100 interfaced to and android application and Blynk to transmit the voice
commands and a camera is fed to view the live streaming of the actions commanded.
xi
1.2 DEVELOPMENT OF MODEL
The proposed system design based on micro-controller connected to smart android phone
through Bluetooth module for receiving voice command. The voice command is
converted to text by an app of the android phone and sends necessary data to the micro-
controller for controlling robot movement. After receiving the data, the robot responses
according to the command to perform movement at proper direction according to the
voice command. In Our project micro controller is associated to user smart phone
through Bluetooth module for the reception of voice commands. The received voice
commands will be converted to text by application available in user’s android smart
phone and sends the required data to the micro controller for the movement of robot.
After receiving command robot makes a proper movement with specified direction
according to the given voice command. The development of a voice-controlled robot is
demonstrated with ability to follow voice command from user and does communicate
with user by using pre-recorded human voice sound. The movement of the proposed
robot will be controlled by the voice command of the user. The user uses an android
operated smart phone to give voice command. The command can be fetched using an
app which will convert the voice command into text. The phone will be connected to the
micro controller using a Bluetooth module.
xii
xiii
Fig1.Circuit Diagram
Voice control system block diagram consist of Bluetooth Module, Arduino Uno, Motor
Driver Shield, Battery.
xiv
Fig.2. Block Diagram of Voice Controlled Robot
• The Bluetooth module is connected to the Arduino Uno and motor driver shield.
• Motor driver required for controlling the movement of the robot and operated by
the micro controller to control the four different motors forward, backward, left, and
right by controlling the direction of rotation of motors.
• Smart phones understand the voice input and transfer to the Bluetooth module via
wireless communication.
• Circuit operates by converting the voice input to text and the and further processed
by Arduino.
xv
1.2 VOICE AND SPEECH, VOICE INPUT AND SPEECH
RECOGNITION
Voice is a sound which produced by humans or animals. Voice uses airflow that comes
from lungs. Air makes pressure over vocal folds and these vocal folds vibrate. Normally
speech produces as whisper in our throat by using neck, chest, head and abdomen this
whisper becomes our speech. Our speech is unique for every people and also it helps
other people to understand each other’s personality, mood and most importantly it helps
people to communicate. Sounds are using mechanical waves for traveling around gases,
liquids and solids. Mechanical waves transport their energy to one medium to another
medium while using vibration. Due to take voice microphone is required. Microphone is
a hardware which can convert analog input to a digital output. Digital data can be
understood, modify and store by computers. Computers can recognize speech by using
some complex algorithms and good dictionaries for these algorithms. Most of
recognition programs use Hidden Markov Model (HMM) and Mel-frequency cepstral
coefficients (MFCC) and frequency spectral decomposing technique to use both of those
algorithms. I have used Microsoft Visual Basic for making speech recognition it can
access Microsoft’s speech recognition tool while using framework, .NET and C#
programming language. First Microsoft speech recognition tool has been introduced for
Microsoft vista at 2006 and this toll uses Microsoft SAPI (Speech Application
Programming Interface) interface packed and this packed includes Microsoft speech
recognizer program for windows.
xvi
transmitter to the MAX232 circuit to send values MAX232 converted comments to the
RF receiver I connected PIC 16F877A circuit. My RF components is very simply ones
the only uses 433 MHz frequency and this is approximately equal to the 433 cycles per
second. Importing thing is when we use these components our receiver and transmitter
frequency should be equal if it is not than they cannot communicate with each other.
There are two important radio modulation technique exist today they are Frequency
Modulation (FM) and Amplitude Modulation (AM).
To communicate with Arduino, we first need to install its free software on the internet
and install. The software is very easy to use and install it creates just one .uno files on the
xvii
microprocessors these files are making user confuse because of there are many different
files generating. After installing Arduino is ready to usage including dictionaries using
dictionaries is very easy on the Arduino and Arduino does not requires any configuration
setting when programming these setting madden by program itself on the background.
User can use USB cable to connect Arduino and after that user can install his code to
Arduino far more easily and quickly than microcontroller.
Hardware designs,
Hardware connections,
Hardware integrations,
Computer programs,
Coding languages,
xix
2. TECHNICAL CONTENT
There is too many control devices in the environment like car steering wheel, computer
keyboards, elevator buttons, etc. But all these processes can be made easily with human
speech. Speech recognition programs can be also using by government or a company to
communicate or guide to people who need some official paper or other applications from
these companies. People can speak with speech recognition programs and find their way,
buying something things or services, access data from data base, write their documents,
writing text messages, making internet search, controlling wheelchair for paralyzed
people etc. all those services are available with touch system but with very good speech
recognizing system this kind of services will be using much more easily and make for
user search efficient and faster. With improvements in artificial intelligent systems
speech recognizing systems will be more importing and it using area will be increased
faster.
Wireless systems are very importing in these days, these systems removes cables around
and gives its users to ability connect internet and wireless networks for many different
applications. With smart phones wireless technology using area increased these systems
are very importing for community. Government use this wireless network in the public
areas like Istanbul metropolitan municipality use wireless technology to get location of
their busses and via mobile applications they share this information with the Istanbul
citizens. In these days communicating is very importing issue and with improvements in
the wireless technology systems communicating is being much easier and efficient. On
xx
the project I have used two type of wireless device these devices are radio frequency and
Bluetooth.
Radio frequency systems is essential for this day it used by many devices around us.
With using Frequency Modulation technique, we can listen sound in the range any radio
station and it is also common to use this modulation people communicate each other over
long distances. Radio is one of the important events on the history it is like new era on
the communication system, before radio being frequently used people used other
techniques but these techniques were slow and not guaranty to carry. Today we use cell
phones and those phones uses radio frequencies with using different modulation
techniques. Because of radio frequency we can watch television, all we need is a simple
antenna then we can listen and see pictures on the screen. Satellites also use this
frequency to communicate with word and sending their broadcast to the people. On the
emergency situations these radio frequencies are using to communicate between helper
groups to save people or help them in these case police, hospitals, and similar companies
uses those frequencies to communicate.
Motors are using in many industrial and daily application like cars, elevators, etc. to
make our live easier. Without of motors people could make many hard jobs with their
body power and this is not so efficient for today’s industry. Motors are very popular and
controlling them is very importing issue engineers and scientists still try to control
motors more efficient. With efficient motor control industrial technology could be
improve much faster and this affects other areas either. There is much kind of motors in
the industrial area because their applications vary due to application it used.
xxi
2.1.7 USING ARDUINO BENEFITS
Connecting things is getting very complex thing because there is too many cables and
too many port. With Bluetooth technology this problem could be solving and people
could connect their devices more easily, more beautify. The main idea of this invention
is cable-free computer connections, which means real freedom for working environment
regardless wire availability and device restriction. This Bluetooth technology allows
portable computers, notebooks, mobile phones, personal digital assistant and other
helpful materials to use short range, low power radio technology to connect to each other
very easily. Bluetooth is using 2.4 to 2.5 GHz frequency spectrum to communicate.
While Bluetooth communication with other Bluetooth device its signals hops between
channels and frequencies. It can communicate in the short range but its usage areas very
varying, it can be used to data transmission between two devices like computer to
computer, computer to cell phone, cell phone to computer, cell phone to cell phone.
Bluetooth also using to head phones to connect musical device, computer or cell phone
wirelessly, Bluetooth communication is pretty secure it hops between frequencies so
jammers and similar devices getting hard time to restrict its communication. Bluetooth
also can easily choose device that it will send its data, firstly Bluetooth device search
device near it and second it asks user should I get paired with this device to connect it
securely and if user permits they starts to their communications.
xxii
2.2. TECHNICAL BACKGROUND
Voice is a sound generating from humans or animals while producing it people using
their lung, vocal fold, muscles. Voice producing has two different steps, one of them is
humans create a voice using airflow over their lungs and this airflow vibrates their vocal
fold and this vibration called voice. Voice is changes by genre for humans for women it
is around 180 to 220 Hz and for men it is founded 110 Hz. High voice’s frequency is
bigger but for low voices amplitude is greater. Figure 2.1 indicates vocal fold vibration.
Due to
xxii
i
speech, human body requires to use forty thousand of neuromuscular events. Human
speech is produced by pressure madden by the lung which creates phonation in the
glottis in the larynx that is then this phonation modified by the vocal tract into different
vowels and consonants. Figure 2.2 and 2.3 indicates how speech developing in our body.
xxi
v
Figure 2.3: block diagram of speech production
[2].
After speech created in our body it travels through air or other mediums which let
it pass. Sound waves travel by using their energy to make vibration or collides
movement and while doing this it comes to receiver. Today some specific devices using
to receive sound waves one of the common devices is microphone. Microphone converts
analog input to digital output. Figure 2.4 has two types of condenser microphone devices
circuit design.
Incoming sound waves comes microphone and this makes a mechanical deflection of the
cone and voice coin. Microphone’s coil is moving around the permanent magnets and
this creates a time varying current. Condenser microphones use electrostatic forces
instead of magnetic induction. Condensers are a capacitor type and incoming sound
waves’ vibration changes its capacitance. Figure 2.5 indicates an electret microphone
cartridge; its condensers use its diaphragm to get sound waves and this start the
operation.
xxv
Due to implement applications with speech computers and other devices should detect
and record voices. There are two type of recording option these are digital and analog.
Most of devices records analog voices and after that they convert analog voice to digital
voice if this is necessary. Analog signal is an electrical shape of a sound's vibration
waveform, or variations in pressure devices like microphone transmits these vibrations of
its diaphragm to an electrical wave. This electrical wave goes to computer sound card or
other audio devices. Analog audio should be converting to digital signal before recording
it to the memory. Converter takes extremely much "snapshots" for detecting changes in
electric wave patterns (between 16,000 and 96,000 per second) and make up outputs one
code that allows a computer or other devices to use something similar data to the original
sound pressures. With taking much more snapshots that one converter takes per second,
digital copy will be more accurate [4].
Due to making a study for speech signals noise is one of the basic and important
problem. Noises make difficult speech recognition for computers and other devices
which interested with signals. Due to making a study for speech signals noise is one of
the basic and important problem figures 2.7 indicates entropy and noises (energy) effect
for a speech signal.
Noises make difficult speech recognition for computers and other devices which
interested with signals. With using two input cancelling approach technique recognition
xxv
i
errors could be reduce by about 75% (40% to 10%) it is depending speaker digit
recognition task [4].
For example, DC motors speeds depend dc current gave on it. Dc motors can be run
both forward and backward depending current direction passes over it this direction can
be changing by using H-bridges. DC motors has very high speed but they do not have
that much torque. To gain much torque power, with using gears and transmissions
motors speed power can be converting to torque. Other example is servo motors these
motors has always same current inside it but size of the pulse determines direction of
turning for typical servo motors large pulses means forward and smaller pulses mean
backward. Servo also allows turning with an angle its typical movement is one or two
degrees for per pulse.
xxv
ii
Figure 2.19: Frequency modulation. [19].
Figure 2.16:isdcvery
Digital modulation motors
old inside’s schematic.
technique [16].in many application with this
that used
modulation carrier was switched or keyed on and off to create some pulse shaped pulses.
This modulation named as amplitude shit keying (ASK). Figure 2.20 shows
fundamentals for digital modulation characteristics. During to design of this modulation
technique developers tried minimize losing data in the message to make this system
more useful carrier must have huge power.
xxv
iii
Figure 2.20: fundamentals for digital modulation characteristics. [19].
Phase shifting keying (PSK) another way to modulation signal it is similar to frequency
shifting keying (FSK) but for the PSK shifting in the phase and for the FSK shifting in
the frequency. Figure 2.21 shows PSK characteristic and figure 2.22 indicates FSK
characteristic.
For the figure 2.22 (a) representing bit streams these could be zeros and ones, (b)
representing a modulated signal with using PSK, (c) represent modulated signal’s
spectrum.
Radio Frequency technique has been used by many wireless applications since its first
invention. Radio Frequency is using very frequently in our live, it is on the air and
because of radio frequency people can listen radio frequencies, watch television,
communicate from long distance without cable and with using this people also can-do
various things. Radio frequency is a kind of electrical current that have some certain
properties that allow it to broadcast with using an antenna. These frequencies are not
xxi
x
visible for human eyes these are infrared side of visible light. If an AC current generates
an electromagnetic field or a wave at a frequency that is necessary to broadcast, then we
can say this AC current is Radio frequency. It is mechanical oscillation on the air and
this oscillation carries some electrical pusses with it these pulses considered by another
machine and get meaning on their communication. Radio frequencies range can be
varied about 3 kHz to300GHz, this corresponded frequency of radio waves and
alternating current it carried. To carry pulses there is many modulations technique exist
and using in this report main modulation technique used as (FM) frequency modulation.
Frequency modulation is a wave with instantaneously frequency changing. Frequency
modulation usually uses on FSK frequency –shifting keying technique this modulation
and frequency usually used on the radios, radars and other similar devices. To
understand FM signal to considering a modulating signal, figure 2.23 compares FM
signals with modulating signal.
xxx
Figure 2.23: FSK modulation system characteristics. [20].
Signals are modulated by using radio frequency carrier and then new radio frequency
signal moves up and down in frequency as indicated figure 2.23. Signals move up and
down is very important to communicate this movement known as the deviation and is
normally quoted as the number of kilohertz deviation. For example, the signal can have a
deviation of ±3 kHz so carrier moves up and down by 3 kHz. Advantages of FM
modulation are resilience to noise, easy to implementation with using low power on the
transmitter components and receiver components, long distance when compared to the
amplitude modulation which is used very frequently in daily life.
xxx
i
Arduino is open-source electronic prototyping platform based on flexible to use
easy to use hardware and software tool which includes a microprocessor. Arduino uses
ATmega series microcontroller. Today there are many type of Arduino exist today most
popular ones are Arduino MEGA, Arduino UNO and many other type. Arduino UNO
uses ATmega328 series of microcontroller; it has 28 ports inside it. Arduino has 20 pins
14 of them are Digital I/O pins and 6 of them are PWM (analog) output. Arduino has
32k flash memory include itself and its clock speed 16Mhz.
Figure 2.24: Arduino UNO board and its USB connection cable. [21].
xxx
ii
Arduino has it is own software and this software can be freely downloadable on the
Arduinos own web side. This software of Arduino is very easy to use it does not require
too much configuration one you choose your dictionaries and wrote your code Arduino
takes care of all other configuration settings and makes things much easier. To installing
code to Arduino is also very easy after code verified its complier than user just need to
connect its cable to the PC than Arduino’s software finds its hardware and when user
installs code to the hardware it is still easy to debug Arduino without using different
hardware or software. If user defines serial communication with PC, then user can check
what Arduino does when it’s working. When software fist opened an empty space
opening this page’s name became today’s history and it called sketch history and
alphabetical count for number of new documents. Arduinos option bar include five
different menus these are file, edit, sketch, tools and help these menus help user to find
user’s required applications. On the file menu examples are very tutoring for the
beginners and they are also showing user how to use dictionaries on their applications.
And second option bar includes verify, upload serial monitor, new, open, save functions.
Figure 2.25 indicates an empty Arduino page on my computer.
xxx
iii
Figure 2.25: Arduino software an empty page screen
shoot.
Arduino can be using with another hardware while installing and using its dictionary. In
this project Arduino should control two different motor and to control these Adafruit
motor shield has been used. This shield could control 4 different DC motor, 2 servo
motor and 1 stepper motor. This shield provided 4H-Bridges on its L293D chipset and
per bridge can stand and have self-shutdown opportunity for more than 0.6A or 1.2A
peak. 4 directional DC motor have 8-bit speed control option this device can stand hot
and when something goes wrong, they have protection diodes on their self. It also comes
with its own dictionary to help users; users can directly write direction of rotation setting
speed easily and manage motors torque. These shields also provide user to use six analog
input pins of the Arduino so user could add another external hardware on his system.
Figure 2.26 shows an Adafruit motor shield circuit. [22]
xxx
iv
Figure 2.26: Adafruit’s motor shield circuit. [22]
xxx
v
earlier versions old Bluetooth could hops 800 per second. Connection with Bluetooth
fairly easy as indicated before it is simply using key matching process to connect each
other and it requires and pair code between devices after it given devices connects each
other. Security over Bluetooth is pretty good early versions of Bluetooth were encrypted
to stop any attack coming from the outside and now they added key matching and
pairing code. Bluetooth devices have a good search mechanism they can find other
devices on the 30m range and they can connect with them. Bluetooth’s power
requirement is very low but it is range is low and it is not so fast connection. Maximum
range of Bluetooth is like 30m and it can connect with 7 different devices it is called
piconet. Bluetooth can make slave and master connection with different devices on this
network Master waits for its slaves when a slave connects its network and paired with it
master send data to them and waits for answer, master also make those device
synchronal and communicate between them. Figure 2.27 shows a Bluetooth slave and
master connection.
xxx
vi
2.3. TECHNICAL OBJECTIVES
2.3.1 SPEECH RECOGNITION
Here we allow users to control the robotic vehicle remotely by voice commands. A
Bluetooth module is usually a hardware component, wireless product to work with the
computer. The blue tooth can be accessory or peripheral, wireless headphone or other
product such as cellphones. Arduino Bluetooth control android application transmit
command using Bluetooth to the Arduino Uno so that it can move in the required
direction like moving forward, backward, turning left, turning right and stop. After
assembling the components of the Assembled robot is shown in Fig.3.
xxx
vii
Fig.3.Developed Robot
Step 2: By turning on the HC-05 Bluetooth module and Bluetooth mobile connection get
established is shown in following Fig.5.
xxx
viii
Fig.5.Connecting to HC-05 Bluetooth Module
Step 3: By turning on the Bluetooth on mobile and HC05 on Arduino Board the
application gets connected to HC-05 is shown in following Fig.6.
Step 4: After connecting to HC-05, by tapping the mic symbol in the application the
dialog box will be enabled is shown in Fig.7
xxx
ix
Fig.7. Tapping on the mic symbol will enable this dialog box
Step 5: In the enabled dialog box when the users say backward command will be
transmitted to the robot and to take forward action is shown in Fig.8.
Step6: In the enabled dialog box when the users say backward command will be
transmitted to the robot and take backward action is shown in Fig.9.
xl
Fig .9. Transmitting the command to robot to move backward
Step7: In the enabled dialog box when the users say left command will be transmitted to
the robot and take left action is shown in Fig.10.
xli
Fig. 10. Transmitting the command to robot to move to its left
Step8: In the enabled dialog box when the users say right command will be transmitted
to the robot and take right action is shown in Fig.11.
Step9: In the enabled dialog box when the users say stop command will be transmitted to
the robot and robot stops accordingly is shown in Fig.12.
xlii
Fig. 12 Transmitting command to robot to stop its movement
#include <AFMotor.h>
#define Echo A0
#define Trig A1
#define motor 10
xliii
#define spoint 103
char value;
int distance;
int Left;
int Right;
int L = 0;
int R = 0;
int L1 = 0;
int R1 = 0;
Servo servo;
AF_DCMotor M1(1);
AF_DCMotor M2(2);
AF_DCMotor M3(3);
AF_DCMotor M4(4);
void setup() {
Serial.begin(9600);
pinMode(Trig, OUTPUT);
pinMode(Echo, INPUT);
servo.attach(motor);
M1.setSpeed(Speed);
M2.setSpeed(Speed);
M3.setSpeed(Speed);
M4.setSpeed(Speed);
xliv
}
void loop() {
Obstacle();
Bluetoothcontrol();
voicecontrol();
void Bluetoothcontrol() {
if (Serial.available() > 0) {
value = Serial.read();
Serial.println(value);
if (value == 'F') {
forward();
backward();
left();
right();
Stop();
xlv
void Obstacle() {
distance = ultrasonic();
Stop();
backward();
delay(100);
Stop();
L = leftsee();
servo.write(spoint);
delay(800);
R = rightsee();
servo.write(spoint);
if (L < R) {
right();
delay(500);
Stop();
delay(200);
} else if (L > R) {
left();
delay(500);
Stop();
delay(200);
xlvi
} else {
forward();
void voicecontrol() {
if (Serial.available() > 0) {
value = Serial.read();
Serial.println(value);
if (value == '^') {
forward();
backward();
L = leftsee();
servo.write(spoint);
if (L >= 10 ) {
left();
delay(500);
Stop();
Stop();
xlvi
i
R = rightsee();
servo.write(spoint);
if (R >= 10 ) {
right();
delay(500);
Stop();
Stop();
Stop();
int ultrasonic() {
digitalWrite(Trig, LOW);
delayMicroseconds(4);
digitalWrite(Trig, HIGH);
delayMicroseconds(10);
digitalWrite(Trig, LOW);
xlvi
ii
return cm;
void forward() {
M1.run(FORWARD);
M2.run(FORWARD);
M3.run(FORWARD);
M4.run(FORWARD);
void backward() {
M1.run(BACKWARD);
M2.run(BACKWARD);
M3.run(BACKWARD);
M4.run(BACKWARD);
void right() {
M1.run(BACKWARD);
M2.run(BACKWARD);
M3.run(FORWARD);
M4.run(FORWARD);
void left() {
M1.run(FORWARD);
M2.run(FORWARD);
xlix
M3.run(BACKWARD);
M4.run(BACKWARD);
void Stop() {
M1.run(RELEASE);
M2.run(RELEASE);
M3.run(RELEASE);
M4.run(RELEASE);
int rightsee() {
servo.write(20);
delay(800);
Left = ultrasonic();
return Left;
int leftsee() {
servo.write(180);
delay(800);
Right = ultrasonic();
return Right;
loop ()
l
Inside the infinite loop () we first check if serial data is available in the buffer. If data is
found then the characters are added one by one to the array ‘inSerial’ using a while loop.
Then we will call the Check_Protocol() function with ‘inSerial’ as an argument inside it.
This function will be responsible for controlling the robot’s motion by comparing the
received data with predefined strings.
forward ()
The forward () function will be responsible for moving the robot in the forward
direction. We will use the run () method on the motor instances with ‘FORWARD’ as an
argument inside it to move all the motors in the forward direction. Moreover, we also set
the speed of all the motors by using the setSpeed() method on the motor instances. Here
we are passing 255 as a parameter inside it. Valid parameters include 0-255 where 255 is
the highest speed.
back ()
The back () function will be responsible for moving the robot in the backward direction.
We will use the run () method on the motor instances with ‘BACKWARD’ as an
argument inside it to move all the motors in the backward direction. Moreover, we also
set the speed of all the motors by using the setSpeed() method on the motor instances.
Here we are passing 255 as a parameter inside it. Valid parameters include 0-255 where
255 is the highest speed.
left ()
The left () function will move the robot to the left direction. This is done by moving the
right-side motors in a forward direction with maximum speed and stopping the left side
motors. Note that we connected left side motors to M3/M4 terminals and right-side
motors to M1/M2 terminals.
li
2.4. WORK PLAN
Due to make speech recognition I first searched a good program and I came up with
three solutions one of them were MATLAB second LABVIEW and last option was
Microsoft Visual Studio. Fist I tried to MATLAB but I could not make it because it was
much more complex than other options, again I had to use a dictionary like I did on the
Visual studio but with using it I would have some problems to connecting hardware and
communication tools. LABVIEW were a good program I installed it but I was not known
it so I decided to use Microsoft Visual Studio. Microsoft Visio could use Microsoft
speech search engine and this gives me better results than MATLAB and it was easier.
I searched Microsoft forums and visual studios example codes and wrote my speech
recognizing code, I made it on the English language and specified with some words I
wanted to use.
lii
2.4.5 ARDUINO AND ADAFRUIT MOTOR CONTROLLING PLAN
I brought an Arduino board and a motor controller board for four motors but I just used
two motors. I downloaded Arduino’s program on the internet and made some exercises
to learn it and I also installed and learned how to use motor controlling with looking its
exercises and its forums. I have learned how to connect Arduino with my computer and
how to install program inside it. I have learned how to control motor how many motors
can I control which pins are never used and which are used. I learned how to supply
Arduino without of connecting computer.
liii
2.2 Understanding of USART Interface.
liv
6.4 Get data from computer
2.4.2. DELIVERABLES
This project will be delivered speech recognition system that can control something
without of wires. For this project I will control two cars, but it can also work for a
computer keyboard or a mobile phone message text box. While changing and extending
dictionary this project’s main code can manage these devices.
lv
Serial
Sending orders to
communication
motor via wireless
lvi
CONCLUSION
The aim of the project is to give a small gift to the unfortunate people who are physically
handicapped. By giving simple voice commands, their daily chores can be very easily
accomplished. And the voice commands are successfully transmitted via Bluetooth and
on receiving the commands the robot will perform desired operations. This project will
reduce the human power and perform actions which humans can't perform. Such robots
can be used in places like industries, military and defense, research purposes. The “Voice
Controlled Robotic Vehicle” project has many applications and in present and future.
The project can be made more effective by adding features to it in the future. The project
has applications in wide variety of areas such as military, home security, rescue
missions, industries, medical assistance etc. We were successful in implementing a
simple model of voice controlled robotic vehicle using the available resources. The
implementation of this project is easy, so this robot is beneficial for human life. The
Voice Control Robot is useful for disable people and monitoring purpose. It works on
simple voice command, so it is easy to use. It is useful for those areas where humans
can’t reach. The size of this robot is small, so we can use this robot for spying purpose. It
can be used for surveillance. We can implement web cam in this robot for security
purpose. The voice recognition software has an accuracy and for identify a voice
command and it is also highly sensitive to the surrounding noise.
lvii
FUTURE WORK
1. This task work has been limited to short range Bluetooth module. Utilizing a
long-range modules and other availability gadgets will bring about network with
the robot for significant distances.
2. Picture preparing can be executed in the robot to distinguish the shading and the
items.
3. A warm camera can be introduced to detect the warmth produced by bodies
valuable in military purposes to distinguish foes on the lines.
4. Programmed Targeting System can be executed in the robot for following the
objective.
5. Further upgrade in venture can be utilized for Home security and military
purposes where the orders can be given to robot without chance by expanding the
range and by introducing cameras.
6. The robot is valuable in places where people discover hard to reach however
human voice comes to. For example, in fire circumstances, in profoundly
poisonous zones.
7. It is the one of the significant phases of Humanoid robots.
8. Discourse and voice acknowledgment security frameworks.
9. The robot can be used for monitoring or investigation.
lviii
REFERENCES
[1] Surjeet and Nisha Gupta “A Novel Voice Controlled Robotic Vehicle for Smart City
Applications”, Journal of Physics: Conference Series in 2020.
[2] Shubh Srivastava and Rajnish Singh “Voice Controlled Robot Car Using Arduino”,
IRJET in May,2020.
[3] K. Kannan and Dr. Selvakumar “Arduino Based Controlled Robot”,SRM University,
IRJET in Mar,2015.
[4] Dr. Joseph Picone and Lawrence Rabier and Biing-Hwang Juang “Fundamentals of
speech recognition”, TIFR Researches in October 2013.
[5] Cecilia Caruncho Lluagno “cepstral analysis on the mel frequency scale and a
adaptive algorithm for it”, Tugraz in November 2013.
[6] Kin Hong Wong “Aduio feature Extraction techniques”, The Chinese University of
Hong Kong in October 2013.
[7] Adafruit “Adafruit Motor/Stepper/Servo Shield for Arduino kit”, Adafruit in Feb
2014.
[8] Anurag Mishra, Pooja Makula, Akshaya Kumar, Krit Karan,V.K. Mittal, “A Voice-
Controlled Personal Assistant Robot”, IEEE Xplore,2015.
[9] M. Meghana “Hand gesture recognition and voice-controlled robot”, Materials Today
in May 2020.
[10] M.Bhanu chandu, Kirupa Ganapathy “Voice Controlled Human Assistence Robot”,
International Conference on Advanced Computing & Communication Systems
(ICACCS) in August 2020.
[11] P. Mahesh Reddy, Suram Pavan Kalyan Reddy, G R Sai Karthik, Priya B.K,
“Intuitive Voice Controlled Robot for Obstacle, Smoke and Fire Detection for Physically
Challenged People”, International Conference on Trends in Electronics and Informatics
(ICOEI), in 2020.
lix
[12] Ms. M. Ramjan Begum, Mr. S. Chandramouli, Mr. T. Gowtham, “Design and
Development of Dual Axis Control Robot for Writing Robot Through Speech
Recognition”, International Research Journal of Modernization in Engineering
Technology and Science in 2020.
[13] Linda John, “Voice Control Human Assistance Robot, National Conference on
Technical Advancements for Social Upliftment”, Proceedings of the 2 nd VNC in 2020.
[14] Anurag Mishra, Pooja Makula, Akshay Kumar, Krit karan, and V.K. Mittal, “A
voice controlled personal assistant robot”, International Conference on Industrial
Instrumentation and Control (ICIC) in 2015.
[15] Dyah Ayu Anggreini Tuasikal, Hanif Fakhrurroja, Carmadi Machbub, “Voice
Activation Using Speaker Recognition for Controlling Humanoid Robot”, International
Conference on System Engineering and Technology (ICSET) in 2018.
[17] Ass. Prof. Emad S. Othman, “Voice Controlled Personal Assistant Using Raspberry
Pi”, International Journal of Scientific & Engineering Research Vol 8 in 2017.
[18] Harshada Rajput, Karuna Sawant, Dipika Shetty, Punit Shukla, Prof. Amit
Chougule, “Voice- Based Home Automation System Using Raspberry Pi”, International
Research Journal of Engineering and Technology (IRJET) in 2018.
[19] Megalingam R.K., Vadivel S.R.R., Yadav P.K., Nigam K., Geesala R.T., Chandra
R., “Implementation of Low-Cost Mobile Robot for Rescuing Challenge”, IRJET in
2019.
[21] Anjali Verma, Deepak Kumar, Hariom Maurya, Anuj Kumar, Mr. Prabhakant
Dwivedi, “Voice Control Robot Using Arduino, International Research Journal of
Modernization in Engineering Technology and Science, Vol 02 in 2020.
lx
[22] Abikshit Timsina, Dev Chandra Sharma, Nirmala Sharma, Allen Bhutia, Sujala
Pardhan, “Voice Command Robotics Car”, International Research Journal of
Modernization in Engineering Technology and Science, Volume:02 in 2020.
lxi