Professional Documents
Culture Documents
Prepared by
PRAMIT P. BADGE (1621002)
HARSHAL S. PATIL (1421041)
ANAND S. IGHAVE (1421019)
UJJWAL THORAT (1521054)
Guide
U.M. THORKAR
(Assistant Professor in Instrumentation)
i
GOVERNMENT COLLEGE OF ENGINEERING, JALGAON 425002
An Autonomous Institute of Maharashtra, NAAC Accredited
Department Of Instrumentation Engineering
( NBA Accredited )
CERTIFICATE
ii
DECLARATION
Place: Jalgaon
Date:
PRAMIT P.BADGE (1621002)
HARSHAL S. PATIL (1421041)
ANAND S. IGHAVE (1421019)
UJJWAL THORAT (1521054)
iii
ACKNOWLEDGMENT
We would like to thank our seminar and project Guide Asst.Prof. U.M. THORKAR SIR,
Assistant Professor in INSTRUMENTATION ENGINEERING DEPT., GOVERNMENT
COLLEGE OF ENGINEERING for their continuous support and valuable suggestions
throughout this work carried out by us.
iv
ABSTRACT
A humanoid robot is a robot with its body shape built to resemble the human body. The
design may be for functional purposes, such as interacting with human tools and environments,
for experimental purposes, such as the study of bipedal locomotion, or for other purposes. In
general, humanoid robots have a torso, a head, two arms, and two legs, though some forms of
humanoid robots may model only part of the body, for example, from the waist up. Some
humanoid robots also have heads designed to replicate human facial features such as eyes and
mouths. Androids are humanoid robots built to aesthetically resemble humans.
Besides the research, humanoid robots are being developed to perform human tasks like
personal assistance, through which they should be able to assist the sick and elderly, and dirty or
dangerous jobs. Humanoids are also suitable for some procedurally-based vocations, such as
reception-desk administrators and automotive manufacturing line workers. In essence, since they
can use tools and operate equipment and vehicles designed for the human form, humanoids could
theoretically perform any task a human being can, so long as they have the proper software.
However, the complexity of doing so is immense.Humanoid robots are currently widely studied
because of the many future applications they could be used for. Many researchers are working on
the locomotion aspects. We are more interested in dual-arm manipulation tasks, because of our
long experience on this topic. In this paper, we consider the task consisting in assembling two
objects, each of them being held by one of the humanoid arms, as human beings often do. In this
framework, we briefly recall methods that we have developed in the past for (i) hybrid position/
force control of a two-arm robot and (ii) relative positioning of the end-effectors of two
manipulators.
v
TABLE OF CONTENT
CERTIFICATE 2
DECLARATION 3
ABSTRACT 4
1 INTRODUCTION 7
2 LITERATURE SURVEY 8
2.1 MORPHOLOGY 9
3 PROBLEM STATEMENT 11
4 BASIC THEORY 12
5 DISCUCTION. 20
REFERENCES 21
vi
CHAPTER 1
INTRODUCTION
Humanoid robots are now used as research tools in several scientific areas.
Researchers study the human body structure and behavior (biomechanics) to build
humanoid robots. On the other side, the attempt to simulate the human body leads to a
better understanding of it. Human cognition is a field of study which is focused on how
humans learn from sensory information in order to acquire perceptual and motor skills.
This knowledge is used to develop computational models of human behavior and it has
been improving over time.
It has been suggested that very advanced robotics will facilitate the
enhancement of ordinary humans. See transhumanism.Although the initial aim of
humanoid research was to build better orthosis and prosthesis for human beings,
knowledge has been transferred between both disciplines. A few examples are powered leg
prosthesis for neuromuscularly impaired, ankle-foot orthosis, biological realistic leg
prosthesis and forearm prosthesis.Besides the research, humanoid robots are being
developed to perform human tasks like personal assistance, through which they should be
able to assist the sick and elderly, and dirty or dangerous jobs. Humanoids are also suitable
for some procedurally-based vocations, such as reception-desk administrators and
automotive manufacturing line workers. In essence, since they can use tools and operate
equipment and vehicles designed for the human form, humanoids could theoretically
perform any task a human being can, so long as they have the proper software. However,
the complexity of doing so is immense.
vii
MOTIVATION:
THEME:
Humanoid robots are now used as research tools in several scientific areas. Researchers
study the human body structure and behavior (biomechanics) to build humanoid robots. On the
other side, the attempt to simulate the human body leads to a better understanding of it. Human
cognition is a field of study which is focused on how humans learn from sensory information in
order to acquire perceptual and motor skills. This knowledge is used to develop computational
models of human behavior and it has been improving over time. It has been suggested that very
advanced robotics will facilitate the enhancement of ordinary humans. See transhumanism.
Although the initial aim of humanoid research was to build better orthosis and prosthesis for
human beings, knowledge has been transferred between both disciplines. A few examples are
powered leg prosthesis for neuromuscularly impaired, ankle-foot orthosis, biological realistic leg
prosthesis and forearm prosthesis. Besides the research, humanoid robots are being developed to
perform human tasks like personal assistance, through which they should be able to assist the
sick and elderly, and dirty or dangerous jobs. Humanoids are also suitable for some procedurally-
based vocations, such as reception-desk administrators and automotive manufacturing line
workers. In essence, since they can use tools and operate equipment and vehicles designed for
the human form, humanoids could theoretically perform any task a human being can, so long as
viii
they have the proper software. However, the complexity of doing so is immense. They are also
becoming increasingly popular as entertainers. For example, Ursula, a female robot, sings, plays
music, dances and speaks to her audiences at Universal Studios. Several Disney theme park
shows utilize animatronic robots that look, move and speak much like human beings. Although
these robots look realistic, they have no cognition or physical autonomy. Various humanoid
robots and their possible applications in daily life are featured in an independent documentary
film called Plug & Pray, which was released in 2010.
ORGANISATION OF REPORT:
Chapter 1-
In this chapter basically we are discussing the introduction of our project. And also we
are including the motivation and the theme related to our project.
Chapter 2-
The literature survey is given in this chapter (previously done researches related to the
project).
Chapter 3-
The problem statement and the work schedule distributed among the group members is
given in this chapter.
Chapter 4-
The Basic Theory related to our project and the detail characteristics of components
which we are using in our project is given in this chapter.
Chapter 5-
ix
CHAPTER 2
LITERATURE SURVEY
x
DISCUSSION OF ABSTRACTS—This paper investigates the implementation of
the voice Google assistant on a Raspberry Pi microcomputer. First, the Voice Kit of Google is
presented. This device can be attached to a Raspberry Pi and a voice Google assistant is
obtained. The necessary steps to implement the voice Google assistant on a system that contains
among the Raspberry Pi only a microphone and a speaker, instead of the Voice Kit, are presented.
In this way a voice Google assistant can be made more easily and flexible. This newly created
device has several working modes that are analyzed. Finally, a speech recognition system that
works in Romanian language is presented and evaluated.
Ass. Prof. Emad S. Othman, Senior Member IEEE - Region 8, High Institute for
Computers and Information Systems, AL-Shorouk Academy, Cairo – Egypt, PH-
0020-010-25830256.
xi
2.4 STUDY OF MORPHOLOGY
The role of the morphology appears as a fascinating open field. Exploring the interaction
between body properties and cognition could lead to both a better understanding of animals
behaviour (human being in particular) and to build robot more adapted and robust to an open
environment with unpredictable interaction. In particular we can highlight the acquisition of
sensorimotor task and the exploration of adapted bodies for natural physical and social
interaction with humans.In this context, we should not only take care of the robot body design
but both introduce the morphology as an experimental variable and conduct experiments in the
real world, indeed the best model of the world is the world itself .
However such experiments raised two major issues researchers tried to avoid for years by using
simulation. First, having a robot moving in the real world leads to problems linked to the
platform robustness against mistake. An efficient experimental platform should not break itself
while acting in the real world and at least, it should be easy to repair it in case of problem.
xii
CHAPTER 3
PROBLEM STATEMENT
Controllers 02
xiii
• Affordable: To make Poppy widely accessible, we keep the cost relatively low.
Price components for 7500-8000.
Problem Statement
xiv
CHAPTER 4
BASIC THEORY
xv
Ethernet is being used to provide internet connection to the voice command
system. Since the system relies on online text to speech conversion, online query processing and
online speech to text conversion hence we need a constant connection to achieve all this.
Monitor provides the developer an additional way to look at the code and make
any edits if any. It is not required for any sort of communication with the end user.
Speakers, once the query put forward by the user has been processed, the text
output of that query is converted to speech using the online text to speech converter. Now this
speech which is the audio output is sent to the user using the speakers which are running on
audio out.
"
First, when the user starts the system, he uses a microphone to send in the input.
Basically, what it does is that it takes sound input from the user and it is fed to the computer to
process it further. Then, that sound input if fed to the speech to text converter, which converts
audio input to text output which is recognizable by the computer and can also be processed by it.
Then that text is parsed and searched for keywords. Our voice command system is
built around the system of keywords where it searches the text for key words to match. And once
key words are matched then it gives the relevant output.
xvi
This output is in the form of text. This is then converted to speech output using a
text to speech converter which involves using an optical character recognition system. OCR
categorizes and identifies the text and then the text to speech engine converts it to the audio
output. This output is transmitted via the speakers which are connected to the audio jack of the
raspberry pi as shown in Figure 2.
"
xvii
• Text To Speech Engine
• (AVS) is a Text-To-Speech (TTS) engine is used to create a spoken sound version
of the text in a computer document, such as a help file or a Web page. TTS can
enable the reading of computer display information for the visually challenged
person, or may simply be used to augment the reading of a text message. To use
(AVS) engine, an application has to be created in the Amazon developers console
and the generated API key has to be used to access the speech engine. It requires
continuous internet connection as data is sent over the Amazon servers.
• Query Processor
• The Voice Command System has a module for query processing which works in
general like many query processors do. That means, taking the input from the
users, searching for relevant outputs and then presenting the user with the
appropriate output. In this system we are using the site wolfram alpha as the
source for implementing query processing in the system. The queries that can be
passed to this module include retrieving information about famous personalities,
simple mathematical calculations, description of any general object etc
• Wikipedia
• This module works on the keyword of “wiki”. The system asks for what you
would like to learn about. Then the request is made to the Wikipedia API for the
required query. It generates the summary of the information regarding the query
and the data is output through the microphone to the listener in audio form. In
case of failure, the error message is generated saying “unable to reach dictionary
of wiki”.
• News
• News module can be executed by using the keyword “news”. The headlines of top
articles are retrieved from the internet using Google news. The system tells the
xviii
user all these headlines and asks the user if any of these articles should be sent to
the user’s email address. If the user specifies the number of the article to be sent,
the article is sent to the specified email address. Otherwise, no further action is
taken. If any failure occurs in retrieving headlines or sending articles, a
corresponding error message is generated.
2. EQUIPMENT/COMPONENT LIST
xix
Technical Specification:
▪ RASPBERRYPI-MODB-1GB RPI-MODB-16GB-RASBIAN
▪ DSI display port for connecting the Raspberry Pi touch screen display
▪ Micro SD port for loading your operating system and storing data
▪ Expected to have the same form factor has the Pi 2 Model B, however the
LEDs will change position
xx
Features:
• USB interface
• Comes Pre-loaded Arduino Uno bootloader
• Software exports servo sequences to Arduino Uno for running servo
sequences
• 50 Hz update rate
• Small size of 80 X 47 mm
• Servo sequencer with speed, delay, goto and many other features
xxi
4.2.3 TOWER PRO MG995 SERVO MOTORS
FEATURES :
3. High resolution
4. Accurate positioning
SPECIFICATIONS
1. Model: MG995
2. Weight: 55 gm
4. Servo Plug: JR
xxii
4.2.4 TOWER PRO MG90
SPECIFICATIONS
• Modulation: Analog
• Torque: 4.8V: 30.60 oz-in (2.20 kg-cm)
xxiii
• Gear Type: Metal
• Pulse Cycle: 20 ms
• Pulse Width: 400-2400 µs
• Rotation : 0°-180°
xxiv
3. TOOLS USED
RASPBIAN
ARDUINO IDE
xxv
CHAPTER 5
DISCUSSION
• Starting from scratch, all the details, software and hardware are presented. Google
assistant is available on smartphones, but using it on Raspberry Pi has the advantage that
this microcomputer can be interfaced with other hardware devices. We presented a
simple example that turns on/off some LEDS by voice commands. However, this
application can be extended to any smart home or assistive devices for impaired
individuals.
Most importantly, this application can work in practice in any language, however, only
one at a time.
• In terms of future work, we would like to implement an application that will use the voice
command to interact with a DC motor that can be integrated in a smart home device.
• Also we want to conduct a speech recognizer experiment that does not require internet
access. In addition, we would like to incorporate a text to speech function on Raspberry
Pi that uses Romanian as its default language.
xxvi
REFERENCES
[1] Poppy: Open Source 3D Printed Robot for Experiments in Developmental Robotics.
Matthieu Lapeyre, Pierre Rouanet, Jonathan Grizou, Steve N’Guyen, Alexandre Le
Falher, Fabien Depraetre, Pierre-Yves Oudeyer Flowers Laboratory, Inria / ENSTA-
Paristech
Bordeaux, France
Email: matthieu.lapeyre@inria.fr
[2] Implementation of Google Assistant on Rasberry Pi
Septimiu Mischie Faculty of Electronics, Telecommunications and Information
Technologies Politehnica University of Timisoara Timisoara, Romania
septimiu.mischie@upt.ro Liliana Mâțiu-Iovan Faculty of Electronics,
Telecommunications and Information Technologies Politehnica University of Timisoara
Timisoara, Romania liliana.matiu-iovan@upt.ro Gabriel Gășpăresc Faculty of
Electronics, Telecommunications and Information Technologies Politehnica University
of Timisoara Timisoara, Romania gabriel.gasparesc@upt.ro
Ass. Prof. Emad S. Othman, Senior Member IEEE - Region 8, High Institute for Computers
and Information Systems, AL-Shorouk Academy, Cairo – Egypt, PH- 0020-010-25830256. E-
mail: emad91@hotmail.com IJSER © 2017 http://www.ijser.org
xxvii