International Journal of Computer Trends and Technology (IJCTT) volume 4 Issue 7July 2013

ISSN: 2231-2803 http://www.ijcttjournal.org Page 2150

Drawing Using Hand Gestures
N.Kunal
#1
, Pattan Akram
#2
, Rishab kumar jain
#3
, A.Kranthi chandu
#4
, P.V.Karthick
#5

M.R.Narsinga Rao
*6
#
Department of Computer Science Engineering, K.L.University, Vaddeswaram, India

#1
St udent ,
#2
St udent ,
#3
St udent
#4
St udent
#5
St udent

*6
Pr of essor




Abstract:This paper deals with the latest technology called
the Gesture based design. Its a wearable interface that
augments the physical world around us with the digital
information. Its a concept at grass root level which
allows users to connect with the internet seamlessly.
Without the use of keyboard, mouse we can see video
access, change, move data simply . It performs the
corresponding commands accessing the operation of the
mobile device connected to it and the action is projected
using a projector over any surface. Its more possibly to
be implemented in future because of its cost constraints.it
has some constraints which can be resolved by extensive
research.
Keywords:
Projector, Camera, Computing device, Gestures.
I. INTRODUCTION
This is a wearable gestural interface that enhances the
physical world around us with digital information and lets
us use natural hand gestures to interact with that
information. It is based on the concepts of augmented
reality and has well implemented the perceptions of it. This
technology has integrated the real world objects with
digital world. The fabulous technology is a blend of many
exquisite technologies. The thing which makes it
magnificent is the marvelous integration of all those
technologies and presents it into a single portable and

economical product. It associates technologies like
hand gesture recognition image capturing, processing, and
manipulation, etc. It superimposes the digital world on the
real world This technology is a perception of augmented
reality concept. Like senses enable us to perceive
information about the environment in different ways it also
aims at perceiving information. This is in fact, about
comprehending information more than our available
senses. And today there is not just this physical world from
where we get information but also the digital world which
has become a part of our life. This digital world is now as
important to us as this physical world. And with the
internet the digital world can be expanded many times the
physical world. God hasnt given us sense to interact with
the digital world so we have created them like smart
phones, tablets, computers, laptops, net books, PDAs,
music players, and others gadgets. These gadgets enable us
to communicate with the digital world around us.
But were humans and our physical body isnt
meant for digital world so we cant interact directly to the
digital world. For instance we press keys to dial a number;
we type text to search it and so on. This means for an
individual to communicate with the digital world he/she
must learn it. We dont communicate directly and
efficiently to the digital world as we do with the real world.
The This technology is all about interacting to the digital
world in most efficient and direct way. Hence, it wouldnt
be wrong to conclude This technology as gateway between
digital and real world. Before this technology came there
were other methods like Speech recognition software,
International Journal of Computer Trends and Technology (IJCTT) volume 4 Issue 7July 2013
ISSN: 2231-2803 http://www.ijcttjournal.org Page 2151

touch recognition etc., which empowered us with direct
interfacing.
Humans take decisions after acquiring inputs from
the senses. But the information we collect arent enough to
result in the right decisions. But the information which
could help making a good decision is largely available on
internet. Although the information can be gathered by
connecting devices like computers and mobiles but they are
restricted to the screen and there is no direct interaction
between the tangible physical world and intangible digital
world. This This technology provides us with the freedom
of interacting with the digital world with hand gestures.
This technology has a wide application in the field
of artificial intelligence. This methodology can aid in
synthesis of bots that will be able to interact with humans.
Its a hi-tech device seamlessly
integrate Analog information with our everyday physical
world. The movements of the marked fingers are traced by
the camera in fraction of seconds and the output is
displayed on the projector. Its a portable device and eases
the operation which we regularly perform. Basically the
Gesture based design technology concept involves the use
of hand gestures .The finger tip will contain colored
markers and hence gestures performed will be captured by
the camera. Then its given to the computing device for the
corresponding action to be performed. The action is
projected on the surface through the projector. Software
algorithms and computer vision technologies will be used
to enable the action from the computing device for the
corresponding gesture captured in the camera [5]. This
gesture based technology can be used for a variety of
applications like performing basic actions, drawing with
the movement of fingers, selecting the colors, erasing the
canvas etc..The slight modification of this method lead to
the use of commands that is analog information into real
world. The analog data is converted into digital and
performed as action, as all times the hand gestures cannot
be used. This was how the wearable device is fitted to the
human body .Here color markers are used in the finger tips

Fig1: Representation Of Gesture Based Design
In our technology we use commands for performing the
same operations. Many gesture recognition methods and
algorithms are being formulated till now, we tried to use an
easy and open source [1].
To ensure accurate gesture recognition and an
intuitive interface a number of constraints are applied [2].
A region in the front of the projection screen is defined as
the active zone and the gestures are ignored, if the gestures
are performed out of this area. Gestures are also defined by
a set start posture, end posture and dynamic motion
between the start and end postures [4].Perhaps the use of
gestures is most powerful when combined with other input
modalities, especially voice. Allowing combined voice and
gestural input has several tangible advantages. The first is
purely practical-ease of expression .Ease corresponds to the
efficiency with which commands can be remembered and
expressiveness, size of command vocabulary.
II. IMPLEMENTATION:
The Gesture based device comprises of
A. Camera
B. projector
C. Computing device
D. Mirror
International Journal of Computer Trends and Technology (IJCTT) volume 4 Issue 7July 2013
ISSN: 2231-2803 http://www.ijcttjournal.org Page 2152


The Gesture based device is a mini projector
coupled with a Camera and a computing device. The
hardware components are coupled in a pendant like mobile
wearable device .Both the camera and the projector are
connected to the computing device. The projector, projects
the visual information enabling surfaces, walls and
physical objects around the user to be used as interfaces.
While the camera takes the commands which were trained
by the user and executes the corresponding action through
the projector, enabling the actions from the computing
device.
The above selected devices are the quite common
and can be found quite easily, taking the whole thing away
from complexity. The above devices have their own unique
tasks to perform. This is just the grass root of the project.
A. The camera:
This acts as the input device for our application. The
view front of the camera set the canvas for our drawing.
What ever moves the user makes while recording gets
captured and if the user selects to draw, the marker gets
activated and they can draw any form. The accuracy of the
drawings depends on the digital properties of the camera
and the distance between the camera, the marker and the
canvas. With the help of the camera, literally any surface
can become the canvas for the user.
B. The projector
This acts as the output device for the application. This
displays the output of what the user is doing. The camera
and projector should be arranged properly in order to make
a proper drawing canvas. The pocket projector is
recommended, else the conventional or the computer
screen can be used for experimental purpose.
.
C. Computing device:
It can be a mobile, laptop or a desktop. For mobility
purpose mobile or laptop is recommended, but they should
be Windows based devices. This consists of the application
which interprets the motion captured by the camera and
forwards the output to the projector. This acts as the heart
of the whole application.
D. The mirror:
This is optional if the user is using the pocket projector
hanging to his neck as the pendent. The basic purpose of
this is to diffract the projector rays perpendicular to the
canvas. The mirror is placed at an angle of 45 degrees.
The future application of this technology can bring a giant
leap in how we see at the all the electronic gedgets. The
conventional input and output devices can be replaced with
the natural human gestures. Not only that it can help the
handicap person who cannot get up from a wheelchair and
has to ring a doorbell at the door and suppose that door bell
has gesture recognition, then easily he/she can use their
hands to operate the bell [3].

Fig 2: Basic Design of Our Concept




International Journal of Computer Trends and Technology (IJCTT) volume 4 Issue 7July 2013
ISSN: 2231-2803 http://www.ijcttjournal.org Page 2153

III. CONCLUSION:
The Gesture based design technology using gesture
movement and speech integrated circuits are emerging
innovative ideas. We have a seamless access to data or
information that may exist to help us make decisions. This
provides access to relevant information about the things in
the environment and enables the new interactions between
the real world and the world of data. Although the
miniaturization of computing devices allows us to carry
computers in our pockets, there had been no link between
the digital devices we carry and our interactions with the
physical world, and our gestures at an efficient level.

The gesture based design is developed to
seamlessly integrate information into reality. The future
may depend upon this Gesture based design. May be within
this 2020, the proliferation and the use of this technology is
immense. Sufficient awareness of the Gesture based design
will lead to further development of any technology which
aids for getting information and performing any type of
action practically at any time, using simply the gestures
and commands given.
The advantage of this technology is portable, its
connectedness between the world and the information. Its
cost effectiveness and data can accessed from the machine
directly in real time. It can also be said as an open source
technology. Within twenty years this technology will bring
a drastic change in the field of science and will create a
revolutionary change among the mass.

REFERENCES:
[1] Alon,J .Athitsos,V.Quan,YuanSclaroff,S. Computer Science Dept.,
Boston Univ., Boston, MA, USA, A Unified Framework for Gesture
Recognition and Spatiotemporal Gesture Segmentation, IEEE
transactions on Pattern Analysis and Machine Intelligence, Volume:
31, Issue:9 pp 1685 - 1699 ., Sept. 2009

[2] Mu-Chun SuInst. of Computer Science & Inf. Eng., Nat. Central
Univ., Chung-Li A fuzzy rule-based approach to spatio-temporal hand
gesture recognition,Systems, Man, and Cybernetics, Part C:


Applications and Reviews, IEEE Transactions on Volume: 30,
Issue:2 pp276 281., May 2000

[3] Kirishima, T. Sato, K. Chihara, K.Dept. of Electr. Eng., Nara Nat.
Coll.

of Technol., J apan Robotics, Gesture Spotting and Recognition for
HumanRobot Interaction, IEEE Transactions on Volume: 23,
Issue:2 pp256 270., April 2007

[4] Real-time gesture recognition by learning and selective control of
visual interest points: Pattern Analysis and Machine Intelligence,
IEEE Transactions on, Volume: 27 , Issue:3, pp351 364., March 2005

[5] Ozer, I.B. Tiehan Lu Wolf, W. Princeton Univ., NJ , USA Design of a
real-time gesture recognition system: high performance through
algorithms and software Signal Processing, IEEE Volume: 22, Issue:3,
pp 57 64., May 2005

[6] http://boingboing.net/2009/11/12/sixthsense-technology.html

[7] http://theviewspaper.net/sixth-sense-technology-will-revolutionise-
theworld/