1

Sinhgad Technical Education Society’s

SINGHAD INSTITUTE OF TECHNOLOGY
LONAVALA
TAL. MAVAL,
DIST: PUNE-410401

A
SEMINAR REPORT
ON
“SIXTH SENSE TECHNOLOGY”

SUBMITTED BY:
MUDIT AGARWAL
UNDER THE GUIDENCE OF
PROF. V.P.TONDE
DEPARTMENT OF INFORMATION TECHNOLOGY

SEMINAR
2

Approval Sheet
The seminar Entitled
SIXTH SENSE TECHNOLOGY

BY
Name Exam No.

Is hereby approved in partial fulfillment

For the third year in Information Technology (Term -1).

PROF. V.P.TONDE
GUIDE

Department Of Information Technology

Sinhgad Institute of Technology, Lonavala.
2010–2011.

CERTIFICATE
3

SIXTH SENSE TECHNOLOGY

This is to certify that the above mentioned

Seminar has been carried out by
Name Exam No.

Students of third year engineering (Term - 1)

2010-2011

Department of Information Technology

Sinhgad Institute of Technology, Lonavala.
2010–2011.

GUIDE H.O.D
PROF. V.P.TONDE PROF. K.J. KARANDE

PRINCIPAL
DR. S.S. INAMDAR
4

I would like to mention our sincere gratitude towards our principal Dr.S.S.INAMDAR
and H.O.D.Prof. K.J. KARANDE, IT- Department, for giving us opportunity to carry out my
seminar.
I would like to express our heart full gratitude towards my guide, Prof.V.P.TONDE for
his invaluable advice for the successful completion of this dissertation.
I also like to extend my sincere thanks to other staff of the IT - Department for their
invaluable help and support.
Finally I take this opportunity to mention my sincere thanks to one and all those who
helped us directly or indirectly for the completion of our seminar.

MUDIT AGARWAL
ROLL NO:- 34
T.E.I.T
5

Over millions of years to sense the world around us. When

encountered something, someone or some place, we use our five
natural senses to perceive information about it; that information
helps us make decisions and chose the right actions to take. But
arguably the most useful information that can help us make the
right decision is not naturally perceivable with our five senses,
namely the data, information and knowledge that mankind has
accumulated about everything and which is increasingly all
available online. Although the miniaturization of computing
devices allows us to carry computers in our pockets, keeping us
continually connected to the digital world, there is no link between
our digital devices and our interactions with the physical world.
Information is confined traditionally on paper or digitally on a
screen. SixthSense bridges this gap, bringing intangible, digital
information out into the tangible world, and allowing us to interact
with this information via natural hand gestures. ‘SixthSense’ frees
information from its confines by seamlessly integrating it with
reality, and thus making the entire world your computer.
6

Contents
1. SEMINAR APPROVAL SHEET
2. CERTIFICATE
3. ACKNOWLEDGEMENT
4. ABSTRACT

TITLE PAGE NO
1. Introduction to the Traditional systems 7
2. what is sixth sense technology? 8
3 . Sixth Sense Prototype 9
3.1. Projector
3.2. Camera
3.3. Coloured markers
4. Working 12
5. Applications 15
6. Cost and Availibility 16
7. Bibliography 17
7

Int roduction to the Traditional systems

• Information is traditionally confined to paper or digitally to a
screen.
• Even though computing devices allows us to carry computers in
our pockets, that connects to the digital world continuously,
BUT is no link between our digital devices and our interactions
with the physical world.

SIT,Lonavala
8

What is Sixth Sense?

SixthSense is a wearable gestural interface device developed by

Pranav Mistry, a PhD student in the Fluid Interfaces Group at the MIT
Media Lab. It is similar to Telepointer, a neckworn projector/camera
system developed by Media Lab student Steve Mann (which Mann
originally referred to as "Synthetic Synesthesia of the Sixth Sense

Sixth Sense Prototype

The SixthSense prototype is comprised of a pocket projector, a mirror

and a camera. The hardware components are coupled in a pendant like
mobile wearable device. Both the projector and the camera are
connected to the mobile computing device in the user’s pocket. The
projector projects visual information enabling surfaces, walls and
physical objects around us to be used as interfaces; while the camera
recognizes and tracks user's hand gestures and physical objects using
computer-vision based techniques. The software program processes
SIT,Lonavala
9

the video stream data captured by the camera and tracks the locations
of the colored markers (visual tracking fiducials) at the tip of the
user’s fingers using simple computer-vision techniques. The
movements and arrangements of these fiducials are interpreted into
gestures that act as interaction instructions for the projected
application interfaces. The maximum number of tracked fingers is
only constrained by the number of unique fiducials, thus SixthSense
also supports multi-touch and multi-user interaction.

The SixthSense prototype implements several applications that

demonstrate the usefulness, viability and flexibility of the system. The
map application lets the user navigate a map displayed on a nearby
surface using hand gestures, similar to gestures supported by Multi-
Touch based systems, letting the user zoom in, zoom out or pan using
intuitive hand movements. The drawing application lets the user draw
on any surface by tracking the fingertip movements of the user’s
index finger. SixthSense also recognizes user’s freehand gestures
(postures). For example, the SixthSense system implements a gestural
camera that takes photos of the scene the user is looking at by
detecting the ‘framing’ gesture. The user can stop by any surface or
wall and flick through the photos he/she has taken. SixthSense also
lets the user draw icons or symbols in the air using the movement of
the index finger and recognizes those symbols as interaction
instructions. For example, drawing a magnifying glass symbol takes
the user to the map application or drawing an ‘@’ symbol lets the user
check his mail. The SixthSense system also augments physical objects
the user is interacting with by projecting more information about
these objects projected on them. For example, a newspaper can show
live video news or dynamic information can be provided on a regular
piece of paper. The gesture of drawing a circle on the user’s wrist
projects an analog watch.

SIT,Lonavala
10

Another type of prototypes.

SIT,Lonavala
11

Working

SIT,Lonavala
12

The camera recognizes objects around you instantly, with the micro-
projector overlaying the information on any surface, including the
object itself or your hand. Then, you can access or manipulate the
information using your fingers. Need to make a call? Extend your
hand on front of the projector and numbers will appear for you to
click. Need to know the time? Draw a circle on your wrist and a
watch will appear. Want to take a photo? Just make a square with
your fingers, highlighting what you want to frame, and the system
will make the photo—which you can later organize with the others
using your own hands over the air.
while the camera recognizes and tracks user's hand gestures and
physical objects using computer-vision based techniques. The
software program processes the video stream data captured by the
camera and tracks the locations of the colored markers (visual
tracking fiducials) at the tip of the user’s fingers using simple
computer-vision techniques. The movements and arrangements of
these fiducials are interpreted into gestures that act as interaction
instructions for the projected application interfaces. The maximum
number of tracked fingers is only constrained by the number of
unique fiducials, thus SixthSense also supports multi-touch and multi-
user interaction.

Examples:
• Sixth Sense analyses what the user sees and visually augments
surfaces or physical objects the user is interacting with.

SIT,Lonavala
13

SIT,Lonavala
14

• The user interact with the projected information through natural

hand gestures, arm movements, or interaction with the object
itself.

• WUW projects information onto surfaces, walls, and physical

objects around us.

SIT,Lonavala
15

APPLICATIONS

The SixthSense prototype implements several applications that

demonstrate the usefulness, viability and flexibility of the system. The
map application lets the user navigate a map displayed on a nearby
surface using hand gestures, similar to gestures supported by Multi-
Touch based systems, letting the user zoom in, zoom out or pan using
intuitive hand movements. The drawing application lets the user draw
on any surface by tracking the fingertip movements of the user’s
index finger. SixthSense also recognizes user’s freehand gestures
(postures). For example, the SixthSense system implements a gestural
camera that takes photos of the scene the user is looking at by
detecting the ‘framing’ gesture. The user can stop by any surface or
wall and flick through the photos he/she has taken. SixthSense also
lets the user draw icons or symbols in the air using the movement of
the index finger and recognizes those symbols as interaction
instructions. For example, drawing a magnifying glass symbol takes
the user to the map application or drawing an ‘@’ symbol lets the user
check his mail. The SixthSense system also augments physical objects
the user is interacting with by projecting more information about
these objects projected on them. For example, a newspaper can show
live video news or dynamic information can be provided on a regular
piece of paper. The gesture of drawing a circle on the user’s wrist
projects an analog watch.

Cost And Availability

SIT,Lonavala
16

• The device can be made in current prototype system costs

approximately $350 to build.

• In Indian currency 17000Rs .

• Sixth Sense hardware and software at present works with

smartphones.

• The software’s source code will be available on an open-source

model. AS THE STATEMENT OF IT’S MAKER.

Bibliography

=> www. wikipedia.com

=> www.pranavmistry.com

SIT,Lonavala
17

=> www. msn search.com

=> www. Alta vista.com
=>www.gizmodo.com/5167790/sixth-sense-technology-may-
change-how-we-look-at-the-world-forever

SIT,Lonavala