I.

INTRODUCTION
Sixth Sense Technology is a mini-projector coupled with a camera and a cell phone which acts as the computer and connected to the Cloud, all the information stored on the web. Sixth Sense can also obey hand gestures. The camera recognizes objects around a person instantly, with the micro-projector overlaying the information on any surface, including the object itself or hand. Also can access or manipulate the information using fingers. Make a call by Extend hand on front of the projector and numbers will appear for to click. Know the time by Draw a circle on wrist and a watch will appear. take a photo by Just make a square with fingers, highlighting what want to frame, and the system will make the photo which can later organize with the others using own hands over the air and The device has a huge number of applications , it is portable and easily to carry as can wear it in neck. The drawing application lets user draw on any surface by observing the movement of index finger. Mapping can also be done anywhere with the features of zooming in or zooming out. The camera also helps user to take pictures of the scene is viewing and later can arrange them on any surface. Some of the more practical uses are reading a newspaper. reading a newspaper and viewing videos instead of the photos in the paper. Or live sports updates while reading the newspaper. The device can also tell arrival, departure or delay time of air plane on tickets. For book lovers it is nothing less than a blessing. Open any book and find the Amazon ratings of the book. To add to it, pick any page and the device gives additional information on the text, comments and lot more add on feature.

II. HISTORY
SixthSense is a wearable gestural interface device developed by Pranav Mistry, a PhD student in the Fluid Interfaces Group at the MIT Media Lab. It is similar to Telepointer, a neckworn projector/camera system developed by Media Lab student Steve Mann (which Mann originally referred to as "Synthetic Synesthesia of the Sixth Sense").

FIG 2.1 EQUIPMENT

2.1 HOW THE IDEA AROSE? We grew up interacting with the physical objects around us. There are an enormous number of them that we use every day. Unlike most of our computing devices, these objects are much more fun to use. When you talk about objects, one other thing automatically comes attached to that thing, and that is gestures: how we manipulate these objects, how we use these objects in everyday life. We use gestures not only to interact with these objects, but we also use them to interact with each other. A gesture of "Namaste!", maybe, to respect someone, or maybe -- in India I don't need to teach a kid that this means "four runs" in cricket. It comes as a part of our everyday learning. So, It is very interested, from the beginning, that how -- How our knowledge about everyday objects and gestures, and how we use these objects, can be leveraged to our interactions with the 2

digital world. Rather than using a keyboard and mouse, why can we not use our computer in the same way that we interact in the physical world? So, he started this exploration about eight years back, and it literally started with a mouse on his desk. Rather than using it for his computer, he actually opened it. Most of you might be aware that, in those days, the mouse used to come with a ball inside, and there were two rollers that actually guide the computer where the ball is moving, and, accordingly, where the mouse is moving. So, he was interested in these two rollers, and he actually wanted more, so he borrowed another mouse from a friend -- never returned to him -- and he now had four rollers. Interestingly, what he did with these rollers is, basically, he took them off of these mouses and then put them in one line. It had some strings and pulleys and some springs. What he got is basically a gesture interface device that actually acts as a motion-sensing device made for two dollars. So, here, whatever movement he do in his physical world is actually replicated inside the digital world just using this small device that he made, around eight years back, in 2000.

FIG 2.2 CONTROL WITH HANDS

2.2. STICKY NOTES: Because he was interested in integrating these two worlds, he thought of sticky notes. he thought, "Why can he not connect the normal interface of a physical sticky note to the digital world?" A message written on a sticky note to his mom on paper can come to an SMS, or maybe a meeting reminder automatically syncs with his digital calendar -- a to-do list that automatically syncs with you. But you can also search in the digital world, or maybe you can write a query, saying, "What is Dr. Smith's address?" and this small system actually prints it out -- so it actually acts like a paper input-output system, just made out of paper.

FIG 2.3 STICKY NOTES

2.3. PEN THAT CAN DRAW IN 3 DIMENSIONS: In another exploration, he thought of making a pen that can draw in three dimensions. So, he implemented this pen that can help designers and architects not only think in three dimensions, but they can actually draw so that it's more intuitive to use that way. Then he thought, "Why not make a Google Map, but in the physical world?" Rather than typing a keyword to find something, he put his objects on top of it. If he put a boarding pass, it will show me where the flight gate is. A coffee cup will show where you can find more coffee, or where you can trash the cup.

FIG 2.4 3D PENS

III. WORKING & APPLICATIONS So, these were some of the earlier explorations he did because the goal was to connect these two worlds seamlessly. Among all these experiments, there was one thing in common: he was trying to bring a part of the physical world to the digital world. he was taking some part of the objects, or any of the intuitiveness of real life, and bringing them to the digital world, because the goal was to make our computing interfaces more intuitive. But then he realized that we humans are not actually interested in computing. What we are interested in is information. We want to know about things. We want to know about dynamic things going around.

FIG 3.1 IMAGINARY CONTROLS

So he thought, around last year -- in the beginning of the last year -- he started thinking, "Why can I not take this approach in the reverse way?" Maybe, "How about I take his digital world and paint the physical world with that digital information?" Because pixels are actually, right now, confined in these rectangular devices that fit in our pockets. Why can I not remove this confine and take that to his everyday objects, everyday life so that I don't need to learn the new language for interacting with those pixels?

FIG 3.2 COLOUR CAPS

So, in order to realize this dream, he actually thought of putting a big-size projector on his head. he think that's why this is called a head-mounted projector, isn't it? he took it very literally, and took his bike helmet, put a little cut over there so that the projector actually fits nicely. So now, what he can do -- he can augment the world around me with this digital information. But later, he realized that he wanted to interact with those digital pixels, also. So he put a small camera over there that acts as a digital eye. Later, we moved to a much better, consumer-oriented pendant version of that that many of you now know as the Sixth Sense device. But the most interesting thing about this particular technology is that you can carry your digital world with you wherever you go. You can start using any surface, any wall around you, as an interface. The camera is actually tracking all your gestures. Whatever you're doing with your hands, it understands that gesture. And, actually, if you see, there are some color markers that in the beginning version we are using with it. You can start painting on any wall. You stop by a wall, and start painting on that wall. But we are not only tracking one finger, here. We are giving you the freedom of using all of both of your hands, so you can actually use both of your hands to zoom into or zoom out of a map just by pinching all present. The camera is actually doing -- just, getting all the images -- is doing the edge recognition and also the color recognition and so many other small algorithms are going on inside. So, technically, it's a little bit complex, but it gives you an output which is more intuitive to use, in some sense. But he got more excited that you can actually take it outside. Rather than getting your camera out of your pocket, you can just do the gesture of taking a photo and it takes a photo for you.

And later he can find a wall, anywhere, and start browsing those photos or maybe, "OK, he want to modify this photo a little bit and send it as an email to a friend." So, we are looking for an era where computing will actually merge with the physical world. And, of course, if you don't have any surface, you can start using your palm for simple operations. Here, he dials a phone number just using his hand. The camera is actually not only understanding your hand movements, but, interestingly, is also able to understand what objects you are holding in your hand.

FIG 3.3 SHEET AS A GOOGLE HOMEPAGE

What we're doing here is actually -- for example, in this case, the book cover is matched with so many thousands, or maybe millions of books online, and checking out which book it is. Once it has that information, it finds out more reviews about that, or maybe New York Times has a sound overview on that, so you can actually hear, on a physical book, a review as sound. ("Famous talk at Harvard University ...")

FIG 3.4 LIVE IN NEWS PAPER

This was Obama's visit last week to MIT. ("... and particularly he wants to thank two outstanding MIT ...") So, he was seeing the live [video] of his talk, outside, on just a newspaper. Your newspaper will show you live weather information rather than having it updated -- like, you have to check your computer in order to do that, right? 7

When he is going back, he can just use his boarding pass to check how much his flight has been delayed, because at that particular time, hes not feeling like opening his iPhone, and checking out a particular icon. And he thinks this technology will not only change the way -- Yes. It will change the way we interact with people, also, not only the physical world. The fun part is, hes going to the Boston metro, and playing a pong game inside the train on the ground, right? And he thinks the imagination is the only limit of what you can think of when this kind of technology merges with real life.

FIG 3.5 BOARDING PASS

But many of you argue, actually, that all of our work is not only about physical objects. We actually do lots of accounting and paper editing and all those kinds of things; what about that? And many of you are excited about the next generation tablet computers to come out in the market. So, rather than waiting for that, he actually made his own, just using a piece of paper. So, what he did here is remove the camera -- All the webcam cameras have a microphone inside the camera. He removed the microphone from that, and then just pinched that -- like he just made a clip out of the microphone -- and clipped that to a piece of paper, any paper that you found around. So now the sound of the touch is getting me when exactly hes touching the paper. But the camera is actually tracking where his fingers are moving. You can of course watch movies. ("Good afternoon. His name is Russell ...") ("... and he was a Wilderness Explorer in Tribe 54.") And you can of course play games. (Car engine) Here, the camera actually understands how you're holding the paper and playing a car-racing game.

FIG 3.6 GAMES ON SHEET

Many of you already must have thought, OK, you can browse. Yeah. Of course you can browse to any websites or you can do all sorts of computing on a piece of paper wherever you need it. So, more interestingly, hes interested in how we can take that in a more dynamic way. When he comes back to his desk he can just pinch that information back to his desktop so he can use his full-size computer. And why only computers? We can just play with papers. Paper world is interesting to play with. Here, hes taking a part of a document and putting over here a second part from a second place -and hes actually modifying the information that he have over there. Yeah. And he says, "OK, this looks nice, let me print it out, that thing." So he now have a print-out of that thing, and now -- The workflow is more intuitive the way we used to do it maybe 20 years back, rather than now switching between these two worlds. So, as a last thought, he think that integrating information to everyday objects will not only help us to get rid of the digital divide, the gap between these two worlds, but will also help us, in some way, to stay human, to be more connected to our physical world. And it will help us, actually, not be machines sitting in front of other machines. That's all.

FIG 3.7 APPLCATIONS IN DAILYLIFE

IV. CONCLUSION This super cool idea, the simplicity and omnipresence of gestures is such a great idea to incorporate into the modern technology. All eight years of effort has resulted into a benchmark stepping into next generation of man and machine interaction. The ease of use will be so helpful for those who arent tech savvy. Also, this gives us freedom from periphery hardware.

10

V. REFERENCES 1. "Telepointer: Hands-Free Completely Self Contained Wearable Visual Augmented Reality without Headwear and without any Infrastructural Reliance", IEEE International Symposium on Wearable Computing (ISWC00), pp. 177, 2000, Los Alamitos, CA, USA 2. "Cyborg: Digital Destiny and Human Possibility in the Age of the Wearable Computer", Steve Mann with Hal Niedzviecki, ISBN 0385658257 (Hardcover), Random House Inc, 304 pages, 2001. 3. Intelligent Image Processing, John Wiley and Sons, 384pp, 02001NOV02, ISBN 0-47140637-6 4. sixthsense. Pranav Mistry. 5. CNet News: MIT's 6th Sense device could trump Apple's multitouch 6. New York Times - At TED, Virtual Worlds Collide With Reality 7. http://www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsense_technolo gy.html TED Talks - Pranav Mistry: The thrilling potential of SixthSense technology

11