SEMINAR REPORT ON

VIRTUAL KEYBOAD Submitted By

HIMANSHU SEKHAR DASH
Regd. No- 1105298005

Under The Guidance Of

SATYA RANJAN MOHAPATRA
Department of MCA/ Computer Science and Engineering / Information Technology

GANDHI INSTITUTE FOR TECHNOLOGY

BIJU PATNAIK UNIVERSITY OF TECHNOLOGY ROURKELA, ORISSA

-:1:-

A 2nd Semester seminar. Bhubaneswar. Satya ranjan mohapatra GUIDE and Lecturer in CSE/IT/MCA Gandhi Institute for Technology Bhubaneswar Satya Ranjan Mohapatra H. who carried out the seminar work under my/our supervision in partial fulfillment of the requirement for the M.1105298005 of Gandhi Institute For Technology. No.CERTIFICATE This to certify that the seminar report entitled “SIXTH SENSE TECHNOLOGY” is submitted by HIMANSHU SEKHAR DASH of Master in Computer Application. bearing the Regd.O.D (CSE/IT/MCA) Gandhi Institute for Technology Bhubaneswar SIGNATURE OF SPOC GANDHI INSTITUTE FOR TECHNOLOGY BHUBANESWAR Department of MCA/ Computer Science and Engineering / Information Technology -:2:- .C.

I would also like to thank Prof. I feel pleasure to register our gratitude with deep feeling and sense of honor to my parents to encourage me to study in the field of Information Technology and my friends who help me to prepare this record. Department of MCA/ Computer Science and Engineering / Information Technology for his continued drive for better quality in everything that allowed me to carry out my project work. No. who continuously guided me for my seminar work and supported me at every endeavor.D. I would also like to thank Prof. 1105298005 -:3:- . H.O. HIMANSHU SEKHAR DASH Regd. Finally. SPOC of our seminar for his effort to manage the seminar class and drive it successfully. Satya Ranjan Mohapatra. I would like to register our special thanks to the staff & members of MCA/Computer Science and Engineering and Information Technology Department for their kind co-operation and at every state at directly or indirectly to bring out the work successfully.ACKNOWLEDGEMENT I wish to convey my hearty thanks to SATYA RANJAN MOHAPATRA. Priyabrata Nayak.

Sixth sense technology helps to bridge this gap between tangible and nontangible world. all the information stored on the web. The Sixth Sense prototype is used to implement several applications that have shown the usefulness. It can turn any surface into a touch-screen for computing.ABSTRACT Although miniaturized versions of computers help us to connect to the digital world even while we are travelling there aren’t any device as of now which gives a direct link between the digital world and our physical interaction with the real world. a PhD student in the Fluid Interfaces Group at the MIT Media Lab. It is not a technology which is aimed at changing human habits but causing computers and other machines to adapt to human needs.0 view of human and machine interactions. controlled by simple hand gestures. Sixth Sense device is a mini-projector coupled with a camera and a cell phone—which acts as the computer and your connection to the Cloud. -:4:- . The sixth sense technology has a Web 4. Sixth Sense integrates digital information into the physical world and its objects. Sixth Sense device is basically a wearable gestural interface that connects the physical world around us with digital information and lets us use natural hand gestures to interact with this information .The sixth sense technology was developed by Pranav Mistry. Usually the information’s are stored traditionally on a paper or a digital storage device. It also supports multi user and multi touch provisions. making the entire world your computer. viability and flexibility of the system. The current prototype costs around $350.

7.CONTENTS 1. 2. 5. 4. 6. 3. DEFINATION INTRODUCTION GESTURE RECOGNITION APPLICATION HOW IT WORK ADVANTAGES CONCLUSION -:5:- .

The Sixth Sense prototype is used to implement several applications that have shown the usefulness. It also supports multi user and multi touch provisions. viability and flexibility of the system -:6:- . controlled by simple hand gestures. Sixth Sense device is a mini-projector coupled with a camera and a cell phone-which acts as the computer and your connection to the Cloud. all the information stored on the web. The current prototype costs around $350. It can turn any surface into a touch-screen for computing.DEFINATION Sixth Sense Technology integrates digital information into the physical world and its objects. making the entire world your computer. It is not a technology which is aimed at changing human habits but causing computers and other machines to adapt to human needs.

colored marker and a camera. The camera. mirror and projector is connected wirelessly to a blue tooth smart phone device that can easily fit into the user's pocket.A software then processes the data that is collected by the capturing device and produces analysis. The Sixth Sense prototype is comprised of a pocket projector.INTRODUCTION 'Sixth Sense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information the hardware components are coupled in a pendant like mobile wearable device. a mirror.The software that is used in sixth sense device is open source type -:7:- .

-:8:- .

Gesture recognition technique basically focuses on the emotion recognition from the face and hand gesture recognition. Neural network approaches or statistical templates are the commonly used techniques used for the recognition purposes.GESTURE RECOGNITION It is a technology which is aimed at interpreting human gestures with the help of mathematical algorithms. In the early versions of gesture recognition process special type of hand gloves which provide information about hand position orientation and flux of the fingers. This technique have an high accuracy usually showing accuracy of more than 95%. Time dependent neural network will also be used for real time recognition of the gestures -:9:- . It can provide a much better alternative to text user interfaces and graphical user interface which requires the need of a keyboard or mouse to interact with the computer. Interfaces which solely depends on the gestures requires precise hand pose tracking. In the SixthSense devices colored bands are used for this purpose. Gender recognition technique enables humans to interact with computers in a more direct way without using any external interfacing devices. Once hand pose has been captured the gestures can be recognized using different technique's.

-:10:- .

APPLICATION The sixth sense technology finds a lot of application in the modern world. The sixth sense devices bridge the gap by bringing the digital world into the real world and in that process allowing the users toiu interact with the information without the help of any machine interfaces. The sixth sense technology allows the user to interact the information through hand gestures. This is a quiet efficient way compared to the text and graphic based user interface. According to the words of its developers the extend of use of this new device is only limited by the imagination of human beings The sixth sense recognizes the objects around us and displays the information relating to those objects in a real time environment. It has the potential to form the transparent user interface for accessing the information around us -:11:- . usefulness and flexibility of this new technology. Prototypes of the sixth sense device have demonstrated viability.

it may change the way we interact with -:12:- . walls and physical objects around us to be used as interfaces. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. a mirror and a camera.HOW IT WORK The Sixth Sense prototype is comprised of a pocket projector. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers at the tip of the user’s fingers using simple computer-vision techniques. However. processing. image capturing. which is captured by the camera. instead of requiring you to be in front of a big screen like Tom Cruise. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers at the tip of the user’s fingers using simple computer-vision techniques. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces. Sixth Sense can do its magic—and a lot more— everywhere. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. This process is done using some techniques of computer vision. with the microprojector overlaying the information on any surface. and manipulation. The technology is mainly based on hand gesture recognition. while the camera recognizes and tracks user's hand gestures and physical objects using computer-vision based techniques. The technology in itself is nothing more than the combination of some stunning technologies. The projector projects visual information enabling surfaces. this has the potential of becoming the ultimate "transparent" user interface for accessing information about everything around us. that is. in the simplest way possible. The maximum number of tracked fingers is only constrained by the number of unique fiducials. walls and physical objects around us to be used as interfaces. while the camera recognizes and tracks user’s hand gestures and physical objects using computervision based techniques. including the object itself or your hand. If they can get rid of the colored finger caps and it ever goes beyond the initial development phase. The key here is that Sixth Sense recognizes the objects around you. thus Sixth Sense also supports multi-touch and multi-user interaction. The hardware components are coupled in a pendant like mobile wearable device. The camera recognizes objects around you instantly. Then. The software of the technology uses the video stream. It also supports multi touch and multi user interaction. But as it is now. Clearly. displaying information automatically and letting you access it in any way you want. and also tracks the location of the tips of the fingers to recognize the gestures. you can access or manipulate the information using your fingers. etc.

-:13:- .the real world and truly give everyone complete awareness of the environment around us.

It can be easily carried around without any difficulty. Ø Data access directly from the machines in real time: With help of a sixth sense device the user can easily access data from any machine at real time speed. -:14:- .ADVANTAGES Ø Portable: One of the main advantages of the sixth sense devices is its small size and portability. Ø Cost effective: The cost incurred for the construction of the sixth sense proto type is quiet low. Ø Support multi touch and multi user interaction: Multi touch and multi user interaction is another added feature of the sixth sense devices. The sixth sense devices have not been made in large scale for commercial purpose. Sixth sense devices also incooperates multi user functionality. Multi sensing technique allows the user to interact with system with more than one than one finger at a time. All the devices are light in weight and the smart phone can easily fit into the user’s pocket. It was made from parts collected together from common devices. Once that happens it’s almost certain that the device will cost much lower than the current price. The prototype of the sixth sense is designed in a such a way that it gives more importance to the portability factor. The data access through recognition of hand gestures is much easier and user friendlier compared to the text user interface or graphical user interface which requires keyboard or mouse. And a typical sixth sense device cost up to $300. This is typically useful for large interaction scenarios such as interactive table tops and walls. The user doesn’t require any machine-human interface to access the data..

. We can project the information into any surface and can work and manage the data as per our convenience. requirement of a platform or a screen to analyze and interpret the data has become obsolete. This enables other developers to contribute to the development of the system -:15:- .Ø Mind map the idea anywhere: With the advent of the sixth sense device. Ø Open source software: The software that is used to interpret and analysis the data collected by the device is made open source.

allowing us to interact with this information via natural hand gestures. This prototype implements several applications that demonstrate the usefulness. displaying information automatically and letting us to access it in any way we need. viability and flexibility of the system. -:16:- .CONCLUSION Sixth Sense recognizes the objects around us. This became the ultimate “transparent” user interface for accessing information about everything around us.

Sign up to vote on this title
UsefulNot useful