SEMINAR REPORT ON

VIRTUAL KEYBOAD Submitted By

HIMANSHU SEKHAR DASH
Regd. No- 1105298005

Under The Guidance Of

SATYA RANJAN MOHAPATRA
Department of MCA/ Computer Science and Engineering / Information Technology

GANDHI INSTITUTE FOR TECHNOLOGY

BIJU PATNAIK UNIVERSITY OF TECHNOLOGY ROURKELA, ORISSA

-:1:-

Bhubaneswar. No.C. Satya ranjan mohapatra GUIDE and Lecturer in CSE/IT/MCA Gandhi Institute for Technology Bhubaneswar Satya Ranjan Mohapatra H. who carried out the seminar work under my/our supervision in partial fulfillment of the requirement for the M.D (CSE/IT/MCA) Gandhi Institute for Technology Bhubaneswar SIGNATURE OF SPOC GANDHI INSTITUTE FOR TECHNOLOGY BHUBANESWAR Department of MCA/ Computer Science and Engineering / Information Technology -:2:- .1105298005 of Gandhi Institute For Technology.O.A 2nd Semester seminar. bearing the Regd.CERTIFICATE This to certify that the seminar report entitled “SIXTH SENSE TECHNOLOGY” is submitted by HIMANSHU SEKHAR DASH of Master in Computer Application.

H. HIMANSHU SEKHAR DASH Regd.ACKNOWLEDGEMENT I wish to convey my hearty thanks to SATYA RANJAN MOHAPATRA.O. Priyabrata Nayak. I would also like to thank Prof. Finally. 1105298005 -:3:- . who continuously guided me for my seminar work and supported me at every endeavor. No. I would also like to thank Prof. Satya Ranjan Mohapatra.D. I feel pleasure to register our gratitude with deep feeling and sense of honor to my parents to encourage me to study in the field of Information Technology and my friends who help me to prepare this record. Department of MCA/ Computer Science and Engineering / Information Technology for his continued drive for better quality in everything that allowed me to carry out my project work. SPOC of our seminar for his effort to manage the seminar class and drive it successfully. I would like to register our special thanks to the staff & members of MCA/Computer Science and Engineering and Information Technology Department for their kind co-operation and at every state at directly or indirectly to bring out the work successfully.

The Sixth Sense prototype is used to implement several applications that have shown the usefulness. Sixth Sense device is basically a wearable gestural interface that connects the physical world around us with digital information and lets us use natural hand gestures to interact with this information . controlled by simple hand gestures.ABSTRACT Although miniaturized versions of computers help us to connect to the digital world even while we are travelling there aren’t any device as of now which gives a direct link between the digital world and our physical interaction with the real world. It also supports multi user and multi touch provisions. -:4:- . Usually the information’s are stored traditionally on a paper or a digital storage device. viability and flexibility of the system. making the entire world your computer. Sixth sense technology helps to bridge this gap between tangible and nontangible world. Sixth Sense integrates digital information into the physical world and its objects. The sixth sense technology has a Web 4. a PhD student in the Fluid Interfaces Group at the MIT Media Lab. It can turn any surface into a touch-screen for computing.0 view of human and machine interactions. It is not a technology which is aimed at changing human habits but causing computers and other machines to adapt to human needs. all the information stored on the web. Sixth Sense device is a mini-projector coupled with a camera and a cell phone—which acts as the computer and your connection to the Cloud. The current prototype costs around $350.The sixth sense technology was developed by Pranav Mistry.

6. 4. 7. 5. DEFINATION INTRODUCTION GESTURE RECOGNITION APPLICATION HOW IT WORK ADVANTAGES CONCLUSION -:5:- . 3.CONTENTS 1. 2.

DEFINATION Sixth Sense Technology integrates digital information into the physical world and its objects. viability and flexibility of the system -:6:- . making the entire world your computer. It also supports multi user and multi touch provisions. The current prototype costs around $350. all the information stored on the web. controlled by simple hand gestures. Sixth Sense device is a mini-projector coupled with a camera and a cell phone-which acts as the computer and your connection to the Cloud. It is not a technology which is aimed at changing human habits but causing computers and other machines to adapt to human needs. The Sixth Sense prototype is used to implement several applications that have shown the usefulness. It can turn any surface into a touch-screen for computing.

INTRODUCTION 'Sixth Sense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information the hardware components are coupled in a pendant like mobile wearable device. The camera.A software then processes the data that is collected by the capturing device and produces analysis. The Sixth Sense prototype is comprised of a pocket projector. mirror and projector is connected wirelessly to a blue tooth smart phone device that can easily fit into the user's pocket.The software that is used in sixth sense device is open source type -:7:- .colored marker and a camera. a mirror.

-:8:- .

GESTURE RECOGNITION It is a technology which is aimed at interpreting human gestures with the help of mathematical algorithms. Gesture recognition technique basically focuses on the emotion recognition from the face and hand gesture recognition. Gender recognition technique enables humans to interact with computers in a more direct way without using any external interfacing devices. Once hand pose has been captured the gestures can be recognized using different technique's. Time dependent neural network will also be used for real time recognition of the gestures -:9:- . It can provide a much better alternative to text user interfaces and graphical user interface which requires the need of a keyboard or mouse to interact with the computer. This technique have an high accuracy usually showing accuracy of more than 95%. In the early versions of gesture recognition process special type of hand gloves which provide information about hand position orientation and flux of the fingers. Neural network approaches or statistical templates are the commonly used techniques used for the recognition purposes. In the SixthSense devices colored bands are used for this purpose. Interfaces which solely depends on the gestures requires precise hand pose tracking.

-:10:- .

The sixth sense technology allows the user to interact the information through hand gestures. The sixth sense devices bridge the gap by bringing the digital world into the real world and in that process allowing the users toiu interact with the information without the help of any machine interfaces. It has the potential to form the transparent user interface for accessing the information around us -:11:- . This is a quiet efficient way compared to the text and graphic based user interface. usefulness and flexibility of this new technology.APPLICATION The sixth sense technology finds a lot of application in the modern world. Prototypes of the sixth sense device have demonstrated viability. According to the words of its developers the extend of use of this new device is only limited by the imagination of human beings The sixth sense recognizes the objects around us and displays the information relating to those objects in a real time environment.

The technology in itself is nothing more than the combination of some stunning technologies. processing. including the object itself or your hand. image capturing. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. with the microprojector overlaying the information on any surface. in the simplest way possible.HOW IT WORK The Sixth Sense prototype is comprised of a pocket projector. It also supports multi touch and multi user interaction. and manipulation. Sixth Sense can do its magic—and a lot more— everywhere. etc. this has the potential of becoming the ultimate "transparent" user interface for accessing information about everything around us. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers at the tip of the user’s fingers using simple computer-vision techniques. The projector projects visual information enabling surfaces. walls and physical objects around us to be used as interfaces. The projector projects visual information enabling surfaces. instead of requiring you to be in front of a big screen like Tom Cruise. a mirror and a camera. The software of the technology uses the video stream. Clearly. The camera recognizes objects around you instantly. you can access or manipulate the information using your fingers. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. that is. it may change the way we interact with -:12:- . The technology is mainly based on hand gesture recognition. However. Then. which is captured by the camera. displaying information automatically and letting you access it in any way you want. while the camera recognizes and tracks user’s hand gestures and physical objects using computervision based techniques. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers at the tip of the user’s fingers using simple computer-vision techniques. and also tracks the location of the tips of the fingers to recognize the gestures. But as it is now. thus Sixth Sense also supports multi-touch and multi-user interaction. walls and physical objects around us to be used as interfaces. while the camera recognizes and tracks user's hand gestures and physical objects using computer-vision based techniques. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. This process is done using some techniques of computer vision. The hardware components are coupled in a pendant like mobile wearable device. The key here is that Sixth Sense recognizes the objects around you. The maximum number of tracked fingers is only constrained by the number of unique fiducials. If they can get rid of the colored finger caps and it ever goes beyond the initial development phase.

-:13:- .the real world and truly give everyone complete awareness of the environment around us.

The prototype of the sixth sense is designed in a such a way that it gives more importance to the portability factor. The user doesn’t require any machine-human interface to access the data. The sixth sense devices have not been made in large scale for commercial purpose. It was made from parts collected together from common devices. -:14:- . Multi sensing technique allows the user to interact with system with more than one than one finger at a time. Ø Data access directly from the machines in real time: With help of a sixth sense device the user can easily access data from any machine at real time speed.ADVANTAGES Ø Portable: One of the main advantages of the sixth sense devices is its small size and portability. It can be easily carried around without any difficulty. Once that happens it’s almost certain that the device will cost much lower than the current price.. All the devices are light in weight and the smart phone can easily fit into the user’s pocket. This is typically useful for large interaction scenarios such as interactive table tops and walls. Ø Cost effective: The cost incurred for the construction of the sixth sense proto type is quiet low. Sixth sense devices also incooperates multi user functionality. And a typical sixth sense device cost up to $300. The data access through recognition of hand gestures is much easier and user friendlier compared to the text user interface or graphical user interface which requires keyboard or mouse. Ø Support multi touch and multi user interaction: Multi touch and multi user interaction is another added feature of the sixth sense devices.

. Ø Open source software: The software that is used to interpret and analysis the data collected by the device is made open source. requirement of a platform or a screen to analyze and interpret the data has become obsolete. We can project the information into any surface and can work and manage the data as per our convenience. This enables other developers to contribute to the development of the system -:15:- .Ø Mind map the idea anywhere: With the advent of the sixth sense device.

displaying information automatically and letting us to access it in any way we need.CONCLUSION Sixth Sense recognizes the objects around us. -:16:- . This became the ultimate “transparent” user interface for accessing information about everything around us. allowing us to interact with this information via natural hand gestures. This prototype implements several applications that demonstrate the usefulness. viability and flexibility of the system.