You are on page 1of 18

Touchless Touch Screen Technology

SEMINAR REPORT SUBMITTED TO MANIPAL UNIVERSITY, MANIPAL

FOR THE PARTIAL FULLFILLMENT OF THE DEGREE OF MASTER OF COMPUTER APPLICATION

By Dhaval Patel(Reg. No: 100919060)

DEPARTMENT OF MASTER OF COMPUTER APPLICATION MANIPAL INSTITUTE OF TECHNOLOGY MANIPAL UNIVERSITY, MANIPAL-576104 KARNATAKA, INDIA APR 2012

Manipal. No part of this work has been submitted for the award of a degree or diploma either to this University or to any other Universities. Place: Manipal Date: 04-04-2012 i . a constituent Institute of Manipal University. Manipal Institute of Technology.DECLARATION I hereby declare that this seminar report entitled Touchless Touch Screen Technology is original and has been carried out by me in the Department of Master of Computer Application.

. . . . . . . . . . . . . . .2 5. . . . . . . . . . . . . . . . .4 5. . . . . . . . . . . . . . . . . . TOUCH WALL . .Contents 1 INTRODUCTION 2 TECHNOLOGY BEHIND IT 2. . . . . . . . . . . .1 TOUCH SENSOR . . . . . . . . . . . . .3 5. . 3 4 5 5 6 8 8 9 11 12 12 14 14 15 3 WORKING 4 GLIMPSE OF GBUI 5 APPLICATION 5. . . . . TOUCHLESS SDK . . . . . .1 5. . . . . . . .5 TOUCHSCREEN MONITOR . . . . . . . . . . . . . TOUCHLESS DEMO . . TOUCHLESS USER INTERFACE . . . . . . . . . . . . . . . . . . . 6 DRAWBACK 7 FUTURE WORKS 8 CONCLUSION 1 . . . .

machinery. Touch screen displays are ubiquitous worldwide. MP3 players or mobile phones without touching them. A simple user interface for Touchless control of electrically operated equipment. appliances. This sensor is then connected to a digital image processor. or holding the hand in one area or pointing with one finger for example. EllipticLabs innovative technology lets you control your gadgets like Computers. a hand wave in a certain direction. or a flick of the hand in one area. 2 . Unlike other systems which depend on distance to the sensor or sensor selection this system depends on hand and or finger motions. The device is based on optical pattern recognition using a solid state optical matrix sensor with a lens to detect hand motions. which interprets the patterns of motion and outputs the results as signals to control fixtures.Gone are the days when you have to fiddle with the touch screens and end scratching up.Abstract It was the touch screens which initially created great furore.Frequent touching a touchscreen display with a pointing device such as a finger can result in the gradual de-sensitization of the touchscreen to input and can ultimately lead to failure of the touchscreen. To avoid this a simple user interface for Touchless control of electrically operated equipment is being developed. or any device controllable through electrical signals.

and Groupe 3D.100 laying around. This unique screen is made by TouchKo . This is a pretty unique and interesting invention. until you break out in a sweat.everyone felt 3 . Now this technology doesn’t compare to the hologram-like IO2 Technologies Heliodisplay M3 . With the touchless touch screen your hand doesn’t have to come in contact with the screen at all. When the I-phone was introduced. Everybody loves a touch screen and when you get a gadget with touch screen the experience is really exhilarating. it works by detecting your hand movements in front of it. but thats for anyone that has $18. however after closer examination it looks like it could be quite a workout. White Electronics Designs .1 INTRODUCTION The touch less touch screen sounds like it would be nice and easy. The screen resembles the Nintendo Wii without the Wii Controller. You probably wont see this screen in stores any time soon.

Most of the time we have to wipe the screen to get a better unobtrusive view of the screen[4].And the hardware setup is so compact that it can be fitted into a tiny 4 . .the exhilaration started fading. Simply point your finger in the air towards the device and move it accordingly to control the navigation in the device. Same thing happens with I-pod touch. Thanks to EllipticLabs innovative technology that lets you control your gadgets like Computers. MP3 players or mobile phones without touching them.the same. While using the phone with the finger tip or with the stylus the screen started getting lots of finger prints and scratches. They term this as ”Touchless human/machine user interface for 3D navigation”. still dirty marks over such beautiful glossy screen is a strict no-no. When we use a screen protector.The sensor can be placed either on the table or near the screen. 2 TECHNOLOGY BEHIND IT It obviously requires a sensor but the sensor is neither hand mounted nor present on the screen.But gradually.

You just point at the screen (from as far as 5 feet away).The touch sensor is placed over a display screen so that the responsive area of panel covers the viewable area of the screen. 5 . The system is capable of detecting movements in 3-dimensions without ever having to put your fingers on the screen.It recognizes the position of an object from as 5 feet[4].1 TOUCH SENSOR A touch sensor is a clear glass panel with a touch responsive area. 2.device like a MP3 player or a mobile phone. 3 WORKING It obviously requires a sensor but the sensor is neither hand mounted nor present on the screen. and you can manipulate objects in 3D[5]. The sensor can be placed either onthe table or near the screen. Their patented touchless interface doesn’t require that you wear any special sensors on your hand either.

The best part? Elliptic Labs says their technology will be easily small enough to be implemented into cell phones and the like.Sensors are mounted around the screen that is being used. but it looks promising nonetheless. IPod touchless. Microsoft’s XD Huang demonstrated how his company sees the future of the GUI at ITEXPO this past September in fact. But at the show. The GBUI as seen in the Matrix 6 . the example was in 2 dimensions. It recognizes the position of an object from as 5 feet. What is to stop unintentional gestures being used as input is not entirely clear. anyone? 4 GLIMPSE OF GBUI We have seen the futuristic user interfaces of movies like Minority Report and the Matrix Revolutions where people wave their hands in 3 dimensions and the computer understands what the user wants and shifts and sorts data with precision. And the hardware setup is so compact that it can be fitted into a tiny device like a MP3 player or a mobile phone. by interacting in the line-of-sight of these sensors the motion is detected and interpreted into on-screen movements. not 3 dimensions.

7 . So after reading a document . The demos included the concept of software understanding business processes and helping you work.you could just push it off the side of your screen and the system would know to post it on an intranet and also send a link to a specific group of people.The GBUI as seen in the Minority Report Microsoft’s vision on the UI In their Redmond headquarters and it involves lots of gestures which allow you to take applications and forward them on to others with simple hand movements.

such as for doctors who might be wearing surgical gloves.1 APPLICATION TOUCHSCREEN MONITOR Sure. well. By simply pointing at the screen. but all that touching. everybody is doing touchscreen interfaces these days. like foreplay. Touchscreen interfaces are great. in thin air. The input method is. but this is the first time I’ve seen a monitor that can respond to gestures without actually having to touch the screen.The monitor. Designed for applications where touch may be difficult. The technology detects motion in 3D and requires no special wornsensors for operation. who are hard at work on implementing a touchless interface.5 5.users can manipulate the object being displayed in 3D. Enter the wonder kids from Elliptic Labs. can be a little bit of a drag. Software can then translate gestures into screen commands[3]. the display features capacitive sensors that can read movements from up to 15cm away from the screen. based on technology from TouchKo was recently demonstrated by White Electronic Designs and Tactyl Services at the CeBIT show. 8 .

there is one more thing to mention.5. but actually without having to touch the screen. because user input will not be limited to 2-D anymore. That’s cool. but that I can use my thick. How accurate it can be. We’ll see hopefully very soon!Finally. dirty. bandaged. whether the software will have AI or the user will have to learn how to move her fingers.2 TOUCHLESS USER INTERFACE The basic idea described in the patent is that there would be sensors arrayed around the perimeter of the device capable of sensing finger movements in 3-D space.The user could use her fingers similarly to a touch phone. fingers as well (as opposed to ”plain” touch UI). isn’t it? I think the idea is not only great. it’s the built-in accelerometer. 9 . etc.

10 .

Color based markers defined by the user are tracked and their information is published through events to clients of the SDK.3 TOUCHLESS SDK The Touchless SDK is an open source SDK for . 11 . It enables developers to create multi-touch based applications using a webcam for input.5. All the user needs is a camera.NET applications. the Touchless SDK enables touch without touching. Using the SDK lets developers offer users ”a new and cheap way of experiencing multi-touch capabilities.” to track the multi-colored objects as defined by the developer. Well. In a nutshell. Just about any webcam will work[1]. without the need of expensive hardware or software.” a webcam-driven multi-touch interface SDK that enables ”touch without touching”[2]. Microsoft Office Labs has just released ”Touchless.

zoom. The demo was created using the Touch less SDK and Windows Forms with C#.5 TOUCH WALL Touch Wall refers to the touch screen hardware setup itself. one would love to hear what use you make of it! 5.up to 4 player version of a pong-like game.where you control a snake with a marker. no geekiness required. the corresponding software to run Touch Wall. Defender .4 TOUCHLESS DEMO The Touch less Demo is an open source application that anyone with a webcam can use to experience multi-touch.where you can rotate. and Draw the marker is used to guess what.5.” If you wind up using the SDK. is 12 . Map . draw![2] Mike demonstrated Touch less at a recent Office Labs’ Productivity Science Fair where it was voted by attendees as ”most interesting project. There are 4 fun demos: Snake . and move a map using 2 markers. which is built on a standard version of Vista.

the hardware to ”turn almost anything into a multi-touch interface” for Touch Wall is just ”hundreds of dollars”[3]. Touch Wall and Plex are superficially similar to Microsoft Surface. But what Microsoft has done with a few hundred dollars worth of readily available hardware is stunning. Touch Wall certainly isn’t the first multi-touch product we’ve seen (see iPhone). Early prototypes. on a cardboard screen. While Surface retails at around $10. It is a fundamentally simpler mechanical system. and a the system worked fine.000.called Plex. and is also significantly cheaper to produce. A projector was used to show the Plex interface on the cardboard. A camera notes when something breaks through the laser line and feeds that information back to the Plex software. simply. 13 . a multi-touch table computer that was introduced in 2007 and which recently became commercially available in select AT&T stores. were made. say Pratley and Sands. of course. Touch Wall consists of three infrared lasers that scan a surface. In addition to Surface. there are a number of early prototypes emerging in this space.

It’s also clear that the only real limit on the screen size is the projector. You might even save some money. But touch interfaces are nothing new – witness ATM machines. • Used in sophisticated environment. meaning that entire walls can easily be turned into a multi touch user interface. How about getting completely out of touch? A startup called LM3Labs says it’s working with major computer makers in Japan.You should be able to buy an Airstrike-equipped laptop next year. with high-end stand-alone keyboards to 14 . You can drag windows around or close them. 6 DRAWBACK • Proper environment is required. • Public interaction has been monitored. by pointing and gesturing in midair above the keyboard. Scrap those white boards in the office. Called Airstrike. Taiwan and the US to incorporate touch less navigation into their laptops. 7 FUTURE WORKS Many personal computers will likely have similar screens in the near future. the system uses tiny charge-coupled device (CCD) cameras integrated into each side of the keyboard to detect user movements. and make every flat surface into a touch display instead. for instance. • Initial cost is very high.

8 CONCLUSION Today’s thoughts are again around user interface.Any such system is unlikely to replace typing and mousing. May be few years down the line. cell phones. Our body may be turned in to an input device! References [1] Touchless Writer: Object Tracking & Neural Network Recognition. Airstrike aims to give you an occasional quick break from those activities.com. Clemson University.van. Research Cees van Berkel.blogspot. Efforts are being put to better the technology day-in and day-out. our body can be transformed into a virtual mouse.com 15 .touchlesstouchscreen. [4] www. Mehran Roshandel. Cees.Philips UK Laboratories. But that’s not the point. The Milton W. Hamed Ketabdar. SC 29631 [2] MagiWrite: Towards Touchless Digit Entry Using 3D Space Around Mobile Devices.follow.berkel@philips. Clemson. Redhill. Yang Wu & Lu Yu. virtual keyboard and what not??. Holcombe Department of Electrical and Computer Engineering. webcams and laptops. The Touchless touch screen user interface can be used effectively in computers.Kamer Ali Yksel [3] 3D Touchless Display Interaction.

com/2008/09/touchless-touch-screen-thatsenses-your.[5] http://www.html 16 .touchuserinterface.