SEMINAR TOPIC

ON

TOUCHLESS TOUCHSCREEN TECHNOLOGY

BY

FOUSIYA MUHAMMED(811221052)

Submitted in partial fulfilment of the

Requirement for the award M.Sc. (Computer Science) degree of
University of Kerala
2022-24

SCHOOL OF DISTANCE EDUCATION

UNIVERSITY OF KERALA

KARIAVATTOM

1
 CERTIFICATE

This is to certify that the seminar report entitled “Touchless

Touchscreen Technology” is a bonafide report of the seminar
done by FOUSIYA MUHAMMED (811221052) under my
supervision and guidance towards partial fulfillment of the
requirements for the award of the Degree of MSc Computer
Science at School of Distance Education, University of Kerala.

External Examiner 1: Lecturer in charge

External Examiner 2:

2
 ACKNOWLEDGEMENT

We would like to express our heartfelt thanks to our honorable Director Dr. K. S.

Suresh Kumar, School of Distance Education, University of Kerala for providing the

required facilities for completion of work. We express a deep sense of gratitude to

Mrs. Liji I H, Coordinator and Assistant Professor of Computer Science, University of

Kerala for support and kindhearted cooperation. We gratefully acknowledge the support and

proper guidance extended by our guide Mrs. Liji I H, Assistant Professor of Computer

Science.

We extended thanks to our parents, classmates, friends, and all well-wishers who

helped us to make this case study a success. We are thankful to God almighty for the

strength and presence of mind to complete the case study successfully, we humbly solicit

and almighty’s blessings.

Our sincere thanks and apologies to anyone who deserves the credit but whose

name fail to appear in the list above.

With gratitude,

FOUSIYA MUHAMMED

3
 ABSTRACT

It was the touch screens which initially created great furore.Gone

are the days when you have to fiddle with the touch screens and

end scratching up. Touch screen displays are ubiquitous

worldwide.Frequent touching a touchscreen display with a

pointing device such as a finger can result in the gradual de-

sensitization of the touchscreen to input and can ultimately lead to

failure of the touchscreen. To avoid this a simple user interface for

Touchless control of electrically operated equipment is being

developed. EllipticLabs innovative technology lets you control

your gadgets like Computers, MP3 players or mobile phones

without touching them. A simple user interface for Touchless

control of electrically operated equipment. Unlike other systems

which depend on distance to the sensor or sensor selection this

system depends on hand and or finger motions, a hand wave in a

certain direction, or a flick of the hand in one area, or holding the

hand in one area or pointing with one finger.

4
 CONTENTS

SI.NO. INDEX PAGE.NO.

6-7
1 INTRODUCTION

8-11
2 OBJECTIVES
12-32
3 CONTENT

33-37
4 ADVANTAGES AND DIS ADVANTAGES

38
5 CONCLUSION

39
6 REFERENCE

5
 INTRODUCTION

The touch less touch screen sounds like it would be nice and

easy, however after closer examination it looks like it could be

quite a workout. This unique screen is made by TouchKo ,

White Electronics Designs , and Groupe 3D. The screen

resembles the Nintendo Wii without the Wii Controller. With

the touchless touch screen your hand doesn’t have to come in

contact with the screen at all, it works by detecting your hand

movements in front of it. This is a pretty unique and interesting

invention, until you break out in a sweat. Now this technology

doesn’t compare to the hologram-like IO2 Technologies

Heliodisplay M3 .

You probably wont see this screen in stores any time soon.

Everybody loves a touch screen and when you get a gadget with

touch screen the experience is really exhilarating. When the I-

phone was introduced,everyone felt the same.But gradually,the

exhilaration started fading. While using the phone with the

6
finger tip or with the stylus the screen started getting lots of

finger prints and scratches. When we use a screen protector; still

dirty marks over such beautiful glossy screen is a strict no-no.

Same thing happens with I-pod touch. . Most of the time we

have to wipe the screen to get a better unobtrusive view of the

screen.

Thanks to EllipticLabs innovative technology that lets you

control your gadgets like Computers, MP3 players or mobile

phones without touching them. Simply point your finger in the

air towards the device and move it accordingly to control the

navigation in the device. They term this as “Touchless

human/machine user interface for 3D navigation ”.

7
 OBJECTIVES

Touchless touchscreen technology aims to offer an intuitive and

hygienic user interface experience by eliminating physical

contact with the screen. The objectives of touchless touchscreen

technology include:

 In recent years, technological innovations have continually

reshaped our daily interactions, particularly in the realm of

user interfaces. Among these advancements, touchless

touchscreen technology emerges as a significant milestone,

offering a paradigm shift in how humans engage with

digital displays. This essay delves into the multifaceted

objectives that underpin the development and

implementation of touchless touchscreen technology.

 Traditional touchscreen interfaces, ubiquitous in public

spaces ranging from kiosks to ATMs, have long been

8
 recognized as potential breeding grounds for pathogens.

The advent of touchless touchscreen technology seeks to

mitigate this risk by eliminating the need for physical

contact, thus reducing the transmission of germs and

bacteria. In doing so, it addresses not only immediate

concerns surrounding public health but also cultivates a

heightened sense of user confidence and well-being.

 Touchless touchscreens engender a sense of empowerment

and accessibility, fostering greater engagement with digital

interfaces across diverse demographics.

 Touchless touchscreen technology also holds promise in

reducing operational costs and enhancing the longevity of

interactive displays.

 Touchless touchscreen technology aligns with broader

imperatives surrounding privacy protection and compliance

9
 with health guidelines. With growing concerns over data

security and privacy breaches, touchless interfaces offer a

safeguard against inadvertent data transfer through physical

contact.

 In the wake of global health crises, such as the COVID-19

pandemic, touchless technology emerges as a proactive

measure to minimize the spread of infectious diseases by

adhering to stringent health protocols.

 The objectives of touchless touchscreen technology

converge to redefine the landscape of human-computer

interaction, heralding a future where seamless, hygienic,

and inclusive interfaces are the norm.

 By prioritizing hygiene, enhancing user experiences,

integrating advanced gesture recognition, reducing

operational costs, and safeguarding privacy, touchless

10
 interaction modality. Through innovative gesture

recognition algorithms and proximity sensors, users can

navigate interfaces and execute commands with fluidity

and precision, engendering a heightened sense of

engagement and satisfaction.

 The foremost objective of touchless touchscreen

technology lies in promoting hygiene and safety. By

obviating the need for physical contact with the screen, this

technology mitigates the risk of transmitting pathogens and

contaminants, thereby fostering a cleaner and more

hygienic user interface environment.

11
 TOUCHLESS TOUCHSCREEN USER INTERFACE

 A simple user interface for Touchless control of electrically

operated equipment is being developed by Elliptic Labs.

 This technology lets you control our gadgets like Computers,

MP3 players or mobile phones without touching them.

 This unique screen is made by TouchKo, White Electronics

Designs, and Groupe 3D.

 It works by detecting your hand movements in front of it.

This system depends on hand and or finger motions, a hand

wave in a certain direction

The sensor can be placed either on the screen or near the

screen.

12













 The device is based on optical pattern recognition using a

solid state optical matrix sensor with a lens to detect hand

motions.

 This sensor is then connected to a digital image processor,

which interprets the patterns of motion.

 Outputs results as signals to control fixtures, appliances,

machinery, or any device controllable through electrical

signals

13
 WORKING

 Requires a sensor but the sensor is neither hand mounted nor

present on the screen.

 The sensor can be placed either on the table or near the

screen.

 The sensor can recognize the position of an object from as 5

feet.

14
 System is capable of detecting movements in 3D without

ever having to put your fingers on the screen.

 Sensors are mounted around the screen that is being used, by

interacting in the line-of-sight of these sensors the motion is

detected and interpreted into on-screen movements.

 Just point at the screen (from as far as 5 feet away),and you

can manipulate objects in 3D.

 Gestures are translated into screen commands.

15
 APPLICATIONS

Touchless touchscreen technology, often referred to as touchless

gesture recognition or touchless interaction technology, has a

variety of applications across different industries.

 Healthcare: Touchless touchscreens find extensive use in

healthcare settings to minimize the spread of germs and

infections. For instance, touchless interfaces can be utilized

in hospitals for patient monitoring systems, medical

equipment control, or accessing electronic health records

without physical contact.

16
 Retail:

In retail environments, touchless touchscreens can enhance

the customer experience by allowing shoppers to interact

with product information, virtual catalogs, or digital signage

without physical contact. This technology can be especially

valuable in environments like grocery stores or malls where

hygiene is paramount.

 Public Kiosks:

Touchless touchscreens can be implemented in various

public kiosks such as ticket vending machines, information

terminals, or self-checkout stations. This reduces the risk of

cross-contamination in high-traffic areas like airports, train

stations, or shopping centers.

17
 Automotive:

In automotive applications, touchless touchscreens can be

integrated into infotainment systems, allowing drivers and

passengers to control navigation, audio, and other functions

without taking their hands off the wheel or touching

potentially germ-prone surfaces.

 Hospitality:

In the hospitality industry, touchless touchscreens can be

used for self-service check-in/out kiosks, room controls (such

as lighting, temperature, and entertainment systems), or

ordering systems in restaurants and hotels, providing guests

with a convenient and hygienic experience.

18
 Public Spaces:

Touchless touchscreens can be installed in various public

spaces like museums, galleries, or exhibitions, allowing

visitors to interact with digital exhibits, maps, or information

displays without the need for physical contact.

 Banking and Finance:

In banking and finance, touchless touchscreens can be used

for ATM machines, interactive teller machines, or digital

signage to provide customers with secure and hygienic

access to banking services and information.

 Industrial and Manufacturing:

In industrial and manufacturing environments, touchless

touchscreens can be utilized for ne interfaces (HMIs),

allowing workers to control machinery or access data without

needing to remove gloves or compromise hygiene protocols.

19
 MODELLING AND ANALYSIS

Wave Flow

Without ever placing your fingertips on the screen, the system

can detect movements in three dimensions. Sensors are

positioned everywhere around the screen; motion is sensed

and translated into onscreen movements by interacting in the

line of sight of these sensors. The system uses a solid-state

optical matrix sensor with a lens to detect hand gestures and is

based on optical pattern recognition.

This sensor is then coupled with a digital image processor,

which analyses the motion patterns and sends the findings as

signals to operate lights or any other electrically programmable

device. Three infrared lasers are used to scan a surface. It can

determine an object's location up to five feet away.

20
Figure2: Wave Flow of Touchless Touch Screen

21
GESTURE BASED GRAPHICAL USER INTERFACE(GBUI)

Hand motions are converted into computer commands using a Leap motion
controller. Initial studies were performed to determine how the controller
operated and to comprehend fundamental interaction. The controller is used to
test whether sign language can be recognized. The fingerspelling alphabet was
chosen because of the relatively straightforward nature of individual signs and the
wide variety of motions that make up the alphabet.

Figure 3: GBUI Symbols

22
Figure 4: 3D Navigation of Hand Movements in Touchless Screen

23
 METHODOLOGY

WHAT IS A TOUCHSCREEN?

An essential source of input or output, the touch screen is

typically overlaid over an electronic visual display. By

touching the screen, a user can control the information

processing or provide input via single- or multi-touch

gestures.

Instead of employing a middle device, it enables the

user to engage directly with what is displayed.

How Touch Screens Work?

Different devices are now easier to operate thanks to

touch screens.
All it takes is a quick tap or swipe to complete the
necessary action.

24
Touchscreens with resistance

The resistive touch screen technology is one of the most

fundamental systems in ATMs. Two electrically conducting

layers—one resistive and the other conductive—make up this

structure. Spacers keep these two layers apart until you touch

them, separating them. The final component of the system is a

scratch-resistant top.

At all times, an electrical current flow through the two layers.

The electrical current is altered where the two layers of the

screen come into contact when you touch it. The software

calculates the change in the electrical field and its coordinates,

then performs the function pertinent to that location. Despite

being robust and consistent, this system can only support one

touch at a time. High-end devices almost certainly have

capacitive touch screens because of this.

25
Screens with capacitive touch

A layer that holds electric charge made of materials like

copper or indium tin oxide is utilized in capacitive systems.

The configuration is completed with sensors in the corners and

protective housing.

On every corner of the touch screen, a

very little amount of voltage is applied. So

how does it function? A capacitor can be

created by the human body.

It can conduct electricity, therefore. Therefore, some of the

charges are transmitted to the user when the user touches the

screen with his or her finger. Every corner of the screen

detects this. The electric current value at each corner will

change depending on the touch point. This relative

difference enables the programmer to pinpoint the precise

location of the touch and do additional tasks pertaining to location.

26
Displays with infrared touch

It is the less popular and accurate one. On the opposing sides

of the screen, LEDs and Light-detecting photocells are

positioned. Infrared light from the LEDs is projected in front

of the screen, resembling an invisible spider's web. A user can

stop two or more beams by touching the screen at a certain

location. This makes it easier for the controller to identify the

precise spot where the touch occurred, and the

related action is taken. Since the beam is broken, infrared

screens can be used with a finger, a stylus, or even while

wearing gloves.

But because gloves don't transmit electricity, using a

capacitive touch screen while wearing them will be

ineffective. The majority of eBook readers that utilize

infrared touch screens are Sony and Amazon Kindle models.

27
Surface Acoustic Wave (SAW) Touch Screen

Fingers are detected by surface acoustic waves utilizing

sound rather than light.

Its surface reflects ultrasonic noises that are too high-pitched

for humans to hear back and forth.

The user stops the sound beam when they contact the screen,

and the position of the touch is then determined.

28
 PRINCIPLES OF TOUCHLESS TOUCHSCREEN TECHNOLOGY

1.Sensing Technologies: Touchless touchscreen technology

employs different sensing technologies to detect and capture

user interactions. Some common sensing technologies include:

 Infrared Sensors: Infrared sensors detect infrared light

emitted by objects, allowing them to sense the presence,

position, and movement of users' hands or other objects in

the vicinity of the touchscreen.

 Capacitive Sensors: Capacitive sensors detect changes in

capacitance caused by the proximity or touch of conductive

objects, such as a user's hand. This technology is

commonly used in traditional touchscreen displays but can

also be adapted for touchless interaction by detecting

proximity without physical contact.

29
 Depth Sensors: Depth sensors, such as those based on

time-of-flight or structured light principles, measure the

distance to objects in the field of view. These sensors

provide three-dimensional information about the scene,

enabling precise tracking of hand gestures and movements.

 Ultrasound Sensors: Ultrasound sensors emit ultrasonic

waves and measure the time it takes for the waves to reflect

off objects and return to the sensor. By analyzing these

reflections, ultrasound sensors can detect the presence and

position of objects, including user gestures.

 Camera-based Systems: Camera-based systems use one or

more cameras to capture images or videos of the user and

their surroundings. Computer vision algorithms analyze

30
 these images to identify and interpret gestures, motions, or

facial expressions for interaction with the touchscreen.

2. Gesture Recognition Algorithms: Touchless touchscreen technology

relies on sophisticated algorithms for gesture recognition and
interpretation. These algorithms analyze the data captured by the
sensing technology to recognize specific gestures, such as
swipes, taps, pinches, or hand movements, and translate them
into corresponding commands or actions for interacting with
digital content.

3. User Interface Design: Effective user interface design is

essential for touchless touchscreen systems to provide intuitive
and seamless interaction experiences. User interfaces should be
designed to accommodate touchless gestures and motions, with
clear visual feedback to indicate successful interactions and
guide users through the interface.

4. Calibration and Optimization: Touchless touchscreen systems

often require calibration and optimization to ensure accurate and
reliable detection of user interactions. This may involve adjusting
sensor settings, fine-tuning gesture recognition algorithms, or
optimizing the placement and orientation of sensors to minimize
interference and improve performance.

31
5. Integration with Interactive Applications: Touchless

touchscreen technology needs to be seamlessly integrated with

interactive applications and software platforms to enable

meaningful interaction experiences. Application developers

must consider the unique capabilities and constraints of

touchless interaction when designing user interfaces and

implementing interactive features.

32
 ADVANTAGES

Touchless touchscreen technology offers several advantages

over traditional touch-based interfaces, making it a preferred

choice in various applications. Some of the key advantages

include:

1. Hygiene: One of the most significant advantages of touchless

touchscreens is improved hygiene. By eliminating the need for

physical contact, touchless technology reduces the risk of

spreading germs, bacteria, and viruses, making it particularly

beneficial in healthcare settings, public spaces, and high-traffic

environments where hygiene is a concern.

2. Reduced Maintenance: Touchless touchscreens typically

require less maintenance compared to traditional touchscreens

since there is no physical contact with the screen surface. This

can lead to cost savings and increased uptime, especially in

33
 applications where frequent cleaning or maintenance is

impractical or disruptive.

3. Accessibility: Touchless touchscreens can improve accessibility

for individuals with disabilities or mobility impairments. By

enabling interaction through gestures, motions, or voice

commands, touchless technology provides an alternative to

traditional touch-based interfaces, making digital content more

accessible to a wider range of users.

4. Intuitive Interaction: Touchless touchscreens offer intuitive

and natural interaction experiences, allowing users to interact

with digital content using gestures and motions similar to real-

world interactions. This can enhance user engagement, usability,

and satisfaction, particularly in applications where traditional

input methods may be cumbersome or unintuitive.

5. Enhanced User Experience: Touchless touchscreens can

enhance the overall user experience by providing a more

immersive and engaging interaction environment. Whether used

in retail displays, interactive exhibits, or entertainment systems,

34
 touchless technology can captivate users and create memorable

experiences that encourage exploration and interaction.

6. Flexibility and Adaptability: Touchless touchscreens are

highly adaptable to different environments and use cases. They

can be deployed in various settings, such as public kiosks,

educational institutions, automotive interfaces, and industrial

environments, offering flexibility in implementation and usage.

35
 DISADVANTAGES

While touchless touchscreen technology offers numerous

advantages, it also comes with some limitations and

disadvantages. Here are several drawbacks to consider:

1. Limited Accuracy: Touchless touchscreens may have

limitations in accurately detecting and interpreting user gestures,

especially in complex or dynamic environments. Factors such as

ambient lighting, background clutter, and user variability can

affect the accuracy of gesture recognition, leading to errors or

misinterpretations.

2. Complex Gestures: Some touchless touchscreen systems may

require users to perform complex or specific gestures to trigger

actions or commands. This can lead to confusion or frustration

among users, especially if the required gestures are not intuitive

or easy to remember.

3. Learning Curve: Users may need time to become familiar with

36
4. touchless interaction techniques and gestures, particularly if

they are accustomed to traditional touch-based interfaces. The

learning curve associated with touchless technology can hinder

adoption and usability, especially in environments where users

have limited exposure to such systems.

5. Cost: Implementing touchless touchscreen technology can be

more expensive than traditional touch-based interfaces,

primarily due to the cost of specialized sensors, cameras, and

gesture recognition software. Additionally, integrating touchless

technology into existing systems or infrastructure may require

additional investments in hardware, software, and training.

6. Privacy Concerns: Touchless touchscreen systems that utilize

cameras or sensors to capture user interactions may raise privacy

concerns, particularly in environments where sensitive or

personal information is involved. Users may be apprehensive

about the collection and use of biometric data for gesture

recognition or user identification purposes, leading to privacy-

related objections or regulatory compliance issues.

37
 CONCLUSION

This paper gives an overview of touch-free screen technology.

The use of this technology provides the user with the
flexibility to use the system appropriately. The proposed
touchless touchscreen technology is appropriate for Android
mobile phones, laptops, ATM machines, and other
applications. The maintenance work of a touchscreen display
can be reduced by using this technology. Touchless touching
Technology is constantly evolving. Today's thoughts revolve
once more around the user interface. Day in and day out,
efforts are made to improve technology. The touchless
touchscreen user interface works well on computers, cell
phones, webcams, and laptops. Perhaps in a few years, our
bodies will be transformed into virtual mice, virtual
keyboards, and so on.

38
 REFERENCES

[1] A.K. Jain, A. Ross, K. Nandakumar, Introduction to Biometrics,

Springer, 2021.

[2] K. O'Hara et al., "Touchless interaction in surgery",

Communications of the ACM, vol. 57, no. 1, pp. 70-77, 2022.

[3] J. Wachs, H. Stern, Y. Edan, M. Gillam, C. Feied, M. Smith, J.

Handler, "Real-Time Hand Gesture Interface for Browsing
Medical Images".

[4] P. Peltonen, E. Kurvinen, A. Salovaara, G. Jacucci, T. Ilmonen,

J. Evans, A.Oulasvirta, P. Saarikko, "It's mine don't touch!:
interactions at a large multi-touch display in a city centre",
CHI '08: Proceeding of the twenty-sixth annual SIGCHI
conference on Human factors in computing systems, ACM, pp.
1285-1294, 2020

39