Professional Documents
Culture Documents
Eye Gaze Communication: BMSCE - ECE - 2011-2012
Eye Gaze Communication: BMSCE - ECE - 2011-2012
Abstract
The field of human computer interaction has been undergoing a new renaissance
lately. While many companies have, and continue to spend millions to develop
highly visually appealing GUIs and state-of-art interaction systems for the
common users since the inception of desktops, the development of interactive
systems for the disabled has taken a kick start relatively recently. And the
Eyegaze systems are one of the most pivotal inventions in this context. The
Eyegaze System is a communication and control system for people with complex
physical disabilities. You run the system with your eyes. By looking at control
keys displayed on a screen, a person can synthesize speech, control his
environment (lights, appliances, etc.), type, operate a telephone, run computer
software, operate a computer mouse, and access the Internet and e-mail. Eye gaze
Systems are being used to write books, attend school and enhance the quality of
life of people with disabilities all over the world.
BMSCE|ECE|2011-2012
Page 1
TABLE OF CONTENTS
1 INTRODUCTION
1.1 System overview
1.2 System features
1.3 System output
1.4 System software
1.5Eyegaze analysis system
Page 2
BMSCE|ECE|2011-2012
Page 3
CHAPTER 1
INTRODUCTION
1.1 System Overview
Most of us blessed to operate the computer with ease using our hands. But there
are some who cant use their hands and for them the voice guided systems have
been in use for quite some time now. But about paralytic patients with no
mobility and speech? Even when their brains are functional and they are visually
and aurally blessed to know what is going around. So shouldnt they be able to
effectively use their intelligence? Now they can with the Eyegaze communication
system.
Page 4
Calibration: Fully automated calibration is fast (15 - seconds), easy and long
lasting.
Accuracy: Highly accurate and tolerant to many variations, such as pupil drift
and head range variation - typical average bias error 0.45 degrees. Good tolerance
to ambient infrared light and to high-speed head motion.
Binocular Eye Tracking: Tracks both of the subjects eyes to increase gaze
point accuracy by adjusting for head rotation.
Trace Suite: This suite of programs captures a subjects gaze when presented
with static or moving images or during computer operations. In addition to
generating the standard data of our Analysis System, the users gaze and the
stimulus are linked so they can be replayed and studied in depth. The observer
can view the subjects screen, eye images and gaze point in real time on a
separate monitor.
BMSCE|ECE|2011-2012
Page 5
an eye-found flag indicating whether or not the eye is visible to the camera and
thus whether or not a valid gazepoint is calculated,
pupil diameter,
3-dimensional location of the eyeball centre within the camera field of view, an
indicator of head location and movement, and
Windows XP Professional
Page 6
Mini computer
Expandable: will allow you to add on binocular eye tracking and wide field of
view camera lenses in the future
Improved accuracy!
Averaging of gaze points from both eyes gives you an improved estimate of gaze
point
BMSCE|ECE|2011-2012
Page 7
CHAPTER 2
SKILLS NEEDED BY EYEGAZE USERS
2.1Good control of eye
The user must be able to look up, down, left and right. He must be able to fix his
gaze on all areas of a 15-inch screen that is about 24 inches in front of his face.
He must be able to focus on one spot for at least 1/2 second.
2.2Adequate vision
The user should be able to view the screen correctly.
Ability to read
Memory
Cognition
BMSCE|ECE|2011-2012
Page 8
CHAPTER 3
WORKING OF EYEGAZESYSTEMS
3.1 OVERVIEW
As a user sits in front of the Eyegaze monitor, a specialized video camera mounted
below the monitor observes one of the user's eyes. Sophisticated image- processing
software in the Eyegaze System's computer continually analyzes the video image of
the eye and determines where the user is looking on the screen. Nothing is attached
to the user's head or body.
BMSCE|ECE|2011-2012
Page 9
BMSCE|ECE|2011-2012
Page 10
CHAPTER 4
Menu of Eye-gaze Systems
4.1The main menu
The Main Menu appears on the screen as soon as the user completes a 15-second
calibration procedure. The Main Menu presents a list of available Eyegaze
programs. The user calls up a desired program by looking at the Eyegaze key next
to his program choice.
BMSCE|ECE|2011-2012
Page 11
BMSCE|ECE|2011-2012
Page 12
4.5Run Second PC
The Run Second PC program permits the Eyegaze Communication
System to act as a peripheral keyboard and Mouse interface to a Windows
computer. The user can run any off-the-shelf software he chooses on the second
computer. He can access the Internet, and send e-mail by looking at keyboard and
mouse control screens on the Eyegaze monitor. The programs being run are
displayed on the second computers monitor. Typed text appears simultaneously
on the Eyegaze and second pcs screens
BMSCE|ECE|2011-2012
Page 13
4.8 Television
Television programs can be displayed directly on the desktop
Eyegaze System screen. On-screen volume and channel controls provide
independent operation. (Not available on the Portable Eyegaze System).
BMSCE|ECE|2011-2012
Page 14
Eye-Gaze input system has to detect gaze direction of users. Our Eye-Gaze input
system. Runs an image analysis software for Eye-Gaze detection.
Page 15
The evaluation experiments for the proposed system were conducted with five
objects. Subjects were browsing through two web sites, the results show that the
subjects can operate this system as they planned, and correct easily errors in
operation.
BMSCE|ECE|2011-2012
Page 16
CHAPTER 5
HOW TO RUN EYEGAZE SYSTEM?
A user operates the Eyegaze System by looking at rectangular keys that are
displayed on the control screen. To "press" an Eyegaze key, the user looks at the
key for a specified period of time. The gaze duration required to visually activate a
key, typically a fraction of a second, is adjustable. An array of menu keys and exit
keys allow the user to navigate around the Eyegaze programs independently
BMSCE|ECE|2011-2012
Page 17
CHAPTER 6
Uses of Eyegaze
Every year more than 100 000 people are diagnosed with motor neurone diseases.
Typically, even when all other ways of communicating are either severely
damaged or completely lost, the eyes still function. Communication by Gaze
Interaction (COGAIN) is a Network of Excellence designed specifically to help
people with these disabilities to communicate more effectively with eye gaze. At
the COGAIN stand you can see how this technology is used by a person who
relies on it.
Eye tracking systems that allow text entry by eye gaze have been in
existence for about two decades, but the technology is still only available to a
small portion of the potential user population. Obstacles for more wide-spread use
currently include: the high cost of eye tracking equipment, the limitation that gaze
communication applications may only work with a particular dedicated eye
tracking device, and finally that eye tracking devices are often hard to use and
require experts to operate them.
Turn pages on the computer screen by looking at "up" or "down". (Read Text)
Play games, two "Paddle" games, plus Solitaire and Slot Machine. (Games)
BMSCE|ECE|2011-2012
Page 18
Be at two sites!! Portable computer has a handle to hand-carry between two sites.
Two sets of other components and cables for access to Eyegaze System at school,
work or home. Dimensions 9"x5'txl7'1, weight approximately 16 lbs.
(Transportable Computer)
Speak 100 "canned phrases" through a speech synthesizer, with a single glance of
the eye. Phrases can be changed by caregiver or user. (Phrases)
Control appliances anywhere in the home or office from one Eyegaze screen. No
special wiring. (Lights and Appliances)
Dial and answer a speaker phone from one screen. "Phone Book" stores 16
frequently used numbers. (Telephone)
CHAPTER 7
Environment required for an Eyegaze system
Because eye tracking is done using infrared light. Eyegaze system must take care
of light sources in the room in order to ensure the best accuracy. The Eyegaze
System must be operated in an environment where there is limited of ambient
infrared light. Common sources of infrared light are sunlight and incandescent
light bulbs. The System makes its predictions based on the assumption that the
only source of infrared light shining on the user's eye is coming from the center of
the camera. Therefore, stray sources of infrared may degrade the accuracy or
prevent Eyegaze operation altogether. The System works best away from
windows, and in a room lit with fluorescent or mercury-vapor lights, which are
low in infrared.
BMSCE|ECE|2011-2012
Page 19
CHAPTER 8
EYETRACKING V/S GAZE TRACKING
Eye trackers necessarily measure the rotation of the eye with respect to the
measuring system. If the measuring system is head mounted, as with EOG, then
eye-in-head angles are measured. If the measuring system is table mounted, as
with scleral search coils or table mounted camera (remote) systems, then gaze
angles are measured.
In many applications, the head position is fixed using a bite bar, a forehead
support or something similar, so that eye position and gaze are the same. In other
cases, the head is free to move, and head movement is measured with systems
such as magnetic or video based head trackers.
For head-mounted trackers, head position and direction are added to eye-in-head
direction to determine gaze direction. For table-mounted systems, such as search
coils, head direction is subtracted from gaze direction to determine eye-in-head
position.
Eye tracking in practice
A great deal of research has gone into studies of the mechanisms and dynamics of
eye rotation, but the goal of eye tracking is most often to estimate gaze direction.
Users may be interested in what features of an image draw the eye, for example.
It is important to realize that the eye tracker does not provide absolute gaze
direction, but rather can only measure changes in gaze direction. In order to know
precisely what a subject is looking at, some calibration procedure is required in
which the subject looks at a point or series of points, while the eye tracker records
the value that corresponds to each gaze position. (Even those techniques that
track features of the retina cannot provide exact gaze direction because there is no
specific anatomical feature that marks the exact point where the visual axis meets
the retina, if indeed there is such a single, stable point.) An accurate and reliable
calibration is essential for obtaining valid and repeatable eye movement data, and
this can be a significant challenge for non-verbal subjects or those who have
unstable gaze.
BMSCE|ECE|2011-2012
Page 20
CHAPTER 9
Developments in Eyegaze Technology
LC technologies have recently developed a Portable Eyegaze System. The
Portable Eyegaze System can be mounted on a wheelchair and run from a 12-volt
battery or wall outlet. It weighs only 6 lbs (2.7 kg) and its dimensions are
2.5"x8"x9" (6.5cm x20cm x23cm). The Portable Eyegaze System comes with a
flat screen monitor and a table mounts for its monitor. The monitor can be lifted
off the table mount and slipped into a wheelchair mount.
Fig 9.1The Scientist Stephan Hawking uses this system with wheelchair to
communicate.
BMSCE|ECE|2011-2012
Page 21
CHAPTER 10
EYETRACKING APPLICATIONS
Eye tracking has significant potential for the creation of new and exciting applications in a
broad range of fields:
Neurosciences /Neuropsychology
Vision Research
Experimental Psychology
Cognitive Psychology
Psycholinguistics
Developmental Psychology
Science of Education
Medicine /Opthalmology
BMSCE|ECE|2011-2012
Page 22
CHAPTER 11
ADVANTAGES
People who have used the alphabet clustering system realize that this old process
can become tiresome and confusing (picture of alphabet clustering is shown
below). However, this newer method of a spreadsheet-like communication board
is useful because it can cater to whatever each particular individual would like to
express. There is unlimited vocabulary that can be used on these boards. In
addition, this encoded system can be used with phrases, letters, words, numbers,
pictures or anything else that is needed. Once a person knows how to indicate
what they want in each row and column, the possibilities are infinite amounts of
communication. A user may become frustrated with too much information on a
particular board. However, he or she can simply start a new board with new
vocabulary (but the same colors, letters, and/or numbers). Although users will
need initial training and practice, the benefits of communicating effectively prove
that this short adaptation process is worth it.
Facts
*Other technologies that use the eyes are becoming popular including eye typing.
*LC Technologies, Inc. is developing a system called EYETRACKING, that will
pioneer the use of computers by nonverbal, disabled persons.
*The success of an eye-gaze board will be increased if it is introduced during an
activity that is enjoyable to the individual.
*The eye-gaze board should look age appropriate so that the person is
comfortable using it.
*The ability to express oneself is something that no one should be deprived of.
BMSCE|ECE|2011-2012
Page 23
CHAPTER 12
DISADVANTAGES
13.1 Disadvantages
It causes diariah
Each method of eye tracking has advantages and disadvantages, and the choice
of an eye tracking system depends on considerations of cost and application.
There are offline methods and online procedures like AttentionTracking. There
is a trade-off between cost and sensitivity, with the most sensitive systems costing
many tens of thousands of dollars and requiring considerable expertise to operate
properly. Advances in computer and video technology have led to the
development of relatively low cost systems that are useful for many applications
and fairly easy to use. Interpretation of the results still requires some level of
expertise, however, because a misaligned or poorly calibrated system can produce
wildly erroneous data.
BMSCE|ECE|2011-2012
Page 24
CHAPTER 13
CONCLUSION
The main reason for eye-gaze based user interfaces being attractive is that the
direction of the eye-gaze can express the interests of the user-it is a potential
porthole into the current cognitive processes-and communication through the
direction of the eyes is faster than any other mode of human communication. It is
argued that eye-gaze tracking data is best used in multimodal interfaces where the
user interacts with the data instead of the interface, in so-called non-command
user interfaces
BMSCE|ECE|2011-2012
Page 25
CHAPTER 14
REFERENCES
[1]
IEEE
TRANSACTIONS
ON
NEURAL
SYSTEMS
AND
[2] Perceptual Gaze Extent & Level of Detail in VR:Looking outside the Box
Hunter Murphy*,Andrew T. Duchowski*
Department of Computer Science,Clemson University
{hmurphy/Andrew}@vr.clemson.edu
BMSCE|ECE|2011-2012
Page 26