P. 1
Blue Eyes Ppt

Blue Eyes Ppt

4.6

|Views: 35,576|Likes:
Published by Krishna
This ppt is abt how the blue eye technology works
This ppt is abt how the blue eye technology works

More info:

Published by: Krishna on Mar 30, 2009
Copyright:Attribution Non-commercial

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
download as PPTX, PDF, TXT or read online from Scribd
See more
See less

08/16/2013

pdf

text

original

Blue eye technology

( blue eyes – Human operator monitoring system )

BY

Agenda
n n n n n n n n n n

Motivation What is BlueEye technology ? What is BlueEyes ? System designing System overview DAU CSU Data security IBM research Conclusion

Motivation
n

Human error - a frequent reason of catastrophes and ecological disasters
– temporal indisposition – weariness – oversight Monitoring of conscious brain involvement

Lack of complex solution exploiting wireless link technology, database systems and AI algorithms

What is blue eye technology ?
n

The BLUE EYES technology aims at creating computational machines that have perceptual and sensory ability like those of human beings.

 

How can we make computers “see” and “feel” ?
n

n

Blue eyes uses sensing technology to identify a user’s actions and to extract key information. Information is then analyzed to determine the user’s physical ,emotional ,or informational state.

What is Blue Eyes ?
n

The complex solution for humanoperator monitoring:
– – – – Visual attention monitoring Physiological condition Operator’s position detection Wireless data acquisition using bluetooth

What is BlueEyes not?
n

n

Doesn’t predict nor interfere with operator’s thoughts Cannot force directly the operator to work

IBM research
BLUE EYE – EMOTIONAL MOUSE sensors in the mouse ,sense the physiological attributes which are correlated to emotions using correlation model -by simply touching the mouse ,the computer will be able to determine a person’s emotional state. n BLUE EYE enabled TELEVISION – could become active when the user makes an eye contact.
n

Physiological foundations
Human brain

Preconscious brain
• • alogical „automatic”

Conscious brain • • • manages the knowledge logical reasoning makes decisions

Conscious brain - operation modes

Exploratory mode

Planning mode

The eye movement sensor
n n

-

Off-shelf eye movement sensor – Jazz multisensor Supplies raw digital data regarding Eye position Level of blood oxygenation Acceleration along horizontal and vertical axes Ambient light intensity

Eye movements
• • Retina - central vision (macula) Central vision and the conscious brain

Saccade - a rapid eye jump to a new location assigned by the conscious attention process.

Saccades presence

Exploratory mode

Jazz multisensor

Jazz Multisensor

Jazz

Design objectives
n

A mobile data acquisition device

• A reliable real-time buffering, processing and recording • A clear visualization interface • Mechanisms for creating custom data analyzers • To ensure a possibility of distributing the processing among a number of computers

Implementation and engineering considerations -THREE groups of users
n

n

n

OPERATOR -a person whose physiological parameters are supervised - authorization in the system - receiving alerts SUPERVISOR – a person responsible for analyzing operator’s condition and performance. SYSTEM ADMINISTRATORS- maintains the system deliver tools for adding - new operator’s to the database - defining alarm conditions - configuring logging tools - creating new analyzer modules

Designing
A personal area network for linking all the operators and the supervising system n Two major units - DAU (data acquisition unit ) - CSU (central system unit )
n

System overview
Data Acquisition Unit
Atmel 89C52 microcontroll er Jazz Multisensor

Central System Unit
Bluetoo th
Connection Manager Data Analysis Visualizati on Module Data Logger

Bluetoot h

Bluetooth technology provides means for creating a Personal Area Network linking the operators and the central system.

DAU
The DAU consists of the following components n ATMEL 8952 microcontroller n BLUE TOOTH MODULE – supports synchronous voice data transmission n PCM CODEC –used to transmit operator’s voice and central system sound feedback n UART –communication between bluetooth module and microcontroller (115200 bps) n MAX232 –level shifter n ALPHAUNUMERIC LCD display n LED indicators n ID CARD interface

DAU - features
is

Data Acquisition Unit

n
Atmel 89C52 microcontroll er Jazz Multisensor

Bluetoot h

n

n

n

Lightweight Runs on batteries low power consumption Easy to use - does not disturb the operator working ID cards for operator authorization

DAU - components
microphone earphone

MC 145483 PCM codec Jazz Multisensor Beeper LCD display LED indicators Simple keyboar d

Atmel 89C52 microcontroller
UART

MAX2 32

BlueEyes
ID card interface
ID card
Data Acquisition Unit

UART

Bluetoot h modul

Microcontroller & blue tooth module

EEPROMS & the PCB

Implementation - DAU
n


n n

Made from scratch by the team

n

n n

n

Bluetooth module inside Jazz sensor interface Microphone and earphone sockets 5-key keyboard Two lines, 8 characters LCD Powered from 6 AA batteries

Implementation - DAU
PCM codec board Microcontroller board

Batteries and Bluetooth module voltage level monitor

CSU - features
n

n

n n n

n

Connection management Bluetoo th Data processing Visualization Data recording Access verification System maintenance

Central System Unit
Connection Manager Data Analysis Visualizati on Module Data Logger

CSU – components
n

n

n

n

CONNECTION MANAGER – main task to perform low-level blue tooth communication DATA ANALYSIS MODULE – performs the analysis of the raw sensor data in order to obtain information about operator’s physiological condition DATA LOGGER MODULE – provides support for storing the monitored data. VISULAIZATION MODULE – provides user interface for the supervisors

CSU - Visualization Module
n

Raw and processed data visualization using:
– – – VU-meters pie-charts time series

n

audio and video data playback

CSU - saccade detector
n

Saccade detector and conscious brain involvement level calculation
Raw eye movement data
Eye movement velocity 250 200 150 100 50 0 -50 -100 -150 -200 -250 0 8000 16000
Time [ms]

Differentiation

Velocity

24000

32000

Visual attention level
60 Attention level (Lva) 50 40 30 20 10 0 0 8000 16000 Time [ms] 24000 32000

Conscious brain involvement level

CSU - Connection Manager
Operator Data Manager

• •

Bluetoo th

... ...

Bluetooth Connection Manager

Inquires for new devices in range Raw • Establishes connections Separated Data • Operator Supports operator data streams Buffer Manager roamingAlert Alerts buffer • Feeds Operator Manager ... with physiological data ...

•Data demultiplexer modules •Data producer queues

Initializes Bluetooth

Bluetoo th

Operator Manager

Raw Data Buffer Alert buffer

Alerts

CSU - Data Analysis
• Custom data analyzers - decision tree based classifiers • Automatic decision tree coefficients generation - C4.5 based algorithm
Assigned category
“Yes” No ... answer “Yes” “No” No answer

Data samples

...

Decision tree coefficients

CSU - Data Analysis
n

Custom data analyzers - decision tree based classifiers
Example: Operator gesture recognition
(simplified) Vertical Acceleration variance value high Horizontal Acceleration variance high

Y Y

N
Horizontal Acceleration variance high

N
“YES”

N

Y
“NO”

No answer

CSU - intermodule communication
n

Uses buffered thread-safe queues and producer-consumer scheme
register at
Data consumer

creates Data producer

Data queue

Data Data consumer & Processing consumer producer

D ata q ueu e D ata q ueu e

Data consumer

Data Data consumer & Processing consumer producer

CSU - intermodule communication
Connection Connection Manager Manager Operator manager Operator manager (OM) (OM) Alerts

... ...

O O M M

O O M M

Separated physiological data streams

Data Analysis Data Analysis

Visualization Visualization Module Module

Data Logger

Processed data

Recorded (off-line) data

Implementation - CSU
• Standard MDI user interface
n

n n n n

Custom-built Bluetooth communication routines Intel USB camera ID card programmer Developed using Visual C++ 6.0 Deployment environment: Windows 2000, MS SQL Server

Future improvements
DAU small CMOS camera to monitor the operator’s point of gaze single PCB (SMD technology) low voltage ICs - LiIO batteries power CSU data mining algorithms advanced database encryption using e.g. AES algorithm

Data security
n

n n n n

Only registered mobile devices can connect to the system Bluetooth connection authentication Bluetooth connection encryption Access rights restrictions Personal and physiological data encryption

App licat ions of Blue Eyes
n

Generic control rooms

(System can be applied in every working
environment requiring permanent operator’s attention) – Power station – Captain bridge – Flight control centers – Operating theatres – anesthesiologists

Blue E yes - benefits
n n

Prevention from dangerous incidents Minimization of
– – – ecological consequences financial loss a threat to a human life

n

The reconstruction of the course of operator’s work

References
n n n n n n

www.seminar4u.com www.howstuffswork.com www.cs.put.poznan.com www.whitepapers.com www.ibmresearchcenter.com www.almaden.ibm.com

Conclusion
n

n

In the near future ,ordinary household devices- such as television , refrigerators ,ovens may be able to do their jobs when we look at them and speak to them. Future applications of blue eye technology is limitless

Thank you

You're Reading a Free Preview

Download
scribd
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->