P. 1
Blue Eyes Technology

Blue Eyes Technology

4.5

|Views: 4,757|Likes:
Published by SUNIL
Contact:sunil_cp@hotmail.com
Contact:sunil_cp@hotmail.com

More info:

Categories:Types, Research
Published by: SUNIL on Mar 04, 2009
Copyright:Attribution Non-commercial
List Price: $4.99 Buy Now

Availability:

Read on Scribd mobile: iPhone, iPad and Android.
See more
See less

12/31/2015

$4.99

USD

pdf

text

original

INFORMATION SEARCH AND ANALYSIS

SKILL
SEMINAR ON
BLUE EYES TECHNOLOGY
NAME :
BATCH CODE :
REGISTRATION NO :
DATE :
HEAD OF CENTRE CO-ORDINATOR

ACKNOWLEDGEMENT
I thank the almighty God the light o! my
li!e !o" g"anting me the #t"ength $o%"age and kno&ledge to
$om'lete thi# ISAS #%$$e##!%lly(
I &i#h to 'la$e on "e$o"d my '"o!o%nd g"atit%de to M"#(S&a'na !o"
ha)ing gi)en me the o''o"t%nitie# to $om'lete thi# ISAS
#%$$e##!%lly(
I #in$e"ely thank my g%ide ********** !o" hi# )al%a+le g%idan$e
and #%''o"t( I thank !o" timely #%gge#tion# and $on#tant
en$o%"agement that +oo#ted %' my mo"ale and led to the
a$$om'li#hment o! thi# ISAS(
I e,tend my thank# to all tea$hing and non-tea$hing #ta!! &ho &e"e
al&ay# "eady to hel' me to "ea$h my ta#k(
I am inde+ted to my 'a"ent# !"iend# and "elati)e# !o" thei"
'hy#i$al '#y$hologi$al and mo"al #%''o"t e,tended +y them at all
time(

TABLE OF CONTENTS
-( INTROD.CTION
/( EMOTION AND COM0.TING

1( THEORIES AND TECHNO2OGIES
1(- 0A.2 E3MAN4S FACIA2 E50RESSION
1(/ MAN.A2 AND GA6E IN0.T CASCADED 7MAGIC8
0OINTING
1(/(- IM02IMENTATION
1(1 ARTIFICIA2 INTE22IGENT S0EECH
RECOGNITION
1(1(- THE TECHNO2OG9
1(1(/ S0EECH RECOGNITION
1(: THE SIM02E .SER INTERST TRAC3ER 7S.ITOR8
:( 0O6NAN B2.EE9ES
:(- S9STEM O;ER;IE<
:(/ TOO2S DE;E2O0ED
=( A002ICATIONS
>( CONC2.SION
-(INTROD.CTION
Imagine yo%"#el! in a &o"ld &he"e h%man# inte"a$t
&ith $om'%te"#( 9o% a"e #itting in !"ont o! yo%" 'e"#onal $om'%te" that $an
li#ten talk o" e)en #$"eam alo%d( It ha# the a+ility to gathe" in!o"mation
a+o%t yo% and inte"a$t &ith yo% th"o%gh #'e$ial te$hni?%e# like !a$ial
"e$ognition #'ee$h "e$ognition et$( It $an e)en %nde"#tand yo%" emotion# at
the to%$h o! the mo%#e( It )e"i!ie# yo%" identity !eel# yo%" '"e#ent# and
#ta"t# inte"a$ting &ith yo% (9o% a#k the $om'%te" to dial to yo%" !"iend at hi#
o!!i$e( It "eali@e# the %"gen$y o! the #it%ation th"o%gh the mo%#e dial# yo%"
!"iend at hi# o!!i$e and e#ta+li#he# a $onne$tion(
H%man $ognition de'end# '"ima"ily on the a+ility to
'e"$ei)e inte"'"et and integ"ate a%dio-)i#%al# and #en#o"ing in!o"mation(
Adding e,t"ao"dina"y 'e"$e't%al a+ilitie# to $om'%te"# &o%ld ena+le
$om'%te"# to &o"k togethe" &ith h%man +eing# a# intimate 'a"tne"#(
Re#ea"$he"# a"e attem'ting to add mo"e $a'a+ilitie# to $om'%te"# that &ill
allo& them to inte"a$t like h%man# "e$ogni@e h%man '"e#ent# talk li#ten o"
e)en g%e## thei" !eeling#(
The B2.EE9ES te$hnology aim# at $"eating
$om'%tational ma$hine# that ha)e 'e"$e't%al and #en#o"y a+ility like tho#e
o! h%man +eing#( It %#e# non-o+t"%#ige #en#ing method em'loying mo#t
mode"n )ideo $ame"a# and mi$"o'hone# to identi!y the %#e"4# a$tion#
th"o%gh the %#e o! im'a"ted #en#o"y a+ilitie#( The ma$hine $an %nde"#tand
&hat a %#e" &ant# &he"e he i# looking at and e)en "eali@e hi# 'hy#i$al o"
emotional #tate#(
/( EMOTION AND COM0.TING
One goal o! h%man $om'%te" inte"a$tion 7HCI8 i# to make
an ada'ti)e #ma"t $om'%te" #y#tem( Thi# ty'e o! '"oAe$t $o%ld 'o##i+ly
in$l%de ge#t%"e "e$ognition !a$ial "e$ognition eye t"a$king #'ee$h
"e$ognition et$( Anothe" non-in)a#i)e &ay to o+tain in!o"mation a+o%t a
'e"#on i# th"o%gh to%$h( 0eo'le %#e thei" $om'%te"# to o+tain #to"e and
mani'%late data %#ing thei" $om'%te"( In o"de" to #ta"t $"eating #ma"t
$om'%te"# the $om'%te" m%#t #ta"t gaining in!o"mation a+o%t the %#e"( O%"
'"o'o#ed method !o" gaining %#e" in!o"mation th"o%gh to%$h i# )ia a
$om'%te" in'%t de)i$e the mo%#e( F"om the 'hy#iologi$al data o+tained
!"om the %#e" an emotional #tate may +e dete"mined &hi$h &o%ld then +e
"elated to the ta#k the %#e" i# $%""ently doing on the $om'%te"( O)e" a 'e"iod
o! time a %#e" model &ill +e +%ilt in o"de" to gain a #en#e o! the %#e"B#
'e"#onality( The #$o'e o! the '"oAe$t i# to ha)e the $om'%te" ada't to the
%#e" in o"de" to $"eate a +ette" &o"king en)i"onment &he"e the %#e" i# mo"e
'"od%$ti)e( The !i"#t #te'# to&a"d# "eali@ing thi# goal a"e de#$"i+ed he"e(
Ro#alind 0i$a"d 7-CCD8 de#$"i+e# &hy emotion# a"e
im'o"tant to the $om'%ting $omm%nity( The"e a"e t&o a#'e$t# o! a!!e$ti)e
$om'%ting: gi)ing the $om'%te" the a+ility to dete$t emotion# and gi)ing the
$om'%te" the a+ility to e,'"e## emotion#( Not only a"e emotion# $"%$ial !o"
"ational de$i#ion making a# 0i$a"d de#$"i+e# +%t emotion dete$tion i# an
im'o"tant #te' to an ada'ti)e $om'%te" #y#tem( An ada'ti)e #ma"t $om'%te"
#y#tem ha# +een d"i)ing o%" e!!o"t# to dete$t a 'e"#on4# emotional #tate( An
im'o"tant element o! in$o"'o"ating emotion into $om'%ting i# !o"
'"od%$ti)ity !o" a $om'%te" %#e"( A #t%dy 7D"ye" E Ho"o&it@ -CCD8 ha#
#ho&n that 'eo'le &ith 'e"#onalitie# that a"e #imila" o" $om'lement ea$h
othe" $olla+o"ate &ell( D"ye" 7-CCC8 ha# al#o #ho&n that 'eo'le )ie& thei"
$om'%te" a# ha)ing a 'e"#onality( Fo" the#e "ea#on# it i# im'o"tant to
de)elo' $om'%te"# &hi$h $an &o"k &ell &ith it# %#e"( By mat$hing a
'e"#on4# emotional #tate and the $onte,t o! the e,'"e##ed emotion o)e" a
'e"iod o! time the 'e"#on4# 'e"#onality i# +eing e,hi+ited( The"e!o"e +y
gi)ing the $om'%te" a longit%dinal %nde"#tanding o! the emotional #tate o!
it# %#e" the $om'%te" $o%ld ada't a &o"king #tyle &hi$h !it# &ith it# %#e"4#
'e"#onality( The "e#%lt o! thi# $olla+o"ation $o%ld in$"ea#e '"od%$ti)ity !o"
the %#e"( One &ay o! gaining in!o"mation !"om a %#e" non-int"%#i)ely i# +y
)ideo( Came"a# ha)e +een %#ed to dete$t a 'e"#on4# emotional #tate
7Fohn#on -CCC8( <e ha)e e,'lo"ed gaining in!o"mation th"o%gh to%$h( One
o+)io%# 'la$e to '%t #en#o"# i# on the mo%#e( Th"o%gh o+#e")ing no"mal
$om'%te" %#age 7$"eating and editing do$%ment# and #%"!ing the &e+8
'eo'le #'end a''"o,imately -G1 o! thei" total $om'%te" time to%$hing thei"
in'%t de)i$e( Be$a%#e o! the in$"edi+le amo%nt o! time #'ent to%$hing an
in'%t de)i$e &e &ill e,'lo"e the 'o##i+ility o! dete$ting emotion th"o%gh
to%$h(
1( THEORIES AND TECHNO2OGIES
1(- 0A.2 E3MAN4S FACIA2 E50RESSION
Ba#ed on 0a%l Ekman4# !a$ial e,'"e##ion &o"k &e #ee a
$o""elation +et&een a 'e"#on4# emotional #tate and a 'e"#on4# 'hy#iologi$al
mea#%"ement#( Sele$ted &o"k# !"om Ekman and othe"# on mea#%"ing !a$ial
+eha)io"# de#$"i+e Ekman4# Fa$ial A$tion Coding Sy#tem 7Ekman and
Ro#en+e"g -CCD8( One o! hi# e,'e"iment# in)ol)ed 'a"ti$i'ant# atta$hed to
de)i$e# to "e$o"d $e"tain mea#%"ement# in$l%ding '%l#e gal)ani$ #kin
"e#'on#e 7GSR8 tem'e"at%"e #omati$ mo)ement and +lood '"e##%"e( He
then "e$o"ded the mea#%"ement# a# the 'a"ti$i'ant# &e"e in#t"%$ted to mimi$
!a$ial e,'"e##ion# &hi$h $o""e#'onded to the #i, +a#i$ emotion#( He de!ined
the #i, +a#i$ emotion# a# ange" !ea" #adne## di#g%#t Aoy and #%"'"i#e( F"om
thi# &o"k D"ye" 7-CC18 dete"mined ho& 'hy#iologi$al mea#%"e# $o%ld +e
%#ed to di#ting%i#h )a"io%# emotional #tate#(
Si, 'a"ti$i'ant# &e"e t"ained to e,hi+it the !a$ial
e,'"e##ion# o! the #i, +a#i$ emotion#( <hile ea$h 'a"ti$i'ant e,hi+ited the#e
e,'"e##ion# the 'hy#iologi$al $hange# a##o$iated &ith a!!e$t &e"e a##e##ed(
The mea#%"e# taken &e"e GSR hea"t "ate #kin tem'e"at%"e and gene"al
#omati$ a$ti)ity 7GSA8( The#e data &e"e then #%+Ae$t to t&o analy#e#( Fo"
the !i"#t analy#i# a m%ltidimen#ional #$aling 7MDS8 '"o$ed%"e &a# %#ed to
dete"mine the dimen#ionality o! the data( Thi# analy#i# #%gge#ted that the
'hy#iologi$al #imila"itie# and di##imila"itie# o! the #i, emotional #tate# !it
&ithin a !o%" dimen#ional model( Fo" the #e$ond analy#i# a di#$"iminant
!%n$tion analy#i# &a# %#ed to dete"mine the mathemati$ !%n$tion# that &o%ld
di#ting%i#h the #i, emotional #tate#( Thi# analy#i# #%gge#ted that all !o%"
'hy#iologi$al )a"ia+le# made #igni!i$ant non"ed%ndant $ont"i+%tion# to the
!%n$tion# that di#ting%i#h the #i, #tate#( Mo"eo)e" the#e analy#e# indi$ate
that the#e !o%" 'hy#iologi$al mea#%"e# a"e #%!!i$ient to dete"mine "elia+ly a
'e"#on4# #'e$i!i$ emotional #tate( Be$a%#e o! o%" need to in$o"'o"ate the#e
mea#%"ement# into a #mall non-int"%#i)e !o"m &e &ill e,'lo"e taking the#e
mea#%"ement# !"om the hand( The amo%nt o! $ond%$ti)ity o! the #kin i# +e#t
taken !"om the !inge"#( Ho&e)e" the othe" mea#%"e# may not +e a# o+)io%#
o" "o+%#t( <e hy'othe#i@e that $hange# in the tem'e"at%"e o! the !inge" a"e
"elia+le !o" '"edi$tion o! emotion( <e al#o hy'othe#i@e the GSA $an +e
mea#%"ed +y $hange in mo)ement in the $om'%te" mo%#e( O%" e!!o"t# to
de)elo' a "o+%#t '%l#e mete" a"e not di#$%##ed he"e(
1(/ MAN.A2 AND GA6E IN0.T CASCADED 7MAGIC8 0OINTING
Thi# &o"k e,'lo"e# a ne& di"e$tion in %tili@ing eye ga@e
!o" $om'%te" in'%t( Ga@e t"a$king ha# long +een $on#ide"ed a# an alte"nati)e
o" 'otentially #%'e"io" 'ointing method !o" $om'%te" in'%t( <e +elie)e that
many !%ndamental limitation# e,i#t &ith t"aditional ga@e 'ointing( In
'a"ti$%la" it i# %nnat%"al to o)e"load a 'e"$e't%al $hannel #%$h a# )i#ion
&ith a moto" $ont"ol ta#k( <e the"e!o"e '"o'o#e an alte"nati)e a''"oa$h
d%++ed MAGIC 7Man%al And Ga@e In'%t Ca#$aded8 'ointing( <ith #%$h an
a''"oa$h 'ointing a''ea"# to the %#e" to +e a man%al ta#k %#ed !o" !ine
mani'%lation and #ele$tion( Ho&e)e" a la"ge 'o"tion o! the $%"#o"
mo)ement i# eliminated +y &a"'ing the $%"#o" to the eye ga@e a"ea &hi$h
en$om'a##e# the ta"get( T&o #'e$i!i$ MAGIC 'ointing te$hni?%e# one
$on#e")ati)e and one li+e"al &e"e de#igned analy@ed and im'lemented
&ith an eye t"a$ke" &e de)elo'ed( They &e"e then te#ted in a 'ilot #t%dy(
Thi# ea"ly #tage e,'lo"ation #ho&ed that the MAGIC 'ointing te$hni?%e#
might o!!e" many ad)antage# in$l%ding "ed%$ed 'hy#i$al e!!o"t and !atig%e
a# $om'a"ed to t"aditional man%al 'ointing g"eate" a$$%"a$y and nat%"alne##
than t"aditional ga@e 'ointing and 'o##i+ly !a#te" #'eed than man%al
'ointing( The '"o# and $on# o! the t&o te$hni?%e# a"e di#$%##ed in light o!
+oth 'e"!o"man$e data and #%+Ae$ti)e "e'o"t#(
1(/(-(IM02IMENTATION
The MAGIC 'ointing '"og"am take# data !"om +oth the
man%al in'%t de)i$e 7o! any ty'e #%$h a# a mo%#e8 and the eye t"a$king
#y#tem "%nning eithe" on the #ame ma$hine o" on anothe" ma$hine $onne$ted
)ia #e"ial 'o"t( Ra& data !"om an eye t"a$ke" $an not +e di"e$tly %#ed !o"
ga@e-+a#ed inte"a$tion d%e to noi#e !"om image '"o$e##ing eye mo)ement
Aitte"# and #am'le# taken d%"ing #a$$ade 7+alli#ti$ eye mo)ement8 'e"iod#(
<e e,'e"imented &ith )a"io%# !ilte"ing te$hni?%e# and !o%nd the mo#t
e!!e$ti)e !ilte" in o%" $a#e i# #imila" to that de#$"i+ed( The goal o! !ilte"
de#ign in gene"al i# to make the +e#t $om'"omi#e +et&een '"e#e")ing #ignal
+and&idth and eliminating %n&anted noi#e( In the $a#e o! eye t"a$king a#
Fa$o+ a"g%ed eye in!o"mation "ele)ant to inte"a$tion lie# in the !i,ation#(
The key i# to #ele$t !i,ation 'oint# &ith minimal delay( Sam'le# $olle$ted
d%"ing a #a$$ade a"e %n&anted and #ho%ld +e a)oided( In de#igning o%"
algo"ithm !o" 'i$king 'oint# o! !i,ation &e $on#ide"ed o%" t"a$king #y#tem
#'eed 71H H@8 and that the MAGIC 'ointing te$hni?%e# %tili@e ga@e
in!o"mation only on$e !o" ea$h ne& ta"get '"o+a+ly immediately a!te" a
#a$$ade( O%" !ilte"ing algo"ithm &a# de#igned to 'i$k a !i,ation &ith
minim%m delay +y mean# o! #ele$ting t&o adAa$ent 'oint# o)e" t&o #am'le#(
1(1 ARTIFICIA2 INTE22IGENT S0EECH RECOGNITION
It i# im'o"tant to $on#ide" the en)i"onment in &hi$h the
#'ee$h "e$ognition #y#tem ha# to &o"k( The g"amma" %#ed +y the #'eake"
and a$$e'ted +y the #y#tem noi#e le)el noi#e ty'e 'o#ition o! the
mi$"o'hone and #'eed and manne" o! the %#e"4# #'ee$h a"e #ome !a$to"#
that may a!!e$t the ?%ality o! #'ee$h "e$ognition (<hen yo% dial the
tele'hone n%m+e" o! a +ig $om'any yo% a"e likely to hea" the #ono"o%#
)oi$e o! a $%lt%"ed lady &ho "e#'ond# to yo%" $all &ith g"eat $o%"te#y #aying
I<el$ome to $om'any 5( 0lea#e gi)e me the e,ten#ion n%m+e" yo% &antJ(
9o% '"ono%n$e the e,ten#ion n%m+e" yo%" name and the name o! 'e"#on
yo% &ant to $onta$t( I! the $alled 'e"#on a$$e't# the $all the $onne$tion i#
gi)en ?%i$kly( Thi# i# a"ti!i$ial intelligen$e &he"e an a%tomati$ $all-handling
#y#tem i# %#ed &itho%t em'loying any tele'hone o'e"ato"(
1(1(-THETECHNO2OG9
A"ti!i$ial intelligen$e 7AI8 in)ol)e# t&o +a#i$ idea#( Fi"#t
it in)ol)e# #t%dying the tho%ght '"o$e##e# o! h%man +eing#( Se$ond it deal#
&ith "e'"e#enting tho#e '"o$e##e# )ia ma$hine# 7like $om'%te"# "o+ot# et$8(
AI i# +eha)io" o! a ma$hine &hi$h i! 'e"!o"med +y a h%man +eing &o%ld
+e $alled intelligent( It make# ma$hine# #ma"te" and mo"e %#e!%l and i# le##
e,'en#i)e than nat%"al intelligen$e( Nat%"al lang%age '"o$e##ing 7N208
"e!e"# to a"ti!i$ial intelligen$e method# o! $omm%ni$ating &ith a $om'%te" in
a nat%"al lang%age like Engli#h( The main o+Ae$ti)e o! a N20 '"og"am i# to
%nde"#tand in'%t and initiate a$tion( The in'%t &o"d# a"e #$anned and
mat$hed again#t inte"nally #to"ed kno&n &o"d#( Identi!i$ation o! a key &o"d
$a%#e# #ome a$tion to +e taken( In thi# &ay one $an $omm%ni$ate &ith the
$om'%te" in one4# lang%age( No #'e$ial $ommand# o" $om'%te" lang%age a"e
"e?%i"ed( The"e i# no need to ente" '"og"am# in a #'e$ial lang%age
!o"$"eating #o!t&a"e(
1(1(/ S0EECH RECOGNITION
The %#e" #'eak# to the $om'%te" th"o%gh a mi$"o'hone
&hi$h in %#edK a #im'le #y#tem may $ontain a minim%m o! th"ee !ilte"#( The
mo"e the n%m+e" o! !ilte"# %#ed the highe" the '"o+a+ility o! a$$%"ate
"e$ognition( 0"e#ently #&it$hed $a'a$ito" digital !ilte"# a"e %#ed +e$a%#e
the#e $an +e $%#tom-+%ilt in integ"ated $i"$%it !o"m( The#e a"e #malle" and
$hea'e" than a$ti)e !ilte"# %#ing o'e"ational am'li!ie"#( The !ilte" o%t'%t i#
then !ed to the ADC to t"an#late the analog%e #ignal into digital &o"d( The
ADC #am'le# the !ilte" o%t'%t# many time# a #e$ond( Ea$h #am'le
"e'"e#ent# di!!e"ent am'lit%de o! the #ignal (E)enly #'a$ed )e"ti$al line#
"e'"e#ent the am'lit%de o! the a%dio !ilte" o%t'%t at the in#tant o! #am'ling(
Ea$h )al%e i# then $on)e"ted to a +ina"y n%m+e" '"o'o"tional to the
am'lit%de o! the #am'le( A $ent"al '"o$e##o" %nit 7C0.8 $ont"ol# the in'%t
$i"$%it# that a"e !ed +y the ADCS( A la"ge RAM 7"andom a$$e## memo"y8
#to"e# all the digital )al%e# in a +%!!e" a"ea( Thi# digital in!o"mation
"e'"e#enting the #'oken &o"d i# no& a$$e##ed +y the C0. to '"o$e## it
!%"the"( The no"mal #'ee$h ha# a !"e?%en$y "ange o! /HH H@ to D kH@(
Re$ogni@ing a tele'hone $all i# mo"e di!!i$%lt a# it ha# +and&idth limitation
o! 1HH H@ to1(1 kH@(A# e,'lained ea"lie" the #'oken &o"d# a"e '"o$e##ed
+y the !ilte"# and ADC#( The +ina"y "e'"e#entation o! ea$h o! the#e &o"d#
+e$ome# a tem'late o" #tanda"d again#t &hi$h the !%t%"e &o"d# a"e
$om'a"ed( The#e tem'late# a"e #to"ed in the memo"y( On$e the #to"ing
'"o$e## i# $om'leted the #y#tem $an go into it# a$ti)e mode and i# $a'a+le
o! identi!ying #'oken &o"d#( A# ea$h &o"d i# #'oken it i# $on)e"ted into
+ina"y e?%i)alent and #to"ed in RAM( The $om'%te" then #ta"t# #ea"$hing
and $om'a"e# the +ina"y in'%t 'atte"n &ith the tem'late#( t i# to +e noted
that e)en i! the #ame #'eake" talk# the #ame te,t the"e a"e al&ay# #light
)a"iation# in am'lit%de o" lo%dne## o! the #ignal 'it$h !"e?%en$y di!!e"en$e
time ga' et$( D%e to thi# "ea#on the"e i# ne)e" a 'e"!e$t mat$h +et&een the
tem'late and +ina"y in'%t &o"d( The 'atte"n mat$hing '"o$e## the"e!o"e %#e#
#tati#ti$al te$hni?%e# and i# de#igned to look !o" the +e#t !it(
The )al%e# o! +ina"y in'%t &o"d# a"e #%+t"a$ted
!"om the $o""e#'onding )al%e# in the tem'late#( I! +oth the )al%e# a"e #ame
the di!!e"en$e i# @e"o and the"e i# 'e"!e$t mat$h( I! not the #%+t"a$tion
'"od%$e# #ome di!!e"en$e o" e""o"( The #malle" the e""o" the +ette" the
mat$h( <hen the +e#t mat$h o$$%"# the &o"d i# identi!ied and di#'layed on
the #$"een o" %#ed in #ome othe" manne"( The #ea"$h '"o$e## take# a
$on#ide"a+le amo%nt o! time a# the C0. ha# to make many $om'a"i#on#
+e!o"e "e$ognition o$$%"#( Thi# ne$e##itate# %#e o! )e"y high-#'eed
'"o$e##o"#( A la"ge RAM i# al#o "e?%i"ed a# e)en tho%gh a #'oken &o"d may
la#t only a !e& h%nd"ed milli#e$ond# +%t the #ame i# t"an#lated into many
tho%#and# o! digital &o"d#( It i# im'o"tant to note that alignment o! &o"d#
and tem'late# a"e to +e mat$hed $o""e$tly in time +e!o"e $om'%ting the
#imila"ity #$o"e( Thi# '"o$e## te"med a# dynami$ time &a"'ing "e$ogni@e#
that di!!e"ent #'eake"# '"ono%n$e the #ame &o"d# at di!!e"ent #'eed# a# &ell
a# elongate di!!e"ent 'a"t# o! the #ame &o"d( Thi# i# im'o"tant !o" the
#'eake"-inde'endent "e$ogni@e"#(
1(: THE SIM02E.SER INTERST TRAC3ER 7S.ITOR8
Com'%te"# &o%ld ha)e +een m%$h mo"e 'o&e"!%l
had they gained 'e"$e't%al and #en#o"y a+ilitie# o! the li)ing +eing# on the
ea"th( <hat need# to +e de)elo'ed i# an intimate "elation#hi' +et&een the
$om'%te" and the h%man#( And the Sim'le .#e" Inte"e#t T"a$ke" 7S.ITOR8
i# a "e)ol%tiona"y a''"oa$h in thi# di"e$tion(
By o+#e")ing the <e+'age a neti@en i# +"o&#ing the S.ITOR $an hel' +y
!et$hing mo"e in!o"mation at hi# de#kto'( By #im'ly noti$ing &he"e the
%#e"4# eye# !o$%# on the $om'%te" #$"een the S.ITOR $an +e mo"e '"e$i#e
in dete"mining hi# to'i$ o! inte"e#t( It $an e)en deli)e" "ele)ant in!o"mation
to a handheld de)i$e( The #%$$e## lie# in ho& m%$h the #%ito" $an +e
intimate to the %#e"( IBMB# Bl%eEye# "e#ea"$h '"oAe$t +egan &ith a #im'le
?%e#tion a$$o"ding to My"on Fli$kne" a manage" in AlmadenB# .SER
g"o%': Can &e e,'loit non)e"+al $%e# to $"eate mo"e e!!e$ti)e %#e"
inte"!a$e#L One #%$h $%e i# ga@eMthe di"e$tion in &hi$h a 'e"#on i# looking(
Fli$kne" and hi# $olleag%e# ha)e $"eated #ome ne& te$hni?%e# !o" t"a$king a
'e"#onB# eye# and ha)e in$o"'o"ated thi# ga@e-t"a$king te$hnology into t&o
'"ototy'e#( One $alled S.ITOR 7Sim'le .#e" Inte"e#t T"a$ke"8 !ill# a
#$"olling ti$ke" on a $om'%te" #$"een &ith in!o"mation "elated to the %#e"B#
$%""ent ta#k( S.ITOR kno&# &he"e yo% a"e looking &hat a''li$ation# yo%
a"e "%nning and &hat <e+ 'age# yo% may +e +"o&#ing( NI! IBm "eading a
<e+ 'age a+o%t IBM !o" in#tan$eN #ay# 0a%l Maglio the Almaden
$ogniti)e #$ienti#t &ho in)ented S.ITOR Nthe #y#tem '"e#ent# the late#t
#to$k '"i$e o" +%#ine## ne&# #to"ie# that $o%ld a!!e$t IBM( I! I "ead the
headline o!! the ti$ke" it 'o'# %' the #to"y in a +"o&#e" &indo&( I! I #ta"t to
"ead the #to"y it add# "elated #to"ie# to the ti$ke"( ThatB# the &hole idea o! an
attenti)e #y#temMone that attend# to &hat yo% a"e doing ty'ing "eading #o
that it $an attend to yo%" in!o"mation need#(N
:( 0O6NAN B2.EE9ES
The #y#tem de)elo'ed +y 0o@nan .ni)e"#ity o!
Te$hnology i# intended to +e the $om'le, #ol%tion !o" monito"ing and
"e$o"ding the o'e"ato"4# $on#$io%# +"ain in)ol)ement a# &ell a# hi#
'hy#iologi$al $ondition( Thi# "e?%i"ed de#igning a 0e"#onal A"ea Net&o"k
linking all the o'e"ato"# and the #%'e")i#ing #y#tem( A# the o'e"ato" %#ing
hi# #ight and hea"ing #en#e# the #tate o! the $ont"olled #y#tem the
#%'e")i#ing #y#tem &ill look a!te" hi# 'hy#iologi$al $ondition(
:(- S9STEM O;ER;IE<
B2.EE9ES #y#tem '"o)ide# te$hni$al mean# !o"
monito"ing and "e$o"ding the o'e"ato"4# +a#i$ 'hy#iologi$al 'a"amete"#( The
mo#t im'o"tant 'a"amete" i# #a$$adi$ a$ti)ity- &hi$h ena+le# the #y#tem to
monito" the #tat%# o! the o'e"ato"4# )i#%al attention along &ith head
a$$ele"ation &hi$h a$$om'anie# la"ge di#'la$ement o! the )i#%al a,i#
7#a$$ade# la"ge" than -= deg"ee#8( Com'le, ind%#t"ial en)i"onment $an
$"eate a dange" o! e,'o#ing the o'e"ato" to to,i$ #%+#tan$e# &hi$h $an
a!!e$t hi# $a"dia$ $i"$%lato"y and '%lmona"y #y#tem#( Th%# on the g"o%nd#
o! lethy#mog"a'hi$ #ignal taken !"om the !o"ehead #kin #%"!a$e the #y#tem
$om'%te# hea"t +eat "ate and +lood o,ygenation( The B2.EE9ES #y#tem
$he$k# a+o)e 'a"amete"# again#t a+no"mal 7e(g( a lo& le)el o! +lood
o,ygenation o" a high '%l#e "ate8 o" %nde#i"a+le 7e(g( a longe" 'e"iod o!
lo&e"ed )i#%al attention8 )al%e# and t"igge"# %#e"-de!ined ala"m# &hen
ne$e##a"y( O%ite o!ten in an eme"gen$y #it%ation o'e"ato"# #'eak to
them#el)e# e,'"e##ing thei" #%"'"i#e o" #tating )e"+ally the '"o+lem(
The"e!o"e the o'e"ato"4# )oi$e 'hy#iologi$al 'a"amete"# and an o)e"all
)ie& o! the o'e"ating "oom a"e "e$o"ded( Thi# hel'# to "e$on#t"%$t the $o%"#e
o! o'e"ato"#4 &o"k and '"o)ide# data !o" long-te"m analy#i#( Thi# #y#tem
$on#i#t# o! a mo+ile mea#%"ing de)i$e and a $ent"al analyti$al #y#tem( The
mo+ile de)i$e i# integ"ated &ith Bl%etooth mod%le '"o)iding &i"ele##
inte"!a$e +et&een #en#o"# &o"n +y the o'e"ato" and the $ent"al %nit( ID $a"d#
a##igned to ea$h o! the o'e"ato"# and ade?%ate %#e" '"o!ile# on the $ent"al
%nit #ide '"o)ide ne$e##a"y data 'e"#onali@ation #o di!!e"ent 'eo'le $an %#e a
#ingle mo+ile de)i$e(
:(/ TOO2S DE;E2O0ED
In $"eating the ha"d&a"e 'a"t o! the DA. &e +%ilt a de)elo'ment +oa"d
&hi$h ena+led %# to mo%nt $onne$t and te#t )a"io%# 'e"i'he"al de)i$e#
$oo'e"ating &ith the mi$"o$ont"olle"(D%"ing the im'lementation o! the DA.
&e needed a 'ie$e o! #o!t&a"e to e#ta+li#h and te#t Bl%etooth $onne$tion#(
<e the"e!o"e $"eated a tool $alled Bl%eDenti#t( The tool '"o)ide# #%''o"t !o"
$ont"olling the $%""ently $onne$ted Bl%etooth de)i$e( It# !%n$tion# a"e: lo$al
de)i$e management 7"e#etting "eading lo$al BDPADDR '%tting in
In?%i"yG0age and In?%i"yG0age #$an mode# "eading the li#t o! lo$ally
#%''o"ted !eat%"e# and #etting .ART #'eed8 and $onne$tion management
7"e$ei)ing and di#'laying In?%i"y #$an "e#%lt# e#ta+li#hing AC2 link#
adding SCO $onne$tion# 'e"!o"ming link a%tho"i@ation '"o$ed%"e #ending
te#t data 'a$ket# and di#$onne$ting8(To te#t the 'o##i+ilitie# and 'e"!o"man$e
o! the "emaining 'a"t# o! the 0"oAe$t 3it 7$om'%te" $ame"a and data+a#e
#o!t&a"e8 &e $"eated Bl%eCa't%"e The tool #%''o"t# $a't%"ing )ideo data
!"om )a"io%# #o%"$e# 7.SB &e+-$am ind%#t"ial $ame"a8 and #to"ing the data
in the MS SO2 Se")e" data+a#e( Additionally the a''li$ation 'e"!o"m#
#o%nd "e$o"ding( A!te" !ilte"ing and "emo)ing in#igni!i$ant !"agment# 7i(e(
#ilen$e8 the a%dio data i# #to"ed in the data+a#e( Finally the '"og"am 'lay#
the "e$o"ded a%dio)i#%al #t"eam( <e %#ed the #o!t&a"e to mea#%"e data+a#e
#y#tem 'e"!o"man$e and to o'timi@e #ome o! the SO2 ?%e"ie# 7e(g( &e
"e'la$ed $o""elated SO2 ?%e"ie# &ith $%"#o" o'e"ation#8( Sin$e all the
$om'onent# o! the a''li$ation ha)e +een te#ted tho"o%ghly they &e"e "e%#ed
in the !inal #o!t&a"e &hi$h additionally "ed%$ed te#ting time(<e al#o
$"eated a #im'le tool !o" "e$o"ding Fa@@ M%lti#en#o" mea#%"ement#( The
'"og"am "ead# the data %#ing a 'a"allel 'o"t and &"ite# it to a !ile(To '"og"am
the o'e"ato"4# 'e"#onal ID $a"d &e %#e a #tanda"d 'a"allel 'o"t a# the
E0ROM# and the 'o"t a"e +oth TT2-$om'liant( A #im'le dialog-+a#ed
a''li$ation hel'# to a$$om'li#h the ta#k(
=( A002ICATIONS
-( Re#ea"$he"# !"om IBM Cente" in San Fo#e CA "e'o"t that a n%m+e" o!
la"ge "etaile"# ha)e im'lemented #%")eillan$e #y#tem# that "e$o"d and
inte"'"et $%#tome" mo)ement# %#ing #o!t&a"e !"om AlmadenB# Bl%eEye#
"e#ea"$h '"oAe$t( Bl%eEye# #o!t&a"e make# #en#e o! &hat the $ame"a# #ee to
an#&e" key ?%e#tion# !o" "etaile"# in$l%ding Ho& many #ho''e"# igno"ed a
'"omotionL Ho& many #to''edL Ho& long did they #tayL Did thei" !a$e#
"egi#te" +o"edom o" delightL Ho& many "ea$hed !o" the item and '%t it in
thei" #ho''ing $a"t#L Bl%eEye# &o"k# +y t"a$king '%'il eye+"o& and mo%th
mo)ement( <hen monito"ing '%'il# the #y#tem %#e# a $ame"a and t&o
in!"a"ed light #o%"$e# 'la$ed in#ide the '"od%$t di#'lay( One light #o%"$e i#
aligned &ith the $ame"aB# !o$%#K the othe" i# #lightly o!! a,i#( <hen the eye
look# into the $ame"a-aligned light the '%'il a''ea"# +"ight to the #en#o"
and the #o!t&a"e "egi#te"# the $%#tome"B# attention( Thi# i# &ay it $a't%"e#
the 'e"#onB# in$ome and +%ying '"e!e"en$e#( Bl%eEye# i# a$ti)ely +een
in$o"'o"ated in #ome o! the leading "etail o%tlet#(
/( Bl%e Eye# $an +e a''lied in the a%tomo+ile ind%#t"y( By #im'ly to%$hing
a $om'%te" in'%t de)i$e #%$h a# a mo%#e the $om'%te" #y#tem i# de#igned
to +e a+le to dete"mine a 'e"#onB# emotional #tate( Fo" $a"# it $o%ld +e %#e!%l
to hel' &ith $"iti$al de$i#ion# like: NI kno& yo% &ant to get into the !a#t lane
+%t IBm a!"aid I $anBt do that( 9o%" too %'#et "ight no&N and the"e!o"e a##i#t
in d"i)ing #a!ely(
1( <e $o%ld #ee it# %#e in )ideo game# &he"e it $o%ld gi)e indi)id%al
$hallenge# to $%#tome"# 'laying )ideo game#( Ty'i$ally ta"geting
$omme"$ial +%#ine##(The integ"ation o! $hild"enB# toy# te$hnologie# and
$om'%te"# i# ena+ling ne& 'lay e,'e"ien$e# that &e"e not $omme"$ially
!ea#i+le %ntil "e$ently( The Intel 0lay O51 Com'%te" Mi$"o#$o'e the
Me/Cam &ith F%n Fai" and the Com'%te" So%nd Mo"'he" a"e $omme"$ially
a)aila+le #ma"t toy '"od%$t# de)elo'ed +y the Intel Sma"t Toy 2a+ in( One
theme that i# $ommon a$"o## the#e 0C-$onne$ted toy# i# that %#e"# inte"a$t
&ith them %#ing a $om+ination o! )i#%al a%di+le and ta$tile in'%t E o%t'%t
modalitie#( The '"e#entation &ill '"o)ide an o)e")ie& o! the inte"a$tion
de#ign o! the#e '"od%$t# and 'o#e #ome %ni?%e $hallenge# !a$ed +y
de#igne"# and enginee"# o! #%$h e,'e"ien$e# ta"geted at no)i$e $om'%te"
%#e"# namely yo%ng $hild"en(
:( The !amilia" and %#e!%l $ome !"om thing# &e "e$ogni@e( Many o! o%"
!a)o"ite thing#B a''ea"an$e $omm%ni$ate thei" %#eK they #ho& the $hange in
thei" )al%e tho%gh 'atina( A# te$hnologi#t# &e a"e no& 'oi#ed to imagine a
&o"ld &he"e $om'%ting o+Ae$t# $omm%ni$ate &ith %# in-#it%K &he"e &e a"e(
<e %#e o%" look# !eeling# and a$tion# to gi)e the $om'%te" the e,'e"ien$e
it need# to &o"k &ith %#( 3ey+oa"d# and mi$e &ill not $ontin%e to dominate
$om'%te" %#e" inte"!a$e#( 3ey+oa"d in'%t &ill +e "e'la$ed in la"ge mea#%"e
+y #y#tem# that kno& &hat &e &ant and "e?%i"e le## e,'li$it
$omm%ni$ation( Sen#o"# a"e gaining !idelity and %+i?%ity to "e$o"d '"e#en$e
and a$tion#K #en#o"# &ill noti$e &hen &e ente" a #'a$e #it do&n lie do&n
'%m' i"on et$( 0e")a#i)e in!"a#t"%$t%"e i# "e$o"ding it( Thi# talk &ill $o)e"
'"oAe$t# !"om the Conte,t A&a"e Com'%ting G"o%' at MIT Media 2a+(
=( C%""ent inte"!a$e# +et&een $om'%te"# and h%man# $an '"e#ent
in!o"mation )i)idly +%t ha)e no #en#e o! &hethe" that in!o"mation i# e)e"
)ie&ed o" %nde"#tood( In $ont"a#t ne& "eal-time $om'%te" )i#ion te$hni?%e#
!o" 'e"$ei)ing 'eo'le allo&# %# to $"eate NFa$e-"e#'on#i)e Di#'lay#N and
N0e"$e'ti)e En)i"onment#N &hi$h $an #en#e and "e#'ond to %#e"# that a"e
)ie&ing them( .#ing #te"eo-)i#ion te$hni?%e# &e a"e a+le to dete$t t"a$k
and identi!y %#e"# "o+%#tly and in "eal time( Thi# in!o"mation $an make
#'oken lang%age inte"!a$e mo"e "o+%#t +y #ele$ting the a$o%#ti$ in!o"mation
!"om a )i#%ally-lo$ali@ed #o%"$e( En)i"onment# $an +e$ome a&a"e o! ho&
many 'eo'le a"e '"e#ent &hat a$ti)ity i# o$$%""ing and the"e!o"e &hat
di#'lay o" me##aging modalitie# a"e mo#t a''"o'"iate to %#e in the $%""ent
#it%ation( The "e#%lt# o! o%" "e#ea"$h &ill allo& the inte"!a$e +et&een
$om'%te"# and h%man %#e"# to +e$ome mo"e nat%"al and int%iti)e(
>( CONC2.SION
The ninetie# &itne##ed ?%ant%m lea'# inte"!a$e de#igning !o" im'"o)ed man
ma$hine inte"a$tion#( The B2.E E9ES te$hnology en#%"e# a $on)enient
&ay o! #im'li!ying the li!e +y '"o)iding mo"e deli$ate and %#e" !"iendly
!a$ilitie# in $om'%ting de)i$e#( No& that &e ha)e '"o)en the method the
ne,t #te' i# to im'"o)e the ha"d&a"e( In#tead o! %#ing $%m+e"#ome mod%le#
to gathe" in!o"mation a+o%t the %#e" it &ill +e +ette" to %#e #malle" and le##
int"%#i)e %nit#( The day i# not !a" &hen thi# te$hnology &ill '%#h it# &ay
into yo%" ho%#e hold making yo% mo"e la@y( It may e)en "ea$h yo%" hand
held mo+ile de)i$e( Any &ay thi# i# only a te$hnologi$al !o"e$a#t(

ACKNOWLEDGEMENT

I thank the almighty God, the light of my life, for granting me the strength, courage and knowledge to complete this ISAS successfully. I wish to place on record my profound gratitude to Mrs.Swapna for having given me the opportunities to complete this ISAS successfully. I sincerely thank my guide ********** for his valuable guidance and support. I thank for timely suggestions and constant encouragement that boosted up my morale and led to the accomplishment of this ISAS. I extend my thanks to all teaching and non-teaching staff who were always ready to help me to reach my task. I am indebted to my parents, friends and relatives for their physical, psychological and moral support extended by them at all time.

You're Reading a Free Preview

Download
scribd
/*********** DO NOT ALTER ANYTHING BELOW THIS LINE ! ************/ var s_code=s.t();if(s_code)document.write(s_code)//-->