Professional Documents
Culture Documents
Brain Gate Technology
Brain Gate Technology
1INTRODUCTI
ON
BrainGat ei sabr aini mpl antsy stem dev elopedbyt hebi o-techcompany
Cy berki neticsi nconj unct ionwi t
ht heDepar tmentofNeur osci enceatBr own
Uni ver si
ty.Thedev elopmentoft hebr ai ngat esy stem br ai n-comput eri nterfacei s
toenabl et hosewi thsev erepar alysisandot herneur ologi calcondi ti
onst ol i
ve
mor epr oduct ivelyandi ndependent l
y.Thecomput erchi p, whi chi simpl antedi nto
thebr ain,moni torsbr ai nact ivit
yi nt hepat ientandconv er t
st hei nt entionoft he
useri nt o comput ercommands.Cur rent lyt hechi p usesabout100 hai r-
thin
elect rodest hatsenset heel ect r
o- magnet icsignat ur eofneur onsf ir
ingi nspeci fi
c
areasoft hebr ain.
Theact ivityi st r
ansl at edi ntoel ect ri
cal lychar gedsi gnal sandi st hensentand
decodedusi ngapr ogram,whi chcanmov ear obot icar m,acomput ercursor ,or
ev enawheel chai r
.Sci ent ist sar edev elopi ngt hebr aingat esy stemsunder l
ying
cor et echnol ogyi nt heneur opor tsy st em t o enabl ei mpr ov ed di agnosi sand
treat mentf oranumberofneur ologicalcondi t i
ons,suchasepi lepsyandbr ain
trauma.Br ai ngat ewi llbet hef i
rsthumandev i
cet hathasbeendesi gnedt o
recor d,f il
ter,andampl ifymul tiplechannel sofsi mul taneousl yr ecor dedneur al
act ivi
tyatav eryhi ghspat ialandt empor alresol ution.Whenaper sonbecomes
par alyzed,neur alsi gnalf rom t hebr ainnol ongerr eacht hei rdesi gnat edsi teof
termi nat i
on.Howev er,t hebr aincont i
nuest osendoutt hesesi gnal sal though
theydonotr eacht heirdest ination.I tist hesesi gnal st hatt hebr aingat esy stem
picksupandt heymustbepr esenti nor derf ort hesy stem t owor k.
Iti sf oundt hatpeopl ewi thl ong- st anding,sev erepar al ysiscangener ate
signal si nt hear eaoft hebr ainr esponsi bl eforv ol unt arymov ementandt hese
signal scanbedet ect ed,r ecor ded,r out edoutoft hebr aint oacomput erand
conv erted int o act ionsenabl i
ng apar al yzed pat ientt o per form basi ct asks.
Sci entistsar et oi mpl antt i
nycomput erchi psi nt hebr ainsofpar alyzedpat ients
whi chcoul d‘ readt heirt hought s’.Br aingat econsi st sofasur gicallyi mplant ed
sensort hatr ecor dst heact i
vityofdozensofbr aincel lssi mul taneousl y .The
sy stem al sodecodest hesesi gnal si nr ealt i
met ocont rolacomput erorot her
ext ernaldev i
ces.Thebr ain gat et echnol ogypl at form wasdesi gned t ot ake
adv ant ageoft hef actt hatmanypat ient swi t
hmot ori mpai r menthav eani ntact
brai nt hatcanpr oducemov ementcommandsal l
owi ngt hebr ai ngat esy stem t o
creat eanout putsi gnaldi rect l
yf r
om t hebr ain,by passi ngt her out et hrought he
ner vest ot hemuscl est hatcannotbeusedi npar aly zedpeopl e.
1.
2HI
STORY
HansBer
ger
’si
nnov
ati
on i
nthef
iel
d ofhuman br
ainr
esear
ch and i
ts
elect ri
calact ivityhasacl oseconnect ionwi tht hedi scov er yofbr ai ncomput er
i
nt erfaces.Ber geri scr edi t
edwi t ht hedev el opmentofel ect roencephal ogr aphy ,
whi chwasamaj orbr eakt hroughf orhumansandhel pedr esear cher sr ecor d
humanbr ai nact ivit
y –t heel ectroencephal ogr am ( EEG) .Thi swascer tai nlya
maj ordi scov er yinhumanbr ainmappi ng,whi chmadei tpossi bl etodet ectbr ai n
diseases.Ri char dCant on’s1875’ sdi scov eryofel ectricalsi gnal si nani malbr ains
wasani nspi rationf orBer ger.Asoneoft hef irstcommonuseofbr ai ncomput er
i
nt erfacet echnol ogy ,EEGneur o-feedbackhasbeeni nusef orsev eral decades.
They ear1998mar kedasi gni fi
cantdev elopmenti nt hef i
eldofbr ainmappi ng
whenr esear cherPhi l
ipKennedyi mpl ant edt hef irstbr aincomput eri nt er face
objecti nt oahumanbei ng.Howev er , t
heBCIobj ectwasofl imi tedf unct i
on.The
onlybenef itfrom t hisdev elopmentwast heuseofawi rel essdi -
el ectr ode.
JohnDonoghueandhi st eam ofBr ownUni ver sityr esear cher sf ormeda
publ ict radedcompany ,Cy berkinet ics,i n2001.Thegoalwast ocommer cially
desi gnabr aincomput eri nterface,t heso- cal l
ed Br ainGat e.Thecompanyhas
comeup wi th Neur oPor t i t
sf irstcommer ci alpr oduct .Col umbi aUni ver sity
Medi calCent err esear cher shav esuccessf ullymoni toredandr ecor dedel ect rical
act i
vityint hebr ainwi thi mpr ov edpr ecisi on.Accor dingt or esear cher s,Neur oPor t
Neur alMoni t
or i
ngSy st em enabl edt hem t oi dent i
f ymi cro- seizur eact i
v i
typr iort o
epilept i
csei zur esamongpat i
ent s.
June2004mar kedasi gnificantdev elopmenti nt hef ieldwhenMat thewNagl e
becamet hef irsthumant obei mpl ant edwi thaBCI ,Cy ber kinet i
cs’ s Br ainGat e.
In December2004,Jonat han Wol paw and r esear cher s atNew Yor k St at e
Depar tmentofHeal th’sWadswor thCent ercameupwi thar esear chr epor tt hat
demonst rat edt heabi l
ityt ocont rolacomput erusi ngaBCI .Int hest udy ,pat ient s
wer easkedt owearacapt hatcont ainedel ect rodest ocapt ureEEGsi gnal sf rom
themot orcor tex–par toft hecer ebr um gov er ningmov ement .
Anumberofdev elopment shav ebeent aki ngpl acei nt hef i
eld.By2050,i ti s
hasbeensuggest edt hatBCIcoul dbecomeamagi cwand,hel pingmencont rol
object swi tht hei rmi nd.Thedayi sn’ tfarof fwhenmanmaybeabl et ogui dean
out sideobj ectwi t
ht hei rthought si nor dert oconsi st ent lyexecut ebot hnat ur al
andcompl exmot i
onsofev erydayl ife.
1.
3BRAI
NCOMPUTERI
NTERFACE
Abrai
n-computerint
erface(BCI
),sometimescal l
edadirectneur
alinter
face
orabrain-
machi neinter
face,isadi rectcommuni cationpathwaybet weena
humanoranimal br
ain(br
aincellcul
tur
e)andanext ernaldevi
ce.I
none-wayBCI s,
comput
erseitheracceptcommandsf r
om thebrainorsendsi gnal
stoi tbutnot
bot
h.Two-wayBCI s would all
ow brains and externaldevi
ces to exchange
i
nf ormat i
oni nbot hdi rect i
onsbuthav ey ett o besuccessf ull
yi mplanted in
animal sorhumans.I nt hisdef ini
tion,t hewor dbrainmeanst hebr ainorner vous
system ofanor gani cl ifef orm r athert hant hemi nd.Comput ermeansany
processi ng orcomput ationaldev ice,f rom si mple cir
cuitst o si l
i
con chi ps
(i
ncl uding hy potheticalf ut
ur et echnol ogies such as quant um comput i
ng).
Resear chonBCI sbegani nt he1970s,buti twasn' tunti
lthemi d-1990sthatt he
fi
rstwor kingexper i
ment ali mplant si nhumansappear ed.Fol lowingy earsof
animal experimentation, earlywor kingi mplant sinhumansnowexi st,
designedt o
restoredamagedhear i
ng,si ghtandmov ement .Thecommont hreadt hr
oughout
ther esear chisther emar kablecor ticalplastici
tyoft hebrain,whi choftenadapt s
toBCI s,t r
eati
ngpr osthesescont rol l
edbyi mpl antsasnat urall
imbs.Wi t
hr ecent
adv ances i ntechnol ogy and knowl edge,pi oneer i
ng researcher s could now
concei v ablyatt
emptt opr oduceBCI st hataugmenthumanf unct i
onsr at
hert han
simpl yr estori
ngthem, prev i
ouslyonl ythereal m ofscienceficti
on.
Fi
g.1.
1:Bl
ockDi
agr
am OfaBCISy
stem
1.
3.1Pr
inci
ple
Thepr incipleofoperat
ionoftheBrainGat
eNeur alI
nt erfaceSy stem ist hat
withintactbr ai
nf uncti
on,neuralsi
gnal
saregener atedev ent hought heyar enot
senttot hear ms,handsandl egs.Thesesignal
sar einterpr etedbyt hesy stems
andacur sori sshownt ot heuseronacomput erscr eent hatpr ovidesan
alt
ernate" BrainGat epathway "
.Theusercan uset hatcur sort o cont rolt he
comput er,justasamousei sused.Thetechnologydr ivi
ngt hisbreakthroughi n
theBrain-Machi neInter
facefiel
dhasamy riadofpot enti
alappl i
cati
ons, i
ncl uding
thedevelopmentofhumanaugment ati
onformil
itaryandcommer ci
al purposes.
1.
3.2Wor
king
Fi
g.1.
3:Basi
cwor
kingpr
inci
pleoft
heBr
ainGat
e
Alt
hought hepathst hesignalstakeareinsulatedbysomet hingcal l
edmy el
in,
someoft heelectricsi
gnalescapes.Sci enti
stscandet ectthosesi gnals,interpr
et
whattheymeananduset hem t odirectadev i
ceofsomeki nd.Itcanal sowor k
theotherwayar ound.Forexampl e,
researcherscoul dfi
gureoutwhatsi gnal sare
senttothebr ainbyt heopt i
cner v
ewhensomeoneseest hecolorr ed.Theycoul d
ri
gacamer athatwoul dsendt hoseexactsignalsint osomeone’ sbr ainwhenev er
thecamer asawr ed,al
lowingabl indpersonto“ see”wi t
houtey es.
Basical
lyther earetwomet hodst osensethesi gnal
ssent byt heneur ons:
1.
ECoG: Invasivemet hod.
2.
EEG: Noni nvasivemet hod
1.
3.3ECoG–El
ect
rocor
ti
cogr
aphy
:
1.
3.4EEG–El
ect
roencephal
ogr
aphy
1.
4.1Wor
kingOfSof
twar
e
1.4.
3Tr ai
ning
Pr essingt heF3key ,thesy st
em startstotrai
nt heneuralnetwiththe
avai
labledat a.Thetrainingsetusedf orthi
spurposeisthesetofthel
astTrial
Buff
err ecordedt r
ial
s'f eat
ures.Trai
ningtimedependsupont hecomplexi
tyof
thetrainingdat aandt heamountofr ecordeddat
a.
1.
5BRAI
NGATERESEARCHI
NANI
MALS
1.Exper i
mentOnRat s:
Rat si mplant ed wi th BCIsi n Theodor e Ber ger '
s exper i
ment s.Sev er al
l
abor atorieshav emanagedt or ecordsi gnalsf rom monkeyandr atcerebr al
cortexes i n or dert o oper at
e BCI st o carr
youtmov ement .Monkey s hav e
nav i
gat ed comput ercur sor s on scr een and commanded r obotic arms t o
perfor m simplet askssi mpl ybyt hinkingaboutt het askandwi thoutanymot or
output .Otherr esear chonr atshasdecodedv isual signals.
In1999,r esear chersl edbyGar rettStanleyatHar var
dUni versit
ydecoded
neur onalf i
ri
ngst or eproducei magesseenbyr ats.Thet eam usedanar r
ayof
electrodes embedded i nt he t halamus ( which i ntegrat
es al loft he brains
sensor yinput )ofshar pey edr ats.Resear cher st ar geted177br aincel l
sint he
thalamusl at
eral geni culatenucl eusar ea,whichdecodessi gnalsf r
om t hereti
na.
Ther atswer eshownei ghtshor tmov i
es, andt heirneur onfir
ingswer erecorded.
Usingmat hemat i
calf il
ters,ther esear chersdecodedt hesi gnalst ogener ate
mov i
esofwhatt her atssawandwer eabl etor econst r
uctrecogni zablescenes
andmov i
ngobj ects.
2.Exper imentOnMonkey s
Lat erexper i
ment sbyNi coleli
susi ngr hesusmonkey s, succeededi ncl osing
thef eedbackl oopandr eproducedmonkeyr eachingandgr aspi ngmov ement s
i
nar obotar m.Wi t
ht heirdeepl ycleftandf urrowedbr ai
ns, r
hesusmonkey sare
consi der edt obebet t
ermodel sforhumanneur ophy si
ologyt hanowlmonkey s.
Themonkey swer et rai
nedt or eachandgr aspobj ect sonacomput erscr eenby
mani pul atingaj oystickwhi lecor respondi ngmov ement sbyar obotar m wer e
hidden.Themonkey swer elatershownt her obotdi rectl
yandl ear nedt ocont rol
i
tbyv iewi ng i t
smov ements.TheBCIused v el ocit
ypr edi cti
onst o cont rol
reachi ngmov ement sandsi mul t
aneousl ypr edictedhandgr ippingf orce.Ot her
l
abst hatdev el opBCI sandal gor i
thmst hatdecodeneur onsi gnal si ncludeJohn
Donoghuef rom Br own Uni versi
ty,Andr ew Schwar tzfr om t heUni ver sit
yof
Pitt
sbur ghandRi chardAnder senf rom Cal tech.Theser esear cher swer eabl eto
produce wor king BCI s even t hough t heyr ecorded si gnal sf r om f arf ewer
neuronst hanNi colelis(15–30neur onsv ersus50–200neur ons) .Donoghue' s
groupr epor tedt rainingr hesusmonkey stouseaBCIt otrackv isual target sona
comput erscr eenwi thorwi thoutassi st anceofaj oystick( closed- l
oopBCI ).
Schwar tz'sgr oupcr eatedaBCIf ort hree- dimensi onaltracki ngi nv irt
ualr eality
andal sor epr oducedBCIcont roli
nar obot i
car m.
1.
6APPLI
CATI
ONS
Fi
g.1.
4:Appl
i
cat
ionOfBr
ainGat
e
6.Thesy stem wi l
lconnectt hebr aingatesensorwi t
hf unctionalelectri
cal
sti
mul ati
on (FES)sy stem,whi ch uses electri
calimpul ses tot r
igger
muscleandl i
mbmov ement .Thef i
rstver
sionwi l
lallow userst omake
simplemov ement st hatcoul dbeusedt operfor
mt askssuchaseat i
ngor
dri
nkingusingt heirownar msandhandsandundert henat uralcontrolof
thei
rownbr ains.Thei nit
ialv er
sionoft hi
sFESsy stem woul dusear m
suppor t
s.Laterv ersions,howev er,wontrequir
esuppor tsandwi llall
ow
userst odoact ivi
tiest hatr equiremor edexterit
y,suchasusi ngcel l
phonesorr emot econt rols.
7.The devi
ce can be used in an int
eract
ive env
ironment;act
ivi
ty
sur
roundi
ngt
hepati
entwil
lnotaf
fectt
heaccuracyofthedevce.
i
1.
7ADVANTAGES
Fi
g.1.
5:Appl
i
cat
ionOfBr
ainComput
eri
nter
facei
nHuman
Wit
haBr ai
nGat eyouCan:
1.Turnonorof ft
heli
ghtsonyourroom
2. Checkandr eadE-mail
s
3. Pl
aygamesi ncomputer
4. Usey ourPC
5.Wat chandcont r
olyourTel
evi
sion
6.Cont r
olaroboti
carm
1.
8 DI
SADVANTAGES
1.
9Fut
ureDev
elopment
s
1.
10CONCLUSI
ON