SSCET 1
Technical paper presentation
“ BRAINGATE SYSTEM”
(Application of human computer interaction)
ABSTRACT: The 'Brain Gate'
The mind-to-movement contains tiny spikes that will
system that allows a extend down about one
quadriplegic man to control a millimetre into the brain after
computer using only his being implanted beneath the
thoughts is a scientific skull,monitoring the activity
milestone. It was reached, in from a small group of
large part, through the brain neurons.It will now be possible
gate system. This system has for a patient with spinal cord
become a boon to the injury to produce brain signals
paralyzed. The Brain Gate that relay the intention of
System is based on Cyber moving the paralyzed limbs,as
kinetics platform technology to signals to an implanted
sense,transmit,analyze and sensor,which is then output as
apply the language of neurons. electronic impulses. These
The principle of operation impulses enable the user to
behind the Brain Gate System operate mechanical devices
is that with intact brain with the help of a computer
function, brain signals are cursor. Matthew Nagle,a 25-
generated even though they are year-old Massachusetts man
not sent to the arms, hands and with a severe spinal cord
legs.The signals are interpreted injury,has been paralyzed from
and translated into cursor the neck down since 2001.After
movements, offering the user taking part in a clinical trial of
an alternate Brain Gate this system,he has opened e-
pathway to control a computer mail,switched TV
with thought,just as individuals channels,turned on lights.He
who have the ability to move even moved a robotic hand
their hands use a mouse. from his wheelchair. This
SSCET 2
marks the first time that neural body to the central nervous
movement signals have been system. Receptors sense things
recorded and decoded in a like chemicals, light, and sound
human with spinal cord and encode this information
injury.The system is also the into electrochemical signals
first to allow a human to transmitted by the sensory
control his surrounding neurons. And interneurons tie
environment using his mind. everything together by
How does the brain control connecting the various neurons
motor function? within the brain and spinal
The brain is cord. The part of the brain that
"hardwired" with connections, controls motor skills is located
which are made by billions of at the ear of the frontal lobe.
neurons that make electricity How does this
whenever they are stimulated. communication happen?
The electrical patterns are Muscles in the body's limbs
called brain waves. Neurons act contain embedded sensors
like the wires and gates in a called muscle spindles that
computer, gathering and measure the length and speed
transmitting electrochemical of the muscles as they stretch
signals over distances as far as and contract as you move.
several feet. The brain encodes Other sensors in the skin
information not by relying on respond to stretching and
single neurons, but by pressure. Even if paralysis or
spreading it across large disease damages the part of the
populations of neurons, and by brain that processes movement,
rapidly adapting to new the brain still makes neural
circumstances. signals. They're just not being
Motor neurons carry sent to the arms, hands and
signals from the central nervous legs.
system to the muscles, skin and A technique called
glands of the body, while neurofeedback uses
sensory neurons carry signals connecting sensors on the
from those outer parts of the scalp to translate brain
SSCET 3
waves into information a System and a cursor is shown
person can learn from. The to the user on a computer
sensors register different screen that provides an
frequencies of the signals alternate "BrainGate pathway".
produced in the brain. The user can use that cursor to
These changes in brain control the computer, just as a
wave patterns indicate mouse is used."
whether someone is
concentrating or
suppressing his impulses, or
whether he is relaxed or
tense.
NEUROPROSTHETIC
DEVICE:
A neuroprosthetic
device known as Braingate
converts brain activity into
computer commands. A sensor
is implanted on the brain, and
electrodes are hooked up to
wires that travel to a pedestal
on the scalp. From there, a fiber
optic cable carries the brain
activity data to a nearby
computer.
PRINCIPLE:
"The principle of
operation of the BrainGate
Neural Interface System is that
with intact brain function,
neural signals are generated
even though they are not sent to
the arms, hands and legs. These
signals are interpreted by the
SSCET 4
BrainGate is a brain implant
system developed by the
bio-tech company
Cyberkinetics in 2003 in
conjunction with the
Department of
Neuroscience at Brown Currently the chip uses
University. The device 100 hair-thin electrodes that
was designed to help 'hear' neurons firing in specific
those who have lost areas of the brain, for example,
control of their limbs, or the area that controls arm
other bodily functions, movement. The activity is
such as patients with translated into electrically
amyotrophic lateral charged signals and are then
sclerosis (ALS) or spinal sent and decoded using a
cord injury. The program, which can move
computer chip, which is either a robotic arm or a
implanted into the computer cursor. According to
patient and converts the the Cyberkinetics' website,
intention of the user into three patients have been
computer commands. implanted with the BrainGate
system. The company has
confirmed that one patient
(Matt Nagle) has a spinal cord
injury, whilst another has
advanced ALS.
In addition to real-time
analysis of neuron patterns to
relay movement, the Braingate
array is also capable of
recording electrical data for
NEURO CHIP: later analysis. A potential use
of this feature would be for a
neurologist to study seizure
SSCET 5
patterns in a patient with removing unnecessary
epilepsy. frequency bands, averaging the
Braingate is currently recruiting current brain activity level,
patients with a range of transforming the measured
neuromuscular and scalp potentials to cortex
neurodegenerative conditions potentials and denoising.
for pilot clinical trials in the Frequency bands of the EEG :
United States. .
Band Frequen- Amplit- Location
cy [Hz] -ude
[_V]
Alpha 8-12 10 -150 Occipital/
(_) Parietal
regions
µ- 9-11 varies Precentral/
rhyth Postcentra
m l regions
Beta 14 -30 25 typically
(_) frontal
regions
Theta 4-7 varies varies
(_)
Delta
<3 varies varies
(_)
DETECTION:
WORKING:
The detection of the input
Operation of the BCI
from the user and them
system is not simply listening
translating it into an action
the EEG of user in a way that
could be considered as key part
let’s tap this EEG in and listen
of any BCI system. This
what happens. The user usually
detection means to try to find
generates some sort of mental
out these mental tasks from the
activity pattern that is later
EEG signal. It can be done in
detected and classified.
time-domain, e.g. by comparing
PREPROCESSING:
amplitudes of the EEG and in
The raw EEG signal
frequency-domain. This
requires some preprocessing
involves usually digital signal
before the feature extraction.
processing for sampling and
This preprocessing includes
SSCET 6
band pass filtering the signal, activity which is used to relay
then calculating these time -or the information to the
frequency domain features and computer. Motivation,
then classifying them. These frustration, fatigue, etc. apply
classification algorithms also here and their effect should
include simple comparison of be taken into consideration
amplitudes linear and non- when planning the training
linear equations and artificial procedures.
neural networks. By constant BIO FEEDBACK:
feedback from user to the The definition of the
system and vice versa, both biofeedback is biological
partners gradually learn more information which is returned
from each other and improve to the source that created it, so
the overall performance. that source can understand it
CONTROL: and have control over it. This
The final part consists biofeedback in BCI systems is
of applying the will of the user usually provided by visually,
to the used application. The e.g. the user sees cursor moving
user chooses an action by up or down or letter being
controlling his brain activity, selected from the alphabet.
which is then detected and
classified to corresponding
action. Feedback is provided to
user by audio-visual means e.g.
when typing with virtual
keyboard, letter appears to the
message box etc.
TRAINING: A boon to the paralyzed
The training is the part -Brain Gate Neural Interface
where the user adapts to the System
BCI system. This training
The first patient,
begins with very simple
Matthew Nagle, a 25-year-old
exercises where the user is
Massachusetts man with a
familiarized with mental
severe spinal cord injury, has
SSCET 7
been paralyzed from the neck
down since 2001. Nagle is
unable to move his arms and
legs after he was stabbed in the
neck. During 57 sessions, at
New England Sinai Hospital
and Rehabilitation Center,
Nagle learned to open
simulated e-mail, draw circular
shapes using a paint program
on the computer and play a
simple videogame, "neural
Pong," using only his thoughts.
He could change the channel
and adjust the volume on a
NAGLE’S STATEMENT:
television, even while
“I can't put it into
conversing. He was ultimately
words. It's just—I use my brain.
able to open and close the
I just thought it. I said, "Cursor
fingers of a prosthetic hand and
go up to the top right." And it
use a robotic limb to grasp and
did, and now I can control it all
move objects. Despite a decline
over the screen. It will give me
in neural signals after few
a sense of independence.”
months, Nagle remained an
active participant in the trial
and continued to aid the clinical
team in producing valuable
feedback concerning the
BrainGate` technology.
SSCET 8
OTHER APPLICATIONS: neuronal firings to reproduce
images seen by cats. The team
used an array of electrodes
embedded in the thalamus
(which integrates all of the
brain’s sensory input) of sharp-
eyed cats. Researchers targeted
177 brain cells in the thalamus
lateral geniculate nucleus area,
which decodes signals from the
retina. The cats were shown
Rats implanted with
eight short movies, and their
BCIs in Theodore Berger's
neuron firings were recorded.
experiments.Several
Using mathematical filters, the
laboratories have managed to
researchers decoded the signals
record signals from monkey
to generate movies of what the
and rat cerebral cortexes in
cats saw and were able to
order to operate BCIs to carry
reconstruct recognisable scenes
out movement. Monkeys have
and moving objects.
navigated computer cursors on
screen and commanded robotic
arms to perform simple tasks
simply by thinking about the
task and without any motor
output. Other research on cats
has decoded visual signals.
Garrett Stanley's In the 1980s, Apostolos
recordings of cat vision using a Georgopoulos at Johns Hopkins
BCI implanted in the lateral University found a
geniculate nucleus (top row: mathematical relationship
original image; bottom row: between the (based on a cosine
recording) in 1999, researchers function). He also found that
led by Garrett Stanley at dispersed groups of neurons in
Harvard University decoded different areas of the brain
SSCET 9
collectively controlled motor the feedback loop and
commands but was only able to reproduced monkey reaching
record the firings of neurons in and grasping movements in a
one area at a time because of robot arm. With their deeply
technical limitations imposed cleft and furrowed brains,
by his equipment.[4] rhesus monkeys are considered
There has been rapid to be better models for human
development in BCIs since the neurophysiology than owl
mid-1990s.[5] Several groups monkeys. The monkeys were
have been able to capture trained to reach and grasp
complex brain motor centre objects on a computer screen
signals using recordings from by manipulating a joystick
neural ensembles (groups of while corresponding
neurons) and use these to movements by a robot arm
control external devices, were hidden.The monkeys were
including research groups led later shown the robot directly
by Richard Andersen, John and learned to control it by
Donoghue, Phillip Kennedy, viewing its movements. The
Miguel Nicolelis, and Andrew BCI used velocity predictions
Schwartz. to control reaching movements
and simultaneously predicted
hand gripping force.
Other labs that develop
BCIs and algorithms that
decode neuron signals include
John Donoghue from Brown
University, Andrew Schwartz
Diagram of the BCI
from the University of
developed by Miguel Nicolelis
Pittsburgh and Richard
and collegues for use on
Andersen from Caltech. These
Rhesus monkeys
researchers were able to
Later experiments by
produce working BCIs even
Nicolelis using rhesus
though they recorded signals
monkeys, succeeded in closing
from far fewer neurons than
SSCET 10
Nicolelis (15–30 neurons Biomedical Instrumentation,
versus 50–200 neurons). Microelectronics, signal
Donoghue's group processing, Artificial Neural
reported training rhesus Networks and Robotics which
monkeys to use a BCI to track has overwhelming
visual targets on a computer developments. Hope these
screen with or without systems will be effectively
assistance of a joystick (closed- implemented for many
loop BCI).[10] Schwartzss's Biomedical applications.
group created a BCI for three-
dimensional tracking in virtual REFERENCES
reality and also reproduced BCI 1)Graun, Christian ; Gerken,
control in a robotic arm. Jens ; Jetter, Hans-Christian ;
Kaonig,Werner ; Reiterer,
CONCLUSION: Harald: MedioVis - a User-
The idea of moving Centred Library Metadata
robots or prosthetic devices not Browser.In: ECDL 2005:
by manual control, but by mere Research and Advanced
“thinking” (i.e., the brain Technology for Digital
activity of human subjects) has Libraries, Proceedingsof the 9th
been a fascinated approach. European Conference on
Medical cures are unavailable Digital Libraries, Springer
for many forms of neural and Verlag, September 2005.
muscular paralysis. The 2)[Heilig u. a. 2008] Heilig,
enormity of the deficits caused Mathias ; Demarmels, Mischa ;
by paralysis is a strong Konig, Werner A. ; Gerken,
motivation to pursue BMI Jens ; Rexhausen, Sebastian ;
solutions. So this idea helps Jetter, Hans-Christian ;
many patients to control the Reiterer, Harald:
prosthetic devices of their own MedioVis: visual information
by simply thinking about the seeking in digital libraries. In:
task. AVI '08: Proceedings ofthe
This technology is well working conference on
supported by the latest fields of Advanced visual interfaces.
SSCET 11
New York, NY, USA :
ACM,Mai 2008, S. 490{491.
3)http://portal.acm.org/citation.
cfm?id=1385569.1385671.
{ ISBN 0-978-60558-141-5
4)[Huffman 2008] Huffman,
Scott: Search evaluation at
Google.
Website.September2008.{URL
http://googleblog.blogspot.com/
2008/09/
search-evaluation-at-
google.html
