You are on page 1of 12

Pv3

Input selectivity via neural-glial signaling

Nicolangelo Iannella
NeuroTek International (Research & Consulting) Pty. Ltd., South Australia
&
Computational and Theoretical Neuroscience Laboratory
School of Information Technology & Mathematical Sciences
Institute for Telecommunications Research
The University of South Australia, Mawson Lakes, Australia
E-mail: nicolangelo.iannella@unisa.edu.au, nicolangelo.iannella@gmail.com

Michel Condemine
Condemine Consulting, Paris, France
E-mail:cc@mcondemine.com

Glial cells including astrocytes are another type of cell that exist in the brain along side neurons. They
have long been thought to play no active role in information processing in the brain especially in the
cerebral cortex. Historically, their role was more to support the physiology well being of neurons also to
provide a medium to support the structure of the brain. Over the past decade, new experimental results
show that glial cells are able to transfer calcium signals with each other and with neurons. Furthermore,
glial cells can also absorb or secrete neural transmitters. This is now forcing a community wide rethink
on the role glial cells play in brain function, including information processing. Due to the glial cell’s prox-
imity to the synapse, tripartate synapses have been proposed and studied computationally. Significantly,
experiments have further shown that glial cells may be involved in the strengthening and weakening of
synaptic strength (synaptic plasticity), however their precise actions during synaptic plasticity are only
now starting to be studied. To this end, it is becoming increasingly important to elucidate the role of
neural-glial signaling during the development of functional properties both at the neural and network
levels. Here, for the first time, we explore how neural-glial signaling and reciprocal calcium/glutamate
cellular communication via tripartate synapses leads to the emergence of input selectivity.

Keywords: Glial cells; neural-glial signaling; Timing-based synaptic plasticity; spiking neurons.

1. Introduction ume.4, 5 Since the turn of this century, evidence has


Glial cells, including astrocytes, have long been begun to emerge implicating that glial cells, in par-
thought of those cells that make sure that neurons ticular astrocytes, in the regulation of synaptic trans-
and synaptic connections are physiologically healthy mission and aid neurons to form connections that
but play no role whatsoever in neural computation give rise to functional neural circuits.6–10
and information processing in the brain.1–3 These Currently, the function of glial cells are being
cells are known to be the “brain glue” that keep reconsidered where there is now sufficient exper-
neurons in place. To this end, many experimental imental evidence implicating them in active roles
and computational neuroscientist have completely in the brain, such as modulating/regulating synap-
ignored glial cells when investigating functional prop- tic transmission.6, 7, 10 Being electrically inert, glial
erties and synaptic plasticity, despite these cells mak- cell responses are driven by calcium influx/changes
ing up half the human brain by number and vol- that can result in the generation of a calcium
wave.11–14 Furthermore, astrocytes have been found

1
Pv3

to form their own networks linked by gap junctions15 mate receptors has been reduced while potentiation
that permit cellular communication via calcium- leads to an increase in the number of glutamate re-
based signaling.16 Recent findings have also illus- ceptors in the PSD and thus a larger maximal cur-
trated their involvement in the formation of synapses rent. Despite this portrayal, the reality is that glia
(synaptognesis)17–20 as well as synaptic plastic- (astrocyte) is an additional component present at the
ity,7, 21, 22 however the precise loci and mechanisms synaptic junction.6
are still unknown.
×10-3 STDP temporal window
Both synaptic plasticity and glial cell responses 3

Weight change ∆W
are driven by calcium. In glia, activity in response to 2

some input manifests itself as non-homogeneous cal- 1

cium profile over time.11–14, 23–25 While in neurons, 0

calcium influx triggers a cascade of events that ul- -1

timately lead to changes in synaptic strength.26–31 -2


-100 -50 0 50
Learning rules have been devise based on particu- ∆ T=tpost-tpre spike interval (ms)
lar attributes of both inputs and outputs, such as
rate32–34 and spike timing,35–38 or purely based upon Figure 1. An example of an STDP temporal window,
reproduced from Froemkes45 experiments on rats.
calcium change (like the BCM model).39–41 Spike
timing-dependent plasticity (STDP) is a timing-
based learning rule that has been investigated both Significantly, experiments have shown that there
experimentally and theoretically to help understand is a form of three-way communication between
how connections and functionality can be learnt pre-synaptic and post-synaptic components of the
by neural circuits composed of spiking neurons in- synapse and glial cells where notably communica-
cluding its relation to calcium-dependent plastic- tion occurs via glutamate release and calcium sig-
ity.33, 35–38 Here, changes in synaptic strength are naling.7, 12, 15, 46–48 Despite originally thought of as
a function of the timing difference between post- passive components there is now increasing evidence
synaptic spike generation and the arrival time of that commands a closer look at the roles of glial
inputs. Notably, potentiation (strengthening of the cells in information processing and synaptic plastic-
synapse) occurs when ∆T = tpost −tpre > 0 while de- ity.7, 24, 49 Recent theoretical studies have begun to
pression (weakening a synapse) occurs when ∆T ≤ 0 investigate the role of glial cells in formation pro-
and its characterized by two exponentially decaying cessing and the impact that they have on neural
windows35, 36, 38 depicted in Fig 1. STDP has previ- function and the behavior of neural circuits.50–65 Re-
ously been shown that it can solve the input selec- cent experiments have further shown that neural-
tivity problem, but only after changing the rule by glial signaling influences synaptic plasticity as well
replacing the fixed maximal amplitude of the depres- the state of cortical circuits and their composite neu-
sion window with a variable maximal amplitude that rons.6–10, 23, 24, 66
changes in an activity-dependent fashion as a func- In this paper, we investigate how neural-glial
tion of the post-synaptic neuron spike activity.42–44 signaling impacts timing based learning by studying
Without this modification input selectivity fails to the formation of input selectivity. Here, for the first
emerge. time, we develop a new hybrid spike-timing learning
Synaptic plasticity rules like STDP, typically rule that explicitly incorporates reciprocal communi-
have taken into consideration a stereotypic struc- cation and signaling between an output neuron and
ture of the synapse consisting of the pre-synaptic a glial cell. We illustrate that this reciprocal commu-
axon terminal and the post-synaptic spine-head. The nication between cell types is critical for input selec-
strength of a synapse is measured in nS and is pro- tivity to emerge as it further provides a more physi-
portional to the maximal amount of electrical current ologically plausible basis for the approximation used
that is generated by a single pre-synaptic input due in pasts studies.43 In the following sections, we de-
to the number of glutamate receptors in the postsy- scribe both the network topology, the models used to
naptic density (PSD) of the spine-head. When plas- describe the cellular properties of neurons and glial
ticity leads to depression then the number of gluta- cells, and how neural-glial signaling takes place. We
Pv3

present our new learning rule that takes advantage Amin and Amax are the minimal and maximal ampli-
of this reciprocal communication and show that this tudes, respectively. For simplicity in representation,
new time-based rule can give rise to input selectivity. the span of our excitatory input neurons matches the
We also quantify importance in the efficacy of glial span of the abstract feature space, so that the first
to neuron signals. and last input neurons are located on the boundaries
of the space. The centres are equally spaced within
2. Materials and Methods this feature space and consequentially input patterns
spanned (covered with some overlap between adja-
2.1. Neural Glial Network Topology cent profiles) the entire feature space. To generate
We built a network of spiking neurons with a feedfor- spike activity in the input neurons, a pattern was
ward network topology. The network itself was com- randomly selected and then it was presented to the
posed of an input layer consisting of 100 excitatory excitatory neuron which generated spikes via random
and 20 inhibitory neurons. These neurons would con- processes governed by the rate determined by the in-
sequentially drive an output neuron and a glial cell. put to the neurons. The pattern would stimulate the
The membrane potential of the output neuron would excitatory neurons for 200 ms after which a new in-
dynamically change over time being driven by its in- put pattern was selected and presented to the exci-
puts and if conditions were favorable then the output tatory input neurons. Inhibitory neurons also gener-
neuron would generate a train of action potentials ated spikes randomly at a constant yet fixed mean
in response to its inputs. Furthermore, the glial cell rate throughout the simulation. The changes of in-
is also stimulated by the input neurons leading to put patterns continued until the output neuron has
changes in calcium activity. As the output neuron learned to respond selectivity to one of the inputs.
and the glial cell contribute to each others activity
in a reciprocal manner, the glial cell also receives in- 2.3. Neural Models
puts from the output neuron and in turn the glial
cell provides an additional calcium driven input to We used efficient spiking neuron models for the input
the output neuron. Excitatory connections originat- neurons to save on computational resources. Excita-
ing from the excitatory neurons of the input layer tory input neurons were designed to encode an ab-
were initial set to the same strength but were altered stract feature space where each neuron responded se-
in an activity-dependent manner as a functions of lectively to inputs by firing action potentials or spikes
spike timing and neural-glial activity. All other con- in a distinct yet finite continuous region of this space.
nections were fixed. Inhibitory neurons were non selective and provided
a constant level of inhibition to the output neuron.
Specifically, the firing pattern of each input neuron
2.2. Stimulation Paradigm is generated through a stochastic process where the
A set of ten distinct input patterns were used whose rate of spike generation of each excitatory input neu-
representation was such that they spanned an ab- ron is determined by an input function described by a
stract feature space. These stimuli were used to gen- Gaussian (bell-shaped) profile of finite spatial width,
erate spike activity in the input neurons. The set of
patterns was constructed to cover our abstract fea- ( )
ture space (without gaps), noting that more input (xi − xjc )2
G(xi ) = Rmin + (Rmax − Rmin ) exp − ,
patterns can be used at the cost of the degree of 2σ 2
overlap between input patterns. The input patterns
were described by a Gaussian profile if finite width,
where xi represents the location of the input neuron
( ) with respect to the feature space, xjc is the centre of
(x − xc )2
G(x) = Amin + (Amax − Amin ) exp − , the input profile, σ = 10, and Rmin and Rmax are the
2σ 2
minimal and maximal firing rates, respectively. Note
that we have replaced the amplitudes Amin and Amax
where x represents a location of the feature space, with Rmin and Rmax . Their parameter values were
xc is the centre of the input profile, and σ = 10, and Rmin = 2 and Rmax = 55, respectively. For an input
Pv3

neuron located at the chosen centre the firing rate is where tj is the arrival time of an incoming spike to
maximal. A set of ten inputs spanning an abstract the output neuron, τd and τo are the respective decay
feature space were used to generate spike activity in and onset time constants, H(·) is the Heaviside step
the input neurons. Ten distinct input patterns were function, and Iglial represents the current generated
used as the input that covers our abstract feature by the glial cell in the output neuron.
space, noting that more input patterns can be used A simple glial cell model was adopted from50
at the cost of the degree of overlap between input and was given by the following set of equations:68, 69
patterns. For simplicity in representation the span
of our excitatory input neurons matches the span ∑
d[Ca2+ ]
of the feature space, so that the first and last in- = −φ + σj δ(t − tj )
dt
put neurons are located on the boundaries of the ab- j
stract feature space. The centres are equally spaced
and consequentially input patterns spanned (covered dφ ( [ ] )
= α β Ca2+ − φ ,
with some overlap between adjacent profiles) the en- dt
tire feature space. The connection strengths between
these 20 inhibitory neurons are equal and do not where ϕ is a recovery variable and σj is assumed to be
change, while excitatory connection weights to the the neuronal spike input to the glial cell since they
output neuron were altered during learning. respond to release of glutamate from pre-synaptic
During learning, input neurons stimulated the neurons, δ(·) represent timing of the spike, and α =
output neuron and glial cell by randomly selecting 0.001 and β = 0.01 are constants so that they repro-
an input centre to be active for short time periods duce the slow time course of calcium change observed
of 200 msec after which a new centre (and corre- in experiments by Kawabata et al (1996).70 Gluta-
sponding input neurons) was randomly selected to mate release from glial cells that is triggered by the
stimulate these output cells. This process continues elevation of calcium can be simply described by a
until input selectivity is established and stable. simple first order process where glial cell glutamate
The output neuron was modelled as a regular fir- release occurs when calcium concentration exceeds a
ing neuron using the Izhekevichs model67 described threshold as described below,50, 68
by  ([ ] [ ] )

 − [glu] + Ca2+ − Ca2+ thres − κλ


dv 
= 0.04v 2 + 5v + 140 − u + Iinput + Iglial d[glu]  [ ] [ ]
dt µ = if Ca2+ > Ca2+ thres
dt 

du 

= a(bv − u) 

dt − [glu] − κλ Otherwise

if v > vthres η = −λ + [glu]
then v → vreset dt
u→u+d
where [Ca2+ ]thres = 0.0018 mM, κ = 200 is the cou-
pling time constant between glutamate and the re-
where a = 0.02, b = 0.2, d = 8, vthres = 30, covery variable λ, µ and η are time constants with
vreset = −65, Iinput represents the current generated values 0.5 s and 10 s, respectively. The current gen-
by synaptic inputs originating from the input neu- erated in the neuron by the glial cell is given by
rons, given by the following experimentally determined relationship
first derived by Nadkarni and Jung59, 61 which relates
∑[ (
(t − tj )
)
current with glial cell calcium concentration.
Iinput = exp −
τd  ([ 2+ ] )
j
( )] 
 2.11[log Ca
] − 196.69
(t − tj ) 
− exp − H(t − tj ), if Ca2+ > 196.96 nM
Iglial =
τo 


0 otherwise
Pv3

As an additional feature, I explicitly allowed the glial where Ad = 0.001125 is a constant, R(t) is a low-pass
cell to alter the neurons recovery variable thus allow- filtered version of the output neuron’s firing pattern,
ing it to change excitability in a homeostatic fashion. p = 2, and ρneuron is the targert firing rate of the
Specifically, the parameter b which appears in the output neuron.
equation describing the neurons recovery variable u
was allowed to be altered in a activity dependent dR(t) R(t) ρpneuron
=− + ,
fashion exclusively driven by the glial cell.50 The cor- dt τR τR
responding equation is given by ρneuron = < ρ(t) >
db #of post-synaptic spikes
= −mIglial + (bs − b). = .
dt ∆T

Note that by changing the maximal amplitude of


2.4. Neural-glial Plasticity Rule the learning rule’s depression window is based on
the assumption that both glial and the output neu-
Plastic changes in the strength of excitatory synapses
ron’s activity can actively and concurrently alter
proceeds via the following new learning rule that is
the underlying biophysical state of both the synapse
both a function of spike timing and neural-glial ac-
and neural excitability. These changes can be viewed
tivity. This new rule can be viewed as an extension
as metaplastic in fashion, a form that when imple-
to the original spike timing-dependent plasticity rule
mented through a multiplicative operation resembles
where the amplitude of the depression component of
a form of Hebbian-like metaplastic learning.
the window is now a function of the neuron’s instan-
taneous firing rate and the current that is generated
in the neuron by the glial cell. This joint timing- 3. Results
neural-glial activity drives changes in the weights The learning rule that we have developed is pre-
of excitatory connections impinging onto the output sented in the materials and methods section under
neuron. The learning rule is expressed as follows the subsection title neural-glial plasticity rule. The
 neural-glial based rule takes advantage of both spike

 Ap exp (−|∆t|/τ+ ) if ∆t > 0 timing-dependent plasticity and the impact of the

∆wj = glial signaling on neural excitability and plasticity.

 −Am (R(t), Iglial ) exp (−|∆t|/τ− ) Our neural-glial plasticity rule simultaneously oper-

if ∆t ≤ 0 ates over two different timescales by combining tim-
ing dependent plastic change with slower alterations
where ∆t = tpre − tpost denotes the interspike inter- of both the rule and the nature of excitability of the
val (the time difference between the arrival time of an neuron. Experiments have shown that neurons com-
input tpre and the time when a post-synaptic spike municate with glial cells via glutamate that in turn
was generated tpost . Ap is a positive constant and triggers changes in calcium signaling in the glial cell
Am (R(t), Iglial ) is a function of the output neurons in response to input.10, 12, 13, 47, 66, 71, 72 In a recipro-
and glial activity, both of which scale the size of indi- cal manner, neurotransmitter is released from the
vidual weight changes. The time constants τ+ and τ− glial cell via an integrate-and-release process trig-
determines the temporal range of the learning win- gered by calcium exceeding some threshold. Experi-
dow in which synaptic strengthening and weakening mental data has suggested that glial cell activity also
occurs, whose parameter values are τ+ = τ− = 5 ms. operates on a longer timescale by allowing changes
The maximal amplitude of the depression win- to both the learning rule at the synapse and the na-
dow given by the following; ture of excitability of the neuron.6, 7, 12, 22, 47, 73 This
synapse-glial-neuron communication via calcium and
Iglial R(t) neurotransmitter forms the functional basis of our
Am (R(t), Iglial ) = 0.15Ad ,
ρptarget rate tripartate synapse and leads to both activity driven
Pv3

0.5 0.08

0.07
20 0.4
0.06

Synaptic weights
Feature space

40 0.05
0.3
0.04
60 0.2 0.03

0.02
80 0.1
0.01

100 0 0
1000 2000 3000 4000 5000 0 20 40 60 80 100
Recording steps of 10 sec Feature space
(A) (B)
Figure 2. Here the standard STDP learning was applied to our network leading to a complete failure in the emergence
of input selectivity. Simulations started by setting the weights of connections from the excitatory input neurons to the
output neuron to the initial value of 0.5. In (A) we present how the synaptic weights from the excitatory input neuron
to the output neuron evolves over 50000 seconds, where 5000 snapshots of these synaptic weights are recorded every 10
seconds. (B) Illustrates the final synaptic weights after the learning process that lasted 50000 seconds. Clearly the output
neuron did not learn to respond selectively to an input feature.

metaplastic and excitability change. To demonstrate ulation paradigm is again described in the subsec-
the usefulness of our neural-glial plasticity rule, we tion entitled stimulation paradigm in the materials
have used this new rule to illustrate that it can solve and methods section. During stimulation, only the
the problem of input selectivity. synapses contributed by the excitatory input neu-
For this task, we have set up a network of spiking rons onto the output neuron are modified via learn-
neurons composed of an input layer consisting of 100 ing. All other synaptic weights are fixed throughout
excitatory and 20 inhibitory cells, an output neuron, the simulation.
and a single glial cell. The input neurons respond As an initial step standard STDP,45 using the
in a stochastic fashion by action potential firing to following parameters Ap = 0.0025, Am = 0.001125,
set of 10 input features. The neurons in the input τp = 13.5 ms, and τm = 34.5 ms was applied to the
layer drive the output neuron to fire and the glial cell network to observe whether or not the output neu-
to develop a calcium-based response signal, respec- ron would learn to respond selectively to the input
tively. Furthermore, the output neuron also provides patterns that were stimulating the system. Figure
inputs to the glial cell, which in turn the calcium de- 2 shows the results of this initial simulation where
rived activity of the glial cell generates a current in input selectivity failed to emerge using standard
the output neuron. The output neuron is described STDP, noting that previous studies had required the
by the Izhekevich model67 while the dynamics of the STDP rule to be modified according to the averaging
glial cell is given by a system of ordinary differential dynamics and mean rate of STDP learning to achieve
equations (ODEs). A full description of the network such a goal.
architecture and the mathematical models for both Figure 2 illustrates both the final set of synap-
the output neuron and the glial cell are presented in tic weights and the evolution of these weights over
the material and methods section. The network was time. Figure 2(A) shows how these synaptic weights
stimulated by 10 input features by randomly select- change during the learning process that lasted 50000
ing a pattern and presenting this to the network for a seconds. Snap shots of these weights were recorded
total of 200 msec after which a new input feature was every 10 seconds. Figure 2(B) illustrates the final
randomly selected and used to stimulate the network. synaptic weights after the learning period of 50000
A full description of the stimulus patterns and stim- seconds. Clearly the output neuron did not learn to
Pv3

Figure 3. Here we present the neural-glial complex as a signal flow diagram that illustrates the interaction between the
learning rule, the neuron, and the glial cell as a tripartate partnership. Note how the learning process, neural, and glial
activities influence and interact with each other, where we note that this interaction takes place across two different tine
scales.

(A) (B)

Figure 4. Here the newly developed neural-glial plasticity rule was applied to our network and clearly leads to the suc-
cessful emergence of input selectivity. Simulations started by setting the weights of connections from the excitatory input
neurons to the output neuron to the initial value of 0.5. In (A) and (B) we present two different trials of how the excitatory
synaptic weights to the output neuron evolve over 20000 seconds, where 2000 snapshots of these synaptic weights are
recorded every 10 seconds. For both of these trials we see that the weight profile becomes tuned or well matched to one
of the input patterns after 20000 seconds of learning.

respond in a selective manner as the final weights The neural-glial plasticity rule that we have de-
clear show no preference for a particular input fea- veloped possess two subtle yet important features.
ture. Clearly standard STDP has failed to generate Supported by experimental findings, the new rule
an output neuron that is selective for a particular takes advantage of two different time scales where
input feature. If it had been successful one would plastic changes occur in the tripartate synapse of the
have expected to see a final set of synaptic weights neuron-glial cell complex. The neural-glial plasticity
that were both quite strong and well matched to a rule not only changes the synaptic weight of con-
single input feature. This matching of weights to in- nections but also adjust both the excitability of the
put feature guarantees the output neuron would fire neuron and modifies the temporal aspects of plastic
strongly and selectively for that input. change as learning progresses. In such a situation, the
Pv3

glial cell can be viewed as playing multiple rules in Figure 5 shows a single example of how the
addition to supporting the well-being of the neuron. evolved weights are a good match to one of the stim-
Here, glial cells actively take part in the learning pro- ulus inputs used during learning. For this example
cess, in a metaplastic fashion, and assists to adjust the output neuron will respond robustly and selec-
learning and the operational level of neural circuits tively to fifth feature input. Again the stimulation
over longer time scales probably in order to main- paradigm is the same as that detailed in the materi-
tain neural activity relatively constant. We dub this als and methods section.
tripartate system the neural-glial complex where the
interaction between the neuron, glial cell, and the 4. Discussion and Conclusion
influences of the learning process allows the plastic Previous experimental and theoretical investigations
change that occurs in the neural-glial complex to be into synaptic plasticity have primarily focused on
visualized from a signal flow point of view. Figure 3 understanding both the consequence(s) and mech-
presents the signal flow that occurs during learning anism(s) that give rise to synaptic change. Such
in the neural-glial complex. studies typically focus on the interaction between
We now repeat our experiment using the neural- pre- and post-synaptic neurons, the underlying phe-
glial plasticity rule whose formulation is presented in nomenological or biophysical mechanisms, and the
the materials and methods under the subsection ti- resulting functional impact of this interaction both
tled neural-glial plasticity rule. This rule relies on at the single cell and network level.28–31, 36, 38, 41, 42
change synaptic weights using both timing informa- The participation of glial cells, however, is rarely
tion and reciprocal signaling between the output neu- mentioned or discussed. Since the turn of the cen-
ron and the glial cell. Figure 4(A)-(B) illustrates the tury there has been a gradual change in consensus
evolution of synaptic weights over a 20000 second on the roles played by glial cells where a proper and
learning period. Two different trials are presented thorough re-examination of their roles in both in-
where the neural-glial plasticity rule clearly leads to formation processing and synaptic plasticity is re-
the formation of an output neuron that can respond quired.2, 6, 17, 19, 20, 74 This is expected to generate a
selectively. Here it is evident that there is subset of clarification about the true roles played by glial cells,
weights that are both strong and matched to one of such as astrocytes, during various cellular processes,
the ten inputs. This configuration guarantees that in particular their role during the development and
the output neuron will fire both strongly and effec- refinement of functional network activity and in-
tively. formation processing. Re-examination of the roles
played by glial cells in the brain has largely been
triggered by novel experiments producing data that
has started to overturn traditional views and be-
liefs.6, 8–10 One of the more significant being that
glials are present simply to support the well being
of neurons and are not involved in neural transmis-
sion. This was considered the norm, however grow-
ing amounts of experimental data are now illustrat-
ing glial cell responses to inputs are driven by cal-
cium signals rather than voltage.24, 73, 75, 76 More-
over, experiments have shown that glial cells can
communicate with neurons by illustrating changes
in a neuron’s membrane potential in response to
glial cell activation have been recorded11, 14, 25, 66, 71
Figure 5. Here we show the final set of synaptic weights and phenomenologically quantified.60, 61, 77 Further-
that emerged as a result of applying our neural-glial
more, experiments have also shown that astrocytes
learning rule for a learning period of 20000 seconds.
Clearly the weights are well matched and overlap with can affect neural transmission6, 12, 46–48, 78 at the level
the fifth feature vector. Hence the output neuron is ex- of single synapses and that glial cells can also in-
pected to respond vigorously and in a selective manner. fluence synaptic plasticity.6, 7, 21, 22 Finally, there is
Pv3

growing evidence of their involvement in the reg- tially even in an actor-critic role. For this to be ex-
ulation of cytokines79–82 and the development of amined further, new experiments need to be devised
neurological disorders like epilepsy, depression, and and carried out, in parallel, standard neural learn-
Alzheimer’s.46, 83, 84 Given that glial cells are esti- ing theory needs to be expanded to incorporate glial
mated to be ten times more numerous than neurons cell activity and it is here that there could be an in-
and are responsible for around half of the mass of the teresting twist where neural-glial signaling may po-
human brain,4, 5 it is now becoming critical that a far tentially implement a correlation-based operation to
more thorough and detailed re-examination of their learning that is also viewed as implementing meta-
roles in brain function and information processing is plastic change across two different timescales.
required. Significantly, this theoretical study was the first
In this paper we have studied how timing based display how neural-glial signaling can give rise to the
synaptic plasticity could be influenced by glial cell formation of a functional property called input se-
activity during the development of input selectiv- lectivity. We found that use of neural-glial signaling
ity, based on the nature of the tripartate synapse. and its physiology underlies metaplastic changes to
Specifically, we presented a neural-glial learning rule timing-based plasticity rules. Specifically, we found
that integrates timing based synaptic plasticity with neural-glial signaling to be critical in the neuron’s
the reciprocal nature of neural-glial communication. ability to develop selective responses to a set of stim-
This allows the rule to take advantage of dynam- uli. Underlying this capability is the dual time scale
ics over two different timescales that allow neurons, nature of signaling between neurons and glial cells
through their concerted interaction with glial cells, to involving both glutamate neurotransmitter and cal-
learn to respond selectively. Significantly, our study cium based cellular signaling. This natural inclusion
is able to provide a biological foundation or sub- of two temporal scales allows neural-glial plasticity to
strate to a commonly used augmentation that needs simultaneously implement processes that give rise to
to be used in spike timing based learning, such as synaptic plasticity and metaplasticity. This is signif-
STDP. For STDP to promote the formation of input icant as it indicates that multiple time scales aid the
selectivity requires introducing activity dependent implementation of novel learning methods, including
changes that augment the original rule, specifically yet to be discovered optimization strategies. Further-
the maximal amplitude of the depression window is more, from a theoretical view point, the inclusion
altered in an activity dependent manner according to of multiple time scales via neural-glial signaling en-
the averaged long time dynamics of STDP learning. riches the dynamical nature of learning, through the
This augmentation was introduced via a theoretical involvement of various biochemical processes includ-
construct. Our neural-glial rule however, is based on ing glutamate and calcium-based cellular signaling.
properties of tripartate synapses and particularly on The dual time scale nature of neural-glial signaling
reciprocal communication between the neuron and suggests that glial cells play an active role not only in
glial cell, which allows the formation of input selec- the maintenance but also in the formation and refine-
tivity. Changes in our learning rule result from meta- ment of functional properties of neurons and neural
plastic changes driven by correlation-based activity circuits. Glial cells can also be considered to have a
between the neuron and the glial cell. This is im- somewhat elusive character in the sense that their re-
portant for two reasons. Firstly, it is known that the sponses are calcium-based rather than being voltage-
glial cell can influence whether a synapse is potenti- dependent. Finally, there is growing evidence to sug-
ated or depressed due to calcium-based neural-glial gest a novel hypothesis that glial cells may act as part
signaling. Secondly, it hints at a potentially larger of a principal-agent neural framework as “gate keep-
role for glial cells in information processing specifi- ers” to neurons in the calcium domain controlling
cally through their potential involvement in imple- the context and flow of information transfer between
menting metaplasticity for both short-term and long neurons and influencing, and in some sense guiding
term changes. An interesting question about neural- the formation and refinement of cortical circuits in a
glial signaling is whether glial cells can act as a “Su- asymmetric fashion. It is clear that the actual roles
pervisor” by providing some form of teaching signal, of glial cells, despite being currently unknown, is ev-
or they can act more in a Reinforcement, or poten- idently far beyond their ill conceived and misleading
Pv3

10

portrayal as “passive” devices. and J. C. Sáez, New roles for astrocytes: gap junc-
tion hemichannels have something to communicate,
Trends in neurosciences 26(11) (2003) 610–617.
References 16. E. A. Newman, Propagation of intercellular calcium
waves in retinal astrocytes and müller cells, The
Bibliography Journal of Neuroscience 21(7) (2001) 2215–2223.
1. J. Kang, L. Jiang, S. A. Goldman and M. Neder- 17. E. M. Ullian, K. S. Christopherson and B. A. Bar-
gaard, Astrocyte-mediated potentiation of inhibitory res, Role for glia in synaptogenesis, Glia 47(3) (2004)
synaptic transmission, Nature neuroscience 1(8) 209–216.
(1998) 683–692. 18. N. J. Allen and B. A. Barres, Signaling between glia
2. A. Bacci, C. Verderio, E. Pravettoni and M. Matte- and neurons: focus on synaptic plasticity, Current
oli, The role of glial cells in synaptic function, Philo- opinion in neurobiology 15(5) (2005) 542–548.
sophical Transactions of the Royal Society B: Bio- 19. M. Slezak and F. W. Pfrieger, New roles for astro-
logical Sciences 354(1381) (1999) 403–409. cytes: regulation of cns synaptogenesis, Trends in
3. P. Kurosinski and J. Götz, Glial cells under physio- neurosciences 26(10) (2003) 531–535.
logic and pathologic conditions, Archives of neurol- 20. F. W. Pfrieger, Role of glial cells in the formation
ogy 59(10) (2002) 1524–1528. and maintenance of synapses, Brain research reviews
4. F. A. Azevedo, L. R. Carvalho, L. T. Grinberg, 63(1) (2010) 39–46.
J. M. Farfel, R. E. Ferretti, R. E. Leite, R. Lent, 21. D. T. Theodosis, D. A. Poulain and S. H. Oliet,
S. Herculano-Houzel et al., Equal numbers of neu- Activity-dependent structural and functional plas-
ronal and nonneuronal cells make the human brain ticity of astrocyte-neuron interactions, Physiological
an isometrically scaled-up primate brain, Journal of reviews 88(3) (2008) 983–1008.
Comparative Neurology 513(5) (2009) 532–541. 22. P. J. Magistretti, Neuron–glia metabolic coupling
5. R. S. Snell, Clinical neuroanatomy (Lippincott and plasticity, Journal of Experimental Biology
Williams & Wilkins, 2010). 209(12) (2006) 2304–2311.
6. E. A. Newman, New roles for astrocytes: regulation 23. C. G. Schipke and H. Kettenmann, Astrocyte re-
of synaptic transmission, Trends in neurosciences sponses to neuronal activity, Glia 47(3) (2004) 226–
26(10) (2003) 536–542. 232.
7. S. Paixão and R. Klein, Neuron–astrocyte commu- 24. T. Fellin, Communication between neurons and as-
nication and synaptic plasticity, Current opinion in trocytes: relevance to the modulation of synaptic and
neurobiology 20(4) (2010) 466–473. network activity, Journal of neurochemistry 108(3)
8. A. Araque, V. Parpura, R. P. Sanzgiri and P. G. Hay- (2009) 533–544.
don, Tripartite synapses: glia, the unacknowledged 25. F. Amzica and M. Steriade, Neuronal and glial mem-
partner, Trends in neurosciences 22(5) (1999) 208– brane potentials during sleep and paroxysmal oscilla-
215. tions in the neocortex, The Journal of Neuroscience
9. A. Araque, R. P. Sanzgiri, V. Parpura and P. G. 20(17) (2000) 6648–6665.
Haydon, Astrocyte-induced modulation of synaptic 26. H. Takechi, J. Eilers and A. Konnerth, A new class of
transmission, Canadian journal of physiology and synaptic response involving calcium release in den-
pharmacology 77(9) (1999) 699–706. dritic spines, Nature 396(6713) (1998) 757–760.
10. A. Araque, G. Carmignoto and P. G. Haydon, Dy- 27. M. F. Bear and R. C. Malenka, Synaptic plasticity:
namic signaling between astrocytes and neurons, An- Ltp and ltd, Current opinion in neurobiology 4(3)
nual Review of Physiology 63(1) (2001) 795–813. (1994) 389–399.
11. H. Hirase, L. Qian, P. Barthó and G. Buzsáki, Cal- 28. M. F. Bear, Bidirectional synaptic plasticity: from
cium dynamics of cortical astrocytic networks in theory to reality, Philosophical Transactions of the
vivo, PLoS Biol 2(4) (2004) p. E96. Royal Society of London B: Biological Sciences
12. G. Perea and A. Araque, Glial calcium signaling 358(1432) (2003) 649–655.
and neuron–glia communication, Cell calcium 38(3) 29. R. C. Malenka and M. F. Bear, Ltp and ltd: an em-
(2005) 375–382. barrassment of riches, Neuron 44(1) (2004) 5–21.
13. G. Perea and A. Araque, Properties of synaptically 30. S. M. Dudek and M. F. Bear, Homosynaptic long-
evoked astrocyte calcium signal reveal synaptic in- term depression in area ca1 of hippocampus and
formation processing by astrocytes, The Journal of effects of n-methyl-d-aspartate receptor blockade.,
neuroscience 25(9) (2005) 2192–2203. Proceedings of the National Academy of Sciences
14. X. Wang, N. Lou, Q. Xu, G.-F. Tian, W. G. Peng, 89(10) (1992) 4363–4367.
X. Han, J. Kang, T. Takano and M. Nedergaard, 31. S. M. Dudek and M. F. Bear, Bidirectional long-term
Astrocytic ca2+ signaling evoked by sensory stimu- modification of synaptic effectiveness in the adult
lation in vivo, Nature neuroscience 9(6) (2006) 816– and immature hippocampus, The Journal of Neuro-
823. science 13(7) (1993) 2910–2918.
15. M. V. Bennett, J. E. Contreras, F. F. Bukauskas 32. D. O. Hebb, Distinctive features of learning in the
Pv3

11

higher animal (London: Oxford University Press, chiatry and clinical neuroscience 251(4) (2001) 159–
1961). 169.
33. P. J. Sjöström, G. G. Turrigiano and S. B. Nelson, 49. T. Fellin and G. Carmignoto, Neurone-to-astrocyte
Rate, timing, and cooperativity jointly determine signalling in the brain represents a distinct multi-
cortical synaptic plasticity, Neuron 32(6) (2001) functional unit, The Journal of physiology 559(1)
1149–1164. (2004) 3–15.
34. R. Kempter, W. Gerstner and J. L. Van Hemmen, 50. D. Reato, M. Cammarota, L. C. Parra and
Hebbian learning and spiking neurons, Physical Re- G. Carmignoto, Computational model of neuron-
view E 59(4) (1999) p. 4498. astrocyte interactions during focal seizure gener-
35. S. Song, K. D. Miller and L. F. Abbott, Competitive ation, Frontiers in computational neuroscience 6
hebbian learning through spike-timing-dependent (2012).
synaptic plasticity, Nature neuroscience 3(9) (2000) 51. D. E. Postnov, L. S. Ryazanova and O. V. Sosnovt-
919–926. seva, Functional modeling of neural–glial interaction,
36. M. C. Van Rossum, G. Q. Bi and G. G. Turri- BioSystems 89(1) (2007) 84–91.
giano, Stable hebbian learning from spike timing- 52. D. Postnov, L. Ryazanova, N. Brazhe, A. Brazhe,
dependent plasticity, The Journal of Neuroscience G. Maximov, E. Mosekilde and O. Sosnovtseva,
20(23) (2000) 8812–8821. Giant glial cell: New insight through mechanism-
37. G.-q. Bi and M.-m. Poo, Synaptic modifications based modeling, Journal of biological physics 34(3-4)
in cultured hippocampal neurons: dependence on (2008) 441–457.
spike timing, synaptic strength, and postsynaptic 53. D. Postnov, R. Koreshkov, N. Brazhe, A. Brazhe
cell type, The Journal of neuroscience 18(24) (1998) and O. Sosnovtseva, Dynamical patterns of calcium
10464–10472. signaling in a functional model of neuron–astrocyte
38. Q. Bi and M. Poo, Precise spike timing determines networks, Journal of biological physics 35(4) (2009)
the direction and extent of synaptic modifications 425–445.
in cultured hippocampal neurons, J. Neurosci 18 54. D. Postnov, N. Brazhe and O. Sosnovtseva, Func-
(1998) 10464–10472. tional modeling of neural-glial interaction, Biosimu-
39. C. R. Rose and A. Konnerth, Stores not just for stor- lation in Biomedical Research, Health Care and Drug
age: intracellular calcium release and synaptic plas- Development, eds. E. Mosekilde, O. Sosnovtseva and
ticity, Neuron 31(4) (2001) 519–522. A. Rostami-Hodjegan (Springer, 2012), pp. 133–151.
40. R. S. Zucker, Calcium-and activity-dependent 55. A. Di Garbo, Dynamics of a minimal neural model
synaptic plasticity, Current opinion in neurobiology consisting of an astrocyte, a neuron, and an interneu-
9(3) (1999) 305–313. ron, Journal of biological physics 35(4) (2009) 361–
41. H. Z. Shouval, M. F. Bear and L. N. Cooper, A 382.
unified model of nmda receptor-dependent bidirec- 56. M. DiNuzzo, T. Gili, B. Maraviglia and F. Giove,
tional synaptic plasticity, Proceedings of the National Modeling the contribution of neuron-astrocyte cross
Academy of Sciences 99(16) (2002) 10831–10836. talk to slow blood oxygenation level-dependent sig-
42. S. Song and L. F. Abbott, Cortical development and nal oscillations, Journal of neurophysiology 106(6)
remapping through spike timing-dependent plastic- (2011) 3010–3018.
ity, Neuron 32(2) (2001) 339–350. 57. A. Pereira and F. A. Furlan, Astrocytes and hu-
43. J.-P. Pfister and W. Gerstner, Triplets of spikes in man cognition: modeling information integration
a model of spike timing-dependent plasticity, The and modulation of neuronal activity, Progress in
Journal of neuroscience 26(38) (2006) 9673–9682. Neurobiology 92(3) (2010) 405–420.
44. W. Gerstner and W. M. Kistler, Spiking neuron 58. A. N. Silchenko and P. A. Tass, Computational mod-
models: Single neurons, populations, plasticity (Cam- eling of paroxysmal depolarization shifts in neurons
bridge university press, 2002). induced by the glutamate release from astrocytes,
45. R. C. Froemke and Y. Dan, Spike-timing-dependent Biological cybernetics 98(1) (2008) 61–74.
synaptic modification induced by natural spike 59. S. Nadkarni and P. Jung, Dressed neurons: model-
trains, Nature 416(6879) (2002) 433–438. ing neural–glial interactions, Physical biology 1(1)
46. E. E. Benarroch, Neuron-astrocyte interactions: (2004) p. 35.
partnership for normal function and disease in the 60. S. Nadkarni and P. Jung, Synaptic inhibition
central nervous system, 80 (2005) 1326–1338. and pathologic hyperexcitability through enhanced
47. G. Perea, M. Navarrete and A. Araque, Tripartite neuron-astrocyte interaction: a modeling study,
synapses: astrocytes process and control synaptic Journal of integrative neuroscience 4(02) (2005)
information, Trends in neurosciences 32(8) (2009) 207–226.
421–431. 61. S. Nadkarni and P. Jung, Modeling synaptic trans-
48. F. Kirchhoff, R. Dringen and C. Giaume, Pathways mission of the tripartite synapse, Physical biology
of neuron-astrocyte interactions and their possible 4(1) (2007) p. 1.
role in neuroprotection, European archives of psy- 62. J. J. Wade, L. J. McDaid, J. Harkin, V. Crunelli and
12

J. Kelso, Bidirectional coupling between astrocytes 73. S. J. Smith, Neural signalling: Neuromodulatory as-
and neurons mediates learning and dynamic coordi- trocytes, Current Biology 4(9) (1994) 807–810.
nation in the brain: a multiple modeling approach, 74. D. D. Wang and A. Bordey, The astrocyte odyssey,
PLoS One 6(12) (2011) p. e29445. Progress in neurobiology 86(4) (2008) 342–367.
63. M. Amiri, G. Montaseri and F. Bahrami, On the 75. H. K. Kimelberg, Functions of mature mammalian
role of astrocytes in synchronization of two coupled astrocytes: a current view, The Neuroscientist 16(1)
neurons: a mathematical perspective, Biological cy- (2010) 79–106.
bernetics 105(2) (2011) 153–166. 76. B. A. Barres, The mystery and magic of glia: a per-
64. M. Amiri, F. Bahrami and M. Janahmadi, On the spective on their roles in health and disease, Neuron
role of astrocytes in epilepsy: a functional modeling 60(3) (2008) 430–440.
approach, Neuroscience research 72(2) (2012) 172– 77. J. Tang, J.-M. Luo and J. Ma, Information
180. transmission in a neuron-astrocyte coupled model,
65. M. Amiri, G. Montaseri and F. Bahrami, A phase PLOSONE 8(11) (2013) p. e80324.
plane analysis of neuron–astrocyte interactions, Neu- 78. M. Zonta and G. Carmignoto, Calcium oscillations
ral Networks 44 (2013) 157–165. encoding neuron-to-astrocyte communication, Jour-
66. D. S. Auld and R. Robitaille, Glial cells and neuro- nal of Physiology-Paris 96(3) (2002) 193–198.
transmission: an inclusive view of synaptic function, 79. J. E. Merrill and E. N. Benveniste, Cytokines in
Neuron 40(2) (2003) 389–400. inflammatory brain lesions: helpful and harmful,
67. E. M. Izhikevich et al., Simple model of spiking neu- Trends in neurosciences 19(8) (1996) 331–338.
rons, IEEE Transactions on neural networks 14(6) 80. M. Vila, V. Jackson-Lewis, C. Guégan, P. Teismann,
(2003) 1569–1572. D.-K. Choi, K. Tieu, S. Przedborski et al., The role
68. L. Pasti, A. Volterra, T. Pozzan and G. Carmignoto, of glial cells in parkinson’s disease, Current opinion
Intracellular calcium oscillations in astrocytes: a in neurology 14(4) (2001) 483–489.
highly plastic, bidirectional form of communication 81. F. Aloisi, G. Borsellino, A. Caré, U. Testa, P. Gallo,
between neurons and astrocytes in situ, The Journal G. Russo, C. Peschle and G. Levi, Cytokine regula-
of neuroscience 17(20) (1997) 7817–7830. tion of astrocyte function: in-vitro studies using cells
69. J. T Porter and K. D McCarthy, Astrocytic neuro- from the human brain, International journal of de-
transmitter receptors in situ and in vivo, Progress in velopmental neuroscience 13(3) (1995) 265–274.
neurobiology 51(4) (1997) 439–455. 82. R. E. Mrak, J. G. Sheng and W. S. T. Grif-
70. S. Kawabata, fin, Glial cytokines in alzheimer’s disease: review
R. Tsutsumi, A. Kohara, T. Yamaguchi, S. Nakan- and pathogenic implications, Human pathology 26(8)
ishi and M. Okada, Control of calcium oscillations (1995) 816–823.
by phosphorylation of metabotropic glutamate re- 83. G. Ricci, L. Volpi, L. Pasquali, L. Petrozzi and G. Si-
ceptors, Nature 383(6595) (1996) 88–92. ciliano, Astrocyte–neuron interactions in neurolog-
71. S. B. Achour and O. Pascual, Astrocyte–neuron ical disorders, Journal of biological physics 35(4)
communication: functional consequences, Neuro- (2009) 317–336.
chemical research 37(11) (2012) 2464–2473. 84. G. Seifert, G. Carmignoto and C. Steinhäuser, Astro-
72. R. D. Fields and G. Burnstock, Purinergic signalling cyte dysfunction in epilepsy, Brain research reviews
in neuron–glia interactions, Nature Reviews Neuro- 63(1) (2010) 212–221.
science 7(6) (2006) 423–436.

You might also like