Professional Documents
Culture Documents
(Received 11 May 2018; revised manuscript received 10 August 2018; published 17 September 2018)
We report a transition from asynchronous to oscillatory behavior in balanced inhibitory networks for
class I and II neurons with instantaneous synapses. Collective oscillations emerge for sufficiently
connected networks. Their origin is understood in terms of a recently developed mean-field model,
whose stable solution is a focus. Microscopic irregular firings, due to balance, trigger sustained oscillations
by exciting the relaxation dynamics towards the macroscopic focus. The same mechanism induces in
balanced excitatory-inhibitory networks quasiperiodic collective oscillations.
DOI: 10.1103/PhysRevLett.121.128301
Introduction.—Cortical neurons fire quite irregularly and the membrane potential evolution, which can be the
with low firing rates, despite being subject to a continuous transmission delay [5,15] or a finite synaptic time [16].
bombardment from thousands of presynaptic excitatory and As the frequency of the COs is related to such external
inhibitory neurons [1]. This apparent paradox can be solved timescale this mechanism is normally related to fast
by introducing the concept of a balanced network, where (>30 Hz) oscillations. Nevertheless, despite many theo-
excitation and inhibition balance each other and the retical studies, it remains unclear which other mechanisms
neurons are kept near their firing threshold [2]. In this could be invoked to justify the broad range of COs’
regime spikes, representing the elementary units of infor- frequencies observed experimentally [17].
mation in the brain, are elicited by stochastic fluctuations in In this Letter we present a novel mechanism for the
the net input current yielding an irregular microscopic emergence of COs in balanced spiking inhibitory networks
activity, while neurons can promptly respond to input in the absence of any synaptic or delay timescale. In
modifications [3]. particular, we show for class I and II neurons [18] that COs
In neural network models balance can emerge sponta- arise from an asynchronous state by increasing the network
neously in coupled excitatory and inhibitory populations connectivity (in-degree). Furthermore, we show that the
thanks to the dynamical adjustment of their firing rates COs can survive only in the presence of irregular spiking
[4–9]. The usually observed dynamics is an asynchronous dynamics due to the dynamical balance. The origin of COs
state characterized by irregular neural firing joined to can be explained by considering the phenomenon at a
stationary firing rates [4,6,7,9]. The asynchronous state macroscopic level; in particular, we extend an exact mean-
has been experimentally observed both in vivo and in vitro field formulation for the spiking dynamics of quadratic
[10,11]; however this is not the only state observable during integrate-and-fire (QIF) neurons [19] to sparse balanced
spontaneous cortical activity. In particular, during sponta- networks. An analytic stability analysis of the mean-field
neous cortical oscillations excitation and inhibition wax model reveals that the asymptotic solution for the macro-
and wane together [12], suggesting that balancing is crucial scopic model is a stable focus and determines the frequency
for the occurrence of these oscillations with inhibition of the associated relaxation oscillations. The agreement of
representing the essential component for the emergence of this relaxation frequency with the COs’ one measured in
the synchronous activity [13,14]. the spiking network suggests that the irregular microscopic
The emergence of collective oscillations (COs) in firings of the neurons are responsible for the emergence of
inhibitory networks has been widely investigated in net- sustained COs corresponding to the relaxation dynamics
works of spiking leaky integrate-and-fire (LIF) neurons. In towards the macroscopic focus. This mechanism elicits
particular, it has been demonstrated that COs emerge from COs through the excitation of an internal macroscopic
asynchronous states via Hopf bifurcations in the presence timescale, which can range from seconds to tens of
of an additional timescale, beyond the one associated with milliseconds, yielding a broad range of collective
neuron #
characterized by two distinct frequencies, whose emer- 5000 5000
gence is due, also in this case, to the excitation of a mean-
field focus induced by fluctuation-driven microscopic 2500 2500
dynamics.
The model.—We consider a balanced network of N 20 30
vi(t)
0 0
-30
pulse-coupled inhibitory neurons, whose membrane poten- -20
1.5 -20
tial evolves as
128301-2
PHYSICAL REVIEW LETTERS 121, 128301 (2018)
0
10
(a) R Γ V2 þ I
R_ ¼ V_ ¼
(b)
2V þ ; þ Rḡ − ðπRÞ2 τm ; ð3Þ
-1 τm π τm
-1
10
10 1
ρ
0 0
to an average
pffiffiffiffi inhibitory synaptic current of amplitude
0.8 0.8 g0 ki R=ð K Þ proportional to its in-degree ki . Therefore, we
CV
0.4 0.4 can consider the neurons as fully coupled, but with random
0 0 values ofpthe
ffiffiffiffi coupling distributed as a Lorentzian of median
0.01 1 0.01 0.1 1
I0 Δ0 ḡ ¼ −g0 K and HWHM Γ ¼ g0 Δ0 . The mean-field for-
mulation (3) takes now the expression,
FIG. 2. Upper panels: order parameter ρ versus K for QIF (a)
and ML (b), the insets report the corresponding CVs. The lower gΔ
panels display in the upper part ρ and in the lower one the CV τm R_ ¼ R 2V þ 0 0 ð4Þ
π
versus I 0 (c) and Δ0 (d) for the QIF. The data refer to various
system sizes: namely, N ¼ 2000 (black), 5000 (red), 10 000 pffiffiffiffi
(green), and 20 000 (violet). The employed parameters are τm V_ ¼ V 2 þ K ðI 0 − τm g0 RÞ − ðπRτm Þ2 : ð5Þ
I 0 ¼ 0.1, g0 ¼ 5, and Δ0 ¼ 1 for ML (b); for QIF g0 ¼ 1,
Δ0 ¼ 0.1, I 0 ¼ 0.006, K ¼ 1000 when not otherwise stated. As we will verify in the following, this formulation
represents a quite good approximation of the collective
by considering the behavior of ρ and CV as a function of dynamics of our network. Therefore, we can safely employ
the external current I 0 and of the parameter controlling the such an effective mean-field model to interpret the observed
structural heterogeneity, namely, Δ0 . The results of these phenomena and to obtain theoretical predictions for the
analyses are shown in Figs. 2(c) and 2(d) for the QIF and spiking network.
for N ¼ 2 000, 10 000, and 20 000. In both cases we fixed Let us first consider the fixed point solutions ðV̄; R̄Þ of
an in-degree K > K c in order to observe collective oscil- Eqs. (4), (5). The result for the average membrane potential
lations and then we increased I 0 or Δ0. In both cases we is V̄ ¼ ð−g0 Δ0 Þ=ð2πÞ, while the firing rate is given by the
observe that for large I 0 (Δ0 ) the microscopic dynamics is following expression:
now imbalanced with few neurons firing regularly with
high rates and the majority of neurons suppressed by this pffiffiffiffi sffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffi !
g0 K 4π 2 I 0 Δ20
high activity. This induces a vanishing of the CV, which R̄τm ¼ 1 þ pffiffiffiffi 2 þ −1 : ð6Þ
somehow measures the degree of irregularity in the micro- 2π 2 K g0 K
scopic dynamics. At large I 0 the dynamics of the network is
controlled by neurons definitely suprathreshold and the This theoretical result reproduces quite well with the
dynamics becomes mean driven [30,31]. The same occurs simulation findings for the QIF spiking network in the
by increasing Δ0 , when the heterogeneity in the in-degree asynchronous regime (observable for sufficiently high Δ0
distribution becomes sufficiently large only few neurons, and I 0 ) over a quite broad range of connectivities (namely,
the ones with in degrees in proximity of the mean K, can 10 ≤ K ≤ 104 ), as shown in Fig. 3(a). At the leading order
balance their activity, while for the remaining neurons it is in K, the firing rate (6) is given by Ra τm ¼ I 0 =g0, which
no more possible to satisfy the balance conditions, as represents the asymptotic result to which the balanced
recently shown in Refs. [32–34]. As a result, COs disappear inhibitory dynamics converges for sufficiently large in
as soon as the microscopic fluctuations, due to the balanced degrees irrespectively of the considered neuronal model,
irregular spiking activity, vanish. as shown in Figs. 3(a) and 3(b) for the QIF and ML models
Effective mean-field model.—In order to understand the and as previously reported in Ref. [24] for LIF neurons. In
origin of these macroscopic oscillations we consider an particular, for the ML model the asymptotic result Ra is
exact macroscopic model recently derived in Ref. [19] for attained already for K ≥ 500, while for the QIF model in
fully coupled networks of pulse-coupled QIF with synaptic degrees larger than 104 are required.
couplings randomly distributed according to a Lorentzian. The linear stability analysis of the solution ðV̄; R̄Þ
The mean-field dynamics of this QIF network can be reveals that this is always a stable focus, characterized
expressed in terms of only two collective variables (namely, by two complex conjugate eigenvalues with a negative
V and R), as follows [19]: real part ΛR τm ¼ −Δ0 =2π and an imaginary part
128301-3
PHYSICAL REVIEW LETTERS 121, 128301 (2018)
25000
(a) (b) (a)
50 2.5 (c)
20000
<R> (Hz) 100
neuron #
40
2 15000
ν1 (Hz)
30
10000
20 1.5
5000
10 0 10
2 4 2 3 4
10 10 K 10 10 K 10 10 0
100 0 0.1 0.2
80 (d)
(c) 20 time (s)
1 (d)
ν1
νosc (Hz)
ν2 (Hz)
50 2 3
0.1 ν1+ν2
10 10 ν2
S(ν)
0
10
-2
10
-1
10
0 10 ν1-ν2 2ν1+ν2 10
0.01
0 -4 -3 -2 -1 1 2 3 4 1
10 10 10 10 10 10 10 10
I0 K 0 25 50 75 100 125 0.001 0.01 0.1 1
ν (Hz) I0
(e)
FIG. 3. Upper panels: average firing rates hRi versus K for QIF
(a) and ML (b), the horizontal dashed (magenta) lines denote Ra FIG. 4. The raster plot for a network of N E ¼ 20 000 excitatory
and the solid (red) line in (a) R̄ in Eq. (6). The choice of (green) and N I ¼ 5000 inhibitory (red) QIF neurons is displayed
parameters (I 0 , Δ0 ) sets the dynamics as asynchronous: (1, 3) in in (a). In (c) and (d) the COs’ frequencies, measured from the
(a) and (0.05, 8) in (b). Lower panels: νosc versus I 0 (c) and versus power spectrum SðνÞ of the mean voltage VðtÞ [shown in (b)], are
K (d) for the QIF, the insets display the same quantities for the reported as symbols versus the excitatory dc current I e0 . The
ML. The red solid line in (c) refers to νth , and in (d) to dashed lines are the theoretical mean-field predictions. The values
1
the theoretically predicted scaling νth ∼ K 4 ; the red dashed line of the parameters are reported in Ref. [22].
in the inset of (c) and (d) to power-law fitting νosc ≃ I 0.40 and
νosc ≃ K 0.10 , respectively. Oscillatory dynamics is observable for
the selected parameter’s values (I 0 , Δ0 ): (0.05, 0.3) in (c) and of the neurons. This is evident from the raster plot reported
(0.05, 0.5) in (d). Other parameters’ values N ¼ 10 000, g0 ¼ 1, in Fig. 4(a). An important novelty is that now the
and K ¼ 1000 in (c). oscillations are characterized by two fundamental frequen-
cies as it becomes evident from the analysis of the power
qffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffi
ffi spectrum SðνÞ of the mean voltage VðtÞ shown in Fig. 4(b).
pffiffiffiffi
ΛI τm ¼ 2R̄τm ð2π 2 R̄τm þ K g0 Þ − ðΔ0 =2πÞ2 . The fre- As expected for a noisy quasiperiodic dynamics, the
spectrum reveals peaks of finite width at frequencies that
quency of the relaxation oscillations towards the stable
can be obtained as linear combinations of two fundamental
fixed point solution is given by νth ¼ ΛI =2π. This repre-
frequencies ν1 and ν2 . The origin of the noisy contribution
sents a good approximation of the frequency νosc of the
can be ascribed to the microscopic irregular firings of the
sustained collective oscillations observed in the QIF net-
neurons. Analogously to the inhibitory case, a theoretical
work over a wide range of values ranging from ultraslow
prediction for the collective oscillation frequencies can be
rhythms to high γ band oscillations, as shown in Fig. 3(c).
obtained by considering an effective mean-field model for
Furthermore, it can be shown that νth predicts the correcting
the excitatory and inhibitory populations of QIF neurons.
scaling of νosc for the QIF for sufficiently large dc currents
The model is now characterized by 4 variables, i.e., the
and/or median in-degree K, namely, νth ≈ I 1=2 0 K
1=4
[as mean membrane potential and the firing rate for each
shown in Figs. 3(c) and 3(d)]. For the ML we observe population, and also in this case one can find as stationary
similar scaling behaviors for νosc, with slightly different solutions of the model a stable focus. However, the stability
exponent, namely, νosc ≈ I 0.4 0 and νosc ≃ K
0.10
; however in of the focus is now controlled by two couples of complex
this case we have no theoretical prediction with which to conjugate eigenvalues; thus the relaxation dynamics of the
compare [see the insets of Figs. 3(c) and 3(d)]. mean field towards the fixed point is quasiperiodic (see the
Excitatory-inhibitory balanced populations.—So far we Supplemental Material for more details [22]). A compari-
have considered only balanced inhibitory networks, but in son between the theoretical values of these relaxation
the cortex the balance occurs among excitatory and frequencies and the measured oscillation frequencies ν1
inhibitory populations. To verify if also in this case and ν2 associated to the spiking network dynamics is
collective oscillations could be identified we have consid- reported in Figs. 4(c) and 4(d) for a wide range of dc
ered a neural network composed of 80% excitatory QIF currents, revealing an overall good agreement. Thus sug-
neurons and 20% inhibitory ones (for more details on the gesting that the mechanism responsible for the collective
considered model see the Supplemental Material in oscillations remains the same identified for the inhibitory
Ref. [22]). The analysis reveals that also in this case network.
collective oscillations can be observed in the balanced Conclusions.—We have shown that in balanced spiking
network in the presence of irregular microscopic dynamics networks with instantaneous synapses COs can be triggered
128301-4
PHYSICAL REVIEW LETTERS 121, 128301 (2018)
by microscopic irregular fluctuations, whenever the neu- [6] A. Renart, J. de la Rocha, P. Bartho, L. Hollender, N. Parga,
rons will share a sufficient number of common inputs. A. Reyes, and K. D. Harris, Science 327, 587 (2010).
Therefore, for a sufficiently large in degree the erratic [7] A. Litwin-Kumar and B. Doiron, Nat. Neurosci. 15, 1498
spiking emissions can promote coherent dynamics. We (2012).
[8] J. Kadmon and H. Sompolinsky, Phys. Rev. X 5, 041030
have verified that the inclusion of a small synaptic time-
(2015).
scale does not alter the overall scenario [25]. [9] M. Monteforte and F. Wolf, Phys. Rev. Lett. 105, 268104
It is known that heuristic firing-rate models, character- (2010).
ized by a single scalar variable (e.g., the Wilson-Cowan [10] J. Barral and A. D. Reyes, Nat. Neurosci. 19, 1690 (2016).
model [36]), are unable to reproduce synchronization [11] N. Dehghani, A. Peyrache, B. Telenczuk, M. Le Van Quyen,
phenomena observed in spiking networks [37,38]. In this E. Halgren, S. S. Cash, N. G. Hatsopoulos, and A. Destexhe,
Letter, we confirm that the inclusion of the membrane Sci. Rep. 6, 23176 (2016).
dynamics in the mean-field formulation is essential to [12] M. Okun and I. Lampl, Nat. Neurosci. 11, 535 (2008).
correctly predict the frequencies of the COs, not only for [13] J. S. Isaacson and M. Scanziani, Neuron 72, 231 (2011).
finite synaptic times (as shown in Ref. [38]), but also for [14] M. Le Van Quyen, L. E. Muller, B. Telenczuk, E. Halgren,
instantaneous synapses in dynamically balanced sparse S. Cash, N. G. Hatsopoulos, N. Dehghani, and A. Destexhe,
Proc. Natl. Acad. Sci. U.S.A. 113, 9363 (2016).
networks. In this latter case, the internal timescale of the
[15] N. Brunel and V. Hakim, Neural Comput. 11, 1621 (1999).
mean-field model controls the COs’ frequencies over a [16] C. Van Vreeswijk, L. Abbott, and G. B. Ermentrout,
wide and continuous range. As we have verified, sustained J. Comput. Neurosci. 1, 313 (1994).
oscillations can be triggered in the mean-field model by [17] G. Chen, Y. Zhang, X. Li, X. Zhao, Q. Ye, Y. Lin, H. W. Tao,
adding noise to the membrane dynamics. Therefore, an M. J. Rasch, and X. Zhang, Neuron 96, 1403 (2017).
improvement of the mean-field theory here presented [18] E. M. Izhikevich, Dynamical Systems in Neuroscience (MIT
should include fluctuations around the mean values. A Press, Cambridge, MA, 2007).
possible strategy could follow the approach reported in [19] E. Montbrió, D. Pazó, and A. Roxin, Phys. Rev. X 5,
Ref. [37] to derive high-dimensional firing-rate models 021028 (2015).
from the associated Fokker-Planck description of the neural [20] G. B. Ermentrout and N. Kopell, SIAM J. Appl. Math. 46,
dynamics [5,15]. Of particular interest would be to under- 233 (1986).
[21] C. Morris and H. Lecar, Biophys. J. 35, 193 (1981).
stand if a two-dimensional rate equation [37] is sufficient to
[22] See Supplemental Material at http://link.aps.org/
faithfully reproduce collective phenomena also in balanced supplemental/10.1103/PhysRevLett.121.128301 for details
networks. on the ML model, on inhibitory QIF networks with
Our results pave the way for a possible extension of the Gaussian distributed in degrees, on the excitatory-inhibitory
reported mean-field model to spatially extended balanced QIF network, and the corresponding mean-field model.
networks [39–42] by following the approach employed to [23] S. Jahnke, R.-M. Memmesheimer, and M. Timme, Front.
develop neural fields from neural mass models [43]. Comput. Neurosci. 3, 13 (2009).
[24] M. Monteforte and F. Wolf, Phys. Rev. X 2, 041007 (2012).
The authors acknowledge N. Brunel for extremely useful [25] H. Bi, M. Segneri, M. di Volo, and A. Torcini, Coexistence
comments on a preliminary version of this Letter, as well as of fast and slow gamma oscillations in a single inhibitory
V. Hakim, E. Montbrió, and L. Shimansky-Geier for neural population (to be published).
enlightening discussions. A. T. has received partial support [26] The coefficient of variation cvðiÞ for the neuron i is the ratio
by the Excellence Initiative I-Site Paris Seine (No. ANR- between the standard deviation and the mean of the
16-IDEX-008) and by the Labex MME-DII (No. ANR-11- interspike intervals associated with the train of spikes
LBX-0023-01). The work has been mainly realized at the emitted by the considered neuron. PThe average coefficient
Max Planck Institute for the Physics of Complex Systems of variation is defined as CV ¼ i cvðiÞ=N.
(Dresden, Germany) as part of the activity of the Advanced [27] D. Golomb, Scholarpedia 2, 1347 (2007).
[28] D. Golomb and D. Hansel, Neural Comput. 12, 1095
Study Group “From Microscopic to Collective Dynamics
(2000).
in Neural Circuits.” [29] S. Luccioli, S. Olmi, A. Politi, and A. Torcini, Phys. Rev.
Lett. 109, 138103 (2012).
[30] A. Renart, R. Moreno-Bote, X.-J. Wang, and N. Parga,
Neural Comput. 19, 1 (2007).
[1] A. Destexhe and D. Paré, J. Neurophysiol. 81, 1531 (1999). [31] D. Angulo-Garcia, S. Luccioli, S. Olmi, and A. Torcini,
[2] T. P. Vogels, K. Rajan, and L. F. Abbott, Annu. Rev. New J. Phys. 19, 053011 (2017).
Neurosci. 28, 357 (2005). [32] I. D. Landau, R. Egger, V. J. Dercksen, M. Oberlaender, and
[3] S. Denève and C. K. Machens, Nat. Neurosci. 19, 375 H. Sompolinsky, Neuron 92, 1106 (2016).
(2016). [33] R. Pyle and R. Rosenbaum, Phys. Rev. E 93, 040302
[4] C. van Vreeswijk and H. Sompolinsky, Science 274, 1724 (2016).
(1996). [34] F. Farkhooi and W. Stannat, Phys. Rev. Lett. 119, 208301
[5] N. Brunel, J. Comput. Neurosci. 8, 183 (2000). (2017).
128301-5
PHYSICAL REVIEW LETTERS 121, 128301 (2018)
[35] M. di Volo, R. Burioni, M. Casartelli, R. Livi, and A. [40] R. Rosenbaum and B. Doiron, Phys. Rev. X 4, 021039
Vezzani, Phys. Rev. E 90, 022811 (2014). (2014).
[36] H. R. Wilson and J. D. Cowan, Biophys. J. 12, 1 (1972). [41] R. Pyle and R. Rosenbaum, Phys. Rev. Lett. 118, 018103
[37] E. S. Schaffer, S. Ostojic, and L. F. Abbott, PLoS Comput. (2017).
Biol. 9, e1003301 (2013). [42] J. Senk, K. Korvasová, J. Schuecker, E. Hagen, T. Tetzlaff,
[38] F. Devalle, A. Roxin, and E. Montbrió, PLoS Comput. Biol. M. Diesmann, and M. Helias, arXiv:1801.06046.
13, e1005881 (2017). [43] S. Coombes, Scholarpedia 1, 1373 (2006), revision
[39] B. Kriener, M. Helias, S. Rotter, M. Diesmann, and G. T. No. 138631.
Einevoll, BMC Neurosci. 14, P123 (2013).
128301-6