Professional Documents
Culture Documents
Gia Dvali
Arnold Sommerfeld Center, Ludwig-Maximilians-Universität,
Theresienstraße 37, 80333 München, Germany,
Max-Planck-Institut für Physik, Föhringer Ring 6, 80805 München, Germany and
Center for Cosmology and Particle Physics, Department of Physics,
New York University, 726 Broadway, New York, NY 10003, USA
(Dated: January 12, 2018)
Motivated by the potential similarities between the underlying mechanisms of the enhanced mem-
ory storage capacity in black holes and in brain networks, we construct an artificial quantum neural
network based on gravity-like synaptic connections and a symmetry structure that allows to describe
the network in terms of geometry of a d-dimensional space. We show that the network possesses a
critical state in which the gapless neurons emerge that appear to inhabit a d−1-dimensional surface,
with their number given by the surface area. In the excitations of these neurons, the network can
arXiv:1801.03918v1 [hep-th] 11 Jan 2018
store and retrieve an exponentially large number of patterns within an arbitrarily narrow energy
gap. The corresponding micro-state entropy of the brain network exhibits an area law. The neural
network can be described in terms of a quantum field, via identifying the different neurons with
the different momentum modes of the field, while identifying the synaptic connections among the
neurons with the interactions among the corresponding momentum modes. Such a mapping allows
to attribute a well-defined sense of geometry to an intrinsically non-local system, such as the neural
network, and vice versa, it allows to represent the quantum field model as a neural network.
a way in which the sense of locality and geometry can tum oscillators describing the different momentum (and
be brought into something intrinsically non-local, such spin/helicity) modes of the field. On the other hand, in
as the neural network. a neural network the elementary degrees of freedom are
the excitations of neurons. We shall represent both of
However, in our construction we shall not simply these entities by the creation and annihilation operators
copy the quantum field model, but rather arrive to the â†k , âk , that satisfy the usual algebra,
desired neural network by a bottom-up approach. For
this purpose we design a neural network in which the [âr , â†k ] = δrk , [âr , âk ] = [â†r , â†k ] = 0 , (1)
synaptic connections are closer cousins to the gravita-
tional interaction as compared to the ones studied in where k and r are the labels. In case of a quantum
[1]. Namely, we study a network in which the synaptic field they identify the various momentum (or angular-
connections Ŵkr among the pairs of neurons (k, r) momentum) modes, whereas in a neural network they
are energetically negative and also proportional to the represent the labels of the neurons. The excitation level
products of their energy thresholds. of a neuron k in a given quantum state is described by an
eigenvalue (or an expectation value) of the corresponding
Again, as in the case of [1], we observe that such number operator n̂k ≡ â†k âk . Thus, the basic states of a
a network exhibits a critical state in which a set of neural network are the Fock states | n1 , n2 , .....i labeled
would-be-high-threshold neurons becomes effectively by the excitations levels of different neurons. Since on
gapless. Correspondingly, in this set of neurons the the quantum field theory side the analogous number
network can store an exponentially large number of operators describe the occupation numbers of respective
patterns within an arbitrarily narrow energy gap. momentum modes, the excitation level of a neuron is
translated as the occupation number of a particle mode.
The entropy of the resulting micro-states depends on
the symmetry structure of the network. We show that, Next thing is the interaction. The quantum neurons
when we impose a symmetry group of a d-dimensional influence each other through the synaptic connections,
sphere, a set of the gapless neurons emerges with their which can be represented as an operator with two or
number equal to an area of a d − 1-dimensional sphere more indexes, Ŵkr . When it is energetically favorable
of the same radius. Correspondingly, the micro-state for the two neurons k and r to simultaneously be in
entropy of the patterns encoded in the excitations of the the excited states, we shall call the synaptic connection
emergent gapless neurons also scales as the area of the excitatory in the energetic sense. Correspondingly, in the
same d − 1-dimensional sphere. opposite case we refer to the connection as inhibitory.
For the quantum field this translates as the interaction
Thus, it appears that the neural network - when energy between the two modes k and j being negative
translated in quantum field theoretic language - can (attractive) or positive (repulsive).
exhibit some intrinsic holographic properties, such as,
the emergence of the gapless neurons inhabiting a Now, the gravitational interaction among the particle
lower dimensional surface with the resulting micro-state modes is attractive and its strength is set by their ener-
entropy that scales as the corresponding area. This gies. Thus, in order to imitate gravity-like connections
is something highly reminiscent of gravitational sys- among the neurons, we shall make the synaptic connec-
tems, such as, the black holes [7] or the AdS space [8–10]. tion among the two neurons k and r negative (excitatory)
and moreover proportional to the product of their thresh-
old energies
In order to import certain ideas from black holes to the Next, we need to come up with some rough guideline
neural networks, we need to establish a dictionary. First, telling us for what type of states we should be looking
we need to connect the basic degrees of freedom in the for in the neural network. This guideline is very simple.
two systems. Let us first ask, what are the black holes From, the quantum field theoretic perspective defined on
from the quantum field theoretic point of view? Minkowski space, The Fock vacuum corresponds to a zero
Although a fully-satisfactory quantum description of occupation number of all the modes, | vaci = | 0, 0, .....i.
black holes is still missing, it is reasonably clear that The black hole state is certainly not a Fock vacuum,
they represent the states in a Hilbert space of quntized but rather some highly excited state. Indeed, to form
fields. We shall not question this statement. Our task a macroscopic black hole of certain size R, we need to
thus boils down to the need of establishing a dictionary produce a very high occupation number of the low mo-
between the states of the qiantum fields and the states of mentum quanta, localized within that region of space.
the quantum neural networks. In quantum field frame- In general, even in a pure gravity theory, a macroscopic
work the elementary degrees of freedom are the quan- black hole effectively consists of many quanta due to a
3
high occupation number of the constituent soft gravitons neuron k. An each level k exhibits a certain degeneracy
that form its gravitational field [12]. Nk due to a symmetry structure of the network that we
For our purposes, this very crude guideline will be shall discuss below. The Hamiltonian (3) can be viewed
enough. This guideline is telling us that with the as a generalized quantum version of the Hopfield model
black hole analogy, we need to look for a state of high [4], but with some important modifications that we shall
memory storage capacity among the states in which now specify.
some of the low-threshold neurons are highly excited,
i.e., corresponding quantum oscillators have the high The operator Ŵkj is a synaptic matrix operator. The
occupation numbers. idea is to choose it to be gravity-like:
k r k r X
To summirize, we establish the following dictionary: Ŵkr ≡ 3− 2 Cskqr â†s âq , (4)
2Λ ∗ s,q
• Particle momentum mode ←→ Neural degree of
freedom; where Λ is a parameter of dimensionality of energy,
whereas Cskqr are dimensionless coefficients that deter-
• Ocillator energy gap ←→ Excitation energy thresh- mine the structure of the synaptic connections. They
old of neuron; will be specified later. The relative factor 3 in the
• Mode occupation number ←→ Excitation level of brackets is introduced for convenience.
neuron;
The parameter ∗ determines the critical level k∗ ,
• Gravitational interaction among particles ←→ Ex- which represents the turning point. From (4) it is clear
citatory synaptic connection among neurons; that the synaptic connection energy among the neurons
changes sign at k r = 32∗ . The over-all sign will be
• Black hole state ←→ Critical state of highly excited normalized in such a way that the connection energy is
low threshold neurons. negative for k r < 32∗ . Thus, in this regime, the connec-
The above dictionary gives us a rough idea that tions are excitatory in the energetic sense. That is, an
in a neural network designed by the above rules, we excitation of one nauron makes it energetically favourable
should encounter a state of an enhanced memory storage to excite others. In other words, an excitation of a given
capacity in form of a state in which some of the lowest neuron, lowers the excitation thresholds of all the other
threshold neurons are highly excited. As we shall see, neurons connected to the former neuron.
this is indeed the case. Correspondingly, in the opposite regime, k r > 32∗ ,
the connection energy becomes positive. This fact
Finally, we would like to comment that our main goal guarantees that the energy of the network is bounded
is to reach a maximal energy efficiency of the memory from below. Indeed, for k r > 32∗ the synaptic
storage, as well as, the efficiency of the response to the connection becomes inhibitory, thereby preventing the
input external patterns. We shall not be interested in im- network from instability. An example of a neural net-
plementation of the learning algorithms and other com- work for a particular choice of Cskqr is depicted on Fig.1.
putational tasks in the quantum neural networks.
Notice, the above synaptic connection among the
neurons, in the excitatory regime, is analogous to a
III. NETWORK gravitational interaction among particles. Therefore,
such a setup represents a most naive way of bringing a
Consider a quantum neural network where neurons gravity-like dynamics into the neural networks. However,
are labelled by a set of integers k1 , ...kd , which we as we shall see, despite its simplicity, it suffices for
shall briefly denote by k. Each neuron corresponds generating an exponential enhancement of memory
to a quantum degree of freedom represented by the storage and pattern recognition capacities with the
corresponding entropy that obeys an area law.
creation and annihilation operators â†k , âk . They satisfy
the commutation relations (1), where k and r denote
We shall now impose a spherical symmetry on the
the two sets k1 , ...kd and r1 , ...rd respectively, and
structure of the neural network. We shall do this in
δrk ≡ δr1 k1 δr2 k2 ...δrd kd .
the
R d sense of a Fourier-transform, by assuming Cskqr ≡
d ΩYs∗ Yk∗ Yq Yr , where, Yk (ϑa ) are the harmonic func-
The Hamiltonian of the network has the following
tions on a d-dimensional unit sphere, with the set of
form,
angular coordinates ϑa , a = 1, ...d, a volume element
k â†k âk − dd Ω and a total volume Ω. Correspondingly, the label k
X X †
Ĥ = âk Ŵkr âr (3)
k k,r
stands for a set of d integers, i.e., Yk ≡ Yk1 ,...,kd , which
satisfy, |k1 | 6 k2 6 ... 6 kd = 0, 1, ..., ∞. These spherical
where the summation is taken over all sets. Here k is harmonics form a complete orthonormal set. In partic-
ular: dd Ω Yk∗ Yr = δkr . The functions Yk represent the
R
the threshold energy required for the excitation of the
4
redefinition of ∆.
Also, for any large-but-finite number N0 , there will diagonal synaptic connections.
be a maximal number n beyond which the interaction
terms shall become important and shall start costing a If we represents the b-neurons as the angular momen-
high energy. The good news is that all the above effects tum modes of a quantum field
can be kept under control at large N0 . X
χ̂ = Yk (ϑa )b̂k , (16)
In addition, due to the conservation of the angular mo- k
mentum, the micro-states split into the super-selection the coupling between the a and b neurons can be written
sectors corresponding to the different values of the total in a compact way as
angular momentum. Z
Ĥab = − dd Ω q(ψ̂ † χ̂ + χ̂† ψ̂) + κ0 χ̂† ∆χ̂ , (17)
Finally, let us comment that an alternative basis for the
information storage can be formed by the coherent states
of the gapless modes, instead of their number eigenstates. where q and κ0 are parameters. Rewriting in momentum
Such states, α∗1 , ..., α∗Ngapless , are the eigenstates of space, we get,
the destruction operators â∗γ and shall be labeled by the X †
(b̂k âk + â†k b̂k ) + b
X †
set of the corresponding complex eigenvalues α∗γ , Ĥab = q b̂k b̂k + ..., (18)
k∈k∗ k∈k∗
â∗γ α∗1 , ..., α∗Ngapless = α∗γ α∗1 , ..., α∗Ngapless .
where, b measures the energy gap for the minimal ex-
(15)
citation level of the input neurons, and q parameterizes
Here α∗γ are the complex parameters that among other
the strength of the synaptic connection between the in-
properties, satisfy the obvious relation |α∗γ |2 = hn̂∗γ i.
put and the output neurons. Since we wish the input
The two coherent P states are almost orthogonal provided
0 2 stimulus to be very soft, we shall take both b and q to
they satisfy γ |α∗γ − α ∗γ | 1. Such a set of the
be very small.
coherent states is approximately classical, provided the
Notice, because the a-neurons with k ∈ / k∗ have very
mean occupation numbers are large, i.e., |α∗γ | 1. The
high energy thresholds, they play no role in recognition
storage of information in the coherent states is especially
of patterns fed by the soft external stimuli carried
useful for generalizing the phenomenon of the critical en-
by b-neurons. Therefore, k ∈ / k∗ modes of b-neurons
hancement of memory to the classical brain networks, as
were disregarded in (18). So the sum only runs over
discussed in [1]. In such a case, from the information
the modes belonging to the critical level k ∈ k∗ and
storage point of view, the neural network becomes equiv-
over the corresponding modes from the b-sector. For
alent to the set of classical harmonic oscillators of very
convenience, we shall label the latter b-modes by the
low frequencies, with the patterns being stored in their
amplitudes and the phases. same index γ as the gapless a-modes: b̂∗γ ∈ b̂k∗ , where
γ = 1, 2, ...Ngapless .
The time-evolution of the state vector of the entire The above features may serve as a supporting evidence
i
system is given by | ti = e− ~ Ĥab t | inib ⊗ | inia , where we that some version of black hole information storage may
took into the account the double-scaling limit and the be taking place within classical brains.
fact that the rest of the Hamiltonian stays zero through-
out the evolution. Finally, we wish to stress that by no means our result
It is easy to obtain the time-evolution of the expec- should be interpreted as an indication that the real
tation values of the excitation levels of a-neurons. For quantum gravity effects play any role in memory storage
example, for b = 0, we have [14],[1]: in biological brains. Such suggestions have been made in
the past [15] and have been partially addressed by [17].
tq This is not the question we are trying to discuss.
ht | â†∗γ â∗γ | ti = |βγ |2 sin2 , (19)
2~
Our idea is fundamentally different. Following [1],
Thus, after time t = π~q , the state of output a-neurons, we suggest that the enhanced memory capacity mech-
copies the input pattern of b-neurons. In other words, anism that operates in black holes is very general in
the information can be encoded (or retrieved) at arbi- its essence and goes beyond the gravitational systems.
trarily small energy cost. Due to criticality, the neural Moreover, it possess a well-defined classical counterpart.
network is sensitive to arbitrarily soft external stimuli. Correspondingly, this mechanism can be operative in
the brain networks, both quantum and classical.
[1] G. Dvali, Critically excited states with enhanced memory [5] J. D. Bekenstein, Black holes and entropy, Phys. Rev. D
and pattern recognition capacities in quantum brain net- 7 (1973) no. 8, 2333–2346.
works: Lesson from black holes, arXiv:1711.09079 [quant- [6] G. Dvali, Area Law Micro-State Entropy from Criticality
ph]. and Spherical Symmetry, arXiv:1712.02233 [hep-th]
[2] G. Dvali and C. Gomez, Black Holes as Critical Point of [7] G.’t Hooft, Dimensional reduction in quantum gravity,
Quantum Phase Transition, Eur. Phys. J. C 74 (2014) gr-qc/9310026;
2752, arXiv:1207.4059 [hep-th]. L. Susskind, The World As A Hologram, J. Math. Phys.
[3] S.C. Kak, Quantum Neural Computing, Advances in 36, 6377 (1995), hep-th/9409089
Imaging and Electron Physics, 94 (1995) 259-314. [8] J.M. Maldacena, The large N limit of superconformal
[4] J.J. Hopfield, Neural Networks and Physical Systems with field theories and supergravity, Adv. Theor. Math. Phys.
Emergent Collective Computational Abilities, Proc, Natl. 2, 231 (1998), hep-th/9711200;
Acad. Sci. USA 79 (1982) 2554
8
[9] S.S. Gubser, I.R. Klebanov and A.M. Polyakov, Gauge For an incomplete list of references, suggesting relevance
theory correlators from non-critical string theory, Phys. of quantum mechanics for biological brains, see [16].
Lett. B 428, 105 (1998), hep-th/9802109; [16] C.I.J.M. Stuart, Y. Takahashi and H. Umezawa, Mixed
[10] E. Witten, Anti-de Sitter space and holography, Adv. system brain dynamics neural memory as a macroscopic
Theor. Math. Phys. 2, 253 (1998), hep-th/9802150 ordered state Foundations of Physics 9 (1979) 301.
[11] L. Susskind and E. Witten, The holographic bound in R. Penrose, Shadows of the Mind, Oxford University
anti-de Sitter space, hep-th/9805114 Press, London, 1994;
[12] G. Dvali and C. Gomez, Black Hole’s Quantum N- K. Pribram, Brain and Perception, (Lawrence Erlbaum,
Portrait, Fortsch. Phys. 61 (2013) 742 [arXiv:1112.3359 NJ, 1991);
[hep-th]]. A. Shimony, Search for a Naturalistic World View, Cam-
[13] N. Bogoliubov, On the theory of superfluidity, J. Phys bridge University Press Cambridge, 1993;
11 no. 1, 23. H.P. Stapp, Mind Matter and Quantum Mechanics,
[14] G. Dvali and M. Panchenko, Black Hole Type Quan- Springer-Verlag, Berlin, 1993.
tum Computing in Critical Bose-Einstein Systems, M. Jibu, S. Hagan, S.R. Hamero, K. H. Pribram and
arXiv:1507.08952 [hep-th]; Black Hole Based Quan- K. Yasue, Quantum optical coherence in cytoskeletal mi-
tum Computing in Labs and in the Sky, Fortschr. crotubules: implications for brain function, Bio Systems,
Phys. 64 (2016) no. 8-9, 569–580, arXiv:1601.01329 32 (1994) 195.
[hep-th]. [17] M. Tegmark, The importance of quantum decoherence
[15] see, e.g., N.E. Mavromatos, D.V. Nanopoulos, A Non- in brain processes, Phys. Rev. E 61(4), 4194 (2000),
critical String (Liouville) Approach to Brain Micro- arXiv:quant-ph/9907009
tubules: State Vector reduction, Memory coding and Ca-
pacity, arXiv:quant-ph/9512021;