Professional Documents
Culture Documents
Brain Computations and Connectivity Edmund T Rolls Full Chapter
Brain Computations and Connectivity Edmund T Rolls Full Chapter
Edmund T. Rolls
Visit to download the full and correct content document:
https://ebookmass.com/product/brain-computations-and-connectivity-edmund-t-rolls/
Brain Computations and Connectivity
Brain Computations and Connectivity
Edmund T. Rolls
Oxford Centre for Computational Neuroscience
Oxford
England
Great Clarendon Street, Oxford, OX2 6DP,
United Kingdom
Oxford University Press is a department of the University of Oxford.
It furthers the University’s objective of excellence in research, scholarship,
and education by publishing worldwide. Oxford is a registered trade mark of
Oxford University Press in the UK and in certain other countries
c Edmund T. Rolls 2023
The moral rights of the author have been asserted
Some rights reserved. No part of this publication may be reproduced, stored in
a retrieval system, or transmitted, in any form or by any means, for commercial purposes,
without the prior permission in writing of Oxford University Press, or as expressly
permitted by law, by licence or under terms agreed with the appropriate
reprographics rights organization.
This is an open access publication, available online and distributed under the terms of a
Creative Commons Attribution – Non Commercial – No Derivatives 4.0
International licence (CC BY-NC-ND 4.0), a copy of which is available at
http://creativecommons.org/licenses/by-nc-nd/4.0/.
Enquiries concerning reproduction outside the scope of this licence
should be sent to the Rights Department, Oxford University Press, at the address above
Published in the United States of America by Oxford University Press
198 Madison Avenue, New York, NY 10016, United States of America
British Library Cataloguing in Publication Data
Data available
Library of Congress Control Number: 2023940370
ISBN 978–0–19–888791–1
DOI: 10.1093/oso/9780198887911.001.0001
Printed and bound by
CPI Group (UK) Ltd, Croydon, CR0 4YY
Links to third party websites are provided by Oxford in good faith and
for information only. Oxford disclaims any responsibility for the materials
contained in any third party website referenced in this work.
Preface
This book, Brain Computations and Connectivity is an update to Rolls Brain Computations:
What and How published by Oxford University Press in 2021. A key part of this updated
version of Brain Computations: What and How is the addition of much new evidence that
has emerged since 2021 on the connectivity of the human brain, which by analysing the
effective or causal connectivity between 360 cortical regions, enriches our understanding
of information processing streams in the human cerebral cortex. Knowing how one cortical
region connects to other cortical regions helps to provide a deeper understanding of how
each stage in a processing stream contributes to the computations being performed, as each
processing stream is now becoming better defined.
The addition in Brain Computations and Connectivity of much new evidence on the con-
nectivity of the human brain is leading to better understanding of what is computed in diff-
erent human brain regions, which in turn has implications for how the computations are per-
formed. The added emphasis in this book on the organisation, connectivity, and functions of
360 cortical regions in the human brain increases the application of new approaches taken to
understanding how the brain works that are described in this book, by making the evidence
very relevant to the human brain, and thereby to those who are interested in disorders of the
human brain, including neurologists and psychiatrists, as well as to all those interested in
understanding how the human brain works in health and disease. The enables the compu-
tational approaches to understanding brain function described in this book to be combined
with and made highly relevant to understanding human brain function. It is hoped that these
developments in understanding human brain function by including analysis of the connec-
tivity of the 360 cortical regions in the Human Connectome Project Multimodal Parcellation
(HCP-MMP) atlas (Glasser et al., 2016a; Huang et al., 2022) as described here will provide a
foundation for future research that by using the HCP-MMP can be related to the connectivity
and functions of these 360 cortical regions in the human brain that are described in this book.
The title of this book, Brain Computations and Connectivity, refers to the importance of this
type of connectivity in understanding what and how the brain computes.
Another feature of this book is that it adopts what was described as a ‘grand unifying
approach’ in a review in the journal Brain (Manohar, 2022) of Brain Computations: What
and How (Rolls, 2021b) in that it takes a biologically plausible approach to how the brain
computes, rather than invoking the artificial intelligence approach of deep learning to try
to account for brain computation. The approach to how the brain computes in this book is
biologically plausible in that it utilises primarily local synaptic modification rules to set up
the synaptic connections between neurons, and unsupervised learning, yet considers how far
this can take us in understanding how the brain operates. This approach is quite different to the
deep learning approach used now in much machine learning and AI, which backpropagates an
error backwards through the network to correct every synaptic weight in all preceding layers
of the network, but there is no connectivity in the brain for that. Moreover, the learning in the
brain is largely unsupervised, whereas deep learning approaches typically require a supervisor
for each output neuron, which in turn requires what must be computed for each output neuron
to be specified by the designer of the deep network. The point is developed (in Chapter 19)
that machine learning might benefit from understanding some of the unsupervised approaches
used by the brain to solve complex problems, including navigation, attention, semantics, and
vi | Preface
even syntax. The title of this book, Brain Computations and Connectivity, also refers to this
concept that the actual connectivity at the local level of neurons and synapses that is found in
the brain is important in understanding what and how it computes.
My aim in making this book Open Access is to make the scholarship and ideas in this
book easily available to colleagues, in the interests of better understanding the human brain
in health and disease. This book can be cited as Rolls, E. T. (2023) Brain Computations
and Connectivity, Oxford University Press, Oxford. The book can be downloaded from
https://www.oxcns.org or from the Oxford University Press website. An advantage of pub-
lication of this book as a .pdf is that it contains extensive hyperlinks, enabling readers to
quickly cross-refer to other parts of the book or to citations. With the .pdf, figures can also be
expanded to show details.
Many scientists, and many others, are interested in how the brain works. In order to un-
derstand this, we need to know what computations are performed by different brain systems;
and how they are computed by each of these systems.
The aim of this book is to elucidate what is computed in different brain systems; and to
describe current computational approaches and models of how each of these brain systems
computes.
To understand how our brains work, it is essential to know what is computed in each
part of the brain. That can be addressed by utilising evidence relevant to computation from
many areas of neuroscience. Knowledge of the connections between different brain regions
is important, for this shows that the brain is organised as systems, with whole series of brain
regions devoted for example to visual processing. That provides a foundation for examin-
ing the computation performed by each brain region, by comparing what is represented in a
brain regions with what is represented in the preceding and following brain regions, using
techniques of for example neurophysiology and functional neuroimaging. The ways in which
effective connectivity is now available for 360 cortical regions are introduced in Chapter 1,
with the results of these new analyses found throughout this book. Neurophysiology at the
single neuron level is needed because this is the level at which information is transmitted
between the computing elements of the brain, the neurons. Evidence from the effects of brain
damage, including that available from neuropsychology, is needed to help understand what
different parts of the system do, and indeed what each part is necessary for. Functional neuro-
imaging is useful to indicate where in the human brain different processes take place, and to
show which functions can be dissociated from each other. So for each brain system, evidence
on what is computed at each stage, and what the system as a whole computes, is essential.
To understand how our brains work, it is also essential to know how each part of the
brain computes. That requires a knowledge of what is computed by each part of the brain,
but it also requires knowledge of the network properties of each brain region. This involves
knowledge of the connectivity between the neurons in each part of the brain, and knowledge
of the synaptic and biophysical properties of the neurons. It also requires knowledge of the
theory of what can be computed by networks with defined connectivity.
There are at least three key goals of the approaches described here. One is to understand
ourselves better, and how we work and think. A second is to be better able to treat the system
when it has problems, for example in mental illnesses. Medical applications are a very impor-
tant aim of the type of research described here. A third, is to be able to emulate the operation
of parts of our brains, which some in the field of artificial intelligence (AI) would like to do to
produce useful computers that incorporate some of the principles of computation utilised by
the brain. All of these goals require, and cannot get off the ground, without a firm foundation
in what is computed by brain systems, and theories and models of how it is computed. To
understand the operation of the whole brain, it is necessary to show how the different brain
Preface | vii
systems operate together: but a necessary foundation for this is to know what is computed in
each brain system, and the connectivity between the different regions involved.
Part of the enterprise here is to stimulate new theories and models of how parts of the brain
work. The evidence on what is computed in different brain systems had advanced rapidly in
the last 50 years, and provides a reasonable foundation for the enterprise, though there is
much that remains to be learned. Theories of how the computation is performed are less
advanced, but progress is being made, and current models are described in this book for
many brain systems, in the expectation that before further advances are made, knowledge of
the considerable current evidence on how the brain computes provides a useful starting point,
especially as current theories do take into account the limitations that are likely to be imposed
by the neural architectures present in our brains. In this book, the focus is on biologically
plausible algorithms for brain computation, rather than for example deep learning which does
not appear to be how the brain learns and computes (Sections B.12 and B.14).
The simplest way to delineate brain computation is to examine what information is
represented at each stage of processing, and how this is different from stage to stage. For
example in the primary visual cortex (V1), neurons respond to simple stimuli such as bars
or edges or gratings and have small receptive fields. Little can be read off from the firing
rates about for example whose face is represented from a small number of neurons in V1.
On the other hand, after four or five stages of processing, in the inferior temporal visual
cortex, information can be read from the firing rates of neurons about whose face is being
viewed, and indeed there is remarkable invariance with respect to the position, size, contrast
and even in some cases view of the face. That is a major computation, and indicates what can
be achieved by biological neuronal network computation.
These approaches can only be taken to understand brain function because there is consid-
erable localization of function in the brain, quite unlike a digital computer. One fundamental
reason for localization of function in the brain is that this minimizes the total length of the
connections between neurons, and thus brain size. Another is that it simplifies the genetic
information that has to be provided in order to build the brain, because the connectivity in-
structions can refer considerably to local connections. These points are developed in my book
Cerebral Cortex: Principles of Operation (Rolls, 2016b).
That brings me to what is different about the present book and Cerebral Cortex: Prin-
ciples of Operation (Rolls, 2016b). Cerebral Cortex: Principles of Operation took on the
enormous task of making progress with understanding how the major part of our brains, the
cerebral cortex, works, by understanding its principles of operation. The present book builds
on that approach, and uses it as background, but has the different aim of taking each of our
brain systems, and describing what they compute, and then what is known about how each
system computes. The issue of how they compute relies for many brain systems on how the
cortex operates, so Cerebral Cortex: Principles of Operation provides an important comple-
ment to the present book.
With its focus on what and how each brain system computes, a field that includes com-
putational neuroscience, this book is distinct from the many excellent books on neuroscience
that describe much evidence about brain structure and function, but do not aim to provide an
understanding of how the brain works at the computational level. This book aims to forge an
understanding of how some key brain systems may operate at the computational level, so that
we can understand how the brain actually performs some of its complex and necessarily com-
putational functions in memory, perception, attention, decision-making, cognitive functions,
and actions.
Indeed, as one of the key aims of this book is to describe what computations are per-
formed by different brain systems, I have chosen to include in this book some of the key actual
discoveries in neuroscience that I believe help to define what computations are performed in
viii | Preface
different brain systems. Part of the aim of citing the original pioneering discoveries is to show
how conceptual advances have been made in our understanding of what is computed in each
region of our brains, for understanding the key discoveries provides a foundation for further
advances.
That makes this book very different from many of the textbooks of neuroscience (such
as Principles of Neural Science (Kandel et al., 2021)), and some of the textbooks of theoret-
ical neuroscience that describe principles of operation of neurons or of networks of neurons
(Dayan and Abbott, 2001; Hertz et al., 1991; Gerstner et al., 2014), but not in general what
is computed in different brain systems, and how it is computed. Further, there are likely to be
great developments in our understanding of how the brain computes, and this book is intended
to set out a framework for new developments, by providing an analysis of what is computed
by different brain systems, and providing some current approaches to how these computations
may be performed. I believe that this book, and its predecessor Brain Computations: What
and How, is pioneering in what I propose is the necessary approach to understanding brain
function, understanding ‘What’ is computed by each brain region, and ‘How’ it is computed.
A test of whether one’s understanding is correct is to simulate the processing on a com-
puter, and to show whether the simulation can perform the tasks performed by the brain, and
whether the simulation has similar properties to the real brain. This approach to neural com-
putation leads to a precise definition of how the computation is performed, and to precise
and quantitative tests of the theories produced. How memory systems in the brain work is a
paradigm example of this approach, because memory-like operations which involve altered
functionality as a result of synaptic modification are at the heart of how many computations in
the brain are performed. It happens that attention and decision-making can be understood in
terms of interactions between and fundamental operations in memory systems in the cortex,
and therefore it is natural to address these areas of cognitive neuroscience in this book. The
same fundamental concepts based on the operation of neuronal circuitry can be applied to all
these functions, as is shown in this book.
One of the distinctive properties of this book is that it links the neural computation ap-
proach not only firmly to neuronal neurophysiology, which provides much of the primary data
about how the brain operates, but also to psychophysical studies (for example of attention);
to neuropsychological studies of patients with brain damage; and to functional magnetic res-
onance imaging (fMRI) (and other neuroimaging) approaches. The empirical evidence that
is brought to bear is largely from non-human primates and from humans, because of the con-
siderable similarity of their cortical systems, and the major differences in their systems-level
computational organization from that of rodents, as set out in Section 19.10.
Another feature of the book is that it aims to describe the principles of operation of the
brain, and in doing that, frequently refers to the original research in which those principles
were discovered. Another feature of the book is that I have also chosen to make each Chapter
relatively understandable on its own, which may involve some information also present in
other parts of the book, so that readers with an interest in one part of the brain can benefit by
reading the relevant chapters, rather than necessarily having to read the whole book.
The overall aims of the book are developed further, and the plan of the book is described,
in Chapter 1. Appendix B describes the fundamental operation of key networks of the type
that are likely to be the building blocks of brain function. Appendix C describes quantitative,
information theoretic, approaches to how information is represented in the brain, which is an
essential framework for understanding what is computed in a brain system, and how it is com-
puted. Appendix D describes Matlab software that has been made available with this book
to provide simple demonstrations of the operation of some key neuronal networks related to
cortical function; to show how the information represented by neurons can be measured; and
to provide a tutorial version of the VisNet program for invariant visual object recognition
Preface | ix
described in Chapter 2. The neural networks programs are also provided in Python. The pro-
grams are available at https://www.oxcns.org.
Part of the material described in the book reflects work performed in collaboration with
many colleagues, whose tremendous contributions are warmly appreciated. The contributions
of many will be evident from the references cited in the text. Especial appreciation is due
to Alessandro Treves, Gustavo Deco, Sylvia Wirth, and Simon M. Stringer, who have con-
tributed greatly in always interesting and fruitful research collaborations on computational
and related aspects of brain function, and to many neurophysiology and functional neuro-
imaging colleagues who have contributed to the empirical discoveries that provide the foun-
dation to which the computational neuroscience must always be closely linked, and whose
names are cited throughout the text. Charl Ning (University of Warwick) is thanked for help
with translating the Matlab neural network programs described in Appendix D into Python.
Dr Patrick Mills and Imogen Kruse are thanked for very helpful comments on an earlier ver-
sion of this book. Much of the work described would not have been possible without financial
support from a number of sources, particularly the Medical Research Council of the UK, the
Human Frontier Science Program, the Wellcome Trust, and the James S. McDonnell Founda-
tion. I am also grateful to many colleagues who I have consulted while writing this book. The
Gatsby Foundation is thanked for a grant towards the cost of making this book Open Access.
The book was typeset by the author using LATEXand WinEdt.
Updates to and .pdfs of many of the publications cited in this book are available at
https://www.oxcns.org. Updates and corrections to the text and notes are also available at
https://www.oxcns.org.
I dedicate this work to the overlapping group: my family, friends, and colleagues – in salutem
praesentium, in memoriam absentium.
Contents
1 Introduction 1
1.1 What and how the brain computes: introduction 1
1.2 What and how the brain computes: plan of the book 3
1.3 Neurons 5
1.4 Neurons in a network 6
1.5 Synaptic modification 8
1.6 Long-term potentiation and long-term depression 10
1.6.1 Long-Term Potentiation 10
1.6.2 Long-Term Depression 13
1.6.3 Spike Timing-Dependent Plasticity 14
1.7 Information encoding by neurons, and distributed representations 15
1.7.1 Definitions 16
1.7.2 Advantages of sparse distributed encoding 17
1.8 Neuronal network approaches versus connectionism 18
1.9 Introduction to three neuronal network architectures 19
1.10 Systems-level analysis of brain function 22
1.11 Brodmann areas 22
1.12 Human Connectome Project Multi-Modal Parcellation atlas of the human cortex 27
1.13 Connectivity of the human brain 36
1.13.1 Connections analyzed with diffusion tractography 37
1.13.2 Functional connectivity 37
1.13.3 Effective connectivity 37
1.14 The fine structure of the cerebral neocortex 39
1.14.1 The fine structure and connectivity of the neocortex 39
1.14.2 Excitatory cells and connections 40
1.14.3 Inhibitory cells and connections 41
1.14.4 Quantitative aspects of cortical architecture 44
1.14.5 Functional pathways through the cortical layers 46
1.14.6 The scale of lateral excitatory and inhibitory effects, and modules 51
13.6 How the computations are performed in the prefrontal cortex 613
13.6.1 Cortical short-term memory systems and attractor networks 613
13.6.2 Prefrontal cortex short-term memory networks, and their relation to percep-
tual networks 615
13.6.3 Mapping from one representation to another in short-term memory 620
13.6.4 The mechanisms of top-down attention 621
13.6.5 Computational necessity for a separate, prefrontal cortex, short-term mem-
ory system 622
13.6.6 Synaptic modification is needed to set up but not to reuse short-term memory
systems 623
13.6.7 Sequence memory 623
13.6.8 Working memory, and planning 623
A.1.4 The angle between two vectors: the normalized dot product 805
A.1.5 The outer product of two vectors 806
A.1.6 Linear and non-linear systems 807
A.1.7 Linear combinations, linear independence, and linear separability 808
A.2 Application to understanding simple neural networks 809
A.2.1 Capability and limitations of single-layer networks 810
A.2.2 Non-linear networks: neurons with non-linear activation functions 812
A.2.3 Non-linear networks: neurons with non-linear activations 813
Bibliography 1045
Index 1139
1 Introduction
Brain Computations and Connectivity. Edmund T. Rolls, Oxford University Press. © Edmund T. Rolls 2023.
DOI: 10.1093/oso/9780198887911.003.0001
2 | Introduction
of the whole brain, it is necessary to show how the different brain systems operate together:
but a necessary foundation for this is to know what is computed in each brain system.
Part of the enterprise here is to stimulate new theories and models of how parts of the brain
work. The evidence on what is computed in different brain systems has advanced rapidly in
the last 50 years, and provides a reasonable foundation for the enterprise, though there is
much that remains to be learned. Theories of how the computation is performed are less ad-
vanced, but progress is being made, and current models are described in this book for many
brain systems. Before further advances are made, knowledge of the considerable current evi-
dence on how the brain computes provides a useful stating point, especially as current theories
do take into account the limitations that are likely to be imposed by the neural architectures
present in our brains.
The simplest way to define brain computation is to examine what information is repres-
ented at each stage of processing, and how this is different from stage to stage. For example
in the primary visual cortex (V1), neurons respond to simple stimuli such as bars or edges or
gratings and have small receptive fields. Little can be read off about for example whose face
is represented from the firing rates of a small number of neurons in V1. On the other hand,
after four or five stages of processing, in the inferior temporal visual cortex, information can
be read from the firing rates of neurons about whose face is being viewed, and indeed there is
remarkable invariance with respect to the position, size, contrast and even in some cases view
of the face. That is a major computation, and indicates what can be achieved by biological
neuronal network computation.
These approaches can only be taken to understand brain function because there is consid-
erable localization of function in the brain, quite unlike a digital computer. One fundamental
reason for localization of function in the brain is that this minimizes the total length of the
connections between neurons, and thus brain size. Another is that it simplifies the genetic
information that has to be provided in order to build the brain, because the connectivity in-
structions can refer considerably to local connections. These points are developed in my book
Cerebral Cortex: Principles of Operation (Rolls, 2016b).
That brings me to what is different about the present book and Cerebral Cortex: Princi-
ples of Operation (Rolls, 2016b). The previous book took on the enormous task of making
progress with understanding how the major part of our brains, the cerebral cortex, works, by
understanding its principles of operation. The present book builds on that approach, and uses
it as background, but has the different aim of taking each of our brain systems, and describing
what they compute, and then what is known about how each system computes. The issue of
how they compute relies for many brain systems on how the cortex operates, so Cerebral
Cortex: Principles of Operation provides an important complement to the present book.
One of the distinctive properties of this book is that it links the neural computation ap-
proach not only firmly to neuronal neurophysiology, which provides much of the primary data
about how the brain operates, but also to psychophysical studies (for example of attention);
to neuropsychological studies of patients with brain damage; and to functional magnetic res-
onance imaging (fMRI) (and other neuroimaging) approaches. The empirical evidence that
is brought to bear is largely from non-human primates and from humans, because of the con-
siderable similarity of their cortical systems, and the overall aims to understand the human
brain, and the disorders that arise after brain damage.
In selecting the research findings on ‘what’ is computed in different brain systems and
on ‘how’ it is computed, to include in this book, I have selected pioneering research that
has helped to identify key computational principles involved for different brain systems. Dis-
coveries that have laid the foundation for our understanding as research has developed are
emphasized. That has meant that much excellent neuroscience research could not be included
in this book: but the aim of the book instead is to identify computational principles of op-
What and how the brain computes: plan of the book | 3
eration of brain systems, providing some of the key research discoveries that have helped to
identify those principles. I hope that future research will extend this aim further.
1.2 What and how the brain computes: plan of the book
In the rest of Chapter 1, I introduce some of the background for understanding brain com-
putation, such as how single neurons operate, how some of the essential features of this can
be captured by simple formalisms, and some of the biological background to what it can be
taken happens in the nervous system, such as synaptic modification based on information
available locally at each synapse.
Each of the following Chapters has parts concerned with what is computed in a brain
system, followed with parts concerned with how it is computed.
Chapters 2–7 consider the main sensory processing systems of the brain: the ventral visual
system with its functions in invariant object recognition (2); the dorsal visual system involved
in spatial visual processing, actions in space, and the spatial coordinate transforms that are
needed (3); the taste system (4); the olfactory system (5); the somatosensory system (6); and
the auditory system (7).
Chapter 8 considers the functions of the temporal lobe, including its functions in semantic
representations.
Chapter 9 considers the functions of the hippocampus, which combines neocortical ‘what’,
‘where’ and reward information to implement episodic memory, and its later recall back to
the neocortex which is implicated in memory consolidation.
Chapter 10 considers the functions of the parietal cortex, which receives much input from
the dorsal processing streams concerned with the location of stimuli and actions in space –
the ‘where and action’ processing stream, and which is also involved in navigation.
Chapter 11 describes the functions of the orbitofrontal cortex and amygdala, which com-
pute reward value from inputs received from the ventral processing streams, and are there-
fore central to understanding the implementation in the brain of emotion and reward-related
decision-making. Chapter 12 shows how the anterior cingulate cortex has functions related
to the initiation of goal-directed action given its inputs from the orbitofrontal cortex about
reward value and its connections with the mid-cingulate motor parts of the cingulate; and
how the posterior cingulate cortex has major connections that link ‘what’ and ‘where’ neo-
cortical systems with the hippocampus, making it an important component of the episodic
memory system, and perhaps with connected cortical regions involved in navigation.
Chapter 13 describes the prefrontal cortex, which provides off-line short-term and work-
ing memory, and the associated functions of planning and top-down attention.
Chapter 14 describes brain systems involved in language and syntax.
Chapter 15 describes motor cortical areas. Chapter 16 describes the basal ganglia, and
Chapter 17 the cerebellum, which are both involved in motor function, but which are now
also implicated in emotional, social, and cognitive functions.
Chapter 18 describes factors that influence the dynamics and stability of cortical systems,
and how these are different in some mental disorders including Schizophrenia, Obsessive-
Compulsive Disorder and Depression.
Chapter 19 describes how the functions of each of these systems provide a foundation
for understanding functions implemented by the whole brain, including many types of com-
plex and useful behaviors. This Chapter also compares computations in the brain with those
performed in digital computers including with machine learning algorithms. This is intended
to be a useful guide for engineers and artificial intelligence experts who may wish to learn
4 | Introduction
from how computations are performed in the brain, and how to emulate the computations per-
formed by the brain. This Chapter also compares the systems-level organisation of comput-
ations in rodent brains with those in primate including human brains, and provides evidence
that there are many differences in the systems-level computations between rodent and prim-
ate including human brains, which is why this book focusses on computations in primate
including human brains.
The Appendices are updated somewhat from those in Cerebral Cortex: Principles of Op-
eration (Rolls, 2016b), and are provided in this book for those who do not have access to
Cerebral Cortex. Appendix A provides an introduction to the linear algebra that is useful
background for the description of the fundamental operation of key networks found in the
brain. Appendix B describes the fundamental operation of key networks of the type that are
likely to be the building blocks of brain function. Appendix C shows how information theory
can be applied to analyze what is represented by populations of neurons and thus to under-
stand brain function. Appendix D describes Matlab software that has been made available
with this book to provide simple demonstrations of the operation of some key neuronal net-
works related to cortical function; to show how the information represented by neurons can
be measured; and to provide a tutorial version of the VisNet program for invariant visual ob-
ject recognition described in Chapter 2. The neural networks programs are also provided in
Python. The programs are available at https://www.oxcns.org.
I start the rest of Chapter 1 with some history showing how recently it is that our under-
standing of the (computational) principles of operation of the brain and cerebral cortex has
started to develop.
Before the 1960s there were many and important discoveries about the phenomenology
of the cortex, for example that damage in one part would affect vision, and in another part
movement, with electrical stimulation often producing the opposite effect. The principles may
help us to understand these phenomena, but the phenomena provide limited evidence about
how the cortex works, apart from the very important principle of localization of function (see
Rolls (2016b)), and the important principle of hierarchical organization (Hughlings Jackson,
1878; Swash, 1989) (see Rolls (2016b)) which has been supported by increasing evidence on
the connections between different cortical areas, which is a fundamental building block for
understanding brain computations.
In the 1960s David Hubel and Torsten Wiesel made important discoveries about the stim-
uli that activate primary visual cortex neurons, showing that they respond to bar-like or edge-
like visual stimuli (Hubel and Wiesel, 1962, 1968, 1977), instead of the small circular re-
ceptive fields in the preceding stage the lateral geniculate nucleus neurons. This led them to
suggest the elements of a model of how this might come about, by cortical neurons that re-
spond to elongated lines of lateral geniculate neurons (Fig. 2.5). This led to the concept that
hierarchical organization over a series of cortical areas might at each stage form combina-
tions of the features represented in the previous cortical area, in what might be termed feature
combination neurons.
However, before 1970 there were few ideas about how the cerebral cortex operates com-
putationally.
David Marr was a pioneer who helped to open the way to an understanding of how the
details of cortical anatomy and connectivity help to develop quantitative theories of how cort-
ical areas may compute, including the cerebellar cortex (Marr, 1969), the neocortex (Marr,
1970), and the hippocampal cortex (Marr, 1971). Marr was hampered by some lack in detail
of the available anatomical knowledge, and did not for example hypothesize that the hip-
pocampal CA3 network was an autoassociation memory. He attempted to test his theory of
Another random document with
no related content on Scribd:
CHAPTER VII.
HANNIBAL’S FIRST TRIUMPH.
The two new Consuls that year were Cnœus Servilius and
Flaminius, and they had between them some sixty thousand troops.
By so unexpectedly crossing the Apennines, and marching through
the awful marshes of the overflowed Arno, Hannibal had entirely
evaded Cnœus Servilius, who was left at Ariminum on the Adriatic,
but he now found Flaminius in Etruria, blocking the way to Rome
with a large force at a place called Arretium. Accordingly, Hannibal,
while still collecting horses and resting his troops, held one day a
council of war to consider the situation.
There were present, Mago, General Hanno, Maharbal, Hasdrubal
the pioneer, who had succeeded Monomachus as head of the
engineering department, Silenus the scribe, with writing materials
handy, and last, but by no means least upon this occasion, Sosilus,
who had, by this time, entirely undertaken the duties of head of the
intelligence department of the army, which were duties in which he
excelled. He had recently organised an excellent system of spies on
a large scale, and the scheme was working admirably. Nothing took
place in the Roman camp, or, for that matter, in Rome itself, without
his being informed; and of all occurrences of interest, Sosilus made
voluminous notes under alphabetical headings, with a view both to
present utility and to incorporation in his future history of the war.
Chœras returned from a horse-raiding expedition just as the
proceedings were commencing. He was not entitled by his rank in
the army to be present at a council of war, but Hannibal, who was
very partial to him on account of his ready humour, called him in as
he saw him marching, with a band of captured horses, past the open
door of the council tent. Hannibal was still suffering agonies from the
attack of ophthalmia, which had already cost him one eye.
Nevertheless, with his usual indomitable courage, as he sat at the
head of the council table, with a silk bandage over the diseased eye,
he looked as unconcerned and jovial as possible. No one could, for a